Trace number 3310044

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587UNSAT 1014.8 127.738

General information on the benchmark

NameSAT02/industrial/aloul/
Homer/homer16.shuffled.cnf
MD5SUMf98b1abe53ae4846a5f9102253ed913e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark738.98
Satisfiable
(Un)Satisfiability was proved
Number of variables264
Number of clauses1476
Sum of the clauses size3168
Maximum clause length11
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21452
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 524

Solver Data 

1014.75/127.73	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310044-1304019080/watcher-3310044-1304019080 -o /tmp/evaluation-result-3310044-1304019080/solver-3310044-1304019080 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3310044-1304019080.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.23 0.26 0.09 2/170 16425
/proc/meminfo: memFree=13522912/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=40160 CPUtime=0 cores=0-7
/proc/16425/stat : 16425 (plingeling) R 16423 16425 16358 0 -1 4202496 448 1250 0 0 0 0 0 0 25 0 4 0 513506006 41123840 372 33554432000 4194304 4417332 140735230616656 18446744073709551615 228122770417 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16425/statm: 10040 372 160 55 0 7926 0
[pid=16425/tid=16431] ppid=16423 vsize=40160 CPUtime=0 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 12 1250 0 0 0 0 0 0 25 0 4 0 513506006 41123840 372 33554432000 4194304 4417332 140735230616656 18446744073709551615 4282112 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=40160 CPUtime=0 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 0 1250 0 0 0 0 0 0 25 0 4 0 513506006 41123840 374 33554432000 4194304 4417332 140735230616656 18446744073709551615 228122770417 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=40160 CPUtime=0 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 0 1250 0 0 0 0 0 0 25 0 4 0 513506006 41123840 374 33554432000 4194304 4417332 140735230616656 18446744073709551615 228122770417 0 0 4096 17442 0 0 0 -1 4 0 0 0

[startup+0.0695921 s]
/proc/loadavg: 1.23 0.26 0.09 2/170 16425
/proc/meminfo: memFree=13522912/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=225712 CPUtime=0.47 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 1578 1250 0 0 47 0 0 0 25 0 9 0 513506006 231129088 1336 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 56428 1336 181 55 0 54314 0
[pid=16425/tid=16431] ppid=16423 vsize=225712 CPUtime=0.06 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 179 1250 0 0 6 0 0 0 18 0 9 0 513506006 231129088 1336 33554432000 4194304 4417332 140735230616656 18446744073709551615 4248888 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=225712 CPUtime=0.05 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 67 1250 0 0 5 0 0 0 18 0 9 0 513506006 231129088 1336 33554432000 4194304 4417332 140735230616656 18446744073709551615 228122406608 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=225712 CPUtime=0.05 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 189 1250 0 0 5 0 0 0 18 0 9 0 513506006 231129088 1336 33554432000 4194304 4417332 140735230616656 18446744073709551615 18446744073699065911 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 225712

[startup+0.114207 s]
/proc/loadavg: 1.23 0.26 0.09 2/170 16425
/proc/meminfo: memFree=13522912/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=228424 CPUtime=0.83 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 2684 1250 0 0 83 0 0 0 25 0 9 0 513506006 233906176 2090 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 57106 2090 181 55 0 54992 0
[pid=16425/tid=16431] ppid=16423 vsize=228424 CPUtime=0.1 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 431 1250 0 0 10 0 0 0 18 0 9 0 513506006 233906176 2090 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364919 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=228424 CPUtime=0.1 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 162 1250 0 0 10 0 0 0 18 0 9 0 513506006 233906176 2090 33554432000 4194304 4417332 140735230616656 18446744073709551615 4250648 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=228424 CPUtime=0.1 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 263 1250 0 0 10 0 0 0 18 0 9 0 513506006 233906176 2090 33554432000 4194304 4417332 140735230616656 18446744073709551615 4309651 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.83
Current children cumulated vsize (KiB) 228424

[startup+0.300174 s]
/proc/loadavg: 1.23 0.26 0.09 2/170 16425
/proc/meminfo: memFree=13522912/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=232800 CPUtime=2.32 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 6599 1250 0 0 231 1 0 0 25 0 9 0 513506006 238387200 3175 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 58200 3175 181 55 0 56086 0
[pid=16425/tid=16431] ppid=16423 vsize=232800 CPUtime=0.29 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 1039 1250 0 0 29 0 0 0 18 0 9 0 513506006 238387200 3175 33554432000 4194304 4417332 140735230616656 18446744073709551615 4291216 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=232800 CPUtime=0.28 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 803 1250 0 0 28 0 0 0 18 0 9 0 513506006 238387200 3175 33554432000 4194304 4417332 140735230616656 18446744073709551615 4354552 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=232800 CPUtime=0.29 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 631 1250 0 0 29 0 0 0 18 0 9 0 513506006 238387200 3175 33554432000 4194304 4417332 140735230616656 18446744073709551615 4253542 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2.32
Current children cumulated vsize (KiB) 232800

[startup+0.701102 s]
/proc/loadavg: 1.23 0.26 0.09 2/170 16425
/proc/meminfo: memFree=13522912/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=238912 CPUtime=5.53 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 14636 1250 0 0 550 3 0 0 25 0 9 0 513506006 244645888 4688 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 59728 4688 181 55 0 57614 0
[pid=16425/tid=16431] ppid=16423 vsize=238912 CPUtime=0.68 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 2117 1250 0 0 68 0 0 0 18 0 9 0 513506006 244645888 4688 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=238912 CPUtime=0.68 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 1743 1250 0 0 68 0 0 0 18 0 9 0 513506006 244645888 4688 33554432000 4194304 4417332 140735230616656 18446744073709551615 4320876 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=238912 CPUtime=0.68 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 1920 1250 0 0 68 0 0 0 18 0 9 0 513506006 244645888 4688 33554432000 4194304 4417332 140735230616656 18446744073709551615 4311347 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.53
Current children cumulated vsize (KiB) 238912

[startup+1.50096 s]
/proc/loadavg: 1.23 0.26 0.09 9/179 16439
/proc/meminfo: memFree=13497188/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=247836 CPUtime=11.91 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 33031 1250 0 0 1185 6 0 0 25 0 9 0 513506006 253784064 6912 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 61959 6912 181 55 0 59845 0
[pid=16425/tid=16431] ppid=16423 vsize=247836 CPUtime=1.49 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 4428 1250 0 0 148 1 0 0 20 0 9 0 513506006 253784064 6912 33554432000 4194304 4417332 140735230616656 18446744073709551615 4199439 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=247836 CPUtime=1.48 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 3928 1250 0 0 148 0 0 0 19 0 9 0 513506006 253784064 6912 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=247836 CPUtime=1.48 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 4385 1250 0 0 147 1 0 0 20 0 9 0 513506006 253784064 6912 33554432000 4194304 4417332 140735230616656 18446744073709551615 4264926 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16435] ppid=16423 vsize=247836 CPUtime=1.48 cores=0-7
/proc/16425/task/16435/stat : 16435 (plingeling) R 16423 16425 16358 0 -1 4202560 3362 1250 0 0 148 0 0 0 25 0 9 0 513506007 253784064 6912 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16425/tid=16436] ppid=16423 vsize=247836 CPUtime=1.48 cores=0-7
/proc/16425/task/16436/stat : 16436 (plingeling) R 16423 16425 16358 0 -1 4202560 4332 1250 0 0 148 0 0 0 20 0 9 0 513506007 253784064 6912 33554432000 4194304 4417332 140735230616656 18446744073709551615 4264999 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16425/tid=16437] ppid=16423 vsize=247836 CPUtime=1.48 cores=0-7
/proc/16425/task/16437/stat : 16437 (plingeling) R 16423 16425 16358 0 -1 4202560 4247 1250 0 0 148 0 0 0 20 0 9 0 513506007 253784064 6912 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16425/tid=16438] ppid=16423 vsize=247836 CPUtime=1.48 cores=0-7
/proc/16425/task/16438/stat : 16438 (plingeling) R 16423 16425 16358 0 -1 4202560 4191 1250 0 0 148 0 0 0 25 0 9 0 513506007 253784064 6912 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=247836 CPUtime=1.47 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 3715 1250 0 0 147 0 0 0 25 0 9 0 513506007 253784064 6912 33554432000 4194304 4417332 140735230616656 18446744073709551615 4356782 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.91
Current children cumulated vsize (KiB) 247836

[startup+3.10067 s]
/proc/loadavg: 1.77 0.39 0.13 9/179 16439
/proc/meminfo: memFree=13490368/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=261928 CPUtime=24.71 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 62793 1250 0 0 2459 12 0 0 25 0 9 0 513506006 268214272 10436 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 65482 10436 181 55 0 63368 0
[pid=16425/tid=16431] ppid=16423 vsize=261928 CPUtime=3.08 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 8022 1250 0 0 307 1 0 0 25 0 9 0 513506006 268214272 10436 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=261928 CPUtime=3.08 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 7524 1250 0 0 307 1 0 0 25 0 9 0 513506006 268214272 10436 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=261928 CPUtime=3.08 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 7561 1250 0 0 307 1 0 0 25 0 9 0 513506006 268214272 10436 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16435] ppid=16423 vsize=261928 CPUtime=3.08 cores=0-7
/proc/16425/task/16435/stat : 16435 (plingeling) R 16423 16425 16358 0 -1 4202560 6494 1250 0 0 307 1 0 0 25 0 9 0 513506007 268214272 10436 33554432000 4194304 4417332 140735230616656 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16425/tid=16436] ppid=16423 vsize=261928 CPUtime=3.08 cores=0-7
/proc/16425/task/16436/stat : 16436 (plingeling) R 16423 16425 16358 0 -1 4202560 8434 1250 0 0 307 1 0 0 25 0 9 0 513506007 268214272 10436 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16425/tid=16437] ppid=16423 vsize=261928 CPUtime=3.08 cores=0-7
/proc/16425/task/16437/stat : 16437 (plingeling) R 16423 16425 16358 0 -1 4202560 8502 1250 0 0 307 1 0 0 25 0 9 0 513506007 268214272 10436 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16425/tid=16438] ppid=16423 vsize=261928 CPUtime=3.08 cores=0-7
/proc/16425/task/16438/stat : 16438 (plingeling) R 16423 16425 16358 0 -1 4202560 7565 1250 0 0 307 1 0 0 25 0 9 0 513506007 268214272 10436 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=261928 CPUtime=3.07 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 8248 1250 0 0 306 1 0 0 25 0 9 0 513506007 268214272 10436 33554432000 4194304 4417332 140735230616656 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.71
Current children cumulated vsize (KiB) 261928

[startup+6.30109 s]
/proc/loadavg: 1.77 0.39 0.13 9/179 16439
/proc/meminfo: memFree=13470708/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=280872 CPUtime=50.29 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 126639 1250 0 0 5006 23 0 0 25 0 9 0 513506006 287612928 15165 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 70218 15165 181 55 0 68104 0
[pid=16425/tid=16431] ppid=16423 vsize=280872 CPUtime=6.28 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 17648 1250 0 0 625 3 0 0 25 0 9 0 513506006 287612928 15165 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=280872 CPUtime=6.28 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 16330 1250 0 0 625 3 0 0 25 0 9 0 513506006 287612928 15165 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=280872 CPUtime=6.28 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 15930 1250 0 0 626 2 0 0 25 0 9 0 513506006 287612928 15165 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16435] ppid=16423 vsize=280872 CPUtime=6.28 cores=0-7
/proc/16425/task/16435/stat : 16435 (plingeling) R 16423 16425 16358 0 -1 4202560 10446 1250 0 0 626 2 0 0 25 0 9 0 513506007 287612928 15165 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16425/tid=16436] ppid=16423 vsize=280872 CPUtime=6.28 cores=0-7
/proc/16425/task/16436/stat : 16436 (plingeling) R 16423 16425 16358 0 -1 4202560 15645 1250 0 0 626 2 0 0 25 0 9 0 513506007 287612928 15165 33554432000 4194304 4417332 140735230616656 18446744073709551615 4237273 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16425/tid=16437] ppid=16423 vsize=280872 CPUtime=6.28 cores=0-7
/proc/16425/task/16437/stat : 16437 (plingeling) R 16423 16425 16358 0 -1 4202560 16836 1250 0 0 626 2 0 0 25 0 9 0 513506007 287612928 15165 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16425/tid=16438] ppid=16423 vsize=280872 CPUtime=6.27 cores=0-7
/proc/16425/task/16438/stat : 16438 (plingeling) R 16423 16425 16358 0 -1 4202560 16013 1250 0 0 625 2 0 0 25 0 9 0 513506007 287612928 15165 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=280872 CPUtime=6.25 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 17348 1250 0 0 623 2 0 0 25 0 9 0 513506007 287612928 15165 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364919 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.29
Current children cumulated vsize (KiB) 280872

[startup+12.7009 s]
/proc/loadavg: 2.73 0.64 0.21 9/179 16439
/proc/meminfo: memFree=13448460/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=307940 CPUtime=101.46 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 210169 1250 0 0 10105 41 0 0 25 0 9 0 513506006 315330560 21906 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 76985 21906 181 55 0 74871 0
[pid=16425/tid=16431] ppid=16423 vsize=307940 CPUtime=12.69 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 27457 1250 0 0 1263 6 0 0 25 0 9 0 513506006 315330560 21906 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=307940 CPUtime=12.68 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 27590 1250 0 0 1263 5 0 0 25 0 9 0 513506006 315330560 21906 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=307940 CPUtime=12.68 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 25435 1250 0 0 1264 4 0 0 25 0 9 0 513506006 315330560 21906 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364811 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16435] ppid=16423 vsize=307940 CPUtime=12.69 cores=0-7
/proc/16425/task/16435/stat : 16435 (plingeling) R 16423 16425 16358 0 -1 4202560 17062 1250 0 0 1265 4 0 0 25 0 9 0 513506007 315330560 21906 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16425/tid=16436] ppid=16423 vsize=307940 CPUtime=12.68 cores=0-7
/proc/16425/task/16436/stat : 16436 (plingeling) R 16423 16425 16358 0 -1 4202560 27983 1250 0 0 1263 5 0 0 25 0 9 0 513506007 315330560 21906 33554432000 4194304 4417332 140735230616656 18446744073709551615 4236941 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16425/tid=16437] ppid=16423 vsize=307940 CPUtime=12.68 cores=0-7
/proc/16425/task/16437/stat : 16437 (plingeling) R 16423 16425 16358 0 -1 4202560 26996 1250 0 0 1264 4 0 0 25 0 9 0 513506007 315330560 21906 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16425/tid=16438] ppid=16423 vsize=307940 CPUtime=12.68 cores=0-7
/proc/16425/task/16438/stat : 16438 (plingeling) R 16423 16425 16358 0 -1 4202560 28296 1250 0 0 1263 5 0 0 25 0 9 0 513506007 315330560 21906 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364769 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=307940 CPUtime=12.61 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 28907 1250 0 0 1257 4 0 0 25 0 9 0 513506007 315330560 21906 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.46
Current children cumulated vsize (KiB) 307940

[startup+25.5006 s]
/proc/loadavg: 3.54 0.88 0.29 9/179 16439
/proc/meminfo: memFree=13408328/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=316028 CPUtime=203.79 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 360245 1250 0 0 20310 69 0 0 25 0 9 0 513506006 323612672 24030 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 79007 24030 181 55 0 76893 0

################
# More data... #
################

[pid=16425/tid=16437] ppid=16423 vsize=390564 CPUtime=51.08 cores=0-7
/proc/16425/task/16437/stat : 16437 (plingeling) R 16423 16425 16358 0 -1 4202560 78114 1250 0 0 5092 16 0 0 25 0 9 0 513506007 399937536 42776 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16425/tid=16438] ppid=16423 vsize=390564 CPUtime=51.08 cores=0-7
/proc/16425/task/16438/stat : 16438 (plingeling) R 16423 16425 16358 0 -1 4202560 68488 1250 0 0 5094 14 0 0 25 0 9 0 513506007 399937536 42776 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=390564 CPUtime=50.83 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 78288 1250 0 0 5069 14 0 0 25 0 9 0 513506007 399937536 42776 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.46
Current children cumulated vsize (KiB) 390564

[startup+102.307 s]
/proc/loadavg: 6.85 2.57 0.93 9/179 16441
/proc/meminfo: memFree=13260476/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=485740 CPUtime=817.86 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 1021323 1250 0 0 81597 189 0 0 25 0 9 0 513506006 497397760 66450 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 121435 66450 181 55 0 119321 0
[pid=16425/tid=16431] ppid=16423 vsize=485740 CPUtime=102.3 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 133306 1250 0 0 10204 26 0 0 25 0 9 0 513506006 497397760 66450 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=485740 CPUtime=102.28 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 144837 1250 0 0 10204 24 0 0 25 0 9 0 513506006 497397760 66450 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=485740 CPUtime=102.27 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 137550 1250 0 0 10204 23 0 0 25 0 9 0 513506006 497397760 66450 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16435] ppid=16423 vsize=485740 CPUtime=102.28 cores=0-7
/proc/16425/task/16435/stat : 16435 (plingeling) R 16423 16425 16358 0 -1 4202560 77679 1250 0 0 10211 17 0 0 25 0 9 0 513506007 497397760 66450 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16425/tid=16436] ppid=16423 vsize=485740 CPUtime=102.28 cores=0-7
/proc/16425/task/16436/stat : 16436 (plingeling) R 16423 16425 16358 0 -1 4202560 128103 1250 0 0 10207 21 0 0 25 0 9 0 513506007 497397760 66450 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16425/tid=16437] ppid=16423 vsize=485740 CPUtime=102.29 cores=0-7
/proc/16425/task/16437/stat : 16437 (plingeling) R 16423 16425 16358 0 -1 4202560 140039 1250 0 0 10203 26 0 0 25 0 9 0 513506007 497397760 66450 33554432000 4194304 4417332 140735230616656 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16425/tid=16438] ppid=16423 vsize=485740 CPUtime=102.29 cores=0-7
/proc/16425/task/16438/stat : 16438 (plingeling) R 16423 16425 16358 0 -1 4202560 124325 1250 0 0 10205 24 0 0 25 0 9 0 513506007 497397760 66450 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364664 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=485740 CPUtime=101.8 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 135041 1250 0 0 10155 25 0 0 25 0 9 0 513506007 497397760 66450 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 817.86
Current children cumulated vsize (KiB) 485740

Solver just ended. Dumping a history of the last processes samples

[startup+115.101 s]
/proc/loadavg: 7.03 2.74 1.01 9/179 16442
/proc/meminfo: memFree=13283348/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=454192 CPUtime=920.16 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 1102983 1250 0 0 91813 203 0 0 25 0 9 0 513506006 465092608 58571 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 113548 58571 181 55 0 111434 0
[pid=16425/tid=16431] ppid=16423 vsize=454192 CPUtime=115.09 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 150782 1250 0 0 11480 29 0 0 25 0 9 0 513506006 465092608 58571 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=454192 CPUtime=115.08 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 153965 1250 0 0 11483 25 0 0 25 0 9 0 513506006 465092608 58571 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=454192 CPUtime=115.07 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 148871 1250 0 0 11482 25 0 0 25 0 9 0 513506006 465092608 58571 33554432000 4194304 4417332 140735230616656 18446744073709551615 4344081 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16435] ppid=16423 vsize=454192 CPUtime=115.08 cores=0-7
/proc/16425/task/16435/stat : 16435 (plingeling) R 16423 16425 16358 0 -1 4202560 80254 1250 0 0 11490 18 0 0 25 0 9 0 513506007 465092608 58571 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16425/tid=16436] ppid=16423 vsize=454192 CPUtime=115.08 cores=0-7
/proc/16425/task/16436/stat : 16436 (plingeling) R 16423 16425 16358 0 -1 4202560 140412 1250 0 0 11485 23 0 0 25 0 9 0 513506007 465092608 58571 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16425/tid=16437] ppid=16423 vsize=454192 CPUtime=115.08 cores=0-7
/proc/16425/task/16437/stat : 16437 (plingeling) R 16423 16425 16358 0 -1 4202560 150259 1250 0 0 11481 27 0 0 25 0 9 0 513506007 465092608 58571 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16425/tid=16438] ppid=16423 vsize=454192 CPUtime=115.08 cores=0-7
/proc/16425/task/16438/stat : 16438 (plingeling) R 16423 16425 16358 0 -1 4202560 130835 1250 0 0 11483 25 0 0 25 0 9 0 513506007 465092608 58571 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=454192 CPUtime=114.53 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 147162 1250 0 0 11426 27 0 0 25 0 9 0 513506007 465092608 58571 33554432000 4194304 4417332 140735230616656 18446744073709551615 4310373 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 920.16
Current children cumulated vsize (KiB) 454192

[startup+121.501 s]
/proc/loadavg: 7.10 2.83 1.04 9/179 16442
/proc/meminfo: memFree=13258444/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=494772 CPUtime=971.32 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 1142981 1250 0 0 96924 208 0 0 25 0 9 0 513506006 506646528 68718 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 123693 68718 181 55 0 121579 0
[pid=16425/tid=16431] ppid=16423 vsize=494772 CPUtime=121.49 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 152679 1250 0 0 12120 29 0 0 25 0 9 0 513506006 506646528 68718 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=494772 CPUtime=121.47 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 157386 1250 0 0 12122 25 0 0 25 0 9 0 513506006 506646528 68718 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=494772 CPUtime=121.47 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 154033 1250 0 0 12121 26 0 0 25 0 9 0 513506006 506646528 68718 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16435] ppid=16423 vsize=494772 CPUtime=121.48 cores=0-7
/proc/16425/task/16435/stat : 16435 (plingeling) R 16423 16425 16358 0 -1 4202560 87563 1250 0 0 12129 19 0 0 25 0 9 0 513506007 506646528 68718 33554432000 4194304 4417332 140735230616656 18446744073709551615 4320992 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16425/tid=16436] ppid=16423 vsize=494772 CPUtime=121.48 cores=0-7
/proc/16425/task/16436/stat : 16436 (plingeling) R 16423 16425 16358 0 -1 4202560 147167 1250 0 0 12124 24 0 0 25 0 9 0 513506007 506646528 68718 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16425/tid=16437] ppid=16423 vsize=494772 CPUtime=121.48 cores=0-7
/proc/16425/task/16437/stat : 16437 (plingeling) R 16423 16425 16358 0 -1 4202560 154903 1250 0 0 12120 28 0 0 25 0 9 0 513506007 506646528 68718 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16425/tid=16438] ppid=16423 vsize=494772 CPUtime=121.48 cores=0-7
/proc/16425/task/16438/stat : 16438 (plingeling) R 16423 16425 16358 0 -1 4202560 136185 1250 0 0 12123 25 0 0 25 0 9 0 513506007 506646528 68718 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364512 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=494772 CPUtime=120.89 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 152622 1250 0 0 12062 27 0 0 25 0 9 0 513506007 506646528 68718 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 971.32
Current children cumulated vsize (KiB) 494772

[startup+124.701 s]
/proc/loadavg: 7.18 2.92 1.08 9/179 16442
/proc/meminfo: memFree=13300492/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=452360 CPUtime=996.9 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 1160234 1250 0 0 99479 211 0 0 25 0 9 0 513506006 463216640 58105 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 113090 58105 181 55 0 110976 0
[pid=16425/tid=16431] ppid=16423 vsize=452360 CPUtime=124.68 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 155981 1250 0 0 12439 29 0 0 25 0 9 0 513506006 463216640 58105 33554432000 4194304 4417332 140735230616656 18446744073709551615 4278314 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=452360 CPUtime=124.68 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 161097 1250 0 0 12442 26 0 0 25 0 9 0 513506006 463216640 58105 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=452360 CPUtime=124.66 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 157214 1250 0 0 12440 26 0 0 25 0 9 0 513506006 463216640 58105 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16435] ppid=16423 vsize=452360 CPUtime=124.68 cores=0-7
/proc/16425/task/16435/stat : 16435 (plingeling) R 16423 16425 16358 0 -1 4202560 87563 1250 0 0 12449 19 0 0 25 0 9 0 513506007 463216640 58105 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16425/tid=16436] ppid=16423 vsize=452360 CPUtime=124.68 cores=0-7
/proc/16425/task/16436/stat : 16436 (plingeling) R 16423 16425 16358 0 -1 4202560 148602 1250 0 0 12444 24 0 0 25 0 9 0 513506007 463216640 58105 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16425/tid=16437] ppid=16423 vsize=452360 CPUtime=124.68 cores=0-7
/proc/16425/task/16437/stat : 16437 (plingeling) R 16423 16425 16358 0 -1 4202560 158203 1250 0 0 12439 29 0 0 25 0 9 0 513506007 463216640 58105 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16425/tid=16438] ppid=16423 vsize=452360 CPUtime=124.68 cores=0-7
/proc/16425/task/16438/stat : 16438 (plingeling) R 16423 16425 16358 0 -1 4202560 136440 1250 0 0 12443 25 0 0 25 0 9 0 513506007 463216640 58105 33554432000 4194304 4417332 140735230616656 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=452360 CPUtime=124.08 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 154691 1250 0 0 12380 28 0 0 25 0 9 0 513506007 463216640 58105 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 996.9
Current children cumulated vsize (KiB) 452360

[startup+126.301 s]
/proc/loadavg: 7.18 2.92 1.08 9/179 16442
/proc/meminfo: memFree=13326904/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=423084 CPUtime=1009.67 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 1170111 1250 0 0 100754 213 0 0 25 0 8 0 513506006 433238016 50787 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 105771 50787 182 55 0 103657 0
[pid=16425/tid=16431] ppid=16423 vsize=423084 CPUtime=126.29 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 158440 1250 0 0 12599 30 0 0 25 0 8 0 513506006 433238016 50787 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16432] ppid=16423 vsize=423084 CPUtime=126.28 cores=0-7
/proc/16425/task/16432/stat : 16432 (plingeling) R 16423 16425 16358 0 -1 4202560 162097 1250 0 0 12602 26 0 0 25 0 8 0 513506006 433238016 50787 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=423084 CPUtime=126.26 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 158238 1250 0 0 12600 26 0 0 25 0 8 0 513506006 433238016 50787 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16436] ppid=16423 vsize=423084 CPUtime=126.28 cores=0-7
/proc/16425/task/16436/stat : 16436 (plingeling) R 16423 16425 16358 0 -1 4202560 148602 1250 0 0 12604 24 0 0 25 0 8 0 513506007 433238016 50787 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16425/tid=16437] ppid=16423 vsize=423084 CPUtime=126.28 cores=0-7
/proc/16425/task/16437/stat : 16437 (plingeling) R 16423 16425 16358 0 -1 4202560 159227 1250 0 0 12599 29 0 0 25 0 8 0 513506007 433238016 50787 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16425/tid=16438] ppid=16423 vsize=423084 CPUtime=126.28 cores=0-7
/proc/16425/task/16438/stat : 16438 (plingeling) R 16423 16425 16358 0 -1 4202560 138320 1250 0 0 12602 26 0 0 25 0 8 0 513506007 433238016 50787 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=423084 CPUtime=125.67 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 155715 1250 0 0 12539 28 0 0 25 0 8 0 513506007 433238016 50787 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1009.67
Current children cumulated vsize (KiB) 423084

[startup+127.101 s]
/proc/loadavg: 7.16 2.98 1.11 8/178 16442
/proc/meminfo: memFree=13314512/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=440916 CPUtime=1014.07 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 1175132 1250 0 0 101193 214 0 0 25 0 4 0 513506006 451497984 54784 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 110229 54810 182 55 0 108115 0
[pid=16425/tid=16431] ppid=16423 vsize=440916 CPUtime=127.09 cores=0-7
/proc/16425/task/16431/stat : 16431 (plingeling) R 16423 16425 16358 0 -1 4202560 159464 1250 0 0 12679 30 0 0 25 0 4 0 513506006 451497984 54823 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364887 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16425/tid=16433] ppid=16423 vsize=440916 CPUtime=127.07 cores=0-7
/proc/16425/task/16433/stat : 16433 (plingeling) R 16423 16425 16358 0 -1 4202560 159262 1250 0 0 12680 27 0 0 25 0 4 0 513506006 451497984 54840 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16425/tid=16439] ppid=16423 vsize=440916 CPUtime=126.47 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 156186 1250 0 0 12619 28 0 0 25 0 4 0 513506007 451497984 54860 33554432000 4194304 4417332 140735230616656 18446744073709551615 228122408024 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1014.07
Current children cumulated vsize (KiB) 440916

[startup+127.501 s]
/proc/loadavg: 7.16 2.98 1.11 2/172 16442
/proc/meminfo: memFree=13300428/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=404528 CPUtime=1014.56 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 1176740 1250 0 0 101242 214 0 0 18 0 2 0 513506006 414236672 56384 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 101132 56384 182 55 0 99018 0
[pid=16425/tid=16439] ppid=16423 vsize=404528 CPUtime=126.87 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 157718 1250 0 0 12659 28 0 0 25 0 2 0 513506007 414236672 56384 33554432000 4194304 4417332 140735230616656 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1014.56
Current children cumulated vsize (KiB) 404528

[startup+127.701 s]
/proc/loadavg: 7.16 2.98 1.11 2/172 16442
/proc/meminfo: memFree=13300428/32951124 swapFree=67111528/67111528
[pid=16425] ppid=16423 vsize=404528 CPUtime=1014.75 cores=0-7
/proc/16425/stat : 16425 (plingeling) S 16423 16425 16358 0 -1 4202496 1176740 1250 0 0 101261 214 0 0 18 0 2 0 513506006 414236672 56384 33554432000 4194304 4417332 140735230616656 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/16425/statm: 101132 56384 182 55 0 99018 0
[pid=16425/tid=16439] ppid=16423 vsize=404528 CPUtime=127.07 cores=0-7
/proc/16425/task/16439/stat : 16439 (plingeling) R 16423 16425 16358 0 -1 4202560 157718 1250 0 0 12679 28 0 0 25 0 2 0 513506007 414236672 56384 33554432000 4194304 4417332 140735230616656 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1014.75
Current children cumulated vsize (KiB) 404528

Child status: 20
Real time (s): 127.738
CPU time (s): 1014.8
CPU user time (s): 1012.64
CPU system time (s): 2.15667
CPU usage (%): 794.441
Max. virtual memory (cumulated for all children) (KiB): 498396

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1012.64
system time used= 2.15667
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1177993
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 490
involuntary context switches= 4435

runsolver used 0.189971 second user time and 0.432934 second system time

The end

Launcher Data 

Begin job on node138 at 2011-04-28 21:31:20
IDJOB=3310044
IDBENCH=87943
IDSOLVER=1695
FILE ID=node138/3310044-1304019080
RUNJOBID= node138-1304019069-16372
PBS_JOBID= 13170279
Free space on /tmp= 71816 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT02/industrial/aloul/Homer/homer16.shuffled.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310044-1304019080/watcher-3310044-1304019080 -o /tmp/evaluation-result-3310044-1304019080/solver-3310044-1304019080 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3310044-1304019080.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f98b1abe53ae4846a5f9102253ed913e
RANDOM SEED=1562383532

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13523184 kB
Buffers:       2089280 kB
Cached:       16706364 kB
SwapCached:          0 kB
Active:       10707464 kB
Inactive:      8151504 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13523184 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:             824 kB
Writeback:           0 kB
AnonPages:       63032 kB
Mapped:          14876 kB
Slab:           503484 kB
PageTables:       4144 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185768 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71816 MiB
End job on node138 at 2011-04-28 21:33:28