Trace number 3309798

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40001 5004.1

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top22.cnf
MD5SUMe822739302a2d834ec9ddfe9fbd0caa2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables55875
Number of clauses177646
Sum of the clauses size434144
Maximum clause length2255
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2108197
Number of clauses of size 368250
Number of clauses of size 4252
Number of clauses of size 520
Number of clauses of size over 5926

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309798-1304008973/watcher-3309798-1304008973 -o /tmp/evaluation-result-3309798-1304008973/solver-3309798-1304008973 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309798-1304008973.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.01 7.97 6.94 2/170 19653
/proc/meminfo: memFree=18963764/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=14528 CPUtime=0 cores=0-7
/proc/19653/stat : 19653 (plingeling) R 19651 19653 18933 0 -1 4202496 1656 1253 0 0 0 0 0 0 18 0 1 0 512493961 14876672 1586 33554432000 4194304 4417332 140736056092784 18446744073709551615 254500385885 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/19653/statm: 3632 1600 140 55 0 1518 0

[startup+0.0891129 s]
/proc/loadavg: 8.01 7.97 6.94 2/170 19653
/proc/meminfo: memFree=18963764/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=34196 CPUtime=0.07 cores=0-7
/proc/19653/stat : 19653 (plingeling) R 19651 19653 18933 0 -1 4202496 6674 1253 0 0 7 0 0 0 18 0 1 0 512493961 35016704 6572 33554432000 4194304 4417332 140736056092784 18446744073709551615 4209539 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/19653/statm: 8549 6572 148 55 0 6435 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 34196

[startup+0.101108 s]
/proc/loadavg: 8.01 7.97 6.94 2/170 19653
/proc/meminfo: memFree=18963764/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=41924 CPUtime=0.09 cores=0-7
/proc/19653/stat : 19653 (plingeling) R 19651 19653 18933 0 -1 4202496 8606 1253 0 0 9 0 0 0 18 0 1 0 512493961 42930176 8504 33554432000 4194304 4417332 140736056092784 18446744073709551615 4231291 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/19653/statm: 10481 8504 148 55 0 8367 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 41924

[startup+0.301071 s]
/proc/loadavg: 8.01 7.97 6.94 2/170 19653
/proc/meminfo: memFree=18963764/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=81104 CPUtime=0.29 cores=0-7
/proc/19653/stat : 19653 (plingeling) R 19651 19653 18933 0 -1 4202496 18401 1253 0 0 28 1 0 0 19 0 1 0 512493961 83050496 18299 33554432000 4194304 4417332 140736056092784 18446744073709551615 4231480 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/19653/statm: 20276 18299 148 55 0 18162 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 81104

[startup+0.70092 s]
/proc/loadavg: 8.01 7.97 6.94 2/170 19653
/proc/meminfo: memFree=18963764/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=242208 CPUtime=2.68 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 32166 1253 0 0 264 4 0 0 18 0 9 0 512493961 248020992 23191 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 60552 23191 175 55 0 58438 0
Current children cumulated CPU time (s) 2.68
Current children cumulated vsize (KiB) 242208

[startup+1.50076 s]
/proc/loadavg: 8.01 7.97 6.94 9/179 19667
/proc/meminfo: memFree=18873552/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=236776 CPUtime=9.07 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 44828 1253 0 0 902 5 0 0 18 0 9 0 512493961 242458624 23543 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 59194 23543 175 55 0 57080 0
[pid=19653/tid=19660] ppid=19651 vsize=236776 CPUtime=1.07 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 8137 1253 0 0 107 0 0 0 19 0 9 0 512494002 242458624 23543 33554432000 4194304 4417332 140736056092784 18446744073709551615 4284784 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=236776 CPUtime=1.08 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 1486 1253 0 0 108 0 0 0 19 0 9 0 512494002 242458624 23543 33554432000 4194304 4417332 140736056092784 18446744073709551615 4301776 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=236776 CPUtime=1.06 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 6600 1253 0 0 105 1 0 0 25 0 9 0 512494002 242458624 23543 33554432000 4194304 4417332 140736056092784 18446744073709551615 4290595 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=236776 CPUtime=1.08 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 945 1253 0 0 108 0 0 0 19 0 9 0 512494002 242458624 23543 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=236776 CPUtime=1.08 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 3855 1253 0 0 108 0 0 0 19 0 9 0 512494002 242458624 23543 33554432000 4194304 4417332 140736056092784 18446744073709551615 4287187 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=236776 CPUtime=1.08 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 1467 1253 0 0 108 0 0 0 19 0 9 0 512494002 242458624 23543 33554432000 4194304 4417332 140736056092784 18446744073709551615 4284595 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=236776 CPUtime=1.07 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 1360 1253 0 0 107 0 0 0 21 0 9 0 512494002 242458624 23543 33554432000 4194304 4417332 140736056092784 18446744073709551615 4290456 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=236776 CPUtime=1.08 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 2513 1253 0 0 108 0 0 0 19 0 9 0 512494003 242458624 23543 33554432000 4194304 4417332 140736056092784 18446744073709551615 4284943 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 9.07
Current children cumulated vsize (KiB) 236776

[startup+3.10044 s]
/proc/loadavg: 8.01 7.97 6.95 9/179 19668
/proc/meminfo: memFree=18869216/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=239520 CPUtime=21.87 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 52911 1253 0 0 2180 7 0 0 18 0 9 0 512493961 245268480 22660 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 59880 22660 181 55 0 57766 0
[pid=19653/tid=19660] ppid=19651 vsize=239520 CPUtime=2.68 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 11236 1253 0 0 267 1 0 0 22 0 9 0 512494002 245268480 22660 33554432000 4194304 4417332 140736056092784 18446744073709551615 4253978 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=239520 CPUtime=2.68 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 1877 1253 0 0 268 0 0 0 23 0 9 0 512494002 245268480 22660 33554432000 4194304 4417332 140736056092784 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=239520 CPUtime=2.66 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 6984 1253 0 0 265 1 0 0 25 0 9 0 512494002 245268480 22660 33554432000 4194304 4417332 140736056092784 18446744073709551615 4235968 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=239520 CPUtime=2.68 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 945 1253 0 0 268 0 0 0 22 0 9 0 512494002 245268480 22660 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=239520 CPUtime=2.68 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 4603 1253 0 0 268 0 0 0 22 0 9 0 512494002 245268480 22660 33554432000 4194304 4417332 140736056092784 18446744073709551615 4330209 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=239520 CPUtime=2.67 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 3350 1253 0 0 267 0 0 0 22 0 9 0 512494002 245268480 22660 33554432000 4194304 4417332 140736056092784 18446744073709551615 4239408 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=239520 CPUtime=2.67 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 2153 1253 0 0 267 0 0 0 25 0 9 0 512494002 245268480 22660 33554432000 4194304 4417332 140736056092784 18446744073709551615 4236319 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=239520 CPUtime=2.67 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 3298 1253 0 0 267 0 0 0 23 0 9 0 512494003 245268480 22660 33554432000 4194304 4417332 140736056092784 18446744073709551615 4320251 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 21.87
Current children cumulated vsize (KiB) 239520

[startup+6.30079 s]
/proc/loadavg: 8.01 7.97 6.95 9/179 19668
/proc/meminfo: memFree=18831396/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=275740 CPUtime=47.46 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 63506 1253 0 0 4738 8 0 0 18 0 9 0 512493961 282357760 33240 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 68935 33240 181 55 0 66821 0
[pid=19653/tid=19660] ppid=19651 vsize=275740 CPUtime=5.87 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 13738 1253 0 0 586 1 0 0 25 0 9 0 512494002 282357760 33240 33554432000 4194304 4417332 140736056092784 18446744073709551615 4258418 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=275740 CPUtime=5.88 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 4374 1253 0 0 588 0 0 0 25 0 9 0 512494002 282357760 33240 33554432000 4194304 4417332 140736056092784 18446744073709551615 4248238 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=275740 CPUtime=5.84 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 6984 1253 0 0 583 1 0 0 25 0 9 0 512494002 282357760 33240 33554432000 4194304 4417332 140736056092784 18446744073709551615 4250053 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=275740 CPUtime=5.88 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 1246 1253 0 0 588 0 0 0 25 0 9 0 512494002 282357760 33240 33554432000 4194304 4417332 140736056092784 18446744073709551615 4250771 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=275740 CPUtime=5.88 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 5668 1253 0 0 588 0 0 0 25 0 9 0 512494002 282357760 33240 33554432000 4194304 4417332 140736056092784 18446744073709551615 4236255 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=275740 CPUtime=5.87 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 4822 1253 0 0 587 0 0 0 25 0 9 0 512494002 282357760 33240 33554432000 4194304 4417332 140736056092784 18446744073709551615 4258488 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=275740 CPUtime=5.87 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 2153 1253 0 0 587 0 0 0 25 0 9 0 512494002 282357760 33240 33554432000 4194304 4417332 140736056092784 18446744073709551615 4249991 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=275740 CPUtime=5.87 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 6056 1253 0 0 587 0 0 0 25 0 9 0 512494003 282357760 33240 33554432000 4194304 4417332 140736056092784 18446744073709551615 4248242 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 47.46
Current children cumulated vsize (KiB) 275740

[startup+12.7005 s]
/proc/loadavg: 8.01 7.97 6.96 9/179 19668
/proc/meminfo: memFree=18842320/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=262912 CPUtime=98.62 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 64729 1253 0 0 9854 8 0 0 18 0 9 0 512493961 269221888 30065 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 65728 30065 181 55 0 63614 0
[pid=19653/tid=19660] ppid=19651 vsize=262912 CPUtime=12.27 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 13747 1253 0 0 1226 1 0 0 25 0 9 0 512494002 269221888 30065 33554432000 4194304 4417332 140736056092784 18446744073709551615 4252163 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=262912 CPUtime=12.28 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 4383 1253 0 0 1228 0 0 0 25 0 9 0 512494002 269221888 30065 33554432000 4194304 4417332 140736056092784 18446744073709551615 4253176 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=262912 CPUtime=12.21 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 7001 1253 0 0 1220 1 0 0 25 0 9 0 512494002 269221888 30065 33554432000 4194304 4417332 140736056092784 18446744073709551615 4336621 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=262912 CPUtime=12.28 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 1246 1253 0 0 1228 0 0 0 25 0 9 0 512494002 269221888 30065 33554432000 4194304 4417332 140736056092784 18446744073709551615 4353435 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=262912 CPUtime=12.28 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 5677 1253 0 0 1228 0 0 0 25 0 9 0 512494002 269221888 30065 33554432000 4194304 4417332 140736056092784 18446744073709551615 4250074 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=262912 CPUtime=12.27 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 5846 1253 0 0 1227 0 0 0 25 0 9 0 512494002 269221888 30065 33554432000 4194304 4417332 140736056092784 18446744073709551615 254500384464 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=262912 CPUtime=12.27 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 2171 1253 0 0 1227 0 0 0 25 0 9 0 512494002 269221888 30065 33554432000 4194304 4417332 140736056092784 18446744073709551615 4277571 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=262912 CPUtime=12.27 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 6193 1253 0 0 1227 0 0 0 25 0 9 0 512494003 269221888 30065 33554432000 4194304 4417332 140736056092784 18446744073709551615 4248907 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 98.62
Current children cumulated vsize (KiB) 262912

[startup+25.501 s]
/proc/loadavg: 8.00 7.97 6.97 9/179 19668
/proc/meminfo: memFree=18825988/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=287488 CPUtime=200.96 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 72013 1253 0 0 20087 9 0 0 18 0 9 0 512493961 294387712 35191 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 71872 35191 181 55 0 69758 0
[pid=19653/tid=19660] ppid=19651 vsize=287488 CPUtime=25.08 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 14787 1253 0 0 2506 2 0 0 25 0 9 0 512494002 294387712 35191 33554432000 4194304 4417332 140736056092784 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=287488 CPUtime=25.08 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 5423 1253 0 0 2508 0 0 0 25 0 9 0 512494002 294387712 35191 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=287488 CPUtime=24.95 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 7538 1253 0 0 2494 1 0 0 25 0 9 0 512494002 294387712 35191 33554432000 4194304 4417332 140736056092784 18446744073709551615 4277291 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=287488 CPUtime=25.08 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 2270 1253 0 0 2508 0 0 0 25 0 9 0 512494002 294387712 35191 33554432000 4194304 4417332 140736056092784 18446744073709551615 4321577 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=287488 CPUtime=25.08 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 6717 1253 0 0 2508 0 0 0 25 0 9 0 512494002 294387712 35191 33554432000 4194304 4417332 140736056092784 18446744073709551615 4366011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=287488 CPUtime=25.08 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 6871 1253 0 0 2507 1 0 0 25 0 9 0 512494002 294387712 35191 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=287488 CPUtime=25.07 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 2709 1253 0 0 2507 0 0 0 25 0 9 0 512494002 294387712 35191 33554432000 4194304 4417332 140736056092784 18446744073709551615 4275642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=287488 CPUtime=25.08 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 7233 1253 0 0 2507 1 0 0 25 0 9 0 512494003 294387712 35191 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 200.96
Current children cumulated vsize (KiB) 287488

[startup+51.1009 s]
/proc/loadavg: 8.08 7.99 7.00 9/179 19669
/proc/meminfo: memFree=18788420/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=326948 CPUtime=405.64 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 106550 1253 0 0 40550 14 0 0 18 0 9 0 512493961 334794752 45056 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 81737 45056 181 55 0 79623 0
[pid=19653/tid=19660] ppid=19651 vsize=326948 CPUtime=50.68 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 22096 1253 0 0 5066 2 0 0 25 0 9 0 512494002 334794752 45056 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=326948 CPUtime=50.68 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 10655 1253 0 0 5067 1 0 0 25 0 9 0 512494002 334794752 45056 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=326948 CPUtime=50.42 cores=0-7

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.08 8.04 8.00 9/179 19814
/proc/meminfo: memFree=15868316/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=3246004 CPUtime=37750.2 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 5509672 1253 0 0 3773978 1042 0 0 18 0 9 0 512493961 3323908096 772864 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 811501 772864 181 55 0 809387 0
[pid=19653/tid=19660] ppid=19651 vsize=3246004 CPUtime=4721.25 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 770657 1253 0 0 471973 152 0 0 25 0 9 0 512494002 3323908096 772864 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=3246004 CPUtime=4722.1 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 651709 1253 0 0 472083 127 0 0 25 0 9 0 512494002 3323908096 772864 33554432000 4194304 4417332 140736056092784 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=3246004 CPUtime=4696.53 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 701945 1253 0 0 469522 131 0 0 25 0 9 0 512494002 3323908096 772864 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=3246004 CPUtime=4722.07 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 652905 1253 0 0 472099 108 0 0 25 0 9 0 512494002 3323908096 772864 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=3246004 CPUtime=4722.08 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 686277 1253 0 0 472077 131 0 0 25 0 9 0 512494002 3323908096 772864 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=3246004 CPUtime=4722.1 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 654113 1253 0 0 472080 130 0 0 25 0 9 0 512494002 3323908096 772864 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=3246004 CPUtime=4721.63 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 678331 1253 0 0 472037 126 0 0 25 0 9 0 512494002 3323908096 772864 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=3246004 CPUtime=4721.95 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 695270 1253 0 0 472063 132 0 0 25 0 9 0 512494003 3323908096 772864 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37750.2
Current children cumulated vsize (KiB) 3246004

[startup+4782.3 s]
/proc/loadavg: 8.16 8.06 8.01 9/179 19816
/proc/meminfo: memFree=15730780/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=3383344 CPUtime=38229.8 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 5568233 1253 0 0 3821932 1052 0 0 18 0 9 0 512493961 3464544256 807199 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 845836 807199 181 55 0 843722 0
[pid=19653/tid=19660] ppid=19651 vsize=3383344 CPUtime=4781.25 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 770657 1253 0 0 477973 152 0 0 25 0 9 0 512494002 3464544256 807199 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=3383344 CPUtime=4782.1 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 701904 1253 0 0 478074 136 0 0 25 0 9 0 512494002 3464544256 807199 33554432000 4194304 4417332 140736056092784 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=3383344 CPUtime=4756.21 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 701945 1253 0 0 475490 131 0 0 25 0 9 0 512494002 3464544256 807199 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=3383344 CPUtime=4782.07 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 659046 1253 0 0 478098 109 0 0 25 0 9 0 512494002 3464544256 807199 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=3383344 CPUtime=4782.08 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 686277 1253 0 0 478077 131 0 0 25 0 9 0 512494002 3464544256 807199 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=3383344 CPUtime=4782.09 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 654113 1253 0 0 478079 130 0 0 25 0 9 0 512494002 3464544256 807199 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=3383344 CPUtime=4781.62 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 680556 1253 0 0 478036 126 0 0 25 0 9 0 512494002 3464544256 807199 33554432000 4194304 4417332 140736056092784 18446744073709551615 4366002 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=3383344 CPUtime=4781.95 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 695270 1253 0 0 478063 132 0 0 25 0 9 0 512494003 3464544256 807199 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38229.8
Current children cumulated vsize (KiB) 3383344

[startup+4842.3 s]
/proc/loadavg: 8.06 8.05 8.00 9/179 19818
/proc/meminfo: memFree=15755304/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=3358852 CPUtime=38709.5 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 5571852 1253 0 0 3869901 1053 0 0 18 0 9 0 512493961 3439464448 801076 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 839713 801076 181 55 0 837599 0
[pid=19653/tid=19660] ppid=19651 vsize=3358852 CPUtime=4841.25 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 770657 1253 0 0 483973 152 0 0 25 0 9 0 512494002 3439464448 801076 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=3358852 CPUtime=4842.1 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 701904 1253 0 0 484074 136 0 0 25 0 9 0 512494002 3439464448 801076 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=3358852 CPUtime=4815.88 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 701945 1253 0 0 481457 131 0 0 25 0 9 0 512494002 3439464448 801076 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=3358852 CPUtime=4842.08 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 662659 1253 0 0 484098 110 0 0 25 0 9 0 512494002 3439464448 801076 33554432000 4194304 4417332 140736056092784 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=3358852 CPUtime=4842.08 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 686283 1253 0 0 484077 131 0 0 25 0 9 0 512494002 3439464448 801076 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=3358852 CPUtime=4842.1 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 654113 1253 0 0 484080 130 0 0 25 0 9 0 512494002 3439464448 801076 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=3358852 CPUtime=4841.62 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 680556 1253 0 0 484036 126 0 0 25 0 9 0 512494002 3439464448 801076 33554432000 4194304 4417332 140736056092784 18446744073709551615 4250651 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=3358852 CPUtime=4841.95 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 695270 1253 0 0 484063 132 0 0 25 0 9 0 512494003 3439464448 801076 33554432000 4194304 4417332 140736056092784 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38709.5
Current children cumulated vsize (KiB) 3358852

[startup+4902.3 s]
/proc/loadavg: 8.08 8.05 8.00 10/180 19822
/proc/meminfo: memFree=15460896/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=3533824 CPUtime=39189.2 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 5657987 1253 0 0 3917841 1076 0 0 18 0 9 0 512493961 3618635776 844819 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 883456 844819 181 55 0 881342 0
[pid=19653/tid=19660] ppid=19651 vsize=3533824 CPUtime=4901.21 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 770657 1253 0 0 489969 152 0 0 25 0 9 0 512494002 3618635776 844819 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=3533824 CPUtime=4902.1 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 734672 1253 0 0 490064 146 0 0 25 0 9 0 512494002 3618635776 844819 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=3533824 CPUtime=4875.56 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 701945 1253 0 0 487425 131 0 0 25 0 9 0 512494002 3618635776 844819 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=3533824 CPUtime=4902.08 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 668669 1253 0 0 490097 111 0 0 25 0 9 0 512494002 3618635776 844819 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=3533824 CPUtime=4902.08 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 686283 1253 0 0 490077 131 0 0 25 0 9 0 512494002 3618635776 844819 33554432000 4194304 4417332 140736056092784 18446744073709551615 4260711 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=3533824 CPUtime=4902.09 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 701470 1253 0 0 490068 141 0 0 25 0 9 0 512494002 3618635776 844819 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=3533824 CPUtime=4901.61 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 680556 1253 0 0 490035 126 0 0 25 0 9 0 512494002 3618635776 844819 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=3533824 CPUtime=4901.95 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 695270 1253 0 0 490063 132 0 0 25 0 9 0 512494003 3618635776 844819 33554432000 4194304 4417332 140736056092784 18446744073709551615 4366025 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39189.2
Current children cumulated vsize (KiB) 3533824

[startup+4962.3 s]
/proc/loadavg: 8.22 8.11 8.02 9/179 19824
/proc/meminfo: memFree=15325632/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=3786224 CPUtime=39668.1 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 5730932 1253 0 0 3965713 1095 0 0 18 0 9 0 512493961 3877093376 908165 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 946556 908165 181 55 0 944442 0
[pid=19653/tid=19660] ppid=19651 vsize=3786224 CPUtime=4960.42 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 803425 1253 0 0 495881 161 0 0 25 0 9 0 512494002 3877093376 908165 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364695 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=3786224 CPUtime=4962.11 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 734672 1253 0 0 496064 147 0 0 25 0 9 0 512494002 3877093376 908165 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=3786224 CPUtime=4935.23 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 701945 1253 0 0 493392 131 0 0 25 0 9 0 512494002 3877093376 908165 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=3786224 CPUtime=4962.09 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 672279 1253 0 0 496097 112 0 0 25 0 9 0 512494002 3877093376 908165 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=3786224 CPUtime=4962.09 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 722850 1253 0 0 496069 140 0 0 25 0 9 0 512494002 3877093376 908165 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=3786224 CPUtime=4962.09 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 701470 1253 0 0 496068 141 0 0 25 0 9 0 512494002 3877093376 908165 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=3786224 CPUtime=4961.61 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 680556 1253 0 0 496035 126 0 0 25 0 9 0 512494002 3877093376 908165 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=3786224 CPUtime=4961.95 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 695270 1253 0 0 496063 132 0 0 25 0 9 0 512494003 3877093376 908165 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39668.1
Current children cumulated vsize (KiB) 3786224



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.91 s]
/proc/loadavg: 8.18 8.11 8.03 9/179 19825
/proc/meminfo: memFree=15283088/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=3829512 CPUtime=40000.7 cores=0-7
/proc/19653/stat : 19653 (plingeling) S 19651 19653 18933 0 -1 4202496 5803509 1253 0 0 3998963 1111 0 0 18 0 9 0 512493961 3921420288 918987 33554432000 4194304 4417332 140736056092784 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 957378 918987 181 55 0 955264 0
[pid=19653/tid=19660] ppid=19651 vsize=3829512 CPUtime=5002.04 cores=0-7
/proc/19653/task/19660/stat : 19660 (plingeling) R 19651 19653 18933 0 -1 4202560 839839 1253 0 0 500038 166 0 0 25 0 9 0 512494002 3921420288 918987 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19653/tid=19661] ppid=19651 vsize=3829512 CPUtime=5003.73 cores=0-7
/proc/19653/task/19661/stat : 19661 (plingeling) R 19651 19653 18933 0 -1 4202560 734672 1253 0 0 500226 147 0 0 25 0 9 0 512494002 3921420288 918987 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=3829512 CPUtime=4976.61 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4202560 701945 1253 0 0 497530 131 0 0 25 0 9 0 512494002 3921420288 918987 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19653/tid=19663] ppid=19651 vsize=3829512 CPUtime=5003.7 cores=0-7
/proc/19653/task/19663/stat : 19663 (plingeling) R 19651 19653 18933 0 -1 4202560 675674 1253 0 0 500257 113 0 0 25 0 9 0 512494002 3921420288 918987 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=19653/tid=19664] ppid=19651 vsize=3829512 CPUtime=5003.71 cores=0-7
/proc/19653/task/19664/stat : 19664 (plingeling) R 19651 19653 18933 0 -1 4202560 722850 1253 0 0 500231 140 0 0 25 0 9 0 512494002 3921420288 918987 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19653/tid=19665] ppid=19651 vsize=3829512 CPUtime=5003.72 cores=0-7
/proc/19653/task/19665/stat : 19665 (plingeling) R 19651 19653 18933 0 -1 4202560 734238 1253 0 0 500220 152 0 0 25 0 9 0 512494002 3921420288 918987 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19653/tid=19666] ppid=19651 vsize=3829512 CPUtime=5003.22 cores=0-7
/proc/19653/task/19666/stat : 19666 (plingeling) R 19651 19653 18933 0 -1 4202560 680556 1253 0 0 500196 126 0 0 25 0 9 0 512494002 3921420288 918987 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19653/tid=19667] ppid=19651 vsize=3829512 CPUtime=5003.57 cores=0-7
/proc/19653/task/19667/stat : 19667 (plingeling) R 19651 19653 18933 0 -1 4202560 695270 1253 0 0 500225 132 0 0 25 0 9 0 512494003 3921420288 918987 33554432000 4194304 4417332 140736056092784 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 3829512

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5004.01 s]
/proc/loadavg: 8.18 8.11 8.03 9/179 19825
/proc/meminfo: memFree=15283088/32950928 swapFree=67111528/67111528
[pid=19653] ppid=19651 vsize=0 CPUtime=40000.9 cores=0-7
/proc/19653/stat : 19653 (plingeling) Z 19651 19653 18933 0 -1 4203548 5803510 1253 0 0 3998967 1121 0 0 18 0 2 0 512493961 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 4 0 0 0
/proc/19653/statm: 0 0 0 0 0 0 0
[pid=19653/tid=19662] ppid=19651 vsize=0 CPUtime=4976.7 cores=0-7
/proc/19653/task/19662/stat : 19662 (plingeling) R 19651 19653 18933 0 -1 4203588 701945 1253 0 0 497530 140 0 0 25 0 2 0 512494002 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5004.1
CPU time (s): 40001
CPU user time (s): 39989.7
CPU system time (s): 11.3003
CPU usage (%): 799.365
Max. virtual memory (cumulated for all children) (KiB): 3941216

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39989.7
system time used= 11.3003
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5804763
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 448
involuntary context switches= 193005

runsolver used 7.8638 second user time and 19.2471 second system time

The end

Launcher Data 

Begin job on node149 at 2011-04-28 18:42:53
IDJOB=3309798
IDBENCH=83113
IDSOLVER=1695
FILE ID=node149/3309798-1304008973
RUNJOBID= node149-1304007216-18947
PBS_JOBID= 13168828
Free space on /tmp= 71928 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top22.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309798-1304008973/watcher-3309798-1304008973 -o /tmp/evaluation-result-3309798-1304008973/solver-3309798-1304008973 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309798-1304008973.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e822739302a2d834ec9ddfe9fbd0caa2
RANDOM SEED=1205942839

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      18964044 kB
Buffers:       2199316 kB
Cached:       11182128 kB
SwapCached:          0 kB
Active:        4494796 kB
Inactive:      8950656 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      18964044 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            3136 kB
Writeback:           0 kB
AnonPages:       64468 kB
Mapped:          14756 kB
Slab:           475124 kB
PageTables:       4344 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   183284 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71928 MiB
End job on node149 at 2011-04-28 20:06:19