Trace number 3261858

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.33 1202.23

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-3-5_528.cnf
MD5SUM7c7070bd15b57ddd9a06dd3709baef54
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark157.607
Satisfiable
(Un)Satisfiability was proved
Number of variables527
Number of clauses12692
Sum of the clauses size38748
Maximum clause length5
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 312356
Number of clauses of size 40
Number of clauses of size 5336
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3261858-1304092396/watcher-3261858-1304092396 -o /tmp/evaluation-result-3261858-1304092396/solver-3261858-1304092396 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3261858-1304092396.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.40 4.52 6.17 2/170 12407
/proc/meminfo: memFree=26628612/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=9444 CPUtime=0 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) R 12405 12407 12004 0 -1 4202496 454 1251 0 0 0 0 0 0 21 0 1 0 520838276 9670656 383 33554432000 4194304 4417332 140737214445488 18446744073709551615 242970550016 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/12407/statm: 2361 383 147 55 0 247 0

[startup+0.00727706 s]
/proc/loadavg: 3.40 4.52 6.17 2/170 12407
/proc/meminfo: memFree=26628612/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=9972 CPUtime=0 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) R 12405 12407 12004 0 -1 4202496 557 1251 0 0 0 0 0 0 21 0 1 0 520838276 10211328 486 33554432000 4194304 4417332 140737214445488 18446744073709551615 242970168880 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/12407/statm: 2493 486 148 55 0 379 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9972

[startup+0.148198 s]
/proc/loadavg: 3.40 4.52 6.17 2/170 12407
/proc/meminfo: memFree=26628612/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=55624 CPUtime=0.44 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 2152 1251 0 0 44 0 0 0 21 0 5 0 520838276 56958976 1722 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 13906 1722 178 55 0 11792 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 55624

[startup+0.300172 s]
/proc/loadavg: 3.40 4.52 6.17 2/170 12407
/proc/meminfo: memFree=26628612/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=56672 CPUtime=1.04 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 2383 1251 0 0 104 0 0 0 21 0 5 0 520838276 58032128 1953 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 14168 1953 178 55 0 12054 0
Current children cumulated CPU time (s) 1.04
Current children cumulated vsize (KiB) 56672

[startup+0.700104 s]
/proc/loadavg: 3.40 4.52 6.17 2/170 12407
/proc/meminfo: memFree=26628612/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=59768 CPUtime=2.64 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 3158 1251 0 0 264 0 0 0 21 0 5 0 520838276 61202432 2728 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 14942 2728 179 55 0 12828 0
Current children cumulated CPU time (s) 2.64
Current children cumulated vsize (KiB) 59768

[startup+1.50097 s]
/proc/loadavg: 3.40 4.52 6.17 9/184 12432
/proc/meminfo: memFree=26603708/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=62720 CPUtime=5.84 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 4385 1251 0 0 584 0 0 0 21 0 5 0 520838276 64225280 3466 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 15680 3466 179 55 0 13566 0
[pid=12407/tid=12429] ppid=12405 vsize=62720 CPUtime=1.45 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 314 1251 0 0 145 0 0 0 25 0 5 0 520838280 64225280 3466 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=62720 CPUtime=1.45 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 634 1251 0 0 145 0 0 0 25 0 5 0 520838280 64225280 3466 33554432000 4194304 4417332 140737214445488 18446744073709551615 4237250 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=62720 CPUtime=1.45 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 488 1251 0 0 145 0 0 0 25 0 5 0 520838280 64225280 3466 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=62720 CPUtime=1.45 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 1545 1251 0 0 145 0 0 0 25 0 5 0 520838280 64225280 3466 33554432000 4194304 4417332 140737214445488 18446744073709551615 4366740 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.84
Current children cumulated vsize (KiB) 62720

[startup+3.10069 s]
/proc/loadavg: 3.40 4.52 6.17 9/184 12432
/proc/meminfo: memFree=26595400/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=67408 CPUtime=12.23 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 7767 1251 0 0 1223 0 0 0 21 0 5 0 520838276 69025792 4663 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 16852 4663 179 55 0 14738 0
[pid=12407/tid=12429] ppid=12405 vsize=67408 CPUtime=3.05 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 1400 1251 0 0 305 0 0 0 25 0 5 0 520838280 69025792 4663 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364811 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=67408 CPUtime=3.05 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 1447 1251 0 0 305 0 0 0 25 0 5 0 520838280 69025792 4663 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=67408 CPUtime=3.05 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 1067 1251 0 0 305 0 0 0 25 0 5 0 520838280 69025792 4663 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=67408 CPUtime=3.04 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 2449 1251 0 0 304 0 0 0 25 0 5 0 520838280 69025792 4663 33554432000 4194304 4417332 140737214445488 18446744073709551615 4264976 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.23
Current children cumulated vsize (KiB) 67408

[startup+6.30114 s]
/proc/loadavg: 3.77 4.58 6.18 9/184 12432
/proc/meminfo: memFree=26583544/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=69984 CPUtime=24.77 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 13779 1251 0 0 2473 4 0 0 21 0 5 0 520838276 71663616 5309 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 17496 5309 179 55 0 15382 0
[pid=12407/tid=12429] ppid=12405 vsize=69984 CPUtime=6.01 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 2244 1251 0 0 599 2 0 0 25 0 5 0 520838280 71663616 5309 33554432000 4194304 4417332 140737214445488 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=69984 CPUtime=6.25 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 3934 1251 0 0 624 1 0 0 25 0 5 0 520838280 71663616 5309 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=69984 CPUtime=6.25 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 2024 1251 0 0 625 0 0 0 25 0 5 0 520838280 71663616 5309 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=69984 CPUtime=6.22 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 4173 1251 0 0 622 0 0 0 25 0 5 0 520838280 71663616 5309 33554432000 4194304 4417332 140737214445488 18446744073709551615 4365026 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.77
Current children cumulated vsize (KiB) 69984

[startup+12.701 s]
/proc/loadavg: 4.11 4.64 6.19 9/184 12432
/proc/meminfo: memFree=26573504/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=81420 CPUtime=50.32 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 29471 1251 0 0 5024 8 0 0 21 0 5 0 520838276 83374080 8173 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 20355 8173 179 55 0 18241 0
[pid=12407/tid=12429] ppid=12405 vsize=81420 CPUtime=12.4 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 5839 1251 0 0 1237 3 0 0 25 0 5 0 520838280 83374080 8173 33554432000 4194304 4417332 140737214445488 18446744073709551615 4236891 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=81420 CPUtime=12.63 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 7814 1251 0 0 1262 1 0 0 25 0 5 0 520838280 83374080 8173 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=81420 CPUtime=12.64 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 6089 1251 0 0 1264 0 0 0 25 0 5 0 520838280 83374080 8173 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=81420 CPUtime=12.58 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 8325 1251 0 0 1257 1 0 0 25 0 5 0 520838280 83374080 8173 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.32
Current children cumulated vsize (KiB) 81420

[startup+25.5008 s]
/proc/loadavg: 4.97 4.80 6.22 9/184 12432
/proc/meminfo: memFree=26553292/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=83708 CPUtime=101.43 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 58825 1251 0 0 10128 15 0 0 21 0 5 0 520838276 85716992 8745 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 20927 8745 179 55 0 18813 0
[pid=12407/tid=12429] ppid=12405 vsize=83708 CPUtime=25.19 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 11445 1251 0 0 2512 7 0 0 25 0 5 0 520838280 85716992 8745 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=83708 CPUtime=25.43 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 16757 1251 0 0 2540 3 0 0 25 0 5 0 520838280 85716992 8745 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=83708 CPUtime=25.45 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 13928 1251 0 0 2543 2 0 0 25 0 5 0 520838280 85716992 8745 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=83708 CPUtime=25.32 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 15291 1251 0 0 2530 2 0 0 25 0 5 0 520838280 85716992 8745 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.43
Current children cumulated vsize (KiB) 83708

[startup+51.1004 s]
/proc/loadavg: 6.00 5.06 6.26 9/184 12469
/proc/meminfo: memFree=26536076/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=93140 CPUtime=203.39 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 106794 1251 0 0 20302 37 0 0 21 0 5 0 520838276 95375360 11102 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 23285 11102 179 55 0 21171 0
[pid=12407/tid=12429] ppid=12405 vsize=93140 CPUtime=50.54 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 23222 1251 0 0 5037 17 0 0 25 0 5 0 520838280 95375360 11102 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=93140 CPUtime=51.01 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 28901 1251 0 0 5091 10 0 0 25 0 5 0 520838280 95375360 11102 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=93140 CPUtime=51.05 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 24282 1251 0 0 5101 4 0 0 25 0 5 0 520838280 95375360 11102 33554432000 4194304 4417332 140737214445488 18446744073709551615 4354144 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=93140 CPUtime=50.76 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 28985 1251 0 0 5071 5 0 0 25 0 5 0 520838280 95375360 11102 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.39
Current children cumulated vsize (KiB) 93140

[startup+102.307 s]
/proc/loadavg: 7.19 5.52 6.36 9/184 12471
/proc/meminfo: memFree=26503952/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=116344 CPUtime=407.89 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 240188 1251 0 0 40726 63 0 0 21 0 5 0 520838276 119136256 16872 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 29086 16872 179 55 0 26972 0
[pid=12407/tid=12429] ppid=12405 vsize=116344 CPUtime=101.7 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 63521 1251 0 0 10141 29 0 0 25 0 5 0 520838280 119136256 16872 33554432000 4194304 4417332 140737214445488 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=116344 CPUtime=102.18 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 68781 1251 0 0 10202 16 0 0 25 0 5 0 520838280 119136256 16872 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=116344 CPUtime=102.25 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 58818 1251 0 0 10217 8 0 0 25 0 5 0 520838280 119136256 16872 33554432000 4194304 4417332 140737214445488 18446744073709551615 4250882 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=116344 CPUtime=101.69 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 47664 1251 0 0 10162 7 0 0 25 0 5 0 520838280 119136256 16872 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 407.89
Current children cumulated vsize (KiB) 116344

[startup+162.3 s]
/proc/loadavg: 7.75 5.99 6.46 9/184 12472
/proc/meminfo: memFree=26485720/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=112788 CPUtime=647.51 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 335532 1251 0 0 64673 78 0 0 21 0 5 0 520838276 115494912 16013 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 28197 16013 179 55 0 26083 0
[pid=12407/tid=12429] ppid=12405 vsize=112788 CPUtime=161.69 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 89134 1251 0 0 16135 34 0 0 25 0 5 0 520838280 115494912 16013 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=112788 CPUtime=162.16 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 98858 1251 0 0 16195 21 0 0 25 0 5 0 520838280 115494912 16013 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=112788 CPUtime=162.25 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 80823 1251 0 0 16214 11 0 0 25 0 5 0 520838280 115494912 16013 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=112788 CPUtime=161.36 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 65313 1251 0 0 16126 10 0 0 25 0 5 0 520838280 115494912 16013 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 647.51
Current children cumulated vsize (KiB) 112788


################
# More data... #
################

[pid=12407/tid=12430] ppid=12405 vsize=206676 CPUtime=701.99 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 291932 1251 0 0 70151 48 0 0 25 0 5 0 520838280 211636224 39455 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=206676 CPUtime=702.25 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 276178 1251 0 0 70184 41 0 0 25 0 5 0 520838280 211636224 39455 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=206676 CPUtime=698.34 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 176489 1251 0 0 69806 28 0 0 25 0 5 0 520838280 211636224 39455 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2804.23
Current children cumulated vsize (KiB) 206676

[startup+762.307 s]
/proc/loadavg: 8.12 7.80 7.21 9/184 12497
/proc/meminfo: memFree=26250344/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=287800 CPUtime=3043.9 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 1077936 1251 0 0 304185 205 0 0 21 0 5 0 520838276 294707200 59736 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 71950 59736 179 55 0 69836 0
[pid=12407/tid=12429] ppid=12405 vsize=287800 CPUtime=761.58 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 283825 1251 0 0 76079 79 0 0 25 0 5 0 520838280 294707200 59736 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=287800 CPUtime=761.99 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 318573 1251 0 0 76147 52 0 0 25 0 5 0 520838280 294707200 59736 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=287800 CPUtime=762.26 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 290106 1251 0 0 76183 43 0 0 25 0 5 0 520838280 294707200 59736 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=287800 CPUtime=758.01 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 184028 1251 0 0 75772 29 0 0 25 0 5 0 520838280 294707200 59736 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3043.9
Current children cumulated vsize (KiB) 287800

[startup+822.301 s]
/proc/loadavg: 8.61 7.99 7.31 9/184 12502
/proc/meminfo: memFree=26244924/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=284576 CPUtime=3282.96 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 1120606 1251 0 0 328067 229 0 0 21 0 5 0 520838276 291405824 58930 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 71144 58930 179 55 0 69030 0
[pid=12407/tid=12429] ppid=12405 vsize=284576 CPUtime=821.19 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 295668 1251 0 0 82021 98 0 0 25 0 5 0 520838280 291405824 58930 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=284576 CPUtime=821.96 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 329227 1251 0 0 82142 54 0 0 25 0 5 0 520838280 291405824 58930 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=284576 CPUtime=822.25 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 303545 1251 0 0 82180 45 0 0 25 0 5 0 520838280 291405824 58930 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=284576 CPUtime=817.49 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 190762 1251 0 0 81719 30 0 0 25 0 5 0 520838280 291405824 58930 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3282.96
Current children cumulated vsize (KiB) 284576

[startup+882.3 s]
/proc/loadavg: 8.30 8.00 7.36 9/184 12503
/proc/meminfo: memFree=26252720/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=269692 CPUtime=3522.58 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 1166176 1251 0 0 352022 236 0 0 21 0 5 0 520838276 276164608 55209 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 67423 55209 179 55 0 65309 0
[pid=12407/tid=12429] ppid=12405 vsize=269692 CPUtime=881.18 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 309270 1251 0 0 88017 101 0 0 25 0 5 0 520838280 276164608 55209 33554432000 4194304 4417332 140737214445488 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=269692 CPUtime=881.94 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 342861 1251 0 0 88138 56 0 0 25 0 5 0 520838280 276164608 55209 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364639 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=269692 CPUtime=882.25 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 310400 1251 0 0 88179 46 0 0 25 0 5 0 520838280 276164608 55209 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=269692 CPUtime=877.15 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 202241 1251 0 0 87684 31 0 0 25 0 5 0 520838280 276164608 55209 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3522.58
Current children cumulated vsize (KiB) 269692

[startup+942.301 s]
/proc/loadavg: 8.18 8.02 7.40 9/184 12505
/proc/meminfo: memFree=26195172/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=296068 CPUtime=3762.24 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 1221909 1251 0 0 375979 245 0 0 21 0 5 0 520838276 303173632 61803 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 74017 61803 179 55 0 71903 0
[pid=12407/tid=12429] ppid=12405 vsize=296068 CPUtime=941.17 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 320089 1251 0 0 94014 103 0 0 25 0 5 0 520838280 303173632 61803 33554432000 4194304 4417332 140737214445488 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=296068 CPUtime=941.92 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 351053 1251 0 0 94135 57 0 0 25 0 5 0 520838280 303173632 61803 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=296068 CPUtime=942.26 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 340640 1251 0 0 94176 50 0 0 25 0 5 0 520838280 303173632 61803 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=296068 CPUtime=936.83 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 208723 1251 0 0 93651 32 0 0 25 0 5 0 520838280 303173632 61803 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3762.24
Current children cumulated vsize (KiB) 296068

[startup+1002.3 s]
/proc/loadavg: 8.12 8.03 7.44 9/184 12507
/proc/meminfo: memFree=26195268/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=326108 CPUtime=4001.87 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 1241816 1251 0 0 399938 249 0 0 21 0 5 0 520838276 333934592 69313 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 81527 69313 179 55 0 79413 0
[pid=12407/tid=12429] ppid=12405 vsize=326108 CPUtime=1001.14 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 320089 1251 0 0 100010 104 0 0 25 0 5 0 520838280 333934592 69313 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=326108 CPUtime=1001.9 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 356958 1251 0 0 100132 58 0 0 25 0 5 0 520838280 333934592 69313 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=326108 CPUtime=1002.25 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 347872 1251 0 0 100174 51 0 0 25 0 5 0 520838280 333934592 69313 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=326108 CPUtime=996.51 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 215493 1251 0 0 99617 34 0 0 25 0 5 0 520838280 333934592 69313 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364482 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4001.87
Current children cumulated vsize (KiB) 326108

[startup+1062.3 s]
/proc/loadavg: 8.10 8.04 7.48 9/184 12508
/proc/meminfo: memFree=26068900/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=393472 CPUtime=4241.5 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 1271089 1251 0 0 423895 255 0 0 21 0 5 0 520838276 402915328 86154 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 98368 86154 179 55 0 96254 0
[pid=12407/tid=12429] ppid=12405 vsize=393472 CPUtime=1061.12 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 331309 1251 0 0 106004 108 0 0 25 0 5 0 520838280 402915328 86154 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=393472 CPUtime=1061.88 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 356958 1251 0 0 106130 58 0 0 25 0 5 0 520838280 402915328 86154 33554432000 4194304 4417332 140737214445488 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=393472 CPUtime=1062.26 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 356064 1251 0 0 106173 53 0 0 25 0 5 0 520838280 402915328 86154 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=393472 CPUtime=1056.19 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 225354 1251 0 0 105584 35 0 0 25 0 5 0 520838280 402915328 86154 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4241.5
Current children cumulated vsize (KiB) 393472

[startup+1122.3 s]
/proc/loadavg: 8.04 8.03 7.51 9/184 12510
/proc/meminfo: memFree=26144652/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=367128 CPUtime=4481.13 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 1309495 1251 0 0 447850 263 0 0 21 0 5 0 520838276 375939072 79568 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 91782 79568 179 55 0 89668 0
[pid=12407/tid=12429] ppid=12405 vsize=367128 CPUtime=1121.09 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 339501 1251 0 0 111999 110 0 0 25 0 5 0 520838280 375939072 79568 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=367128 CPUtime=1121.87 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 365150 1251 0 0 112127 60 0 0 25 0 5 0 520838280 375939072 79568 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=367128 CPUtime=1122.26 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 372448 1251 0 0 112170 56 0 0 25 0 5 0 520838280 375939072 79568 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=367128 CPUtime=1115.86 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 230992 1251 0 0 111550 36 0 0 25 0 5 0 520838280 375939072 79568 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4481.13
Current children cumulated vsize (KiB) 367128

[startup+1182.3 s]
/proc/loadavg: 8.01 8.02 7.54 9/184 12511
/proc/meminfo: memFree=26138200/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=356560 CPUtime=4720.76 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 1359117 1251 0 0 471804 272 0 0 21 0 5 0 520838276 365117440 76926 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 89140 76926 179 55 0 87026 0
[pid=12407/tid=12429] ppid=12405 vsize=356560 CPUtime=1181.06 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 358150 1251 0 0 117991 115 0 0 25 0 5 0 520838280 365117440 76926 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=356560 CPUtime=1181.85 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 371213 1251 0 0 118124 61 0 0 25 0 5 0 520838280 365117440 76926 33554432000 4194304 4417332 140737214445488 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=356560 CPUtime=1182.26 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 391996 1251 0 0 118168 58 0 0 25 0 5 0 520838280 365117440 76926 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=356560 CPUtime=1175.54 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 236354 1251 0 0 117517 37 0 0 25 0 5 0 520838280 365117440 76926 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4720.76
Current children cumulated vsize (KiB) 356560



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.2 s]
/proc/loadavg: 8.09 8.04 7.55 9/184 12512
/proc/meminfo: memFree=26160636/32951132 swapFree=67111364/67111528
[pid=12407] ppid=12405 vsize=362784 CPUtime=4800.28 cores=0,2,4,6
/proc/12407/stat : 12407 (plingeling) S 12405 12407 12004 0 -1 4202496 1372961 1251 0 0 479754 274 0 0 21 0 5 0 520838276 371490816 78482 33554432000 4194304 4417332 140737214445488 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/12407/statm: 90696 78482 179 55 0 88582 0
[pid=12407/tid=12429] ppid=12405 vsize=362784 CPUtime=1200.96 cores=0,2,4,6
/proc/12407/task/12429/stat : 12429 (plingeling) R 12405 12407 12004 0 -1 4202560 362246 1251 0 0 119981 115 0 0 25 0 5 0 520838280 371490816 78482 33554432000 4194304 4417332 140737214445488 18446744073709551615 4365991 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12407/tid=12430] ppid=12405 vsize=362784 CPUtime=1201.76 cores=0,2,4,6
/proc/12407/task/12430/stat : 12430 (plingeling) R 12405 12407 12004 0 -1 4202560 371213 1251 0 0 120115 61 0 0 25 0 5 0 520838280 371490816 78482 33554432000 4194304 4417332 140737214445488 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12407/tid=12431] ppid=12405 vsize=362784 CPUtime=1202.17 cores=0,2,4,6
/proc/12407/task/12431/stat : 12431 (plingeling) R 12405 12407 12004 0 -1 4202560 400188 1251 0 0 120158 59 0 0 25 0 5 0 520838280 371490816 78482 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12407/tid=12432] ppid=12405 vsize=362784 CPUtime=1195.33 cores=0,2,4,6
/proc/12407/task/12432/stat : 12432 (plingeling) R 12405 12407 12004 0 -1 4202560 237910 1251 0 0 119496 37 0 0 25 0 5 0 520838280 371490816 78482 33554432000 4194304 4417332 140737214445488 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.28
Current children cumulated vsize (KiB) 362784

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.23
CPU time (s): 4800.33
CPU user time (s): 4797.57
CPU system time (s): 2.76658
CPU usage (%): 399.284
Max. virtual memory (cumulated for all children) (KiB): 460088

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.57
system time used= 2.76658
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1374213
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 90
involuntary context switches= 21878

runsolver used 1.85172 second user time and 4.54331 second system time

The end

Launcher Data 

Begin job on node128 at 2011-04-29 17:53:16
IDJOB=3261858
IDBENCH=83256
IDSOLVER=1605
FILE ID=node128/3261858-1304092396
RUNJOBID= node128-1304092396-12393
PBS_JOBID= 13170567
Free space on /tmp= 66976 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-3-5_528.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3261858-1304092396/watcher-3261858-1304092396 -o /tmp/evaluation-result-3261858-1304092396/solver-3261858-1304092396 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3261858-1304092396.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7c7070bd15b57ddd9a06dd3709baef54
RANDOM SEED=457448768

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      26627528 kB
Buffers:       1280620 kB
Cached:        4390824 kB
SwapCached:        160 kB
Active:         334312 kB
Inactive:      5403452 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      26627528 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:             848 kB
Writeback:           0 kB
AnonPages:       65632 kB
Mapped:          14780 kB
Slab:           523956 kB
PageTables:       4520 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   192660 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66972 MiB
End job on node128 at 2011-04-29 18:13:21