Trace number 3371434

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.16 1202.23

General information on the benchmark

Nameindustrial/jarvisalo/
eq.atree.braun.12.unsat.cnf
MD5SUM8d6acb9f6b752ad76c024133f5175c69
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1694
Number of clauses5726
Sum of the clauses size14874
Maximum clause length23
Minimum clause length1
Number of clauses of size 13
Number of clauses of size 22490
Number of clauses of size 33143
Number of clauses of size 439
Number of clauses of size 538
Number of clauses of size over 513

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371434-1305416882/watcher-3371434-1305416882 -o /tmp/evaluation-result-3371434-1305416882/solver-3371434-1305416882 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371434-1305416882.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.50 7.99 7.96 2/229 4597
/proc/meminfo: memFree=19175320/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=9456 CPUtime=0 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) R 4595 4597 3882 0 -1 4202496 425 1257 0 0 0 0 0 0 25 0 1 0 653287959 9682944 355 33554432000 4194304 4417452 140737294165456 18446744073709551615 248089698048 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/4597/statm: 2364 355 148 55 0 250 0

[startup+0.117078 s]
/proc/loadavg: 7.50 7.99 7.96 2/229 4597
/proc/meminfo: memFree=19175320/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=52372 CPUtime=0.42 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 1103 1257 0 0 42 0 0 0 25 0 5 0 653287959 53628928 908 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 13093 908 180 55 0 10979 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 52372

[startup+0.201064 s]
/proc/loadavg: 7.50 7.99 7.96 2/229 4597
/proc/meminfo: memFree=19175320/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=53912 CPUtime=0.76 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 1503 1257 0 0 76 0 0 0 25 0 5 0 653287959 55205888 1277 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 13478 1277 180 55 0 11364 0
Current children cumulated CPU time (s) 0.76
Current children cumulated vsize (KiB) 53912

[startup+0.301046 s]
/proc/loadavg: 7.50 7.99 7.96 2/229 4597
/proc/meminfo: memFree=19175320/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=54632 CPUtime=1.16 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 1833 1257 0 0 116 0 0 0 25 0 5 0 653287959 55943168 1480 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 13658 1480 180 55 0 11544 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 54632

[startup+0.700975 s]
/proc/loadavg: 7.50 7.99 7.96 2/229 4597
/proc/meminfo: memFree=19175320/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=55648 CPUtime=2.75 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 3171 1257 0 0 275 0 0 0 25 0 5 0 653287959 56983552 1712 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 13912 1712 180 55 0 11798 0
Current children cumulated CPU time (s) 2.75
Current children cumulated vsize (KiB) 55648

[startup+1.50083 s]
/proc/loadavg: 7.62 8.01 7.97 9/238 4611
/proc/meminfo: memFree=19152580/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=57340 CPUtime=5.94 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 5822 1257 0 0 594 0 0 0 25 0 5 0 653287959 58716160 2155 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 14335 2155 180 55 0 12221 0
[pid=4597/tid=4604] ppid=4595 vsize=57340 CPUtime=1.49 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 1456 1257 0 0 149 0 0 0 25 0 5 0 653287960 58716160 2155 33554432000 4194304 4417452 140737294165456 18446744073709551615 4250873 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=57340 CPUtime=1.48 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 1007 1257 0 0 148 0 0 0 25 0 5 0 653287960 58716160 2155 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=57340 CPUtime=1.48 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 1193 1257 0 0 148 0 0 0 25 0 5 0 653287960 58716160 2155 33554432000 4194304 4417452 140737294165456 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=57340 CPUtime=1.48 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 1388 1257 0 0 148 0 0 0 25 0 5 0 653287960 58716160 2155 33554432000 4194304 4417452 140737294165456 18446744073709551615 4365959 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 57340

[startup+3.10055 s]
/proc/loadavg: 7.62 8.01 7.97 6/231 4632
/proc/meminfo: memFree=19316704/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=61344 CPUtime=12.34 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 11528 1257 0 0 1232 2 0 0 25 0 5 0 653287959 62816256 3166 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 15336 3166 180 55 0 13222 0
[pid=4597/tid=4604] ppid=4595 vsize=61344 CPUtime=3.08 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 2734 1257 0 0 308 0 0 0 25 0 5 0 653287960 62816256 3166 33554432000 4194304 4417452 140737294165456 18446744073709551615 4354762 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=61344 CPUtime=3.07 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 2690 1257 0 0 307 0 0 0 25 0 5 0 653287960 62816256 3166 33554432000 4194304 4417452 140737294165456 18446744073709551615 4366346 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=61344 CPUtime=3.07 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 2809 1257 0 0 307 0 0 0 25 0 5 0 653287960 62816256 3166 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=61344 CPUtime=3.07 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 2517 1257 0 0 307 0 0 0 25 0 5 0 653287960 62816256 3166 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 61344

[startup+6.30099 s]
/proc/loadavg: 7.62 8.01 7.97 9/238 4647
/proc/meminfo: memFree=19080392/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=66728 CPUtime=25.11 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 20523 1257 0 0 2508 3 0 0 25 0 5 0 653287959 68329472 4512 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 16682 4512 180 55 0 14568 0
[pid=4597/tid=4604] ppid=4595 vsize=66728 CPUtime=6.28 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 4722 1257 0 0 628 0 0 0 25 0 5 0 653287960 68329472 4512 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=66728 CPUtime=6.28 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 5499 1257 0 0 627 1 0 0 25 0 5 0 653287960 68329472 4512 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=66728 CPUtime=6.27 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 4998 1257 0 0 627 0 0 0 25 0 5 0 653287960 68329472 4512 33554432000 4194304 4417452 140737294165456 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=66728 CPUtime=6.24 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 4526 1257 0 0 624 0 0 0 25 0 5 0 653287960 68329472 4512 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 66728

[startup+12.7009 s]
/proc/loadavg: 7.68 8.01 7.97 9/238 4647
/proc/meminfo: memFree=18975896/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=71876 CPUtime=50.66 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 34086 1257 0 0 5061 5 0 0 25 0 5 0 653287959 73601024 5783 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 17969 5783 180 55 0 15855 0
[pid=4597/tid=4604] ppid=4595 vsize=71876 CPUtime=12.68 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 8087 1257 0 0 1267 1 0 0 25 0 5 0 653287960 73601024 5783 33554432000 4194304 4417452 140737294165456 18446744073709551615 4353828 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=71876 CPUtime=12.68 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 8916 1257 0 0 1266 2 0 0 25 0 5 0 653287960 73601024 5783 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=71876 CPUtime=12.68 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 8216 1257 0 0 1267 1 0 0 25 0 5 0 653287960 73601024 5783 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=71876 CPUtime=12.59 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 8089 1257 0 0 1258 1 0 0 25 0 5 0 653287960 73601024 5783 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 71876

[startup+25.5006 s]
/proc/loadavg: 7.73 8.00 7.97 9/238 4647
/proc/meminfo: memFree=19022584/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=75924 CPUtime=101.77 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 54233 1257 0 0 10168 9 0 0 25 0 5 0 653287959 77746176 6812 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 18981 6812 180 55 0 16867 0
[pid=4597/tid=4604] ppid=4595 vsize=75924 CPUtime=25.48 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 12611 1257 0 0 2546 2 0 0 25 0 5 0 653287960 77746176 6812 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364420 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=75924 CPUtime=25.48 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 12687 1257 0 0 2545 3 0 0 25 0 5 0 653287960 77746176 6812 33554432000 4194304 4417452 140737294165456 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=75924 CPUtime=25.48 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 13247 1257 0 0 2546 2 0 0 25 0 5 0 653287960 77746176 6812 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=75924 CPUtime=25.3 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 14910 1257 0 0 2528 2 0 0 25 0 5 0 653287960 77746176 6812 33554432000 4194304 4417452 140737294165456 18446744073709551615 4236689 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.77
Current children cumulated vsize (KiB) 75924

[startup+51.1011 s]
/proc/loadavg: 7.91 8.02 7.97 10/238 4684
/proc/meminfo: memFree=19005320/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=87848 CPUtime=203.99 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 94153 1257 0 0 20383 16 0 0 25 0 5 0 653287959 89956352 9785 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 21962 9785 180 55 0 19848 0
[pid=4597/tid=4604] ppid=4595 vsize=87848 CPUtime=51.08 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 24222 1257 0 0 5104 4 0 0 25 0 5 0 653287960 89956352 9785 33554432000 4194304 4417452 140737294165456 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=87848 CPUtime=51.08 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 21189 1257 0 0 5104 4 0 0 25 0 5 0 653287960 89956352 9785 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=87848 CPUtime=51.08 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 22639 1257 0 0 5105 3 0 0 25 0 5 0 653287960 89956352 9785 33554432000 4194304 4417452 140737294165456 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=87848 CPUtime=50.72 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 25325 1257 0 0 5068 4 0 0 25 0 5 0 653287960 89956352 9785 33554432000 4194304 4417452 140737294165456 18446744073709551615 4357269 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.99
Current children cumulated vsize (KiB) 87848

[startup+102.301 s]
/proc/loadavg: 7.96 8.01 7.97 10/238 4686
/proc/meminfo: memFree=18969464/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=102896 CPUtime=408.43 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 162021 1257 0 0 40814 29 0 0 25 0 5 0 653287959 105365504 13561 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 25724 13561 180 55 0 23610 0
[pid=4597/tid=4604] ppid=4595 vsize=102896 CPUtime=102.29 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 41670 1257 0 0 10222 7 0 0 25 0 5 0 653287960 105365504 13561 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=102896 CPUtime=102.28 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 35095 1257 0 0 10222 6 0 0 25 0 5 0 653287960 105365504 13561 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=102896 CPUtime=102.29 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 39289 1257 0 0 10222 7 0 0 25 0 5 0 653287960 105365504 13561 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=102896 CPUtime=101.54 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 45189 1257 0 0 10147 7 0 0 25 0 5 0 653287960 105365504 13561 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.43
Current children cumulated vsize (KiB) 102896

[startup+162.3 s]
/proc/loadavg: 8.10 8.04 7.98 10/238 4687
/proc/meminfo: memFree=18942176/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=133100 CPUtime=647.98 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 238753 1257 0 0 64757 41 0 0 25 0 5 0 653287959 136294400 21080 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 33275 21080 180 55 0 31161 0
[pid=4597/tid=4604] ppid=4595 vsize=133100 CPUtime=162.28 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 61525 1257 0 0 16218 10 0 0 25 0 5 0 653287960 136294400 21080 33554432000 4194304 4417452 140737294165456 18446744073709551615 4250947 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=133100 CPUtime=162.28 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 57560 1257 0 0 16218 10 0 0 25 0 5 0 653287960 136294400 21080 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=133100 CPUtime=162.28 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 57555 1257 0 0 16218 10 0 0 25 0 5 0 653287960 136294400 21080 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=133100 CPUtime=161.11 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 61335 1257 0 0 16101 10 0 0 25 0 5 0 653287960 136294400 21080 33554432000 4194304 4417452 140737294165456 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 647.98
Current children cumulated vsize (KiB) 133100


################
# More data... #
################

[pid=4597/tid=4605] ppid=4595 vsize=279720 CPUtime=762.3 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 158145 1257 0 0 76204 26 0 0 25 0 5 0 653287960 286433280 41372 33554432000 4194304 4417452 140737294165456 18446744073709551615 4250786 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=279720 CPUtime=762.28 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 178157 1257 0 0 76198 30 0 0 25 0 5 0 653287960 286433280 41372 33554432000 4194304 4417452 140737294165456 18446744073709551615 4353830 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=279720 CPUtime=756.76 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 174212 1257 0 0 75649 27 0 0 25 0 5 0 653287960 286433280 41372 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3043.68
Current children cumulated vsize (KiB) 279720

[startup+822.301 s]
/proc/loadavg: 7.06 7.88 7.96 5/228 4731
/proc/meminfo: memFree=19158824/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=281012 CPUtime=3283.22 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 704878 1257 0 0 328206 116 0 0 25 0 5 0 653287959 287756288 41695 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 70253 41695 180 55 0 68139 0
[pid=4597/tid=4604] ppid=4595 vsize=281012 CPUtime=822.29 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 167104 1257 0 0 82202 27 0 0 25 0 5 0 653287960 287756288 41695 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=281012 CPUtime=822.3 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 167342 1257 0 0 82202 28 0 0 25 0 5 0 653287960 287756288 41695 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=281012 CPUtime=822.28 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 188162 1257 0 0 82197 31 0 0 25 0 5 0 653287960 287756288 41695 33554432000 4194304 4417452 140737294165456 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=281012 CPUtime=816.33 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 181492 1257 0 0 81604 29 0 0 25 0 5 0 653287960 287756288 41695 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3283.22
Current children cumulated vsize (KiB) 281012

[startup+882.308 s]
/proc/loadavg: 5.16 7.19 7.71 5/228 4732
/proc/meminfo: memFree=19153720/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=285520 CPUtime=3522.81 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 724540 1257 0 0 352163 118 0 0 25 0 5 0 653287959 292372480 42822 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 71380 42822 180 55 0 69266 0
[pid=4597/tid=4604] ppid=4595 vsize=285520 CPUtime=882.3 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 170896 1257 0 0 88202 28 0 0 25 0 5 0 653287960 292372480 42822 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=285520 CPUtime=882.3 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 167342 1257 0 0 88202 28 0 0 25 0 5 0 653287960 292372480 42822 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=285520 CPUtime=882.28 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 195319 1257 0 0 88197 31 0 0 25 0 5 0 653287960 292372480 42822 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=285520 CPUtime=875.9 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 190205 1257 0 0 87560 30 0 0 25 0 5 0 653287960 292372480 42822 33554432000 4194304 4417452 140737294165456 18446744073709551615 4250972 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3522.81
Current children cumulated vsize (KiB) 285520

[startup+942.301 s]
/proc/loadavg: 4.46 6.62 7.48 5/228 4734
/proc/meminfo: memFree=19089076/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=351056 CPUtime=3762.36 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 754308 1257 0 0 376112 124 0 0 25 0 5 0 653287959 359481344 59186 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 87764 59186 180 55 0 85650 0
[pid=4597/tid=4604] ppid=4595 vsize=351056 CPUtime=942.29 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 175769 1257 0 0 94200 29 0 0 25 0 5 0 653287960 359481344 59186 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=351056 CPUtime=942.29 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 178168 1257 0 0 94199 30 0 0 25 0 5 0 653287960 359481344 59186 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=351056 CPUtime=942.28 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 203386 1257 0 0 94195 33 0 0 25 0 5 0 653287960 359481344 59186 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=351056 CPUtime=935.46 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 196207 1257 0 0 93515 31 0 0 25 0 5 0 653287960 359481344 59186 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3762.36
Current children cumulated vsize (KiB) 351056

[startup+1002.3 s]
/proc/loadavg: 4.20 6.15 7.27 5/228 4739
/proc/meminfo: memFree=19064548/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=375780 CPUtime=4001.93 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 769016 1257 0 0 400066 127 0 0 25 0 5 0 653287959 384798720 65367 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 93945 65367 180 55 0 91831 0
[pid=4597/tid=4604] ppid=4595 vsize=375780 CPUtime=1002.3 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 179522 1257 0 0 100200 30 0 0 25 0 5 0 653287960 384798720 65367 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=375780 CPUtime=1002.3 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 178168 1257 0 0 100200 30 0 0 25 0 5 0 653287960 384798720 65367 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=375780 CPUtime=1002.28 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 208410 1257 0 0 100194 34 0 0 25 0 5 0 653287960 384798720 65367 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=375780 CPUtime=995.03 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 202138 1257 0 0 99471 32 0 0 25 0 5 0 653287960 384798720 65367 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4001.93
Current children cumulated vsize (KiB) 375780

[startup+1062.3 s]
/proc/loadavg: 4.18 5.79 7.07 5/228 4740
/proc/meminfo: memFree=19045924/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=394440 CPUtime=4241.49 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 786003 1257 0 0 424019 130 0 0 25 0 5 0 653287959 403906560 70032 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 98610 70032 180 55 0 96496 0
[pid=4597/tid=4604] ppid=4595 vsize=394440 CPUtime=1062.29 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 186346 1257 0 0 106198 31 0 0 25 0 5 0 653287960 403906560 70032 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=394440 CPUtime=1062.3 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 178168 1257 0 0 106200 30 0 0 25 0 5 0 653287960 403906560 70032 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=394440 CPUtime=1062.28 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 213366 1257 0 0 106193 35 0 0 25 0 5 0 653287960 403906560 70032 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=394440 CPUtime=1054.59 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 207345 1257 0 0 105427 32 0 0 25 0 5 0 653287960 403906560 70032 33554432000 4194304 4417452 140737294165456 18446744073709551615 4366543 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4241.49
Current children cumulated vsize (KiB) 394440

[startup+1122.3 s]
/proc/loadavg: 4.07 5.46 6.87 5/228 4742
/proc/meminfo: memFree=19035340/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=405052 CPUtime=4481.06 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 803562 1257 0 0 447974 132 0 0 25 0 5 0 653287959 414773248 72685 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 101263 72685 180 55 0 99149 0
[pid=4597/tid=4604] ppid=4595 vsize=405052 CPUtime=1122.3 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 191666 1257 0 0 112198 32 0 0 25 0 5 0 653287960 414773248 72685 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=405052 CPUtime=1122.3 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 178168 1257 0 0 112200 30 0 0 25 0 5 0 653287960 414773248 72685 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=405052 CPUtime=1122.27 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 219446 1257 0 0 112192 35 0 0 25 0 5 0 653287960 414773248 72685 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=405052 CPUtime=1114.15 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 213504 1257 0 0 111382 33 0 0 25 0 5 0 653287960 414773248 72685 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4481.06
Current children cumulated vsize (KiB) 405052

[startup+1182.3 s]
/proc/loadavg: 4.02 5.19 6.69 5/228 4743
/proc/meminfo: memFree=19047580/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=394388 CPUtime=4720.63 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 832577 1257 0 0 471926 137 0 0 25 0 5 0 653287959 403853312 70019 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 98597 70019 180 55 0 96483 0
[pid=4597/tid=4604] ppid=4595 vsize=394388 CPUtime=1182.3 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 195632 1257 0 0 118197 33 0 0 25 0 5 0 653287960 403853312 70019 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=394388 CPUtime=1182.3 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 187667 1257 0 0 118199 31 0 0 25 0 5 0 653287960 403853312 70019 33554432000 4194304 4417452 140737294165456 18446744073709551615 4366126 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=394388 CPUtime=1182.28 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 224131 1257 0 0 118191 37 0 0 25 0 5 0 653287960 403853312 70019 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364696 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=394388 CPUtime=1173.72 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 224369 1257 0 0 117337 35 0 0 25 0 5 0 653287960 403853312 70019 33554432000 4194304 4417452 140737294165456 18446744073709551615 4366661 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4720.63
Current children cumulated vsize (KiB) 394388



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.2 s]
/proc/loadavg: 4.02 5.11 6.63 5/228 4744
/proc/meminfo: memFree=19042360/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=397848 CPUtime=4800.1 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 833442 1257 0 0 479873 137 0 0 25 0 5 0 653287959 407396352 70884 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 99462 70884 180 55 0 97348 0
[pid=4597/tid=4604] ppid=4595 vsize=397848 CPUtime=1202.21 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 195632 1257 0 0 120188 33 0 0 25 0 5 0 653287960 407396352 70884 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=397848 CPUtime=1202.21 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 187667 1257 0 0 120190 31 0 0 25 0 5 0 653287960 407396352 70884 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=397848 CPUtime=1202.18 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 224131 1257 0 0 120181 37 0 0 25 0 5 0 653287960 407396352 70884 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=397848 CPUtime=1193.48 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 225234 1257 0 0 119313 35 0 0 25 0 5 0 653287960 407396352 70884 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 397848

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.2 s]
/proc/loadavg: 4.02 5.11 6.63 5/228 4744
/proc/meminfo: memFree=19042360/32950928 swapFree=64721848/67111528
[pid=4597] ppid=4595 vsize=397848 CPUtime=4800.1 cores=1,3,5,7
/proc/4597/stat : 4597 (plingeling) S 4595 4597 3882 0 -1 4202496 833442 1257 0 0 479873 137 0 0 25 0 5 0 653287959 407396352 70884 33554432000 4194304 4417452 140737294165456 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/4597/statm: 99462 70884 180 55 0 97348 0
[pid=4597/tid=4604] ppid=4595 vsize=397848 CPUtime=1202.21 cores=1,3,5,7
/proc/4597/task/4604/stat : 4604 (plingeling) R 4595 4597 3882 0 -1 4202560 195632 1257 0 0 120188 33 0 0 25 0 5 0 653287960 407396352 70884 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4597/tid=4605] ppid=4595 vsize=397848 CPUtime=1202.21 cores=1,3,5,7
/proc/4597/task/4605/stat : 4605 (plingeling) R 4595 4597 3882 0 -1 4202560 187667 1257 0 0 120190 31 0 0 25 0 5 0 653287960 407396352 70884 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4597/tid=4606] ppid=4595 vsize=397848 CPUtime=1202.18 cores=1,3,5,7
/proc/4597/task/4606/stat : 4606 (plingeling) R 4595 4597 3882 0 -1 4202560 224131 1257 0 0 120181 37 0 0 25 0 5 0 653287960 407396352 70884 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4597/tid=4607] ppid=4595 vsize=397848 CPUtime=1193.48 cores=1,3,5,7
/proc/4597/task/4607/stat : 4607 (plingeling) R 4595 4597 3882 0 -1 4202560 225234 1257 0 0 119313 35 0 0 25 0 5 0 653287960 407396352 70884 33554432000 4194304 4417452 140737294165456 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 397848

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.23
CPU time (s): 4800.16
CPU user time (s): 4798.76
CPU system time (s): 1.39779
CPU usage (%): 399.272
Max. virtual memory (cumulated for all children) (KiB): 414784

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.76
system time used= 1.39779
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 834699
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 51
involuntary context switches= 32996

runsolver used 2.50162 second user time and 6.25105 second system time

The end

Launcher Data 

Begin job on node123 at 2011-05-15 01:48:02
IDJOB=3371434
IDBENCH=20468
IDSOLVER=1848
FILE ID=node123/3371434-1305416882
RUNJOBID= node123-1305416880-4537
PBS_JOBID= 13324524
Free space on /tmp= 73356 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT07/industrial/jarvisalo/eq.atree.braun.12.unsat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371434-1305416882/watcher-3371434-1305416882 -o /tmp/evaluation-result-3371434-1305416882/solver-3371434-1305416882 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371434-1305416882.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8d6acb9f6b752ad76c024133f5175c69
RANDOM SEED=1101197497

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19175476 kB
Buffers:        300436 kB
Cached:        3994320 kB
SwapCached:      10528 kB
Active:       10769992 kB
Inactive:      2736408 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19175476 kB
SwapTotal:    67111528 kB
SwapFree:     64721848 kB
Dirty:           10976 kB
Writeback:           0 kB
AnonPages:     9208656 kB
Mapped:          16176 kB
Slab:           176948 kB
PageTables:      31212 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 13189568 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73364 MiB
End job on node123 at 2011-05-15 02:08:06