Trace number 3371482

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.28 1207.06

General information on the benchmark

Nameapplication/leberre/
2dimensionalstrippacking/E00X23.cnf
MD5SUM9cec6483d4ca03e8555377ba059b61ae
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables15364
Number of clauses2133873
Sum of the clauses size18060684
Maximum clause length91
Minimum clause length1
Number of clauses of size 116
Number of clauses of size 240913
Number of clauses of size 337518
Number of clauses of size 422333
Number of clauses of size 5147683
Number of clauses of size over 51885410

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371482-1305429283/watcher-3371482-1305429283 -o /tmp/evaluation-result-3371482-1305429283/solver-3371482-1305429283 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371482-1305429283.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.83 8.01 7.58 5/368 11604
/proc/meminfo: memFree=25424004/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=10832 CPUtime=0 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) R 11602 11604 10794 0 -1 4202496 820 1252 0 0 0 0 0 0 23 0 1 0 635344157 11091968 733 33554432000 4194304 4417452 140735174353648 18446744073709551615 264726404864 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/11604/statm: 2708 733 149 55 0 594 0

[startup+0.102954 s]
/proc/loadavg: 7.83 8.01 7.58 5/368 11604
/proc/meminfo: memFree=25424004/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=22112 CPUtime=0.09 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) R 11602 11604 10794 0 -1 4202496 3688 1252 0 0 9 0 0 0 23 0 1 0 635344157 22642688 3553 33554432000 4194304 4417452 140735174353648 18446744073709551615 264726023774 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/11604/statm: 5528 3553 149 55 0 3414 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 22112

[startup+0.200927 s]
/proc/loadavg: 7.83 8.01 7.58 5/368 11604
/proc/meminfo: memFree=25424004/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=30304 CPUtime=0.19 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) R 11602 11604 10794 0 -1 4202496 5736 1252 0 0 19 0 0 0 23 0 1 0 635344157 31031296 5601 33554432000 4194304 4417452 140735174353648 18446744073709551615 264726404864 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/11604/statm: 7576 5601 149 55 0 5462 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 30304

[startup+0.300909 s]
/proc/loadavg: 7.83 8.01 7.58 5/368 11604
/proc/meminfo: memFree=25424004/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=50784 CPUtime=0.29 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) R 11602 11604 10794 0 -1 4202496 10856 1252 0 0 28 1 0 0 24 0 1 0 635344157 52002816 10721 33554432000 4194304 4417452 140735174353648 18446744073709551615 264726404864 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/11604/statm: 12696 10721 149 55 0 10582 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 50784

[startup+0.70083 s]
/proc/loadavg: 7.83 8.01 7.58 5/368 11604
/proc/meminfo: memFree=25424004/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=112172 CPUtime=0.69 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) R 11602 11604 10794 0 -1 4202496 26211 1252 0 0 67 2 0 0 25 0 1 0 635344157 114864128 26068 33554432000 4194304 4417452 140735174353648 18446744073709551615 264726404864 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/11604/statm: 28043 26068 149 55 0 25929 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 112172

[startup+1.50068 s]
/proc/loadavg: 7.83 8.01 7.58 6/369 11610
/proc/meminfo: memFree=25216056/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=276012 CPUtime=1.49 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) R 11602 11604 10794 0 -1 4202496 67171 1252 0 0 142 7 0 0 25 0 1 0 635344157 282636288 67028 33554432000 4194304 4417452 140735174353648 18446744073709551615 4259903 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/11604/statm: 69003 67028 149 55 0 66889 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 276012

[startup+3.10037 s]
/proc/loadavg: 7.60 7.96 7.57 6/369 11610
/proc/meminfo: memFree=25013316/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=538156 CPUtime=3.09 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) R 11602 11604 10794 0 -1 4202496 132707 1252 0 0 294 15 0 0 25 0 1 0 635344157 551071744 132564 33554432000 4194304 4417452 140735174353648 18446744073709551615 4320823 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/11604/statm: 134539 132564 149 55 0 132425 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 538156

[startup+6.30074 s]
/proc/loadavg: 7.60 7.96 7.57 9/373 11614
/proc/meminfo: memFree=24779672/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=699024 CPUtime=11.46 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 216995 1252 0 0 1119 27 0 0 25 0 5 0 635344157 715800576 162508 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 174756 162508 174 55 0 172642 0
[pid=11604/tid=11611] ppid=11602 vsize=699024 CPUtime=1.73 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 428 1252 0 0 173 0 0 0 25 0 5 0 635344614 715800576 162508 33554432000 4194304 4417452 140735174353648 18446744073709551615 4309653 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=699024 CPUtime=1.71 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 415 1252 0 0 171 0 0 0 20 0 5 0 635344614 715800576 162508 33554432000 4194304 4417452 140735174353648 18446744073709551615 4307843 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=699024 CPUtime=1.72 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 427 1252 0 0 172 0 0 0 25 0 5 0 635344614 715800576 162508 33554432000 4194304 4417452 140735174353648 18446744073709551615 4310248 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=699024 CPUtime=1.71 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 17470 1252 0 0 170 1 0 0 25 0 5 0 635344614 715800576 162508 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.46
Current children cumulated vsize (KiB) 699024

[startup+12.7005 s]
/proc/loadavg: 7.66 7.96 7.57 9/373 11614
/proc/meminfo: memFree=24299932/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1165088 CPUtime=36.91 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 374577 1252 0 0 3632 59 0 0 25 0 5 0 635344157 1193050112 279059 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 291272 279059 179 55 0 289158 0
[pid=11604/tid=11611] ppid=11602 vsize=1165088 CPUtime=8.09 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 52556 1252 0 0 799 10 0 0 25 0 5 0 635344614 1193050112 279059 33554432000 4194304 4417452 140735174353648 18446744073709551615 4263247 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1165088 CPUtime=8.1 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 52419 1252 0 0 799 11 0 0 25 0 5 0 635344614 1193050112 279059 33554432000 4194304 4417452 140735174353648 18446744073709551615 4239401 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1165088 CPUtime=8.12 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 50230 1252 0 0 801 11 0 0 25 0 5 0 635344614 1193050112 279059 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1165088 CPUtime=8.02 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 21117 1252 0 0 800 2 0 0 25 0 5 0 635344614 1193050112 279059 33554432000 4194304 4417452 140735174353648 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 36.91
Current children cumulated vsize (KiB) 1165088

[startup+25.5011 s]
/proc/loadavg: 7.71 7.97 7.57 9/373 11615
/proc/meminfo: memFree=24529216/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=997284 CPUtime=87.96 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 415029 1252 0 0 8728 68 0 0 25 0 5 0 635344157 1021218816 220726 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 249321 220726 179 55 0 247207 0
[pid=11604/tid=11611] ppid=11602 vsize=997284 CPUtime=20.9 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 52558 1252 0 0 2079 11 0 0 25 0 5 0 635344614 1021218816 220726 33554432000 4194304 4417452 140735174353648 18446744073709551615 4260694 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=997284 CPUtime=20.89 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 52545 1252 0 0 2078 11 0 0 25 0 5 0 635344614 1021218816 220726 33554432000 4194304 4417452 140735174353648 18446744073709551615 4277945 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=997284 CPUtime=20.92 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 85699 1252 0 0 2074 18 0 0 25 0 5 0 635344614 1021218816 220726 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=997284 CPUtime=20.66 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 25972 1252 0 0 2064 2 0 0 25 0 5 0 635344614 1021218816 220726 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 87.96
Current children cumulated vsize (KiB) 997284

[startup+51.1013 s]
/proc/loadavg: 7.88 7.98 7.59 9/373 11615
/proc/meminfo: memFree=24410020/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1125596 CPUtime=190.07 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 514951 1252 0 0 18920 87 0 0 25 0 5 0 635344157 1152610304 252804 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 281399 252804 179 55 0 279285 0
[pid=11604/tid=11611] ppid=11602 vsize=1125596 CPUtime=46.49 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 85326 1252 0 0 4634 15 0 0 25 0 5 0 635344614 1152610304 252804 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1125596 CPUtime=46.5 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 85313 1252 0 0 4631 19 0 0 25 0 5 0 635344614 1152610304 252804 33554432000 4194304 4417452 140735174353648 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1125596 CPUtime=46.52 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 119648 1252 0 0 4627 25 0 0 25 0 5 0 635344614 1152610304 252804 33554432000 4194304 4417452 140735174353648 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1125596 CPUtime=45.96 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 26409 1252 0 0 4594 2 0 0 25 0 5 0 635344614 1152610304 252804 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 190.07
Current children cumulated vsize (KiB) 1125596

[startup+102.301 s]
/proc/loadavg: 7.95 7.98 7.61 10/373 11617
/proc/meminfo: memFree=24506924/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1017232 CPUtime=394.31 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 522073 1252 0 0 39342 89 0 0 25 0 5 0 635344157 1041645568 225713 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 254308 225713 179 55 0 252194 0
[pid=11604/tid=11611] ppid=11602 vsize=1017232 CPUtime=97.71 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 85754 1252 0 0 9756 15 0 0 25 0 5 0 635344614 1041645568 225713 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1017232 CPUtime=97.71 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 86373 1252 0 0 9752 19 0 0 25 0 5 0 635344614 1041645568 225713 33554432000 4194304 4417452 140735174353648 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1017232 CPUtime=97.74 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 122505 1252 0 0 9748 26 0 0 25 0 5 0 635344614 1041645568 225713 33554432000 4194304 4417452 140735174353648 18446744073709551615 4239401 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1017232 CPUtime=96.57 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 29186 1252 0 0 9654 3 0 0 25 0 5 0 635344614 1041645568 225713 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 394.31
Current children cumulated vsize (KiB) 1017232

[startup+162.3 s]
/proc/loadavg: 8.09 8.02 7.64 9/373 11618
/proc/meminfo: memFree=24493752/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1027040 CPUtime=633.57 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 546952 1252 0 0 63265 92 0 0 25 0 5 0 635344157 1051688960 228165 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 256760 228165 179 55 0 254646 0
[pid=11604/tid=11611] ppid=11602 vsize=1027040 CPUtime=157.7 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 85754 1252 0 0 15755 15 0 0 25 0 5 0 635344614 1051688960 228165 33554432000 4194304 4417452 140735174353648 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1027040 CPUtime=157.7 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 87194 1252 0 0 15751 19 0 0 25 0 5 0 635344614 1051688960 228165 33554432000 4194304 4417452 140735174353648 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1027040 CPUtime=157.72 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 123589 1252 0 0 15746 26 0 0 25 0 5 0 635344614 1051688960 228165 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1027040 CPUtime=155.86 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 52160 1252 0 0 15580 6 0 0 25 0 5 0 635344614 1051688960 228165 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 633.57
Current children cumulated vsize (KiB) 1027040

[startup+222.314 s]
/proc/loadavg: 8.03 8.01 7.66 9/373 11620
/proc/meminfo: memFree=24483524/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1040832 CPUtime=872.92 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 562696 1252 0 0 87197 95 0 0 25 0 5 0 635344157 1065811968 231613 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 260208 231613 179 55 0 258094 0
[pid=11604/tid=11611] ppid=11602 vsize=1040832 CPUtime=217.71 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 86989 1252 0 0 21756 15 0 0 25 0 5 0 635344614 1065811968 231613 33554432000 4194304 4417452 140735174353648 18446744073709551615 4352496 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1040832 CPUtime=217.71 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 88301 1252 0 0 21752 19 0 0 25 0 5 0 635344614 1065811968 231613 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1040832 CPUtime=217.74 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 123589 1252 0 0 21748 26 0 0 25 0 5 0 635344614 1065811968 231613 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1040832 CPUtime=215.15 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 65562 1252 0 0 21507 8 0 0 25 0 5 0 635344614 1065811968 231613 33554432000 4194304 4417452 140735174353648 18446744073709551615 4321587 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 872.92
Current children cumulated vsize (KiB) 1040832

################
# More data... #
################

[pid=11604/tid=11612] ppid=11602 vsize=1066760 CPUtime=757.73 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 100819 1252 0 0 75752 21 0 0 25 0 5 0 635344614 1092362240 238133 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1066760 CPUtime=757.76 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 195027 1252 0 0 75740 36 0 0 25 0 5 0 635344614 1092362240 238133 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1066760 CPUtime=748.79 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 226371 1252 0 0 74847 32 0 0 25 0 5 0 635344614 1092362240 238133 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3026.6
Current children cumulated vsize (KiB) 1066760

[startup+822.301 s]
/proc/loadavg: 8.26 8.14 7.88 9/373 11639
/proc/meminfo: memFree=24332972/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1150596 CPUtime=3265.86 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 953338 1252 0 0 326433 153 0 0 25 0 5 0 635344157 1178210304 259091 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 287649 259091 180 55 0 285535 0
[pid=11604/tid=11611] ppid=11602 vsize=1150596 CPUtime=817.72 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 190375 1252 0 0 81740 32 0 0 25 0 5 0 635344614 1178210304 259091 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1150596 CPUtime=817.73 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 104272 1252 0 0 81751 22 0 0 25 0 5 0 635344614 1178210304 259091 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1150596 CPUtime=817.75 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 217661 1252 0 0 81736 39 0 0 25 0 5 0 635344614 1178210304 259091 33554432000 4194304 4417452 140735174353648 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1150596 CPUtime=808.08 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 242775 1252 0 0 80773 35 0 0 25 0 5 0 635344614 1178210304 259091 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3265.86
Current children cumulated vsize (KiB) 1150596

[startup+882.314 s]
/proc/loadavg: 8.09 8.11 7.88 9/373 11641
/proc/meminfo: memFree=24392564/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1073044 CPUtime=3505.21 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 1011484 1252 0 0 350359 162 0 0 25 0 5 0 635344157 1098797056 239704 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 268261 239704 180 55 0 266147 0
[pid=11604/tid=11611] ppid=11602 vsize=1073044 CPUtime=877.74 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 206720 1252 0 0 87739 35 0 0 25 0 5 0 635344614 1098797056 239704 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1073044 CPUtime=877.73 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 113573 1252 0 0 87750 23 0 0 25 0 5 0 635344614 1098797056 239704 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1073044 CPUtime=877.76 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 227419 1252 0 0 87736 40 0 0 25 0 5 0 635344614 1098797056 239704 33554432000 4194304 4417452 140735174353648 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1073044 CPUtime=867.38 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 265517 1252 0 0 86700 38 0 0 25 0 5 0 635344614 1098797056 239704 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3505.21
Current children cumulated vsize (KiB) 1073044

[startup+942.301 s]
/proc/loadavg: 8.15 8.12 7.90 9/373 11642
/proc/meminfo: memFree=24315008/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1143468 CPUtime=3744.47 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 1093184 1252 0 0 374273 174 0 0 25 0 5 0 635344157 1170911232 257310 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 285867 257310 180 55 0 283753 0
[pid=11604/tid=11611] ppid=11602 vsize=1143468 CPUtime=937.73 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 225841 1252 0 0 93735 38 0 0 25 0 5 0 635344614 1170911232 257310 33554432000 4194304 4417452 140735174353648 18446744073709551615 4239408 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1143468 CPUtime=937.73 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 146155 1252 0 0 93746 27 0 0 25 0 5 0 635344614 1170911232 257310 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1143468 CPUtime=937.75 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 242464 1252 0 0 93733 42 0 0 25 0 5 0 635344614 1170911232 257310 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1143468 CPUtime=926.67 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 280469 1252 0 0 92626 41 0 0 25 0 5 0 635344614 1170911232 257310 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3744.47
Current children cumulated vsize (KiB) 1143468

[startup+1002.3 s]
/proc/loadavg: 8.09 8.11 7.91 9/373 11644
/proc/meminfo: memFree=24309104/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1142984 CPUtime=3983.75 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 1151378 1252 0 0 398193 182 0 0 25 0 5 0 635344157 1170415616 257190 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 285746 257190 180 55 0 283632 0
[pid=11604/tid=11611] ppid=11602 vsize=1142984 CPUtime=997.73 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 237640 1252 0 0 99733 40 0 0 25 0 5 0 635344614 1170415616 257190 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1142984 CPUtime=997.73 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 154527 1252 0 0 99744 29 0 0 25 0 5 0 635344614 1170415616 257190 33554432000 4194304 4417452 140735174353648 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1142984 CPUtime=997.76 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 265835 1252 0 0 99731 45 0 0 25 0 5 0 635344614 1170415616 257190 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1142984 CPUtime=985.96 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 295121 1252 0 0 98553 43 0 0 25 0 5 0 635344614 1170415616 257190 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3983.75
Current children cumulated vsize (KiB) 1142984

[startup+1062.3 s]
/proc/loadavg: 8.14 8.12 7.92 5/367 11646
/proc/meminfo: memFree=24368000/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1227028 CPUtime=4223.06 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 1218525 1252 0 0 422115 191 0 0 25 0 5 0 635344157 1256476672 278202 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 306757 278202 180 55 0 304643 0
[pid=11604/tid=11611] ppid=11602 vsize=1227028 CPUtime=1057.73 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 251230 1252 0 0 105731 42 0 0 25 0 5 0 635344614 1256476672 278202 33554432000 4194304 4417452 140735174353648 18446744073709551615 4263155 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1227028 CPUtime=1057.73 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 177534 1252 0 0 105741 32 0 0 25 0 5 0 635344614 1256476672 278202 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1227028 CPUtime=1057.76 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 278621 1252 0 0 105729 47 0 0 25 0 5 0 635344614 1256476672 278202 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1227028 CPUtime=1045.25 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 312885 1252 0 0 104481 44 0 0 25 0 5 0 635344614 1256476672 278202 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4223.06
Current children cumulated vsize (KiB) 1227028

[startup+1122.3 s]
/proc/loadavg: 5.43 7.32 7.66 5/363 11665
/proc/meminfo: memFree=24447144/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1151444 CPUtime=4462.36 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 1270518 1252 0 0 446037 199 0 0 25 0 5 0 635344157 1179078656 259306 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 287861 259306 180 55 0 285747 0
[pid=11604/tid=11611] ppid=11602 vsize=1151444 CPUtime=1117.74 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 267351 1252 0 0 111729 45 0 0 25 0 5 0 635344614 1179078656 259306 33554432000 4194304 4417452 140735174353648 18446744073709551615 4316282 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1151444 CPUtime=1117.74 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 189474 1252 0 0 111740 34 0 0 25 0 5 0 635344614 1179078656 259306 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1151444 CPUtime=1117.76 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 289856 1252 0 0 111727 49 0 0 25 0 5 0 635344614 1179078656 259306 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1151444 CPUtime=1104.55 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 325582 1252 0 0 110409 46 0 0 25 0 5 0 635344614 1179078656 259306 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4462.36
Current children cumulated vsize (KiB) 1151444

[startup+1182.3 s]
/proc/loadavg: 4.57 6.76 7.44 5/363 11667
/proc/meminfo: memFree=24569008/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1029892 CPUtime=4701.66 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 1298392 1252 0 0 469962 204 0 0 25 0 5 0 635344157 1054609408 228918 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 257473 228918 180 55 0 255359 0
[pid=11604/tid=11611] ppid=11602 vsize=1029892 CPUtime=1177.74 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 275448 1252 0 0 117728 46 0 0 25 0 5 0 635344614 1054609408 228918 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1029892 CPUtime=1177.73 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 195240 1252 0 0 117738 35 0 0 25 0 5 0 635344614 1054609408 228918 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1029892 CPUtime=1177.76 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 299443 1252 0 0 117726 50 0 0 25 0 5 0 635344614 1054609408 228918 33554432000 4194304 4417452 140735174353648 18446744073709551615 4302930 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1029892 CPUtime=1163.85 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 330006 1252 0 0 116338 47 0 0 25 0 5 0 635344614 1054609408 228918 33554432000 4194304 4417452 140735174353648 18446744073709551615 4358008 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4701.66
Current children cumulated vsize (KiB) 1029892



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207 s]
/proc/loadavg: 4.34 6.50 7.33 5/363 11667
/proc/meminfo: memFree=24573952/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1024180 CPUtime=4800.2 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 1321256 1252 0 0 479812 208 0 0 25 0 5 0 635344157 1048760320 227490 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 256045 227490 180 55 0 253931 0
[pid=11604/tid=11611] ppid=11602 vsize=1024180 CPUtime=1202.45 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 281370 1252 0 0 120198 47 0 0 25 0 5 0 635344614 1048760320 227490 33554432000 4194304 4417452 140735174353648 18446744073709551615 4365949 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1024180 CPUtime=1202.45 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 198445 1252 0 0 120209 36 0 0 25 0 5 0 635344614 1048760320 227490 33554432000 4194304 4417452 140735174353648 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1024180 CPUtime=1202.47 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 305157 1252 0 0 120196 51 0 0 25 0 5 0 635344614 1048760320 227490 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1024180 CPUtime=1188.25 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 338029 1252 0 0 118777 48 0 0 25 0 5 0 635344614 1048760320 227490 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 1024180

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207 s]
/proc/loadavg: 4.34 6.50 7.33 5/363 11667
/proc/meminfo: memFree=24573952/32951124 swapFree=63083164/67111528
[pid=11604] ppid=11602 vsize=1024180 CPUtime=4800.2 cores=1,3,5,7
/proc/11604/stat : 11604 (plingeling) S 11602 11604 10794 0 -1 4202496 1321256 1252 0 0 479812 208 0 0 25 0 5 0 635344157 1048760320 227490 33554432000 4194304 4417452 140735174353648 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/11604/statm: 256045 227490 180 55 0 253931 0
[pid=11604/tid=11611] ppid=11602 vsize=1024180 CPUtime=1202.45 cores=1,3,5,7
/proc/11604/task/11611/stat : 11611 (plingeling) R 11602 11604 10794 0 -1 4202560 281370 1252 0 0 120198 47 0 0 25 0 5 0 635344614 1048760320 227490 33554432000 4194304 4417452 140735174353648 18446744073709551615 4365949 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11604/tid=11612] ppid=11602 vsize=1024180 CPUtime=1202.45 cores=1,3,5,7
/proc/11604/task/11612/stat : 11612 (plingeling) R 11602 11604 10794 0 -1 4202560 198445 1252 0 0 120209 36 0 0 25 0 5 0 635344614 1048760320 227490 33554432000 4194304 4417452 140735174353648 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11604/tid=11613] ppid=11602 vsize=1024180 CPUtime=1202.47 cores=1,3,5,7
/proc/11604/task/11613/stat : 11613 (plingeling) R 11602 11604 10794 0 -1 4202560 305157 1252 0 0 120196 51 0 0 25 0 5 0 635344614 1048760320 227490 33554432000 4194304 4417452 140735174353648 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11604/tid=11614] ppid=11602 vsize=1024180 CPUtime=1188.25 cores=1,3,5,7
/proc/11604/task/11614/stat : 11614 (plingeling) R 11602 11604 10794 0 -1 4202560 338029 1252 0 0 118777 48 0 0 25 0 5 0 635344614 1048760320 227490 33554432000 4194304 4417452 140735174353648 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 1024180

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1207.06
CPU time (s): 4800.28
CPU user time (s): 4798.16
CPU system time (s): 2.12268
CPU usage (%): 397.684
Max. virtual memory (cumulated for all children) (KiB): 1291444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.16
system time used= 2.12268
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1322508
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 92
involuntary context switches= 23206

runsolver used 3.89641 second user time and 10.3894 second system time

The end

Launcher Data 

Begin job on node141 at 2011-05-15 05:14:45
IDJOB=3371482
IDBENCH=83463
IDSOLVER=1848
FILE ID=node141/3371482-1305429283
RUNJOBID= node141-1305426761-10813
PBS_JOBID= 13324603
Free space on /tmp= 73260 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/leberre/2dimensionalstrippacking/E00X23.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371482-1305429283/watcher-3371482-1305429283 -o /tmp/evaluation-result-3371482-1305429283/solver-3371482-1305429283 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371482-1305429283.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9cec6483d4ca03e8555377ba059b61ae
RANDOM SEED=1467204626

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25424160 kB
Buffers:        247052 kB
Cached:        5007352 kB
SwapCached:      15708 kB
Active:        2204532 kB
Inactive:      5079804 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25424160 kB
SwapTotal:    67111528 kB
SwapFree:     63083164 kB
Dirty:          100752 kB
Writeback:           0 kB
AnonPages:     2021028 kB
Mapped:          13288 kB
Slab:           139428 kB
PageTables:      38160 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 86350748 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73260 MiB
End job on node141 at 2011-05-15 05:34:55