Trace number 3280927

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.4 1201.73

General information on the benchmark

Nameindustrial/jarvisalo/
eq.atree.braun.11.unsat.cnf
MD5SUM90581094793af5fc10d4e4b9a10259ac
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark643.759
Satisfiable
(Un)Satisfiability was proved
Number of variables1400
Number of clauses4732
Sum of the clauses size12300
Maximum clause length21
Minimum clause length1
Number of clauses of size 13
Number of clauses of size 22052
Number of clauses of size 32605
Number of clauses of size 427
Number of clauses of size 531
Number of clauses of size over 514

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3280927-1304038488/watcher-3280927-1304038488 -o /tmp/evaluation-result-3280927-1304038488/solver-3280927-1304038488 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3280927-1304038488.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.36 7.90 7.91 6/181 28479
/proc/meminfo: memFree=20517964/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=9132 CPUtime=0 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) R 28477 28479 28251 0 -1 4202496 368 1251 0 0 0 0 0 0 25 0 1 0 594079447 9351168 297 33554432000 4194304 4417332 140737246398704 18446744073709551615 231895490304 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/28479/statm: 2283 297 147 55 0 169 0

[startup+0.00702995 s]
/proc/loadavg: 7.36 7.90 7.91 6/181 28479
/proc/meminfo: memFree=20517964/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=9452 CPUtime=0 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) R 28477 28479 28251 0 -1 4202496 424 1251 0 0 0 0 0 0 25 0 1 0 594079447 9678848 353 33554432000 4194304 4417332 140737246398704 18446744073709551615 4231468 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/28479/statm: 2363 353 147 55 0 249 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9452

[startup+0.136002 s]
/proc/loadavg: 7.36 7.90 7.91 6/181 28479
/proc/meminfo: memFree=20517964/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=118412 CPUtime=0.5 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 1286 1251 0 0 50 0 0 0 25 0 5 0 594079447 121253888 1071 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 29603 1071 181 55 0 27489 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 118412

[startup+0.300971 s]
/proc/loadavg: 7.36 7.90 7.91 6/181 28479
/proc/meminfo: memFree=20517964/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=119828 CPUtime=1.16 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 1937 1251 0 0 116 0 0 0 25 0 5 0 594079447 122703872 1425 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 29957 1425 181 55 0 27843 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 119828

[startup+0.700897 s]
/proc/loadavg: 7.36 7.90 7.91 6/181 28479
/proc/meminfo: memFree=20517964/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=120724 CPUtime=2.76 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 3226 1251 0 0 276 0 0 0 25 0 5 0 594079447 123621376 1649 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 30181 1649 181 55 0 28067 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 120724

[startup+1.50075 s]
/proc/loadavg: 7.41 7.90 7.91 9/186 28489
/proc/meminfo: memFree=20508400/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=121440 CPUtime=5.96 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 5708 1251 0 0 595 1 0 0 25 0 5 0 594079447 124354560 1828 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 30360 1828 181 55 0 28246 0
[pid=28479/tid=28486] ppid=28477 vsize=121440 CPUtime=1.48 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 1357 1251 0 0 148 0 0 0 25 0 5 0 594079448 124354560 1828 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=121440 CPUtime=1.48 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 1228 1251 0 0 148 0 0 0 25 0 5 0 594079448 124354560 1828 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=121440 CPUtime=1.48 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 1389 1251 0 0 148 0 0 0 25 0 5 0 594079448 124354560 1828 33554432000 4194304 4417332 140737246398704 18446744073709551615 4365894 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=121440 CPUtime=1.48 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 1168 1251 0 0 148 0 0 0 25 0 5 0 594079448 124354560 1828 33554432000 4194304 4417332 140737246398704 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 121440

[startup+3.10045 s]
/proc/loadavg: 7.41 7.90 7.91 9/186 28489
/proc/meminfo: memFree=20504040/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=125144 CPUtime=12.34 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 10431 1251 0 0 1233 1 0 0 25 0 5 0 594079447 128147456 2728 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 31286 2728 181 55 0 29172 0
[pid=28479/tid=28486] ppid=28477 vsize=125144 CPUtime=3.08 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 2744 1251 0 0 308 0 0 0 25 0 5 0 594079448 128147456 2728 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=125144 CPUtime=3.07 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 2123 1251 0 0 307 0 0 0 25 0 5 0 594079448 128147456 2728 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=125144 CPUtime=3.08 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 2489 1251 0 0 308 0 0 0 25 0 5 0 594079448 128147456 2728 33554432000 4194304 4417332 140737246398704 18446744073709551615 4250977 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=125144 CPUtime=3.08 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 2509 1251 0 0 308 0 0 0 25 0 5 0 594079448 128147456 2728 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364504 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 125144

[startup+6.30085 s]
/proc/loadavg: 7.41 7.90 7.91 9/186 28489
/proc/meminfo: memFree=20498600/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=128640 CPUtime=25.13 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 18619 1251 0 0 2510 3 0 0 25 0 5 0 594079447 131727360 3624 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 32160 3624 181 55 0 30046 0
[pid=28479/tid=28486] ppid=28477 vsize=128640 CPUtime=6.28 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 4655 1251 0 0 628 0 0 0 25 0 5 0 594079448 131727360 3624 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=128640 CPUtime=6.25 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 4294 1251 0 0 625 0 0 0 25 0 5 0 594079448 131727360 3624 33554432000 4194304 4417332 140737246398704 18446744073709551615 4356944 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=128640 CPUtime=6.28 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 4462 1251 0 0 628 0 0 0 25 0 5 0 594079448 131727360 3624 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=128640 CPUtime=6.28 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 4642 1251 0 0 628 0 0 0 25 0 5 0 594079448 131727360 3624 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 128640

[startup+12.7007 s]
/proc/loadavg: 7.50 7.90 7.91 9/186 28489
/proc/meminfo: memFree=20486620/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=134992 CPUtime=50.69 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 34940 1251 0 0 5064 5 0 0 25 0 5 0 594079447 138231808 5208 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 33748 5208 181 55 0 31634 0
[pid=28479/tid=28486] ppid=28477 vsize=134992 CPUtime=12.68 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 8537 1251 0 0 1267 1 0 0 25 0 5 0 594079448 138231808 5208 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=134992 CPUtime=12.62 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 8732 1251 0 0 1261 1 0 0 25 0 5 0 594079448 138231808 5208 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=134992 CPUtime=12.68 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 8854 1251 0 0 1267 1 0 0 25 0 5 0 594079448 138231808 5208 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=134992 CPUtime=12.68 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 8251 1251 0 0 1267 1 0 0 25 0 5 0 594079448 138231808 5208 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364504 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 134992

[startup+25.5003 s]
/proc/loadavg: 7.58 7.90 7.91 9/186 28490
/proc/meminfo: memFree=20475724/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=137308 CPUtime=101.82 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 58904 1251 0 0 10173 9 0 0 25 0 5 0 594079447 140603392 5801 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 34327 5801 181 55 0 32213 0
[pid=28479/tid=28486] ppid=28477 vsize=137308 CPUtime=25.48 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 13849 1251 0 0 2546 2 0 0 25 0 5 0 594079448 140603392 5801 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=137308 CPUtime=25.34 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 13981 1251 0 0 2532 2 0 0 25 0 5 0 594079448 140603392 5801 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=137308 CPUtime=25.48 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 14745 1251 0 0 2546 2 0 0 25 0 5 0 594079448 140603392 5801 33554432000 4194304 4417332 140737246398704 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=137308 CPUtime=25.48 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 15763 1251 0 0 2546 2 0 0 25 0 5 0 594079448 140603392 5801 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 137308

[startup+51.1005 s]
/proc/loadavg: 7.72 7.91 7.91 9/186 28490
/proc/meminfo: memFree=20457464/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=154548 CPUtime=204.08 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 105590 1251 0 0 20392 16 0 0 25 0 5 0 594079447 158257152 10103 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 38637 10103 181 55 0 36523 0
[pid=28479/tid=28486] ppid=28477 vsize=154548 CPUtime=51.09 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 25024 1251 0 0 5105 4 0 0 25 0 5 0 594079448 158257152 10103 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=154548 CPUtime=50.8 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 26989 1251 0 0 5077 3 0 0 25 0 5 0 594079448 158257152 10103 33554432000 4194304 4417332 140737246398704 18446744073709551615 4366029 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=154548 CPUtime=51.08 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 25767 1251 0 0 5105 3 0 0 25 0 5 0 594079448 158257152 10103 33554432000 4194304 4417332 140737246398704 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=154548 CPUtime=51.08 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 27244 1251 0 0 5104 4 0 0 25 0 5 0 594079448 158257152 10103 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 204.08
Current children cumulated vsize (KiB) 154548

[startup+102.307 s]
/proc/loadavg: 7.89 7.92 7.91 9/186 28492
/proc/meminfo: memFree=20420468/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=163844 CPUtime=408.63 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 173070 1251 0 0 40835 28 0 0 25 0 5 0 594079447 167776256 12435 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 40961 12435 181 55 0 38847 0
[pid=28479/tid=28486] ppid=28477 vsize=163844 CPUtime=102.29 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 39329 1251 0 0 10223 6 0 0 25 0 5 0 594079448 167776256 12435 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=163844 CPUtime=101.73 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 41646 1251 0 0 10167 6 0 0 25 0 5 0 594079448 167776256 12435 33554432000 4194304 4417332 140737246398704 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=163844 CPUtime=102.28 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 42090 1251 0 0 10222 6 0 0 25 0 5 0 594079448 167776256 12435 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=163844 CPUtime=102.29 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 49439 1251 0 0 10221 8 0 0 25 0 5 0 594079448 167776256 12435 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.63
Current children cumulated vsize (KiB) 163844

[startup+162.301 s]
/proc/loadavg: 7.96 7.93 7.91 9/186 28493
/proc/meminfo: memFree=20373164/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=187892 CPUtime=648.29 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 247658 1251 0 0 64788 41 0 0 25 0 5 0 594079447 192401408 18415 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 46973 18415 181 55 0 44859 0
[pid=28479/tid=28486] ppid=28477 vsize=187892 CPUtime=162.28 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 58378 1251 0 0 16219 9 0 0 25 0 5 0 594079448 192401408 18415 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=187892 CPUtime=161.4 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 57249 1251 0 0 16131 9 0 0 25 0 5 0 594079448 192401408 18415 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=187892 CPUtime=162.29 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 62702 1251 0 0 16219 10 0 0 25 0 5 0 594079448 192401408 18415 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=187892 CPUtime=162.29 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 68763 1251 0 0 16217 12 0 0 25 0 5 0 594079448 192401408 18415 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 648.29
Current children cumulated vsize (KiB) 187892


################
# More data... #
################

[pid=28479/tid=28487] ppid=28477 vsize=392624 CPUtime=758.14 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 147663 1251 0 0 75790 24 0 0 25 0 5 0 594079448 402046976 69618 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=392624 CPUtime=762.31 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 175857 1251 0 0 76203 28 0 0 25 0 5 0 594079448 402046976 69618 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=392624 CPUtime=762.31 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 189758 1251 0 0 76202 29 0 0 25 0 5 0 594079448 402046976 69618 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3045.1
Current children cumulated vsize (KiB) 392624

[startup+822.301 s]
/proc/loadavg: 8.05 8.03 7.94 9/186 28520
/proc/meminfo: memFree=20082340/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=391044 CPUtime=3284.76 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 702722 1251 0 0 328362 114 0 0 25 0 5 0 594079447 400429056 69203 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 97761 69203 181 55 0 95647 0
[pid=28479/tid=28486] ppid=28477 vsize=391044 CPUtime=822.31 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 165845 1251 0 0 82203 28 0 0 25 0 5 0 594079448 400429056 69203 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=391044 CPUtime=817.81 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 160265 1251 0 0 81755 26 0 0 25 0 5 0 594079448 400429056 69203 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=391044 CPUtime=822.31 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 175857 1251 0 0 82203 28 0 0 25 0 5 0 594079448 400429056 69203 33554432000 4194304 4417332 140737246398704 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=391044 CPUtime=822.31 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 200189 1251 0 0 82200 31 0 0 25 0 5 0 594079448 400429056 69203 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3284.76
Current children cumulated vsize (KiB) 391044

[startup+882.301 s]
/proc/loadavg: 8.07 8.04 7.95 9/186 28522
/proc/meminfo: memFree=20077844/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=385008 CPUtime=3524.44 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 712556 1251 0 0 352329 115 0 0 25 0 5 0 594079447 394248192 67726 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 96252 67726 181 55 0 94138 0
[pid=28479/tid=28486] ppid=28477 vsize=385008 CPUtime=882.32 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 165845 1251 0 0 88204 28 0 0 25 0 5 0 594079448 394248192 67726 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=385008 CPUtime=877.47 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 164275 1251 0 0 87721 26 0 0 25 0 5 0 594079448 394248192 67726 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=385008 CPUtime=882.31 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 176158 1251 0 0 88203 28 0 0 25 0 5 0 594079448 394248192 67726 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=385008 CPUtime=882.3 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 205712 1251 0 0 88199 31 0 0 25 0 5 0 594079448 394248192 67726 33554432000 4194304 4417332 140737246398704 18446744073709551615 4366109 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.44
Current children cumulated vsize (KiB) 385008

[startup+942.301 s]
/proc/loadavg: 8.07 8.04 7.95 9/186 28523
/proc/meminfo: memFree=20044676/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=383856 CPUtime=3764.12 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 739122 1251 0 0 376293 119 0 0 25 0 5 0 594079447 393068544 67406 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 95964 67406 181 55 0 93850 0
[pid=28479/tid=28486] ppid=28477 vsize=383856 CPUtime=942.32 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 173113 1251 0 0 94203 29 0 0 25 0 5 0 594079448 393068544 67406 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=383856 CPUtime=937.15 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 169178 1251 0 0 93688 27 0 0 25 0 5 0 594079448 393068544 67406 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=383856 CPUtime=942.31 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 181372 1251 0 0 94202 29 0 0 25 0 5 0 594079448 393068544 67406 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=383856 CPUtime=942.31 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 214893 1251 0 0 94198 33 0 0 25 0 5 0 594079448 393068544 67406 33554432000 4194304 4417332 140737246398704 18446744073709551615 4357776 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3764.12
Current children cumulated vsize (KiB) 383856

[startup+1002.3 s]
/proc/loadavg: 8.12 8.06 7.96 9/186 28525
/proc/meminfo: memFree=20025300/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=366532 CPUtime=4003.79 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 770133 1251 0 0 400255 124 0 0 25 0 5 0 594079447 375328768 63075 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 91633 63075 181 55 0 89519 0
[pid=28479/tid=28486] ppid=28477 vsize=366532 CPUtime=1002.31 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 176025 1251 0 0 100202 29 0 0 25 0 5 0 594079448 375328768 63075 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=366532 CPUtime=996.82 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 179860 1251 0 0 99653 29 0 0 25 0 5 0 594079448 375328768 63075 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=366532 CPUtime=1002.3 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 190503 1251 0 0 100200 30 0 0 25 0 5 0 594079448 375328768 63075 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=366532 CPUtime=1002.31 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 223179 1251 0 0 100197 34 0 0 25 0 5 0 594079448 375328768 63075 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.79
Current children cumulated vsize (KiB) 366532

[startup+1062.3 s]
/proc/loadavg: 8.13 8.08 7.97 9/186 28526
/proc/meminfo: memFree=19971300/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=391456 CPUtime=4243.49 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 782359 1251 0 0 424222 127 0 0 25 0 5 0 594079447 400850944 69306 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 97864 69306 181 55 0 95750 0
[pid=28479/tid=28486] ppid=28477 vsize=391456 CPUtime=1062.32 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 176025 1251 0 0 106203 29 0 0 25 0 5 0 594079448 400850944 69306 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364687 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=391456 CPUtime=1056.5 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 182883 1251 0 0 105620 30 0 0 25 0 5 0 594079448 400850944 69306 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=391456 CPUtime=1062.31 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 190503 1251 0 0 106201 30 0 0 25 0 5 0 594079448 400850944 69306 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=391456 CPUtime=1062.31 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 232382 1251 0 0 106196 35 0 0 25 0 5 0 594079448 400850944 69306 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.49
Current children cumulated vsize (KiB) 391456

[startup+1122.3 s]
/proc/loadavg: 8.05 8.06 7.97 9/186 28528
/proc/meminfo: memFree=19913236/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=437324 CPUtime=4483.15 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 799464 1251 0 0 448187 128 0 0 25 0 5 0 594079447 447819776 80773 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 109331 80773 181 55 0 107217 0
[pid=28479/tid=28486] ppid=28477 vsize=437324 CPUtime=1122.32 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 176025 1251 0 0 112203 29 0 0 25 0 5 0 594079448 447819776 80773 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=437324 CPUtime=1116.17 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 190882 1251 0 0 111587 30 0 0 25 0 5 0 594079448 447819776 80773 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=437324 CPUtime=1122.31 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 190503 1251 0 0 112201 30 0 0 25 0 5 0 594079448 447819776 80773 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=437324 CPUtime=1122.32 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 241488 1251 0 0 112195 37 0 0 25 0 5 0 594079448 447819776 80773 33554432000 4194304 4417332 140737246398704 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4483.15
Current children cumulated vsize (KiB) 437324

[startup+1182.3 s]
/proc/loadavg: 8.06 8.06 7.98 9/186 28530
/proc/meminfo: memFree=19898300/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=464424 CPUtime=4722.84 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 817254 1251 0 0 472153 131 0 0 25 0 5 0 594079447 475570176 87548 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 116106 87548 181 55 0 113992 0
[pid=28479/tid=28486] ppid=28477 vsize=464424 CPUtime=1182.33 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 182113 1251 0 0 118202 31 0 0 25 0 5 0 594079448 475570176 87548 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=464424 CPUtime=1175.84 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 190882 1251 0 0 117554 30 0 0 25 0 5 0 594079448 475570176 87548 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=464424 CPUtime=1182.31 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 196301 1251 0 0 118200 31 0 0 25 0 5 0 594079448 475570176 87548 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=464424 CPUtime=1182.32 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 247392 1251 0 0 118195 37 0 0 25 0 5 0 594079448 475570176 87548 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4722.84
Current children cumulated vsize (KiB) 464424



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 7.72 7.99 7.96 5/180 28531
/proc/meminfo: memFree=20179820/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=459976 CPUtime=4800.35 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 818190 1251 0 0 479904 131 0 0 25 0 5 0 594079447 471015424 86436 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 114994 86436 181 55 0 112880 0
[pid=28479/tid=28486] ppid=28477 vsize=459976 CPUtime=1201.73 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 182113 1251 0 0 120142 31 0 0 25 0 5 0 594079448 471015424 86436 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=459976 CPUtime=1195.13 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 190882 1251 0 0 119483 30 0 0 25 0 5 0 594079448 471015424 86436 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=459976 CPUtime=1201.72 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 196568 1251 0 0 120141 31 0 0 25 0 5 0 594079448 471015424 86436 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=459976 CPUtime=1201.72 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 248061 1251 0 0 120135 37 0 0 25 0 5 0 594079448 471015424 86436 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 459976

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 7.72 7.99 7.96 5/180 28531
/proc/meminfo: memFree=20179820/32950928 swapFree=67111524/67111528
[pid=28479] ppid=28477 vsize=459976 CPUtime=4800.35 cores=1,3,5,7
/proc/28479/stat : 28479 (plingeling) S 28477 28479 28251 0 -1 4202496 818190 1251 0 0 479904 131 0 0 25 0 5 0 594079447 471015424 86436 33554432000 4194304 4417332 140737246398704 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28479/statm: 114994 86436 181 55 0 112880 0
[pid=28479/tid=28486] ppid=28477 vsize=459976 CPUtime=1201.73 cores=1,3,5,7
/proc/28479/task/28486/stat : 28486 (plingeling) R 28477 28479 28251 0 -1 4202560 182113 1251 0 0 120142 31 0 0 25 0 5 0 594079448 471015424 86436 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28479/tid=28487] ppid=28477 vsize=459976 CPUtime=1195.13 cores=1,3,5,7
/proc/28479/task/28487/stat : 28487 (plingeling) R 28477 28479 28251 0 -1 4202560 190882 1251 0 0 119483 30 0 0 25 0 5 0 594079448 471015424 86436 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28479/tid=28488] ppid=28477 vsize=459976 CPUtime=1201.72 cores=1,3,5,7
/proc/28479/task/28488/stat : 28488 (plingeling) R 28477 28479 28251 0 -1 4202560 196568 1251 0 0 120141 31 0 0 25 0 5 0 594079448 471015424 86436 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28479/tid=28489] ppid=28477 vsize=459976 CPUtime=1201.72 cores=1,3,5,7
/proc/28479/task/28489/stat : 28489 (plingeling) R 28477 28479 28251 0 -1 4202560 248061 1251 0 0 120135 37 0 0 25 0 5 0 594079448 471015424 86436 33554432000 4194304 4417332 140737246398704 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 459976

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.73
CPU time (s): 4800.4
CPU user time (s): 4799.06
CPU system time (s): 1.3378
CPU usage (%): 399.458
Max. virtual memory (cumulated for all children) (KiB): 472964

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.06
system time used= 1.3378
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 819441
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 129
involuntary context switches= 36419

runsolver used 1.9687 second user time and 4.5943 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-29 02:54:48
IDJOB=3280927
IDBENCH=20472
IDSOLVER=1605
FILE ID=node114/3280927-1304038488
RUNJOBID= node114-1304037280-28270
PBS_JOBID= 13170369
Free space on /tmp= 71804 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT07/industrial/jarvisalo/eq.atree.braun.11.unsat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3280927-1304038488/watcher-3280927-1304038488 -o /tmp/evaluation-result-3280927-1304038488/solver-3280927-1304038488 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3280927-1304038488.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 90581094793af5fc10d4e4b9a10259ac
RANDOM SEED=1910494094

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20518244 kB
Buffers:       2249004 kB
Cached:        9529384 kB
SwapCached:          4 kB
Active:        3342512 kB
Inactive:      8511268 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20518244 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             356 kB
Writeback:           0 kB
AnonPages:       74120 kB
Mapped:          15452 kB
Slab:           516184 kB
PageTables:       4788 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   259704 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71744 MiB
End job on node114 at 2011-04-29 03:14:51