Trace number 3289115

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.15 1202.04

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top21.cnf
MD5SUM9fab5edd49fb904ff76ff7abf98e0d14
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables51138
Number of clauses162526
Sum of the clauses size397144
Maximum clause length2101
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 299113
Number of clauses of size 362300
Number of clauses of size 4230
Number of clauses of size 519
Number of clauses of size over 5863

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3289115-1304080536/watcher-3289115-1304080536 -o /tmp/evaluation-result-3289115-1304080536/solver-3289115-1304080536 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3289115-1304080536.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.42 7.93 7.98 2/174 19625
/proc/meminfo: memFree=18415100/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=13736 CPUtime=0 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) R 19623 19625 19297 0 -1 4202496 1500 1252 0 0 0 0 0 0 21 0 1 0 598284287 14065664 1430 33554432000 4194304 4417332 140734010894864 18446744073709551615 224284622603 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/19625/statm: 3434 1443 143 55 0 1320 0

[startup+0.054933 s]
/proc/loadavg: 7.42 7.93 7.98 2/174 19625
/proc/meminfo: memFree=18415100/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=25412 CPUtime=0.04 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) R 19623 19625 19297 0 -1 4202496 4495 1252 0 0 4 0 0 0 21 0 1 0 598284287 26021888 4376 33554432000 4194304 4417332 140734010894864 18446744073709551615 4262080 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/19625/statm: 6353 4376 148 55 0 4239 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 25412

[startup+0.100924 s]
/proc/loadavg: 7.42 7.93 7.98 2/174 19625
/proc/meminfo: memFree=18415100/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=29508 CPUtime=0.09 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) R 19623 19625 19297 0 -1 4202496 5519 1252 0 0 9 0 0 0 21 0 1 0 598284287 30216192 5400 33554432000 4194304 4417332 140734010894864 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/19625/statm: 7377 5400 148 55 0 5263 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29508

[startup+0.300858 s]
/proc/loadavg: 7.42 7.93 7.98 2/174 19625
/proc/meminfo: memFree=18415100/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=153780 CPUtime=0.6 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 14521 1252 0 0 59 1 0 0 22 0 5 0 598284287 157470720 10193 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 38445 10193 172 55 0 36331 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 153780

[startup+0.700793 s]
/proc/loadavg: 7.42 7.93 7.98 2/174 19625
/proc/meminfo: memFree=18415100/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=159516 CPUtime=2.19 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 16020 1252 0 0 218 1 0 0 22 0 5 0 598284287 163344384 11692 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 39879 11692 174 55 0 37765 0
Current children cumulated CPU time (s) 2.19
Current children cumulated vsize (KiB) 159516

[startup+1.50066 s]
/proc/loadavg: 7.42 7.93 7.98 9/186 19652
/proc/meminfo: memFree=18315416/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=159516 CPUtime=5.39 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 21053 1252 0 0 537 2 0 0 22 0 5 0 598284287 163344384 12974 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 39879 12974 175 55 0 37765 0
[pid=19625/tid=19645] ppid=19623 vsize=159516 CPUtime=1.3 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 1310 1252 0 0 130 0 0 0 25 0 5 0 598284306 163344384 12974 33554432000 4194304 4417332 140734010894864 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=159516 CPUtime=1.28 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 7328 1252 0 0 128 0 0 0 25 0 5 0 598284306 163344384 12974 33554432000 4194304 4417332 140734010894864 18446744073709551615 4284254 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=159516 CPUtime=1.3 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 1630 1252 0 0 130 0 0 0 25 0 5 0 598284306 163344384 12974 33554432000 4194304 4417332 140734010894864 18446744073709551615 4300633 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=159516 CPUtime=1.3 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 1266 1252 0 0 130 0 0 0 25 0 5 0 598284306 163344384 12974 33554432000 4194304 4417332 140734010894864 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.39
Current children cumulated vsize (KiB) 159516

[startup+3.10039 s]
/proc/loadavg: 7.47 7.93 7.98 9/186 19652
/proc/meminfo: memFree=18306376/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=165680 CPUtime=11.78 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 22658 1252 0 0 1176 2 0 0 22 0 5 0 598284287 169656320 13251 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 41420 13251 180 55 0 39306 0
[pid=19625/tid=19645] ppid=19623 vsize=165680 CPUtime=2.9 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 1839 1252 0 0 290 0 0 0 25 0 5 0 598284306 169656320 13251 33554432000 4194304 4417332 140734010894864 18446744073709551615 4248010 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=165680 CPUtime=2.88 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 8399 1252 0 0 287 1 0 0 25 0 5 0 598284306 169656320 13251 33554432000 4194304 4417332 140734010894864 18446744073709551615 4257349 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=165680 CPUtime=2.9 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 1635 1252 0 0 290 0 0 0 25 0 5 0 598284306 169656320 13251 33554432000 4194304 4417332 140734010894864 18446744073709551615 4377727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=165680 CPUtime=2.9 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 1266 1252 0 0 290 0 0 0 25 0 5 0 598284306 169656320 13251 33554432000 4194304 4417332 140734010894864 18446744073709551615 4366081 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.78
Current children cumulated vsize (KiB) 165680

[startup+6.30086 s]
/proc/loadavg: 7.47 7.93 7.98 9/186 19652
/proc/meminfo: memFree=18270224/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=170896 CPUtime=24.57 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 23962 1252 0 0 2455 2 0 0 22 0 5 0 598284287 174997504 14555 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 42724 14555 180 55 0 40610 0
[pid=19625/tid=19645] ppid=19623 vsize=170896 CPUtime=6.1 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 2432 1252 0 0 610 0 0 0 25 0 5 0 598284306 174997504 14555 33554432000 4194304 4417332 140734010894864 18446744073709551615 4258224 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=170896 CPUtime=6.07 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 8992 1252 0 0 606 1 0 0 25 0 5 0 598284306 174997504 14555 33554432000 4194304 4417332 140734010894864 18446744073709551615 4248198 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=170896 CPUtime=6.1 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 1635 1252 0 0 610 0 0 0 25 0 5 0 598284306 174997504 14555 33554432000 4194304 4417332 140734010894864 18446744073709551615 4250017 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=170896 CPUtime=6.1 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 1384 1252 0 0 610 0 0 0 25 0 5 0 598284306 174997504 14555 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.57
Current children cumulated vsize (KiB) 170896

[startup+12.7008 s]
/proc/loadavg: 7.55 7.93 7.98 9/186 19652
/proc/meminfo: memFree=18252612/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=182848 CPUtime=50.13 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 29655 1252 0 0 5010 3 0 0 22 0 5 0 598284287 187236352 17543 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 45712 17543 180 55 0 43598 0
[pid=19625/tid=19645] ppid=19623 vsize=182848 CPUtime=12.5 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 3456 1252 0 0 1250 0 0 0 25 0 5 0 598284306 187236352 17543 33554432000 4194304 4417332 140734010894864 18446744073709551615 4249570 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=182848 CPUtime=12.43 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 9001 1252 0 0 1242 1 0 0 25 0 5 0 598284306 187236352 17543 33554432000 4194304 4417332 140734010894864 18446744073709551615 4259140 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=182848 CPUtime=12.5 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 2228 1252 0 0 1250 0 0 0 25 0 5 0 598284306 187236352 17543 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=182848 CPUtime=12.49 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 5451 1252 0 0 1249 0 0 0 25 0 5 0 598284306 187236352 17543 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364351 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.13
Current children cumulated vsize (KiB) 182848

[startup+25.5007 s]
/proc/loadavg: 7.69 7.95 7.99 9/186 19652
/proc/meminfo: memFree=18277672/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=171800 CPUtime=101.27 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 32714 1252 0 0 10123 4 0 0 22 0 5 0 598284287 175923200 14404 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 42950 14404 180 55 0 40836 0
[pid=19625/tid=19645] ppid=19623 vsize=171800 CPUtime=25.3 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 3634 1252 0 0 2530 0 0 0 25 0 5 0 598284306 175923200 14404 33554432000 4194304 4417332 140734010894864 18446744073709551615 4236630 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=171800 CPUtime=25.16 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 9305 1252 0 0 2515 1 0 0 25 0 5 0 598284306 175923200 14404 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=171800 CPUtime=25.29 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 2685 1252 0 0 2529 0 0 0 25 0 5 0 598284306 175923200 14404 33554432000 4194304 4417332 140734010894864 18446744073709551615 4249512 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=171800 CPUtime=25.29 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 7571 1252 0 0 2529 0 0 0 25 0 5 0 598284306 175923200 14404 33554432000 4194304 4417332 140734010894864 18446744073709551615 4352485 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.27
Current children cumulated vsize (KiB) 171800

[startup+51.1004 s]
/proc/loadavg: 7.85 7.97 7.99 9/186 19652
/proc/meminfo: memFree=18242136/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=201844 CPUtime=203.53 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 58659 1252 0 0 20345 8 0 0 22 0 5 0 598284287 206688256 21914 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 50461 21914 180 55 0 48347 0
[pid=19625/tid=19645] ppid=19623 vsize=201844 CPUtime=50.9 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 10501 1252 0 0 5089 1 0 0 25 0 5 0 598284306 206688256 21914 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=201844 CPUtime=50.62 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 17534 1252 0 0 5060 2 0 0 25 0 5 0 598284306 206688256 21914 33554432000 4194304 4417332 140734010894864 18446744073709551615 4320142 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=201844 CPUtime=50.9 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 6929 1252 0 0 5089 1 0 0 25 0 5 0 598284306 206688256 21914 33554432000 4194304 4417332 140734010894864 18446744073709551615 4306278 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=201844 CPUtime=50.89 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 14176 1252 0 0 5088 1 0 0 25 0 5 0 598284306 206688256 21914 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.53
Current children cumulated vsize (KiB) 201844

[startup+102.307 s]
/proc/loadavg: 8.00 7.99 8.00 9/186 19654
/proc/meminfo: memFree=18172304/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=222736 CPUtime=408.07 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 142728 1252 0 0 40785 22 0 0 22 0 5 0 598284287 228081664 27170 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 55684 27170 180 55 0 53570 0
[pid=19625/tid=19645] ppid=19623 vsize=222736 CPUtime=102.11 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 30938 1252 0 0 10206 5 0 0 25 0 5 0 598284306 228081664 27170 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=222736 CPUtime=101.54 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 43484 1252 0 0 10148 6 0 0 25 0 5 0 598284306 228081664 27170 33554432000 4194304 4417332 140734010894864 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=222736 CPUtime=102.1 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 27279 1252 0 0 10205 5 0 0 25 0 5 0 598284306 228081664 27170 33554432000 4194304 4417332 140734010894864 18446744073709551615 4252365 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=222736 CPUtime=102.1 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 31508 1252 0 0 10206 4 0 0 25 0 5 0 598284306 228081664 27170 33554432000 4194304 4417332 140734010894864 18446744073709551615 4237349 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.07
Current children cumulated vsize (KiB) 222736

[startup+162.301 s]
/proc/loadavg: 8.05 8.00 8.00 9/186 19656
/proc/meminfo: memFree=18141772/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=230600 CPUtime=647.72 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 228164 1252 0 0 64736 36 0 0 22 0 5 0 598284287 236134400 29136 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 57650 29136 180 55 0 55536 0
[pid=19625/tid=19645] ppid=19623 vsize=230600 CPUtime=162.09 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 54279 1252 0 0 16202 7 0 0 25 0 5 0 598284306 236134400 29136 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=230600 CPUtime=161.2 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 67426 1252 0 0 16110 10 0 0 25 0 5 0 598284306 236134400 29136 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=230600 CPUtime=162.09 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 50024 1252 0 0 16201 8 0 0 25 0 5 0 598284306 236134400 29136 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364818 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=230600 CPUtime=162.1 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 46916 1252 0 0 16203 7 0 0 25 0 5 0 598284306 236134400 29136 33554432000 4194304 4417332 140734010894864 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 647.72
Current children cumulated vsize (KiB) 230600


################
# More data... #
################

[pid=19625/tid=19646] ppid=19623 vsize=515964 CPUtime=698.25 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 203414 1252 0 0 69791 34 0 0 25 0 5 0 598284306 528347136 100445 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=515964 CPUtime=701.29 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 207376 1252 0 0 70095 34 0 0 25 0 5 0 598284306 528347136 100445 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=515964 CPUtime=702.1 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 149200 1252 0 0 70188 22 0 0 25 0 5 0 598284306 528347136 100445 33554432000 4194304 4417332 140734010894864 18446744073709551615 4365975 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2803.98
Current children cumulated vsize (KiB) 515964

[startup+762.307 s]
/proc/loadavg: 8.11 8.09 8.04 9/186 19675
/proc/meminfo: memFree=17597416/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=527888 CPUtime=3043.68 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 835297 1252 0 0 304231 137 0 0 22 0 5 0 598284287 540557312 103426 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 131972 103426 180 55 0 129858 0
[pid=19625/tid=19645] ppid=19623 vsize=527888 CPUtime=762.11 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 229057 1252 0 0 76175 36 0 0 25 0 5 0 598284306 540557312 103426 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=527888 CPUtime=757.93 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 219977 1252 0 0 75755 38 0 0 25 0 5 0 598284306 540557312 103426 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=527888 CPUtime=761.31 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 218383 1252 0 0 76095 36 0 0 25 0 5 0 598284306 540557312 103426 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=527888 CPUtime=762.12 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 158361 1252 0 0 76188 24 0 0 25 0 5 0 598284306 540557312 103426 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3043.68
Current children cumulated vsize (KiB) 527888

[startup+822.301 s]
/proc/loadavg: 8.10 8.09 8.04 9/186 19675
/proc/meminfo: memFree=17547912/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=522872 CPUtime=3283.34 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 863224 1252 0 0 328193 141 0 0 22 0 5 0 598284287 535420928 102172 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 130718 102172 180 55 0 128604 0
[pid=19625/tid=19645] ppid=19623 vsize=522872 CPUtime=822.11 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 236785 1252 0 0 82173 38 0 0 25 0 5 0 598284306 535420928 102172 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=522872 CPUtime=817.6 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 221992 1252 0 0 81722 38 0 0 25 0 5 0 598284306 535420928 102172 33554432000 4194304 4417332 140734010894864 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=522872 CPUtime=821.3 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 229087 1252 0 0 82093 37 0 0 25 0 5 0 598284306 535420928 102172 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=522872 CPUtime=822.11 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 165841 1252 0 0 82186 25 0 0 25 0 5 0 598284306 535420928 102172 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3283.34
Current children cumulated vsize (KiB) 522872

[startup+882.301 s]
/proc/loadavg: 8.09 8.09 8.04 9/186 19677
/proc/meminfo: memFree=17438876/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=656916 CPUtime=3523.01 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 922050 1252 0 0 352150 151 0 0 22 0 5 0 598284287 672681984 135683 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 164229 135683 180 55 0 162115 0
[pid=19625/tid=19645] ppid=19623 vsize=656916 CPUtime=882.11 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 247332 1252 0 0 88171 40 0 0 25 0 5 0 598284306 672681984 135683 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=656916 CPUtime=877.26 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 237729 1252 0 0 87685 41 0 0 25 0 5 0 598284306 672681984 135683 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=656916 CPUtime=881.3 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 251618 1252 0 0 88089 41 0 0 25 0 5 0 598284306 672681984 135683 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=656916 CPUtime=882.11 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 175852 1252 0 0 88185 26 0 0 25 0 5 0 598284306 672681984 135683 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3523.01
Current children cumulated vsize (KiB) 656916

[startup+942.3 s]
/proc/loadavg: 8.08 8.08 8.04 9/186 19679
/proc/meminfo: memFree=17380444/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=658104 CPUtime=3762.68 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 949584 1252 0 0 376112 156 0 0 22 0 5 0 598284287 673898496 135980 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 164526 135980 180 55 0 162412 0
[pid=19625/tid=19645] ppid=19623 vsize=658104 CPUtime=942.1 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 248976 1252 0 0 94170 40 0 0 25 0 5 0 598284306 673898496 135980 33554432000 4194304 4417332 140734010894864 18446744073709551615 4313036 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=658104 CPUtime=936.94 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 237729 1252 0 0 93653 41 0 0 25 0 5 0 598284306 673898496 135980 33554432000 4194304 4417332 140734010894864 18446744073709551615 4366011 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=658104 CPUtime=941.3 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 267756 1252 0 0 94086 44 0 0 25 0 5 0 598284306 673898496 135980 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=658104 CPUtime=942.11 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 185604 1252 0 0 94183 28 0 0 25 0 5 0 598284306 673898496 135980 33554432000 4194304 4417332 140734010894864 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3762.68
Current children cumulated vsize (KiB) 658104

[startup+1002.3 s]
/proc/loadavg: 8.13 8.10 8.04 9/186 19681
/proc/meminfo: memFree=17259260/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=716376 CPUtime=4002.35 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 1003503 1252 0 0 400071 164 0 0 22 0 5 0 598284287 733569024 150548 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 179094 150548 180 55 0 176980 0
[pid=19625/tid=19645] ppid=19623 vsize=716376 CPUtime=1002.11 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 268927 1252 0 0 100168 43 0 0 25 0 5 0 598284306 733569024 150548 33554432000 4194304 4417332 140734010894864 18446744073709551615 4232632 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=716376 CPUtime=996.61 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 252167 1252 0 0 99617 44 0 0 25 0 5 0 598284306 733569024 150548 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=716376 CPUtime=1001.3 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 275948 1252 0 0 100085 45 0 0 25 0 5 0 598284306 733569024 150548 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=716376 CPUtime=1002.11 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 196942 1252 0 0 100182 29 0 0 25 0 5 0 598284306 733569024 150548 33554432000 4194304 4417332 140734010894864 18446744073709551615 18446744073699065863 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4002.35
Current children cumulated vsize (KiB) 716376

[startup+1062.3 s]
/proc/loadavg: 8.13 8.11 8.05 9/186 19683
/proc/meminfo: memFree=17219428/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=773748 CPUtime=4242.03 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 1042993 1252 0 0 424034 169 0 0 22 0 5 0 598284287 792317952 164891 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 193437 164891 180 55 0 191323 0
[pid=19625/tid=19645] ppid=19623 vsize=773748 CPUtime=1062.11 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 290573 1252 0 0 106165 46 0 0 25 0 5 0 598284306 792317952 164891 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=773748 CPUtime=1056.29 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 260359 1252 0 0 105584 45 0 0 25 0 5 0 598284306 792317952 164891 33554432000 4194304 4417332 140734010894864 18446744073709551615 18446744073699065863 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=773748 CPUtime=1061.3 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 275948 1252 0 0 106085 45 0 0 25 0 5 0 598284306 792317952 164891 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=773748 CPUtime=1062.11 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 206594 1252 0 0 106180 31 0 0 25 0 5 0 598284306 792317952 164891 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4242.03
Current children cumulated vsize (KiB) 773748

[startup+1122.3 s]
/proc/loadavg: 8.09 8.10 8.05 9/186 19683
/proc/meminfo: memFree=17298008/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=712184 CPUtime=4481.7 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 1087291 1252 0 0 447994 176 0 0 22 0 5 0 598284287 729276416 149500 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 178046 149500 180 55 0 175932 0
[pid=19625/tid=19645] ppid=19623 vsize=712184 CPUtime=1122.11 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 290573 1252 0 0 112165 46 0 0 25 0 5 0 598284306 729276416 149500 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=712184 CPUtime=1115.96 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 284627 1252 0 0 111547 49 0 0 25 0 5 0 598284306 729276416 149500 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=712184 CPUtime=1121.31 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 286477 1252 0 0 112084 47 0 0 25 0 5 0 598284306 729276416 149500 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=712184 CPUtime=1122.11 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 216095 1252 0 0 112179 32 0 0 25 0 5 0 598284306 729276416 149500 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4481.7
Current children cumulated vsize (KiB) 712184

[startup+1182.3 s]
/proc/loadavg: 8.07 8.09 8.05 9/186 19685
/proc/meminfo: memFree=17149048/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=788436 CPUtime=4721.38 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 1113831 1252 0 0 471956 182 0 0 22 0 5 0 598284287 807358464 168563 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 197109 168563 180 55 0 194995 0
[pid=19625/tid=19645] ppid=19623 vsize=788436 CPUtime=1182.11 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 290573 1252 0 0 118165 46 0 0 25 0 5 0 598284306 807358464 168563 33554432000 4194304 4417332 140734010894864 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=788436 CPUtime=1175.63 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 284627 1252 0 0 117514 49 0 0 25 0 5 0 598284306 807358464 168563 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=788436 CPUtime=1181.3 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 302861 1252 0 0 118080 50 0 0 25 0 5 0 598284306 807358464 168563 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=788436 CPUtime=1182.12 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 226251 1252 0 0 118178 34 0 0 25 0 5 0 598284306 807358464 168563 33554432000 4194304 4417332 140734010894864 18446744073709551615 4281860 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4721.38
Current children cumulated vsize (KiB) 788436



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202 s]
/proc/loadavg: 8.12 8.10 8.05 5/181 19688
/proc/meminfo: memFree=17680792/32951124 swapFree=67110396/67111528
[pid=19625] ppid=19623 vsize=847536 CPUtime=4800.09 cores=1,3,5,7
/proc/19625/stat : 19625 (plingeling) S 19623 19625 19297 0 -1 4202496 1136214 1252 0 0 479823 186 0 0 22 0 5 0 598284287 867876864 183338 33554432000 4194304 4417332 140734010894864 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/19625/statm: 211884 183338 180 55 0 209770 0
[pid=19625/tid=19645] ppid=19623 vsize=847536 CPUtime=1201.82 cores=1,3,5,7
/proc/19625/task/19645/stat : 19645 (plingeling) R 19623 19625 19297 0 -1 4202560 290573 1252 0 0 120136 46 0 0 25 0 5 0 598284306 867876864 183338 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=19625/tid=19646] ppid=19623 vsize=847536 CPUtime=1195.22 cores=1,3,5,7
/proc/19625/task/19646/stat : 19646 (plingeling) R 19623 19625 19297 0 -1 4202560 301011 1252 0 0 119470 52 0 0 25 0 5 0 598284306 867876864 183338 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19625/tid=19647] ppid=19623 vsize=847536 CPUtime=1201.01 cores=1,3,5,7
/proc/19625/task/19647/stat : 19647 (plingeling) R 19623 19625 19297 0 -1 4202560 304436 1252 0 0 120050 51 0 0 25 0 5 0 598284306 867876864 183338 33554432000 4194304 4417332 140734010894864 18446744073709551615 4320831 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=19625/tid=19648] ppid=19623 vsize=847536 CPUtime=1201.81 cores=1,3,5,7
/proc/19625/task/19648/stat : 19648 (plingeling) R 19623 19625 19297 0 -1 4202560 230675 1252 0 0 120147 34 0 0 25 0 5 0 598284306 867876864 183338 33554432000 4194304 4417332 140734010894864 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 847536

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.04
CPU time (s): 4800.15
CPU user time (s): 4798.25
CPU system time (s): 1.89871
CPU usage (%): 399.333
Max. virtual memory (cumulated for all children) (KiB): 870312

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.25
system time used= 1.89871
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1137466
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 91
involuntary context switches= 36594

runsolver used 1.88371 second user time and 4.68029 second system time

The end

Launcher Data 

Begin job on node118 at 2011-04-29 14:35:36
IDJOB=3289115
IDBENCH=83115
IDSOLVER=1605
FILE ID=node118/3289115-1304080536
RUNJOBID= node118-1304080536-19612
PBS_JOBID= 13170505
Free space on /tmp= 71612 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top21.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3289115-1304080536/watcher-3289115-1304080536 -o /tmp/evaluation-result-3289115-1304080536/solver-3289115-1304080536 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3289115-1304080536.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9fab5edd49fb904ff76ff7abf98e0d14
RANDOM SEED=1771892462

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18415372 kB
Buffers:       1901676 kB
Cached:       12030424 kB
SwapCached:        600 kB
Active:        9485724 kB
Inactive:      4514660 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18415372 kB
SwapTotal:    67111528 kB
SwapFree:     67110396 kB
Dirty:            5524 kB
Writeback:           0 kB
AnonPages:       67240 kB
Mapped:          14576 kB
Slab:           472376 kB
PageTables:       4892 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   192220 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71612 MiB
End job on node118 at 2011-04-29 14:55:40