Trace number 3372671

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.5 5007.06

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom25.cnf
MD5SUMc40bd543dad558d19995fef4fd742233
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables67777
Number of clauses227761
Sum of the clauses size582177
Maximum clause length2084
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2115213
Number of clauses of size 3111398
Number of clauses of size 4324
Number of clauses of size 523
Number of clauses of size over 5802

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372671-1305439867/watcher-3372671-1305439867 -o /tmp/evaluation-result-3372671-1305439867/solver-3372671-1305439867 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372671-1305439867.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.04 8.07 8.00 2/317 1539
/proc/meminfo: memFree=25221712/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=11584 CPUtime=0 cores=0-7
/proc/1539/stat : 1539 (plingeling) R 1537 1539 1328 0 -1 4202496 597 1253 0 0 0 0 0 0 25 0 1 0 655587179 11862016 527 33554432000 4194304 4417452 140737135307792 18446744073709551615 244446639197 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/1539/statm: 2896 540 140 55 0 782 0

[startup+0.026983 s]
/proc/loadavg: 8.04 8.07 8.00 2/317 1539
/proc/meminfo: memFree=25221712/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=31628 CPUtime=0.01 cores=0-7
/proc/1539/stat : 1539 (plingeling) R 1537 1539 1328 0 -1 4202496 6001 1253 0 0 1 0 0 0 25 0 1 0 655587179 32387072 5931 33554432000 4194304 4417452 140737135307792 18446744073709551615 4264900 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/1539/statm: 7907 5931 149 55 0 5793 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 31628

[startup+0.100957 s]
/proc/loadavg: 8.04 8.07 8.00 2/317 1539
/proc/meminfo: memFree=25221712/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=47032 CPUtime=0.09 cores=0-7
/proc/1539/stat : 1539 (plingeling) R 1537 1539 1328 0 -1 4202496 9767 1253 0 0 8 1 0 0 25 0 1 0 655587179 48160768 9666 33554432000 4194304 4417452 140737135307792 18446744073709551615 244446639085 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/1539/statm: 11758 9698 149 55 0 9644 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 47032

[startup+0.300922 s]
/proc/loadavg: 8.04 8.07 8.00 2/317 1539
/proc/meminfo: memFree=25221712/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=89700 CPUtime=0.29 cores=0-7
/proc/1539/stat : 1539 (plingeling) R 1537 1539 1328 0 -1 4202496 20551 1253 0 0 27 2 0 0 25 0 1 0 655587179 91852800 20449 33554432000 4194304 4417452 140737135307792 18446744073709551615 4231387 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/1539/statm: 22425 20449 149 55 0 20311 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 89700

[startup+1.41868 s]
/proc/loadavg: 8.04 8.07 8.00 2/317 1539
/proc/meminfo: memFree=25221712/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=267624 CPUtime=7.33 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 68926 1253 0 0 724 9 0 0 18 0 9 0 655587179 274046976 37496 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 66906 37496 175 55 0 64792 0
Current children cumulated CPU time (s) 7.33
Current children cumulated vsize (KiB) 267624

[startup+1.50067 s]
/proc/loadavg: 8.04 8.07 8.00 2/317 1539
/proc/meminfo: memFree=25221712/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=267624 CPUtime=7.99 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 68926 1253 0 0 790 9 0 0 18 0 9 0 655587179 274046976 36632 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 66906 36632 175 55 0 64792 0
Current children cumulated CPU time (s) 7.99
Current children cumulated vsize (KiB) 267624

[startup+3.10036 s]
/proc/loadavg: 8.04 8.07 8.00 9/326 1553
/proc/meminfo: memFree=25066536/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=297948 CPUtime=20.76 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 92540 1253 0 0 2064 12 0 0 18 0 9 0 655587179 305098752 36840 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 74487 36840 177 55 0 72373 0
[pid=1539/tid=1546] ppid=1537 vsize=297948 CPUtime=2.52 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 5854 1253 0 0 252 0 0 0 22 0 9 0 655587236 305098752 36840 33554432000 4194304 4417452 140737135307792 18446744073709551615 4346306 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=297948 CPUtime=2.52 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 6155 1253 0 0 252 0 0 0 25 0 9 0 655587236 305098752 36840 33554432000 4194304 4417452 140737135307792 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=297948 CPUtime=2.51 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 9124 1253 0 0 250 1 0 0 25 0 9 0 655587236 305098752 36840 33554432000 4194304 4417452 140737135307792 18446744073709551615 4346249 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=297948 CPUtime=2.53 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 1167 1253 0 0 253 0 0 0 25 0 9 0 655587236 305098752 36840 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=297948 CPUtime=2.52 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 8260 1253 0 0 251 1 0 0 25 0 9 0 655587236 305098752 36840 33554432000 4194304 4417452 140737135307792 18446744073709551615 4346458 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=297948 CPUtime=2.51 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 9258 1253 0 0 250 1 0 0 25 0 9 0 655587236 305098752 36840 33554432000 4194304 4417452 140737135307792 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=297948 CPUtime=2.52 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 7021 1253 0 0 252 0 0 0 22 0 9 0 655587236 305098752 36840 33554432000 4194304 4417452 140737135307792 18446744073709551615 4346501 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=297948 CPUtime=2.5 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 9642 1253 0 0 249 1 0 0 22 0 9 0 655587236 305098752 36840 33554432000 4194304 4417452 140737135307792 18446744073709551615 4346555 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 20.76
Current children cumulated vsize (KiB) 297948

[startup+6.31176 s]
/proc/loadavg: 8.04 8.07 8.00 9/326 1553
/proc/meminfo: memFree=25044596/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=323200 CPUtime=46.42 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 100489 1253 0 0 4629 13 0 0 18 0 9 0 655587179 330956800 43895 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 80800 43895 180 55 0 78686 0
[pid=1539/tid=1546] ppid=1537 vsize=323200 CPUtime=5.73 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 7396 1253 0 0 573 0 0 0 25 0 9 0 655587236 330956800 43895 33554432000 4194304 4417452 140737135307792 18446744073709551615 4236255 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=323200 CPUtime=5.73 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 6899 1253 0 0 573 0 0 0 25 0 9 0 655587236 330956800 43895 33554432000 4194304 4417452 140737135307792 18446744073709551615 4250244 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=323200 CPUtime=5.72 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 9126 1253 0 0 571 1 0 0 25 0 9 0 655587236 330956800 43895 33554432000 4194304 4417452 140737135307792 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=323200 CPUtime=5.74 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 1927 1253 0 0 574 0 0 0 25 0 9 0 655587236 330956800 43895 33554432000 4194304 4417452 140737135307792 18446744073709551615 4365936 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=323200 CPUtime=5.73 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 9754 1253 0 0 572 1 0 0 25 0 9 0 655587236 330956800 43895 33554432000 4194304 4417452 140737135307792 18446744073709551615 4249193 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=323200 CPUtime=5.72 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 10355 1253 0 0 571 1 0 0 25 0 9 0 655587236 330956800 43895 33554432000 4194304 4417452 140737135307792 18446744073709551615 4251950 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=323200 CPUtime=5.73 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 7533 1253 0 0 573 0 0 0 25 0 9 0 655587236 330956800 43895 33554432000 4194304 4417452 140737135307792 18446744073709551615 4232612 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=323200 CPUtime=5.68 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 11440 1253 0 0 567 1 0 0 25 0 9 0 655587236 330956800 43895 33554432000 4194304 4417452 140737135307792 18446744073709551615 4250003 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 46.42
Current children cumulated vsize (KiB) 323200

[startup+12.7006 s]
/proc/loadavg: 8.03 8.07 8.00 9/326 1553
/proc/meminfo: memFree=25048732/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=322428 CPUtime=97.47 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 100639 1253 0 0 9734 13 0 0 18 0 9 0 655587179 330166272 42543 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 80607 42543 180 55 0 78493 0
[pid=1539/tid=1546] ppid=1537 vsize=322428 CPUtime=12.12 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 7415 1253 0 0 1212 0 0 0 25 0 9 0 655587236 330166272 42543 33554432000 4194304 4417452 140737135307792 18446744073709551615 4262481 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=322428 CPUtime=12.12 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 6917 1253 0 0 1212 0 0 0 25 0 9 0 655587236 330166272 42543 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=322428 CPUtime=12.11 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 9155 1253 0 0 1210 1 0 0 25 0 9 0 655587236 330166272 42543 33554432000 4194304 4417452 140737135307792 18446744073709551615 4237202 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=322428 CPUtime=12.13 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 1927 1253 0 0 1213 0 0 0 25 0 9 0 655587236 330166272 42543 33554432000 4194304 4417452 140737135307792 18446744073709551615 4236878 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=322428 CPUtime=12.12 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 9773 1253 0 0 1211 1 0 0 25 0 9 0 655587236 330166272 42543 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=322428 CPUtime=12.11 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 10373 1253 0 0 1210 1 0 0 25 0 9 0 655587236 330166272 42543 33554432000 4194304 4417452 140737135307792 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=322428 CPUtime=12.12 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 7561 1253 0 0 1212 0 0 0 25 0 9 0 655587236 330166272 42543 33554432000 4194304 4417452 140737135307792 18446744073709551615 4357013 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=322428 CPUtime=12.01 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 11459 1253 0 0 1200 1 0 0 25 0 9 0 655587236 330166272 42543 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 97.47
Current children cumulated vsize (KiB) 322428

[startup+25.5012 s]
/proc/loadavg: 8.02 8.06 8.00 9/326 1554
/proc/meminfo: memFree=25021432/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=354952 CPUtime=199.75 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 109022 1253 0 0 19961 14 0 0 18 0 9 0 655587179 363470848 50686 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 88738 50686 180 55 0 86624 0
[pid=1539/tid=1546] ppid=1537 vsize=354952 CPUtime=24.92 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 8673 1253 0 0 2492 0 0 0 25 0 9 0 655587236 363470848 50686 33554432000 4194304 4417452 140737135307792 18446744073709551615 4269830 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=354952 CPUtime=24.93 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 7183 1253 0 0 2492 1 0 0 25 0 9 0 655587236 363470848 50686 33554432000 4194304 4417452 140737135307792 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=354952 CPUtime=24.9 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 11473 1253 0 0 2489 1 0 0 25 0 9 0 655587236 363470848 50686 33554432000 4194304 4417452 140737135307792 18446744073709551615 4232726 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=354952 CPUtime=24.93 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 3321 1253 0 0 2493 0 0 0 25 0 9 0 655587236 363470848 50686 33554432000 4194304 4417452 140737135307792 18446744073709551615 4357856 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=354952 CPUtime=24.92 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 11117 1253 0 0 2491 1 0 0 25 0 9 0 655587236 363470848 50686 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=354952 CPUtime=24.91 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 10620 1253 0 0 2490 1 0 0 25 0 9 0 655587236 363470848 50686 33554432000 4194304 4417452 140737135307792 18446744073709551615 4275646 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=354952 CPUtime=24.92 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 8212 1253 0 0 2492 0 0 0 25 0 9 0 655587236 363470848 50686 33554432000 4194304 4417452 140737135307792 18446744073709551615 4278246 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=354952 CPUtime=24.68 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 12364 1253 0 0 2467 1 0 0 25 0 9 0 655587236 363470848 50686 33554432000 4194304 4417452 140737135307792 18446744073709551615 4277552 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 199.75
Current children cumulated vsize (KiB) 354952

[startup+51.1004 s]
/proc/loadavg: 8.07 8.07 8.00 9/326 1554
/proc/meminfo: memFree=24968460/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=422572 CPUtime=404.28 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 130790 1253 0 0 40411 17 0 0 18 0 9 0 655587179 432713728 67591 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 105643 67591 180 55 0 103529 0
[pid=1539/tid=1546] ppid=1537 vsize=422572 CPUtime=50.52 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 10044 1253 0 0 5052 0 0 0 25 0 9 0 655587236 432713728 67591 33554432000 4194304 4417452 140737135307792 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=422572 CPUtime=50.53 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 8907 1253 0 0 5052 1 0 0 25 0 9 0 655587236 432713728 67591 33554432000 4194304 4417452 140737135307792 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=422572 CPUtime=50.5 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 12424 1253 0 0 5049 1 0 0 25 0 9 0 655587236 432713728 67591 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=422572 CPUtime=50.51 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 11536 1253 0 0 5050 1 0 0 25 0 9 0 655587236 432713728 67591 33554432000 4194304 4417452 140737135307792 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=422572 CPUtime=50.51 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 13694 1253 0 0 5050 1 0 0 25 0 9 0 655587236 432713728 67591 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=422572 CPUtime=50.51 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 15248 1253 0 0 5050 1 0 0 25 0 9 0 655587236 432713728 67591 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=422572 CPUtime=50.52 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 9435 1253 0 0 5052 0 0 0 25 0 9 0 655587236 432713728 67591 33554432000 4194304 4417452 140737135307792 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=422572 CPUtime=50.02 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 13443 1253 0 0 5001 1 0 0 25 0 9 0 655587236 432713728 67591 33554432000 4194304 4417452 140737135307792 18446744073709551615 4365111 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 404.28
Current children cumulated vsize (KiB) 422572

[startup+102.301 s]
/proc/loadavg: 8.09 8.07 8.00 9/326 1556

################
# More data... #
################


[startup+4722.3 s]
/proc/loadavg: 8.05 8.05 8.00 9/326 1700
/proc/meminfo: memFree=22142980/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=3225548 CPUtime=37726.3 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 3169342 1253 0 0 3772096 533 0 0 18 0 9 0 655587179 3302961152 768304 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 806387 768304 180 55 0 804273 0
[pid=1539/tid=1546] ppid=1537 vsize=3225548 CPUtime=4721.72 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 329209 1253 0 0 472118 54 0 0 25 0 9 0 655587236 3302961152 768304 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=3225548 CPUtime=4721.85 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 481295 1253 0 0 472093 92 0 0 25 0 9 0 655587236 3302961152 768304 33554432000 4194304 4417452 140737135307792 18446744073709551615 4357320 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=3225548 CPUtime=4676.23 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 273996 1253 0 0 467575 48 0 0 25 0 9 0 655587236 3302961152 768304 33554432000 4194304 4417452 140737135307792 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=3225548 CPUtime=4720.46 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 685121 1253 0 0 471934 112 0 0 25 0 9 0 655587236 3302961152 768304 33554432000 4194304 4417452 140737135307792 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=3225548 CPUtime=4721.68 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 371432 1253 0 0 472102 66 0 0 25 0 9 0 655587236 3302961152 768304 33554432000 4194304 4417452 140737135307792 18446744073709551615 4353572 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=3225548 CPUtime=4721.83 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 282795 1253 0 0 472140 43 0 0 25 0 9 0 655587236 3302961152 768304 33554432000 4194304 4417452 140737135307792 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=3225548 CPUtime=4721.85 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 358590 1253 0 0 472126 59 0 0 25 0 9 0 655587236 3302961152 768304 33554432000 4194304 4417452 140737135307792 18446744073709551615 4306336 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=3225548 CPUtime=4720.04 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 350845 1253 0 0 471953 51 0 0 25 0 9 0 655587236 3302961152 768304 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37726.3
Current children cumulated vsize (KiB) 3225548

[startup+4782.3 s]
/proc/loadavg: 8.02 8.04 8.00 9/326 1701
/proc/meminfo: memFree=21710200/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=3658280 CPUtime=38205.7 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 3327988 1253 0 0 3819998 570 0 0 18 0 9 0 655587179 3746078720 876487 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 914570 876487 180 55 0 912456 0
[pid=1539/tid=1546] ppid=1537 vsize=3658280 CPUtime=4781.73 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 338554 1253 0 0 478117 56 0 0 25 0 9 0 655587236 3746078720 876487 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=3658280 CPUtime=4781.85 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 501683 1253 0 0 478090 95 0 0 25 0 9 0 655587236 3746078720 876487 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=3658280 CPUtime=4735.63 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 292657 1253 0 0 473510 53 0 0 25 0 9 0 655587236 3746078720 876487 33554432000 4194304 4417452 140737135307792 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=3658280 CPUtime=4780.45 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 718043 1253 0 0 477925 120 0 0 25 0 9 0 655587236 3746078720 876487 33554432000 4194304 4417452 140737135307792 18446744073709551615 4236845 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=3658280 CPUtime=4781.69 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 387272 1253 0 0 478098 71 0 0 25 0 9 0 655587236 3746078720 876487 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=3658280 CPUtime=4781.82 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 282795 1253 0 0 478139 43 0 0 25 0 9 0 655587236 3746078720 876487 33554432000 4194304 4417452 140737135307792 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=3658280 CPUtime=4781.85 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 409824 1253 0 0 478113 72 0 0 25 0 9 0 655587236 3746078720 876487 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=3658280 CPUtime=4780.04 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 361101 1253 0 0 477952 52 0 0 25 0 9 0 655587236 3746078720 876487 33554432000 4194304 4417452 140737135307792 18446744073709551615 4365106 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38205.7
Current children cumulated vsize (KiB) 3658280

[startup+4842.3 s]
/proc/loadavg: 8.04 8.04 8.00 9/326 1704
/proc/meminfo: memFree=21949752/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=3418680 CPUtime=38685.1 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 3418235 1253 0 0 3867914 594 0 0 18 0 9 0 655587179 3500728320 816587 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 854670 816587 180 55 0 852556 0
[pid=1539/tid=1546] ppid=1537 vsize=3418680 CPUtime=4841.73 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 338554 1253 0 0 484117 56 0 0 25 0 9 0 655587236 3500728320 816587 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=3418680 CPUtime=4841.86 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 534465 1253 0 0 484080 106 0 0 25 0 9 0 655587236 3500728320 816587 33554432000 4194304 4417452 140737135307792 18446744073709551615 4358008 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=3418680 CPUtime=4795.03 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 299249 1253 0 0 479448 55 0 0 25 0 9 0 655587236 3500728320 816587 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=3418680 CPUtime=4840.44 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 728500 1253 0 0 483922 122 0 0 25 0 9 0 655587236 3500728320 816587 33554432000 4194304 4417452 140737135307792 18446744073709551615 4236906 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=3418680 CPUtime=4841.68 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 398920 1253 0 0 484094 74 0 0 25 0 9 0 655587236 3500728320 816587 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=3418680 CPUtime=4841.83 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 290987 1253 0 0 484139 44 0 0 25 0 9 0 655587236 3500728320 816587 33554432000 4194304 4417452 140737135307792 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=3418680 CPUtime=4841.85 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 420304 1253 0 0 484111 74 0 0 25 0 9 0 655587236 3500728320 816587 33554432000 4194304 4417452 140737135307792 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=3418680 CPUtime=4840.05 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 371197 1253 0 0 483950 55 0 0 25 0 9 0 655587236 3500728320 816587 33554432000 4194304 4417452 140737135307792 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38685.1
Current children cumulated vsize (KiB) 3418680

[startup+4902.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/326 1706
/proc/meminfo: memFree=21803648/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=3558928 CPUtime=39164.5 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 3477889 1253 0 0 3915846 604 0 0 18 0 9 0 655587179 3644342272 851649 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 889732 851649 180 55 0 887618 0
[pid=1539/tid=1546] ppid=1537 vsize=3558928 CPUtime=4901.74 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 338554 1253 0 0 490118 56 0 0 25 0 9 0 655587236 3644342272 851649 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=3558928 CPUtime=4901.87 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 550849 1253 0 0 490076 111 0 0 25 0 9 0 655587236 3644342272 851649 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=3558928 CPUtime=4854.42 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 299249 1253 0 0 485387 55 0 0 25 0 9 0 655587236 3644342272 851649 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=3558928 CPUtime=4900.45 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 750745 1253 0 0 489920 125 0 0 25 0 9 0 655587236 3644342272 851649 33554432000 4194304 4417452 140737135307792 18446744073709551615 4366528 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=3558928 CPUtime=4901.7 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 398920 1253 0 0 490096 74 0 0 25 0 9 0 655587236 3644342272 851649 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=3558928 CPUtime=4901.84 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 291003 1253 0 0 490140 44 0 0 25 0 9 0 655587236 3644342272 851649 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=3558928 CPUtime=4901.86 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 441313 1253 0 0 490109 77 0 0 25 0 9 0 655587236 3644342272 851649 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=3558928 CPUtime=4900.06 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 371197 1253 0 0 489951 55 0 0 25 0 9 0 655587236 3644342272 851649 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39164.5
Current children cumulated vsize (KiB) 3558928

[startup+4962.3 s]
/proc/loadavg: 8.05 8.05 8.00 9/326 1707
/proc/meminfo: memFree=21595940/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=3777812 CPUtime=39643.9 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 3651896 1253 0 0 3963735 652 0 0 18 0 9 0 655587179 3868479488 906370 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 944453 906370 180 55 0 942339 0
[pid=1539/tid=1546] ppid=1537 vsize=3777812 CPUtime=4961.72 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 346762 1253 0 0 496115 57 0 0 25 0 9 0 655587236 3868479488 906370 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=3777812 CPUtime=4961.86 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 565329 1253 0 0 496070 116 0 0 25 0 9 0 655587236 3868479488 906370 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=3777812 CPUtime=4913.81 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 320625 1253 0 0 491319 62 0 0 25 0 9 0 655587236 3868479488 906370 33554432000 4194304 4417452 140737135307792 18446744073709551615 4356960 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=3777812 CPUtime=4960.42 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 775903 1253 0 0 495914 128 0 0 25 0 9 0 655587236 3868479488 906370 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=3777812 CPUtime=4961.68 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 457736 1253 0 0 496076 92 0 0 25 0 9 0 655587236 3868479488 906370 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=3777812 CPUtime=4961.83 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 291003 1253 0 0 496139 44 0 0 25 0 9 0 655587236 3868479488 906370 33554432000 4194304 4417452 140737135307792 18446744073709551615 4365996 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=3777812 CPUtime=4961.85 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 473697 1253 0 0 496099 86 0 0 25 0 9 0 655587236 3868479488 906370 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=3777812 CPUtime=4960.04 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 384782 1253 0 0 495946 58 0 0 25 0 9 0 655587236 3868479488 906370 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39643.9
Current children cumulated vsize (KiB) 3777812



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5006.91 s]
/proc/loadavg: 8.02 8.04 8.00 9/326 1709
/proc/meminfo: memFree=21752048/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=3616736 CPUtime=40000.3 cores=0-7
/proc/1539/stat : 1539 (plingeling) S 1537 1539 1328 0 -1 4202496 3836707 1253 0 0 3999331 695 0 0 18 0 9 0 655587179 3703537664 866101 33554432000 4194304 4417452 140737135307792 18446744073709551615 244458747877 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 904184 866101 180 55 0 902070 0
[pid=1539/tid=1546] ppid=1537 vsize=3616736 CPUtime=5006.35 cores=0-7
/proc/1539/task/1546/stat : 1546 (plingeling) R 1537 1539 1328 0 -1 4202560 346762 1253 0 0 500578 57 0 0 25 0 9 0 655587236 3703537664 866101 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1539/tid=1547] ppid=1537 vsize=3616736 CPUtime=5006.43 cores=0-7
/proc/1539/task/1547/stat : 1547 (plingeling) R 1537 1539 1328 0 -1 4202560 667690 1253 0 0 500501 142 0 0 25 0 9 0 655587236 3703537664 866101 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1539/tid=1548] ppid=1537 vsize=3616736 CPUtime=4958.05 cores=0-7
/proc/1539/task/1548/stat : 1548 (plingeling) R 1537 1539 1328 0 -1 4202560 320625 1253 0 0 495743 62 0 0 25 0 9 0 655587236 3703537664 866101 33554432000 4194304 4417452 140737135307792 18446744073709551615 4237136 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1539/tid=1549] ppid=1537 vsize=3616736 CPUtime=5005.04 cores=0-7
/proc/1539/task/1549/stat : 1549 (plingeling) R 1537 1539 1328 0 -1 4202560 787341 1253 0 0 500374 130 0 0 25 0 9 0 655587236 3703537664 866101 33554432000 4194304 4417452 140737135307792 18446744073709551615 4365120 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=3616736 CPUtime=5006.21 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4202560 479841 1253 0 0 500520 101 0 0 25 0 9 0 655587236 3703537664 866101 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1539/tid=1551] ppid=1537 vsize=3616736 CPUtime=5006.46 cores=0-7
/proc/1539/task/1551/stat : 1551 (plingeling) R 1537 1539 1328 0 -1 4202560 303209 1253 0 0 500600 46 0 0 25 0 9 0 655587236 3703537664 866101 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1539/tid=1552] ppid=1537 vsize=3616736 CPUtime=5006.48 cores=0-7
/proc/1539/task/1552/stat : 1552 (plingeling) R 1537 1539 1328 0 -1 4202560 502531 1253 0 0 500558 90 0 0 25 0 9 0 655587236 3703537664 866101 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1539/tid=1553] ppid=1537 vsize=3616736 CPUtime=5004.67 cores=0-7
/proc/1539/task/1553/stat : 1553 (plingeling) R 1537 1539 1328 0 -1 4202560 392649 1253 0 0 500408 59 0 0 25 0 9 0 655587236 3703537664 866101 33554432000 4194304 4417452 140737135307792 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 3616736

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5007.02 s]
/proc/loadavg: 8.02 8.04 8.00 9/326 1709
/proc/meminfo: memFree=21752048/32951124 swapFree=44485764/67111528
[pid=1539] ppid=1537 vsize=0 CPUtime=40000.4 cores=0-7
/proc/1539/stat : 1539 (plingeling) Z 1537 1539 1328 0 -1 4203548 3836707 1253 0 0 3999341 704 0 0 18 0 2 0 655587179 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1539/statm: 0 0 0 0 0 0 0
[pid=1539/tid=1550] ppid=1537 vsize=0 CPUtime=5006.29 cores=0-7
/proc/1539/task/1550/stat : 1550 (plingeling) R 1537 1539 1328 0 -1 4203588 479841 1253 0 0 500520 109 0 0 25 0 2 0 655587236 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5007.06
CPU time (s): 40000.5
CPU user time (s): 39993.4
CPU system time (s): 7.09092
CPU usage (%): 798.882
Max. virtual memory (cumulated for all children) (KiB): 3963488

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39993.4
system time used= 7.09092
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3837960
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 808
involuntary context switches= 142821

runsolver used 14.3538 second user time and 35.9665 second system time

The end

Launcher Data 

Begin job on node105 at 2011-05-15 08:11:07
IDJOB=3372671
IDBENCH=83109
IDSOLVER=1851
FILE ID=node105/3372671-1305439867
RUNJOBID= node105-1305435448-1342
PBS_JOBID= 13324740
Free space on /tmp= 73620 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom25.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372671-1305439867/watcher-3372671-1305439867 -o /tmp/evaluation-result-3372671-1305439867/solver-3372671-1305439867 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372671-1305439867.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= c40bd543dad558d19995fef4fd742233
RANDOM SEED=1084950443

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25221868 kB
Buffers:        289376 kB
Cached:        5969408 kB
SwapCached:      39656 kB
Active:         763472 kB
Inactive:      6703712 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25221868 kB
SwapTotal:    67111528 kB
SwapFree:     44485764 kB
Dirty:            4296 kB
Writeback:           4 kB
AnonPages:     1176772 kB
Mapped:          10356 kB
Slab:           129372 kB
PageTables:      66404 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 65318364 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73620 MiB
End job on node105 at 2011-05-15 09:34:36