Trace number 3394062

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.6 5010.45

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v1375c111739g6.cnf
MD5SUMc7c04151ac14a13eb4a03259d055e119
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1375
Number of clauses111739
Sum of the clauses size224743
Maximum clause length25
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2111684
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 555

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394062-1306082667/watcher-3394062-1306082667 -o /tmp/evaluation-result-3394062-1306082667/solver-3394062-1306082667 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394062-1306082667.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.42 7.92 7.96 1/474 3219
/proc/meminfo: memFree=6820192/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=9000 CPUtime=0 cores=0-7
/proc/3219/stat : 3219 (plingeling) R 3217 3219 2990 0 -1 4202496 321 1261 0 0 0 0 0 0 25 0 1 0 719869102 9216000 250 33554432000 4194304 4417452 140737109468096 18446744073709551615 212436016896 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/3219/statm: 2250 250 146 55 0 136 0

[startup+0.0338 s]
/proc/loadavg: 7.42 7.92 7.96 1/474 3219
/proc/meminfo: memFree=6820192/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=14676 CPUtime=0.02 cores=0-7
/proc/3219/stat : 3219 (plingeling) R 3217 3219 2990 0 -1 4202496 1731 1261 0 0 2 0 0 0 25 0 1 0 719869102 15028224 1660 33554432000 4194304 4417452 140737109468096 18446744073709551615 212436016896 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/3219/statm: 3669 1660 148 55 0 1555 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 14676

[startup+0.100789 s]
/proc/loadavg: 7.42 7.92 7.96 1/474 3219
/proc/meminfo: memFree=6820192/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=26964 CPUtime=0.09 cores=0-7
/proc/3219/stat : 3219 (plingeling) R 3217 3219 2990 0 -1 4202496 4803 1261 0 0 9 0 0 0 25 0 1 0 719869102 27611136 4732 33554432000 4194304 4417452 140737109468096 18446744073709551615 212436016896 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/3219/statm: 6741 4732 148 55 0 4627 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26964

[startup+0.300714 s]
/proc/loadavg: 7.42 7.92 7.96 1/474 3219
/proc/meminfo: memFree=6820192/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=195916 CPUtime=1.35 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 16963 1261 0 0 133 2 0 0 18 0 9 0 719869102 200617984 10227 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 48979 10227 177 55 0 46865 0
Current children cumulated CPU time (s) 1.35
Current children cumulated vsize (KiB) 195916

[startup+0.700637 s]
/proc/loadavg: 7.42 7.92 7.96 1/474 3219
/proc/meminfo: memFree=6820192/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=209352 CPUtime=4.54 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 21179 1261 0 0 452 2 0 0 18 0 9 0 719869102 214376448 13557 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 52338 13557 180 55 0 50224 0
Current children cumulated CPU time (s) 4.54
Current children cumulated vsize (KiB) 209352

[startup+1.50049 s]
/proc/loadavg: 7.42 7.92 7.96 10/483 3233
/proc/meminfo: memFree=6762220/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=215480 CPUtime=10.91 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 22782 1261 0 0 1089 2 0 0 18 0 9 0 719869102 220651520 15089 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 53870 15089 180 55 0 51756 0
[pid=3219/tid=3226] ppid=3217 vsize=215480 CPUtime=1.35 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 1937 1261 0 0 135 0 0 0 25 0 9 0 719869116 220651520 15089 33554432000 4194304 4417452 140737109468096 18446744073709551615 4250332 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=215480 CPUtime=1.33 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 1579 1261 0 0 133 0 0 0 25 0 9 0 719869116 220651520 15089 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=215480 CPUtime=1.35 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 1300 1261 0 0 135 0 0 0 19 0 9 0 719869116 220651520 15089 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=215480 CPUtime=1.35 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 3625 1261 0 0 135 0 0 0 22 0 9 0 719869116 220651520 15089 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=215480 CPUtime=1.32 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 691 1261 0 0 132 0 0 0 22 0 9 0 719869116 220651520 15089 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=215480 CPUtime=1.35 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 1479 1261 0 0 135 0 0 0 22 0 9 0 719869116 220651520 15089 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249577 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=215480 CPUtime=1.34 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 1487 1261 0 0 134 0 0 0 23 0 9 0 719869116 220651520 15089 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=215480 CPUtime=1.35 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 1767 1261 0 0 135 0 0 0 19 0 9 0 719869116 220651520 15089 33554432000 4194304 4417452 140737109468096 18446744073709551615 4250306 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 10.91
Current children cumulated vsize (KiB) 215480

[startup+3.10118 s]
/proc/loadavg: 7.42 7.92 7.96 9/483 3233
/proc/meminfo: memFree=6749328/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=234912 CPUtime=23.7 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 29289 1261 0 0 2366 4 0 0 18 0 9 0 719869102 240549888 19951 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 58728 19951 180 55 0 56614 0
[pid=3219/tid=3226] ppid=3217 vsize=234912 CPUtime=2.95 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 2653 1261 0 0 295 0 0 0 25 0 9 0 719869116 240549888 19951 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249943 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=234912 CPUtime=2.91 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 2295 1261 0 0 291 0 0 0 25 0 9 0 719869116 240549888 19951 33554432000 4194304 4417452 140737109468096 18446744073709551615 4250003 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=234912 CPUtime=2.95 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 1300 1261 0 0 295 0 0 0 24 0 9 0 719869116 240549888 19951 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=234912 CPUtime=2.95 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 7268 1261 0 0 294 1 0 0 25 0 9 0 719869116 240549888 19951 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=234912 CPUtime=2.92 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 1407 1261 0 0 292 0 0 0 25 0 9 0 719869116 240549888 19951 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249982 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=234912 CPUtime=2.95 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 1479 1261 0 0 295 0 0 0 25 0 9 0 719869116 240549888 19951 33554432000 4194304 4417452 140737109468096 18446744073709551615 4250306 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=234912 CPUtime=2.94 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 1487 1261 0 0 294 0 0 0 25 0 9 0 719869116 240549888 19951 33554432000 4194304 4417452 140737109468096 18446744073709551615 4236675 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=234912 CPUtime=2.95 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 2483 1261 0 0 295 0 0 0 25 0 9 0 719869116 240549888 19951 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 23.7
Current children cumulated vsize (KiB) 234912

[startup+6.30057 s]
/proc/loadavg: 7.47 7.93 7.96 9/483 3233
/proc/meminfo: memFree=6743748/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=237648 CPUtime=49.25 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 36463 1261 0 0 4920 5 0 0 18 0 9 0 719869102 243351552 20631 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 59412 20631 180 55 0 57298 0
[pid=3219/tid=3226] ppid=3217 vsize=237648 CPUtime=6.15 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 2653 1261 0 0 615 0 0 0 25 0 9 0 719869116 243351552 20631 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=237648 CPUtime=6.06 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 2295 1261 0 0 606 0 0 0 25 0 9 0 719869116 243351552 20631 33554432000 4194304 4417452 140737109468096 18446744073709551615 4248212 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=237648 CPUtime=6.15 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 1505 1261 0 0 615 0 0 0 25 0 9 0 719869116 243351552 20631 33554432000 4194304 4417452 140737109468096 18446744073709551615 4321698 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=237648 CPUtime=6.15 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 14062 1261 0 0 613 2 0 0 25 0 9 0 719869116 243351552 20631 33554432000 4194304 4417452 140737109468096 18446744073709551615 4365078 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=237648 CPUtime=6.12 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 1407 1261 0 0 612 0 0 0 25 0 9 0 719869116 243351552 20631 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=237648 CPUtime=6.15 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 1479 1261 0 0 615 0 0 0 25 0 9 0 719869116 243351552 20631 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=237648 CPUtime=6.14 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 1662 1261 0 0 614 0 0 0 25 0 9 0 719869116 243351552 20631 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=237648 CPUtime=6.15 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 2483 1261 0 0 615 0 0 0 25 0 9 0 719869116 243351552 20631 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 49.25
Current children cumulated vsize (KiB) 237648

[startup+12.7004 s]
/proc/loadavg: 7.51 7.93 7.96 9/483 3233
/proc/meminfo: memFree=6677588/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=272404 CPUtime=100.34 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 61499 1261 0 0 10024 10 0 0 18 0 9 0 719869102 278941696 29320 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 68101 29320 180 55 0 65987 0
[pid=3219/tid=3226] ppid=3217 vsize=272404 CPUtime=12.55 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 3368 1261 0 0 1255 0 0 0 25 0 9 0 719869116 278941696 29320 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249601 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=272404 CPUtime=12.35 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 3010 1261 0 0 1235 0 0 0 25 0 9 0 719869116 278941696 29320 33554432000 4194304 4417452 140737109468096 18446744073709551615 4250086 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=272404 CPUtime=12.55 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 2514 1261 0 0 1255 0 0 0 25 0 9 0 719869116 278941696 29320 33554432000 4194304 4417452 140737109468096 18446744073709551615 4258244 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=272404 CPUtime=12.55 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 32766 1261 0 0 1248 7 0 0 25 0 9 0 719869116 278941696 29320 33554432000 4194304 4417452 140737109468096 18446744073709551615 4365221 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=272404 CPUtime=12.52 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 2122 1261 0 0 1252 0 0 0 25 0 9 0 719869116 278941696 29320 33554432000 4194304 4417452 140737109468096 18446744073709551615 4336656 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=272404 CPUtime=12.55 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 2910 1261 0 0 1255 0 0 0 25 0 9 0 719869116 278941696 29320 33554432000 4194304 4417452 140737109468096 18446744073709551615 4250017 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=272404 CPUtime=12.54 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 2694 1261 0 0 1254 0 0 0 25 0 9 0 719869116 278941696 29320 33554432000 4194304 4417452 140737109468096 18446744073709551615 4258589 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=272404 CPUtime=12.54 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 3198 1261 0 0 1254 0 0 0 25 0 9 0 719869116 278941696 29320 33554432000 4194304 4417452 140737109468096 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 100.34
Current children cumulated vsize (KiB) 272404

[startup+25.5009 s]
/proc/loadavg: 7.62 7.93 7.96 9/483 3234
/proc/meminfo: memFree=6664100/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=314012 CPUtime=202.55 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 101451 1261 0 0 20238 17 0 0 18 0 9 0 719869102 321548288 39722 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 78503 39722 180 55 0 76389 0
[pid=3219/tid=3226] ppid=3217 vsize=314012 CPUtime=25.35 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 3921 1261 0 0 2535 0 0 0 25 0 9 0 719869116 321548288 39722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4310394 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=314012 CPUtime=24.95 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 3334 1261 0 0 2495 0 0 0 25 0 9 0 719869116 321548288 39722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4366469 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=314012 CPUtime=25.34 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 7532 1261 0 0 2534 0 0 0 25 0 9 0 719869116 321548288 39722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=314012 CPUtime=25.35 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 58209 1261 0 0 2524 11 0 0 25 0 9 0 719869116 321548288 39722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4320800 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=314012 CPUtime=25.32 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 2237 1261 0 0 2532 0 0 0 25 0 9 0 719869116 321548288 39722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4335980 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=314012 CPUtime=25.34 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 3913 1261 0 0 2534 0 0 0 25 0 9 0 719869116 321548288 39722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4310971 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=314012 CPUtime=25.34 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 9988 1261 0 0 2533 1 0 0 25 0 9 0 719869116 321548288 39722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=314012 CPUtime=25.34 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 3400 1261 0 0 2534 0 0 0 25 0 9 0 719869116 321548288 39722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4254972 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 202.55
Current children cumulated vsize (KiB) 314012

[startup+51.1011 s]
/proc/loadavg: 7.75 7.93 7.96 9/483 3234
/proc/meminfo: memFree=6563624/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=408196 CPUtime=406.95 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 188055 1261 0 0 40662 33 0 0 18 0 9 0 719869102 417992704 63268 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 102049 63268 180 55 0 99935 0
[pid=3219/tid=3226] ppid=3217 vsize=408196 CPUtime=50.94 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 6981 1261 0 0 5094 0 0 0 25 0 9 0 719869116 417992704 63268 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=408196 CPUtime=50.16 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 6126 1261 0 0 5015 1 0 0 25 0 9 0 719869116 417992704 63268 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=408196 CPUtime=50.94 cores=0-7

################
# More data... #
################


[startup+4722.32 s]
/proc/loadavg: 8.03 8.05 8.00 9/483 3388
/proc/meminfo: memFree=1144564/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=5818272 CPUtime=37702.5 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 5866451 1261 0 0 3769059 1187 0 0 18 0 9 0 719869102 5957910528 1415722 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 1454568 1415722 180 55 0 1452454 0
[pid=3219/tid=3226] ppid=3217 vsize=5818272 CPUtime=4722.11 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 609030 1261 0 0 472079 132 0 0 25 0 9 0 719869116 5957910528 1415722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4343986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=5818272 CPUtime=4648.29 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 664877 1261 0 0 464700 129 0 0 25 0 9 0 719869116 5957910528 1415722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=5818272 CPUtime=4722.32 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 773192 1261 0 0 472080 152 0 0 25 0 9 0 719869116 5957910528 1415722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364684 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=5818272 CPUtime=4722.33 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 1106493 1261 0 0 471987 246 0 0 25 0 9 0 719869116 5957910528 1415722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=5818272 CPUtime=4721.06 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 512032 1261 0 0 471998 108 0 0 25 0 9 0 719869116 5957910528 1415722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=5818272 CPUtime=4722.15 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 615434 1261 0 0 472100 115 0 0 25 0 9 0 719869116 5957910528 1415722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=5818272 CPUtime=4721.68 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 941196 1261 0 0 471984 184 0 0 25 0 9 0 719869116 5957910528 1415722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=5818272 CPUtime=4722.31 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 635280 1261 0 0 472115 116 0 0 25 0 9 0 719869116 5957910528 1415722 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37702.5
Current children cumulated vsize (KiB) 5818272

[startup+4782.3 s]
/proc/loadavg: 8.44 8.15 8.04 9/483 3394
/proc/meminfo: memFree=971152/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=5991928 CPUtime=38180.6 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 5954297 1261 0 0 3816852 1204 0 0 18 0 9 0 719869102 6135734272 1459136 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 1497982 1459136 180 55 0 1495868 0
[pid=3219/tid=3226] ppid=3217 vsize=5991928 CPUtime=4781.94 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 609030 1261 0 0 478061 133 0 0 25 0 9 0 719869116 6135734272 1459136 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=5991928 CPUtime=4707.33 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 752723 1261 0 0 470589 144 0 0 25 0 9 0 719869116 6135734272 1459136 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=5991928 CPUtime=4782.31 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 773192 1261 0 0 478079 152 0 0 25 0 9 0 719869116 6135734272 1459136 33554432000 4194304 4417452 140737109468096 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=5991928 CPUtime=4782.31 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 1106493 1261 0 0 477985 246 0 0 25 0 9 0 719869116 6135734272 1459136 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=5991928 CPUtime=4781.03 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 512032 1261 0 0 477995 108 0 0 25 0 9 0 719869116 6135734272 1459136 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=5991928 CPUtime=4782.13 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 615434 1261 0 0 478098 115 0 0 25 0 9 0 719869116 6135734272 1459136 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=5991928 CPUtime=4780.99 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 941196 1261 0 0 477915 184 0 0 25 0 9 0 719869116 6135734272 1459136 33554432000 4194304 4417452 140737109468096 18446744073709551615 4344176 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=5991928 CPUtime=4782.3 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 635280 1261 0 0 478114 116 0 0 25 0 9 0 719869116 6135734272 1459136 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38180.6
Current children cumulated vsize (KiB) 5991928

[startup+4842.3 s]
/proc/loadavg: 8.16 8.12 8.03 9/483 3395
/proc/meminfo: memFree=438464/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=6524816 CPUtime=38659.6 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 6273454 1261 0 0 3864690 1270 0 0 18 0 9 0 719869102 6681411584 1592365 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 1631204 1592365 180 55 0 1629090 0
[pid=3219/tid=3226] ppid=3217 vsize=6524816 CPUtime=4841.95 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 669100 1261 0 0 484054 141 0 0 25 0 9 0 719869116 6681411584 1592365 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=6524816 CPUtime=4766.39 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 752723 1261 0 0 476495 144 0 0 25 0 9 0 719869116 6681411584 1592365 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=6524816 CPUtime=4842.32 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 887940 1261 0 0 484052 180 0 0 25 0 9 0 719869116 6681411584 1592365 33554432000 4194304 4417452 140737109468096 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=6524816 CPUtime=4842.31 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 1122877 1261 0 0 483980 251 0 0 25 0 9 0 719869116 6681411584 1592365 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=6524816 CPUtime=4841.01 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 512032 1261 0 0 483993 108 0 0 25 0 9 0 719869116 6681411584 1592365 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=6524816 CPUtime=4842.14 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 689559 1261 0 0 484085 129 0 0 25 0 9 0 719869116 6681411584 1592365 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=6524816 CPUtime=4840.99 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 941196 1261 0 0 483915 184 0 0 25 0 9 0 719869116 6681411584 1592365 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364850 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=6524816 CPUtime=4842.29 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 689110 1261 0 0 484100 129 0 0 25 0 9 0 719869116 6681411584 1592365 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38659.6
Current children cumulated vsize (KiB) 6524816

[startup+4902.3 s]
/proc/loadavg: 8.06 8.10 8.02 9/483 3397
/proc/meminfo: memFree=366924/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=6596740 CPUtime=39138.7 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 6291435 1261 0 0 3912597 1273 0 0 18 0 9 0 719869102 6755061760 1610346 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 1649185 1610346 180 55 0 1647071 0
[pid=3219/tid=3226] ppid=3217 vsize=6596740 CPUtime=4901.95 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 669100 1261 0 0 490054 141 0 0 25 0 9 0 719869116 6755061760 1610346 33554432000 4194304 4417452 140737109468096 18446744073709551615 4259618 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=6596740 CPUtime=4825.47 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 752723 1261 0 0 482403 144 0 0 25 0 9 0 719869116 6755061760 1610346 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=6596740 CPUtime=4902.32 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 887940 1261 0 0 490052 180 0 0 25 0 9 0 719869116 6755061760 1610346 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=6596740 CPUtime=4902.31 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 1122877 1261 0 0 489980 251 0 0 25 0 9 0 719869116 6755061760 1610346 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=6596740 CPUtime=4901.01 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 518722 1261 0 0 489992 109 0 0 25 0 9 0 719869116 6755061760 1610346 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=6596740 CPUtime=4902.14 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 689559 1261 0 0 490085 129 0 0 25 0 9 0 719869116 6755061760 1610346 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=6596740 CPUtime=4901 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 952487 1261 0 0 489914 186 0 0 25 0 9 0 719869116 6755061760 1610346 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=6596740 CPUtime=4902.3 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 689110 1261 0 0 490101 129 0 0 25 0 9 0 719869116 6755061760 1610346 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39138.7
Current children cumulated vsize (KiB) 6596740

[startup+4962.3 s]
/proc/loadavg: 8.06 8.09 8.02 9/483 3398
/proc/meminfo: memFree=231364/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=6731816 CPUtime=39617.7 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 6373636 1261 0 0 3960478 1293 0 0 18 0 9 0 719869102 6893379584 1644115 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 1682954 1644115 180 55 0 1680840 0
[pid=3219/tid=3226] ppid=3217 vsize=6731816 CPUtime=4961.95 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 669100 1261 0 0 496054 141 0 0 25 0 9 0 719869116 6893379584 1644115 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364542 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=6731816 CPUtime=4884.49 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 752723 1261 0 0 488305 144 0 0 25 0 9 0 719869116 6893379584 1644115 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=6731816 CPUtime=4962.32 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 887940 1261 0 0 496052 180 0 0 25 0 9 0 719869116 6893379584 1644115 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=6731816 CPUtime=4962.32 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 1122877 1261 0 0 495981 251 0 0 25 0 9 0 719869116 6893379584 1644115 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=6731816 CPUtime=4960.99 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 530951 1261 0 0 495985 114 0 0 25 0 9 0 719869116 6893379584 1644115 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=6731816 CPUtime=4962.14 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 689559 1261 0 0 496085 129 0 0 25 0 9 0 719869116 6893379584 1644115 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=6731816 CPUtime=4961 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 1022459 1261 0 0 495899 201 0 0 25 0 9 0 719869116 6893379584 1644115 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=6731816 CPUtime=4962.3 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 689110 1261 0 0 496101 129 0 0 25 0 9 0 719869116 6893379584 1644115 33554432000 4194304 4417452 140737109468096 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39617.7
Current children cumulated vsize (KiB) 6731816



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.2 s]
/proc/loadavg: 8.02 8.07 8.02 9/483 3401
/proc/meminfo: memFree=170100/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=6793040 CPUtime=40000.2 cores=0-7
/proc/3219/stat : 3219 (plingeling) S 3217 3219 2990 0 -1 4202496 6388942 1261 0 0 3998722 1297 0 0 18 0 9 0 719869102 6956072960 1659421 33554432000 4194304 4417452 140737109468096 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 1698260 1659421 180 55 0 1696146 0
[pid=3219/tid=3226] ppid=3217 vsize=6793040 CPUtime=5009.87 cores=0-7
/proc/3219/task/3226/stat : 3226 (plingeling) R 3217 3219 2990 0 -1 4202560 669100 1261 0 0 500846 141 0 0 25 0 9 0 719869116 6956072960 1659421 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=6793040 CPUtime=4931.64 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4202560 752723 1261 0 0 493020 144 0 0 25 0 9 0 719869116 6956072960 1659421 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3219/tid=3228] ppid=3217 vsize=6793040 CPUtime=5010.24 cores=0-7
/proc/3219/task/3228/stat : 3228 (plingeling) R 3217 3219 2990 0 -1 4202560 887940 1261 0 0 500844 180 0 0 25 0 9 0 719869116 6956072960 1659421 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3219/tid=3229] ppid=3217 vsize=6793040 CPUtime=5010.24 cores=0-7
/proc/3219/task/3229/stat : 3229 (plingeling) R 3217 3219 2990 0 -1 4202560 1138183 1261 0 0 500768 256 0 0 25 0 9 0 719869116 6956072960 1659421 33554432000 4194304 4417452 140737109468096 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3219/tid=3230] ppid=3217 vsize=6793040 CPUtime=5008.9 cores=0-7
/proc/3219/task/3230/stat : 3230 (plingeling) R 3217 3219 2990 0 -1 4202560 530951 1261 0 0 500776 114 0 0 25 0 9 0 719869116 6956072960 1659421 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3219/tid=3231] ppid=3217 vsize=6793040 CPUtime=5010.06 cores=0-7
/proc/3219/task/3231/stat : 3231 (plingeling) R 3217 3219 2990 0 -1 4202560 689559 1261 0 0 500877 129 0 0 25 0 9 0 719869116 6956072960 1659421 33554432000 4194304 4417452 140737109468096 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3219/tid=3232] ppid=3217 vsize=6793040 CPUtime=5008.92 cores=0-7
/proc/3219/task/3232/stat : 3232 (plingeling) R 3217 3219 2990 0 -1 4202560 1022459 1261 0 0 500691 201 0 0 25 0 9 0 719869116 6956072960 1659421 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3219/tid=3233] ppid=3217 vsize=6793040 CPUtime=5010.22 cores=0-7
/proc/3219/task/3233/stat : 3233 (plingeling) R 3217 3219 2990 0 -1 4202560 689110 1261 0 0 500893 129 0 0 25 0 9 0 719869116 6956072960 1659421 33554432000 4194304 4417452 140737109468096 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 6793040

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.4 s]
/proc/loadavg: 8.02 8.07 8.02 2/477 3402
/proc/meminfo: memFree=5486648/32951124 swapFree=55453480/67111528
[pid=3219] ppid=3217 vsize=0 CPUtime=40000.5 cores=0-7
/proc/3219/stat : 3219 (plingeling) Z 3217 3219 2990 0 -1 4203548 6388942 1261 0 0 3998735 1315 0 0 18 0 2 0 719869102 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/3219/statm: 0 0 0 0 0 0 0
[pid=3219/tid=3227] ppid=3217 vsize=0 CPUtime=4931.85 cores=0-7
/proc/3219/task/3227/stat : 3227 (plingeling) R 3217 3219 2990 0 -1 4203588 752723 1261 0 0 493021 164 0 0 25 0 2 0 719869116 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.45
CPU time (s): 40000.6
CPU user time (s): 39987.4
CPU system time (s): 13.204
CPU usage (%): 798.343
Max. virtual memory (cumulated for all children) (KiB): 6793040

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39987.4
system time used= 13.204
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6390203
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 436
involuntary context switches= 194155

runsolver used 22.0666 second user time and 56.5504 second system time

The end

Launcher Data

Begin job on node102 at 2011-05-22 18:44:28
IDJOB=3394062
IDBENCH=71315
IDSOLVER=1851
FILE ID=node102/3394062-1306082667
RUNJOBID= node102-1306077655-3004
PBS_JOBID= 13387908
Free space on /tmp= 73376 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v1375c111739g6.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394062-1306082667/watcher-3394062-1306082667 -o /tmp/evaluation-result-3394062-1306082667/solver-3394062-1306082667 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394062-1306082667.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= c7c04151ac14a13eb4a03259d055e119
RANDOM SEED=272530736

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       6820596 kB
Buffers:        243656 kB
Cached:        4901400 kB
SwapCached:      24064 kB
Active:       15740836 kB
Inactive:     10097160 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       6820596 kB
SwapTotal:    67111528 kB
SwapFree:     55453480 kB
Dirty:            1564 kB
Writeback:           0 kB
AnonPages:    20681508 kB
Mapped:          23344 kB
Slab:           120496 kB
PageTables:      99640 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 135453608 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73376 MiB
End job on node102 at 2011-05-22 20:08:00