Trace number 3371471

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.12 1203.85

General information on the benchmark

Nameapplication/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-countbits128-tseitin.cnf
MD5SUM47da9e46b00ffd3e0b0f453a6c3c9f38
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2179.95
Satisfiable
(Un)Satisfiability was proved
Number of variables95810
Number of clauses287045
Sum of the clauses size669769
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2191362
Number of clauses of size 395681
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371471-1305422156/watcher-3371471-1305422156 -o /tmp/evaluation-result-3371471-1305422156/solver-3371471-1305422156 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371471-1305422156.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.85 8.03 7.98 5/353 28207
/proc/meminfo: memFree=21391780/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=11676 CPUtime=0 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) R 28205 28207 27864 0 -1 4202496 996 1250 0 0 0 0 0 0 25 0 1 0 634631739 11956224 926 33554432000 4194304 4417452 140736547100496 18446744073709551615 255106462676 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/28207/statm: 2919 926 148 55 0 805 0

[startup+0.0609301 s]
/proc/loadavg: 7.85 8.03 7.98 5/353 28207
/proc/meminfo: memFree=21391780/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=23624 CPUtime=0.05 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) R 28205 28207 27864 0 -1 4202496 4002 1250 0 0 5 0 0 0 25 0 1 0 634631739 24190976 3930 33554432000 4194304 4417452 140736547100496 18446744073709551615 4236008 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/28207/statm: 5906 3930 149 55 0 3792 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 23624

[startup+0.10092 s]
/proc/loadavg: 7.85 8.03 7.98 5/353 28207
/proc/meminfo: memFree=21391780/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=27720 CPUtime=0.08 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) R 28205 28207 27864 0 -1 4202496 5026 1250 0 0 8 0 0 0 25 0 1 0 634631739 28385280 4954 33554432000 4194304 4417452 140736547100496 18446744073709551615 255106768640 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/28207/statm: 6930 4954 149 55 0 4816 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 27720

[startup+0.30088 s]
/proc/loadavg: 7.85 8.03 7.98 5/353 28207
/proc/meminfo: memFree=21391780/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=80616 CPUtime=0.29 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) R 28205 28207 27864 0 -1 4202496 18280 1250 0 0 27 2 0 0 25 0 1 0 634631739 82550784 18178 33554432000 4194304 4417452 140736547100496 18446744073709551615 4274337 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/28207/statm: 20154 18178 149 55 0 18040 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 80616

[startup+0.700747 s]
/proc/loadavg: 7.85 8.03 7.98 5/353 28207
/proc/meminfo: memFree=21391780/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=119296 CPUtime=1.74 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 32080 1250 0 0 170 4 0 0 25 0 5 0 634631739 122159104 17635 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 29824 17635 172 55 0 27710 0
Current children cumulated CPU time (s) 1.74
Current children cumulated vsize (KiB) 119296

[startup+1.5006 s]
/proc/loadavg: 7.85 8.03 7.98 9/358 28217
/proc/meminfo: memFree=21312760/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=187608 CPUtime=4.93 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 44982 1250 0 0 487 6 0 0 25 0 5 0 634631739 192110592 19706 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 46902 19706 174 55 0 44788 0
[pid=28207/tid=28214] ppid=28205 vsize=187608 CPUtime=1.14 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 11480 1250 0 0 113 1 0 0 25 0 5 0 634631774 192110592 19706 33554432000 4194304 4417452 140736547100496 18446744073709551615 4276673 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=187608 CPUtime=1.14 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 7936 1250 0 0 113 1 0 0 19 0 5 0 634631774 192110592 19706 33554432000 4194304 4417452 140736547100496 18446744073709551615 4276659 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=187608 CPUtime=1.12 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 5081 1250 0 0 112 0 0 0 25 0 5 0 634631774 192110592 19706 33554432000 4194304 4417452 140736547100496 18446744073709551615 4276543 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=187608 CPUtime=1.14 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 2193 1250 0 0 114 0 0 0 19 0 5 0 634631774 192110592 19706 33554432000 4194304 4417452 140736547100496 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.93
Current children cumulated vsize (KiB) 187608

[startup+3.10033 s]
/proc/loadavg: 7.85 8.03 7.98 9/358 28217
/proc/meminfo: memFree=21277916/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=236172 CPUtime=11.32 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 62243 1250 0 0 1123 9 0 0 25 0 5 0 634631739 241840128 30475 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 59043 30475 176 55 0 56929 0
[pid=28207/tid=28214] ppid=28205 vsize=236172 CPUtime=2.74 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 18210 1250 0 0 272 2 0 0 25 0 5 0 634631774 241840128 30475 33554432000 4194304 4417452 140736547100496 18446744073709551615 4265802 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=236172 CPUtime=2.74 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 13058 1250 0 0 272 2 0 0 23 0 5 0 634631774 241840128 30475 33554432000 4194304 4417452 140736547100496 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=236172 CPUtime=2.72 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 10490 1250 0 0 271 1 0 0 25 0 5 0 634631774 241840128 30475 33554432000 4194304 4417452 140736547100496 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=236172 CPUtime=2.74 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 2193 1250 0 0 274 0 0 0 23 0 5 0 634631774 241840128 30475 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.32
Current children cumulated vsize (KiB) 236172

[startup+6.30076 s]
/proc/loadavg: 7.86 8.03 7.98 9/358 28217
/proc/meminfo: memFree=21274012/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=236128 CPUtime=24.08 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 62257 1250 0 0 2399 9 0 0 25 0 5 0 634631739 241795072 30478 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 59032 30478 178 55 0 56918 0
[pid=28207/tid=28214] ppid=28205 vsize=236128 CPUtime=5.94 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 18216 1250 0 0 592 2 0 0 25 0 5 0 634631774 241795072 30478 33554432000 4194304 4417452 140736547100496 18446744073709551615 4248081 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=236128 CPUtime=5.94 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 13064 1250 0 0 592 2 0 0 25 0 5 0 634631774 241795072 30478 33554432000 4194304 4417452 140736547100496 18446744073709551615 4235357 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=236128 CPUtime=5.88 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 10492 1250 0 0 587 1 0 0 25 0 5 0 634631774 241795072 30478 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364480 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=236128 CPUtime=5.94 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 2193 1250 0 0 594 0 0 0 25 0 5 0 634631774 241795072 30478 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.08
Current children cumulated vsize (KiB) 236128

[startup+12.7006 s]
/proc/loadavg: 7.96 8.04 7.98 9/358 28217
/proc/meminfo: memFree=21295984/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=222304 CPUtime=49.61 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 63009 1250 0 0 4952 9 0 0 25 0 5 0 634631739 227639296 27023 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 55576 27023 179 55 0 53462 0
[pid=28207/tid=28214] ppid=28205 vsize=222304 CPUtime=12.34 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 18217 1250 0 0 1232 2 0 0 25 0 5 0 634631774 227639296 27023 33554432000 4194304 4417452 140736547100496 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=222304 CPUtime=12.34 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 13815 1250 0 0 1232 2 0 0 25 0 5 0 634631774 227639296 27023 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=222304 CPUtime=12.21 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 10492 1250 0 0 1220 1 0 0 25 0 5 0 634631774 227639296 27023 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=222304 CPUtime=12.34 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 2193 1250 0 0 1234 0 0 0 25 0 5 0 634631774 227639296 27023 33554432000 4194304 4417452 140736547100496 18446744073709551615 4250505 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 49.61
Current children cumulated vsize (KiB) 222304

[startup+25.5004 s]
/proc/loadavg: 7.96 8.04 7.98 9/358 28217
/proc/meminfo: memFree=21275752/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=225272 CPUtime=100.67 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 67015 1250 0 0 10057 10 0 0 25 0 5 0 634631739 230678528 27766 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 56318 27766 180 55 0 54204 0
[pid=28207/tid=28214] ppid=28205 vsize=225272 CPUtime=25.14 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 18313 1250 0 0 2512 2 0 0 25 0 5 0 634631774 230678528 27766 33554432000 4194304 4417452 140736547100496 18446744073709551615 4357554 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=225272 CPUtime=25.14 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 16924 1250 0 0 2512 2 0 0 25 0 5 0 634631774 230678528 27766 33554432000 4194304 4417452 140736547100496 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=225272 CPUtime=24.86 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 10492 1250 0 0 2485 1 0 0 25 0 5 0 634631774 230678528 27766 33554432000 4194304 4417452 140736547100496 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=225272 CPUtime=25.14 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 2994 1250 0 0 2514 0 0 0 25 0 5 0 634631774 230678528 27766 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 100.67
Current children cumulated vsize (KiB) 225272

[startup+51.1009 s]
/proc/loadavg: 8.03 8.05 7.99 9/358 28218
/proc/meminfo: memFree=21181284/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=282072 CPUtime=202.78 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 89070 1250 0 0 20267 11 0 0 25 0 5 0 634631739 288841728 41966 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 70518 41966 180 55 0 68404 0
[pid=28207/tid=28214] ppid=28205 vsize=282072 CPUtime=50.74 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 25177 1250 0 0 5072 2 0 0 25 0 5 0 634631774 288841728 41966 33554432000 4194304 4417452 140736547100496 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=282072 CPUtime=50.74 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 19470 1250 0 0 5072 2 0 0 25 0 5 0 634631774 288841728 41966 33554432000 4194304 4417452 140736547100496 18446744073709551615 255106462681 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=282072 CPUtime=50.18 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 12120 1250 0 0 5017 1 0 0 25 0 5 0 634631774 288841728 41966 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364399 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=282072 CPUtime=50.74 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 14011 1250 0 0 5073 1 0 0 25 0 5 0 634631774 288841728 41966 33554432000 4194304 4417452 140736547100496 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 202.78
Current children cumulated vsize (KiB) 282072

[startup+102.313 s]
/proc/loadavg: 8.06 8.06 8.00 9/358 28219
/proc/meminfo: memFree=21080088/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=316876 CPUtime=407.04 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 143403 1250 0 0 40687 17 0 0 25 0 5 0 634631739 324481024 50673 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 79219 50673 180 55 0 77105 0
[pid=28207/tid=28214] ppid=28205 vsize=316876 CPUtime=101.95 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 44858 1250 0 0 10190 5 0 0 25 0 5 0 634631774 324481024 50673 33554432000 4194304 4417452 140736547100496 18446744073709551615 4236616 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=316876 CPUtime=101.51 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 29473 1250 0 0 10148 3 0 0 25 0 5 0 634631774 324481024 50673 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=316876 CPUtime=101.26 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 15626 1250 0 0 10124 2 0 0 25 0 5 0 634631774 324481024 50673 33554432000 4194304 4417452 140736547100496 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=316876 CPUtime=101.96 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 35154 1250 0 0 10192 4 0 0 25 0 5 0 634631774 324481024 50673 33554432000 4194304 4417452 140736547100496 18446744073709551615 4366507 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.04
Current children cumulated vsize (KiB) 316876

[startup+162.3 s]
/proc/loadavg: 8.06 8.06 8.00 10/358 28257
/proc/meminfo: memFree=21215396/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=329352 CPUtime=646.33 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 254493 1250 0 0 64600 33 0 0 25 0 5 0 634631739 337256448 53792 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 82338 53792 180 55 0 80224 0
[pid=28207/tid=28214] ppid=28205 vsize=329352 CPUtime=161.94 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 70865 1250 0 0 16185 9 0 0 25 0 5 0 634631774 337256448 53792 33554432000 4194304 4417452 140736547100496 18446744073709551615 4365181 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=329352 CPUtime=160.83 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 54487 1250 0 0 16076 7 0 0 25 0 5 0 634631774 337256448 53792 33554432000 4194304 4417452 140736547100496 18446744073709551615 4277534 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=329352 CPUtime=161.24 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 47361 1250 0 0 16119 5 0 0 25 0 5 0 634631774 337256448 53792 33554432000 4194304 4417452 140736547100496 18446744073709551615 4288178 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=329352 CPUtime=161.94 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 63488 1250 0 0 16186 8 0 0 25 0 5 0 634631774 337256448 53792 33554432000 4194304 4417452 140736547100496 18446744073709551615 4250762 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 646.33
Current children cumulated vsize (KiB) 329352


################
# More data... #
################

[pid=28207/tid=28215] ppid=28205 vsize=617104 CPUtime=698.98 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 314880 1250 0 0 69855 43 0 0 25 0 5 0 634631774 631914496 125730 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=617104 CPUtime=697.11 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 303292 1250 0 0 69673 38 0 0 25 0 5 0 634631774 631914496 125730 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=617104 CPUtime=701.17 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 675924 1250 0 0 70018 99 0 0 25 0 5 0 634631774 631914496 125730 33554432000 4194304 4417452 140736547100496 18446744073709551615 4369834 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2799.54
Current children cumulated vsize (KiB) 617104

[startup+762.313 s]
/proc/loadavg: 8.19 8.11 8.03 9/358 28492
/proc/meminfo: memFree=20808668/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=698332 CPUtime=3038.93 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 1790990 1250 0 0 303649 244 0 0 25 0 5 0 634631739 715091968 146037 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 174583 146037 180 55 0 172469 0
[pid=28207/tid=28214] ppid=28205 vsize=698332 CPUtime=761.93 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 431528 1250 0 0 76138 55 0 0 25 0 5 0 634631774 715091968 146037 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=698332 CPUtime=758.99 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 346764 1250 0 0 75852 47 0 0 25 0 5 0 634631774 715091968 146037 33554432000 4194304 4417452 140736547100496 18446744073709551615 4311289 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=698332 CPUtime=756.45 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 310290 1250 0 0 75606 39 0 0 25 0 5 0 634631774 715091968 146037 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=698332 CPUtime=761.18 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 684116 1250 0 0 76019 99 0 0 25 0 5 0 634631774 715091968 146037 33554432000 4194304 4417452 140736547100496 18446744073709551615 4357902 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3038.93
Current children cumulated vsize (KiB) 698332

[startup+822.3 s]
/proc/loadavg: 8.12 8.10 8.03 9/358 28493
/proc/meminfo: memFree=20628852/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=867616 CPUtime=3278.23 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 1973436 1250 0 0 327557 266 0 0 25 0 5 0 634631739 888438784 188358 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 216904 188358 180 55 0 214790 0
[pid=28207/tid=28214] ppid=28205 vsize=867616 CPUtime=821.92 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 491944 1250 0 0 82130 62 0 0 25 0 5 0 634631774 888438784 188358 33554432000 4194304 4417452 140736547100496 18446744073709551615 4250633 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=867616 CPUtime=818.98 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 383061 1250 0 0 81847 51 0 0 25 0 5 0 634631774 888438784 188358 33554432000 4194304 4417452 140736547100496 18446744073709551615 4358737 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=867616 CPUtime=815.77 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 369653 1250 0 0 81532 45 0 0 25 0 5 0 634631774 888438784 188358 33554432000 4194304 4417452 140736547100496 18446744073709551615 4277684 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=867616 CPUtime=821.17 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 710486 1250 0 0 82014 103 0 0 25 0 5 0 634631774 888438784 188358 33554432000 4194304 4417452 140736547100496 18446744073709551615 4357379 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3278.23
Current children cumulated vsize (KiB) 867616

[startup+882.301 s]
/proc/loadavg: 8.04 8.08 8.02 9/358 28495
/proc/meminfo: memFree=20746260/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=672464 CPUtime=3517.56 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 2096224 1250 0 0 351471 285 0 0 25 0 5 0 634631739 688603136 139570 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 168116 139570 180 55 0 166002 0
[pid=28207/tid=28214] ppid=28205 vsize=672464 CPUtime=881.93 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 550696 1250 0 0 88122 71 0 0 25 0 5 0 634631774 688603136 139570 33554432000 4194304 4417452 140736547100496 18446744073709551615 4358181 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=672464 CPUtime=878.98 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 425266 1250 0 0 87840 58 0 0 25 0 5 0 634631774 688603136 139570 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=672464 CPUtime=875.11 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 391484 1250 0 0 87462 49 0 0 25 0 5 0 634631774 688603136 139570 33554432000 4194304 4417452 140736547100496 18446744073709551615 4365936 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=672464 CPUtime=881.17 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 710486 1250 0 0 88014 103 0 0 25 0 5 0 634631774 688603136 139570 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364542 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3517.56
Current children cumulated vsize (KiB) 672464

[startup+942.3 s]
/proc/loadavg: 8.01 8.06 8.02 9/358 28497
/proc/meminfo: memFree=20632164/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=748536 CPUtime=3756.9 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 2196136 1250 0 0 375392 298 0 0 25 0 5 0 634631739 766500864 158588 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 187134 158588 180 55 0 185020 0
[pid=28207/tid=28214] ppid=28205 vsize=748536 CPUtime=941.93 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 563038 1250 0 0 94120 73 0 0 25 0 5 0 634631774 766500864 158588 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=748536 CPUtime=938.97 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 440853 1250 0 0 93837 60 0 0 25 0 5 0 634631774 766500864 158588 33554432000 4194304 4417452 140736547100496 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=748536 CPUtime=934.45 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 463467 1250 0 0 93387 58 0 0 25 0 5 0 634631774 766500864 158588 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=748536 CPUtime=941.17 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 710486 1250 0 0 94014 103 0 0 25 0 5 0 634631774 766500864 158588 33554432000 4194304 4417452 140736547100496 18446744073709551615 4232656 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3756.9
Current children cumulated vsize (KiB) 748536

[startup+1002.3 s]
/proc/loadavg: 8.00 8.05 8.01 9/358 28498
/proc/meminfo: memFree=20392712/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=981740 CPUtime=3996.23 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 2346232 1250 0 0 399305 318 0 0 25 0 5 0 634631739 1005301760 216889 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 245435 216889 180 55 0 243321 0
[pid=28207/tid=28214] ppid=28205 vsize=981740 CPUtime=1001.93 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 591086 1250 0 0 100117 76 0 0 25 0 5 0 634631774 1005301760 216889 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=981740 CPUtime=998.97 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 477929 1250 0 0 99832 65 0 0 25 0 5 0 634631774 1005301760 216889 33554432000 4194304 4417452 140736547100496 18446744073709551615 4366074 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=981740 CPUtime=993.78 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 493640 1250 0 0 99316 62 0 0 25 0 5 0 634631774 1005301760 216889 33554432000 4194304 4417452 140736547100496 18446744073709551615 4366646 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=981740 CPUtime=1001.18 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 765285 1250 0 0 100007 111 0 0 25 0 5 0 634631774 1005301760 216889 33554432000 4194304 4417452 140736547100496 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3996.23
Current children cumulated vsize (KiB) 981740

[startup+1062.3 s]
/proc/loadavg: 8.00 8.04 8.01 9/358 28500
/proc/meminfo: memFree=20648996/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=682248 CPUtime=4235.58 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 2580718 1250 0 0 423202 356 0 0 25 0 5 0 634631739 698621952 142016 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 170562 142016 180 55 0 168448 0
[pid=28207/tid=28214] ppid=28205 vsize=682248 CPUtime=1061.93 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 618351 1250 0 0 106113 80 0 0 25 0 5 0 634631774 698621952 142016 33554432000 4194304 4417452 140736547100496 18446744073709551615 4356984 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=682248 CPUtime=1058.98 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 549146 1250 0 0 105822 76 0 0 25 0 5 0 634631774 698621952 142016 33554432000 4194304 4417452 140736547100496 18446744073709551615 4244345 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=682248 CPUtime=1053.13 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 524522 1250 0 0 105247 66 0 0 25 0 5 0 634631774 698621952 142016 33554432000 4194304 4417452 140736547100496 18446744073709551615 4250623 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=682248 CPUtime=1061.18 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 870407 1250 0 0 105987 131 0 0 25 0 5 0 634631774 698621952 142016 33554432000 4194304 4417452 140736547100496 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4235.58
Current children cumulated vsize (KiB) 682248

[startup+1122.3 s]
/proc/loadavg: 8.08 8.06 8.01 9/358 28501
/proc/meminfo: memFree=20331024/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=1045116 CPUtime=4474.91 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 2791029 1250 0 0 447105 386 0 0 25 0 5 0 634631739 1070198784 232733 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 261279 232733 180 55 0 259165 0
[pid=28207/tid=28214] ppid=28205 vsize=1045116 CPUtime=1121.92 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 646891 1250 0 0 112108 84 0 0 25 0 5 0 634631774 1070198784 232733 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=1045116 CPUtime=1118.98 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 605356 1250 0 0 111815 83 0 0 25 0 5 0 634631774 1070198784 232733 33554432000 4194304 4417452 140736547100496 18446744073709551615 4357536 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=1045116 CPUtime=1112.45 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 557258 1250 0 0 111175 70 0 0 25 0 5 0 634631774 1070198784 232733 33554432000 4194304 4417452 140736547100496 18446744073709551615 4309972 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=1045116 CPUtime=1121.18 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 963232 1250 0 0 111974 144 0 0 25 0 5 0 634631774 1070198784 232733 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4474.91
Current children cumulated vsize (KiB) 1045116

[startup+1182.3 s]
/proc/loadavg: 8.10 8.07 8.02 9/358 28503
/proc/meminfo: memFree=20516476/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=820740 CPUtime=4714.26 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 2968603 1250 0 0 471012 414 0 0 25 0 5 0 634631739 840437760 176639 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 205185 176639 180 55 0 203071 0
[pid=28207/tid=28214] ppid=28205 vsize=820740 CPUtime=1181.93 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 671472 1250 0 0 118106 87 0 0 25 0 5 0 634631774 840437760 176639 33554432000 4194304 4417452 140736547100496 18446744073709551615 4265009 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=820740 CPUtime=1178.98 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 636251 1250 0 0 117811 87 0 0 25 0 5 0 634631774 840437760 176639 33554432000 4194304 4417452 140736547100496 18446744073709551615 4270293 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=820740 CPUtime=1171.79 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 576130 1250 0 0 117107 72 0 0 25 0 5 0 634631774 840437760 176639 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=820740 CPUtime=1181.18 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 1066458 1250 0 0 117955 163 0 0 25 0 5 0 634631774 840437760 176639 33554432000 4194304 4417452 140736547100496 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4714.26
Current children cumulated vsize (KiB) 820740



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.8 s]
/proc/loadavg: 8.19 8.10 8.02 9/358 28504
/proc/meminfo: memFree=20613804/32951124 swapFree=67111348/67111528
[pid=28207] ppid=28205 vsize=735520 CPUtime=4800.05 cores=0,2,4,6
/proc/28207/stat : 28207 (plingeling) S 28205 28207 27864 0 -1 4202496 3040653 1250 0 0 479582 423 0 0 25 0 5 0 634631739 753172480 155334 33554432000 4194304 4417452 140736547100496 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/28207/statm: 183880 155334 180 55 0 181766 0
[pid=28207/tid=28214] ppid=28205 vsize=735520 CPUtime=1203.45 cores=0,2,4,6
/proc/28207/task/28214/stat : 28214 (plingeling) R 28205 28207 27864 0 -1 4202560 672362 1250 0 0 120257 88 0 0 25 0 5 0 634631774 753172480 155334 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28207/tid=28215] ppid=28205 vsize=735520 CPUtime=1200.49 cores=0,2,4,6
/proc/28207/task/28215/stat : 28215 (plingeling) R 28205 28207 27864 0 -1 4202560 647939 1250 0 0 119960 89 0 0 25 0 5 0 634631774 753172480 155334 33554432000 4194304 4417452 140736547100496 18446744073709551615 4346458 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=28207/tid=28216] ppid=28205 vsize=735520 CPUtime=1193.06 cores=0,2,4,6
/proc/28207/task/28216/stat : 28216 (plingeling) R 28205 28207 27864 0 -1 4202560 597500 1250 0 0 119231 75 0 0 25 0 5 0 634631774 753172480 155334 33554432000 4194304 4417452 140736547100496 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28207/tid=28217] ppid=28205 vsize=735520 CPUtime=1202.69 cores=0,2,4,6
/proc/28207/task/28217/stat : 28217 (plingeling) R 28205 28207 27864 0 -1 4202560 1104560 1250 0 0 120101 168 0 0 25 0 5 0 634631774 753172480 155334 33554432000 4194304 4417452 140736547100496 18446744073709551615 4357942 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.05
Current children cumulated vsize (KiB) 735520

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.85
CPU time (s): 4800.12
CPU user time (s): 4795.86
CPU system time (s): 4.26835
CPU usage (%): 398.732
Max. virtual memory (cumulated for all children) (KiB): 1291668

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.86
system time used= 4.26835
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3041904
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 181
involuntary context switches= 26475

runsolver used 3.82742 second user time and 9.32558 second system time

The end

Launcher Data 

Begin job on node144 at 2011-05-15 03:15:56
IDJOB=3371471
IDBENCH=82462
IDSOLVER=1848
FILE ID=node144/3371471-1305422156
RUNJOBID= node144-1305419670-27882
PBS_JOBID= 13324583
Free space on /tmp= 73236 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/jarvisalo/smtqfbv-aigs/smtlib-qfbv-aigs-countbits128-tseitin.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371471-1305422156/watcher-3371471-1305422156 -o /tmp/evaluation-result-3371471-1305422156/solver-3371471-1305422156 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371471-1305422156.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 47da9e46b00ffd3e0b0f453a6c3c9f38
RANDOM SEED=1344950862

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21391944 kB
Buffers:        292412 kB
Cached:        3632876 kB
SwapCached:          0 kB
Active:        8390688 kB
Inactive:      2822364 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21391944 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            5092 kB
Writeback:           0 kB
AnonPages:     7287848 kB
Mapped:          27612 kB
Slab:           244832 kB
PageTables:      37672 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 82199092 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73232 MiB
End job on node144 at 2011-05-15 03:36:02