Trace number 3394446

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.8 5011.48

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x14.cnf
MD5SUMf76302f2442dfc7cabc2315e61e55fea
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1176
Number of clauses78498
Sum of the clauses size310464
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21764
Number of clauses of size 30
Number of clauses of size 476734
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394446-1306096356/watcher-3394446-1306096356 -o /tmp/evaluation-result-3394446-1306096356/solver-3394446-1306096356 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394446-1306096356.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.47 7.92 7.96 1/517 12835
/proc/meminfo: memFree=10110608/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=10408 CPUtime=0 cores=0-7
/proc/12835/stat : 12835 (plingeling) R 12833 12835 12622 0 -1 4202496 669 1251 0 0 0 0 0 0 25 0 1 0 721233346 10657792 600 33554432000 4194304 4417452 140737023404832 18446744073709551615 218905730816 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/12835/statm: 2602 600 147 55 0 488 0

[startup+0.07497 s]
/proc/loadavg: 7.47 7.92 7.96 1/517 12835
/proc/meminfo: memFree=10110608/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=26600 CPUtime=0.06 cores=0-7
/proc/12835/stat : 12835 (plingeling) R 12833 12835 12622 0 -1 4202496 4990 1251 0 0 6 0 0 0 25 0 1 0 721233346 27238400 4673 33554432000 4194304 4417452 140737023404832 18446744073709551615 4259629 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/12835/statm: 6650 4673 148 55 0 4536 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 26600

[startup+0.100964 s]
/proc/loadavg: 7.47 7.92 7.96 1/517 12835
/proc/meminfo: memFree=10110608/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=34792 CPUtime=0.09 cores=0-7
/proc/12835/stat : 12835 (plingeling) R 12833 12835 12622 0 -1 4202496 7038 1251 0 0 8 1 0 0 25 0 1 0 721233346 35627008 6721 33554432000 4194304 4417452 140737023404832 18446744073709551615 4323193 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/12835/statm: 8698 6721 148 55 0 6584 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 34792

[startup+0.300902 s]
/proc/loadavg: 7.47 7.92 7.96 1/517 12835
/proc/meminfo: memFree=10110608/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=195376 CPUtime=1.07 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 11085 1251 0 0 105 2 0 0 19 0 9 0 721233346 200065024 9529 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 48844 9529 178 55 0 46730 0
Current children cumulated CPU time (s) 1.07
Current children cumulated vsize (KiB) 195376

[startup+0.7008 s]
/proc/loadavg: 7.47 7.92 7.96 1/517 12835
/proc/meminfo: memFree=10110608/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=222108 CPUtime=4.25 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 19107 1251 0 0 421 4 0 0 19 0 9 0 721233346 227438592 16735 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 55527 16735 180 55 0 53413 0
Current children cumulated CPU time (s) 4.25
Current children cumulated vsize (KiB) 222108

[startup+1.50065 s]
/proc/loadavg: 7.47 7.92 7.96 9/526 12849
/proc/meminfo: memFree=10016544/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=267544 CPUtime=10.63 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 31715 1251 0 0 1056 7 0 0 19 0 9 0 721233346 273965056 28102 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 66886 28102 180 55 0 64772 0
[pid=12835/tid=12842] ppid=12833 vsize=267544 CPUtime=1.29 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 2760 1251 0 0 129 0 0 0 25 0 9 0 721233363 273965056 28102 33554432000 4194304 4417452 140737023404832 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=267544 CPUtime=1.31 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 2746 1251 0 0 131 0 0 0 25 0 9 0 721233363 273965056 28102 33554432000 4194304 4417452 140737023404832 18446744073709551615 4249181 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=267544 CPUtime=1.32 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 2672 1251 0 0 132 0 0 0 19 0 9 0 721233363 273965056 28102 33554432000 4194304 4417452 140737023404832 18446744073709551615 4258267 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=267544 CPUtime=1.32 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 3528 1251 0 0 131 1 0 0 19 0 9 0 721233363 273965056 28102 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364805 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=267544 CPUtime=1.32 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 2753 1251 0 0 132 0 0 0 19 0 9 0 721233363 273965056 28102 33554432000 4194304 4417452 140737023404832 18446744073709551615 4249181 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=267544 CPUtime=1.27 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 2774 1251 0 0 127 0 0 0 22 0 9 0 721233363 273965056 28102 33554432000 4194304 4417452 140737023404832 18446744073709551615 4258180 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=267544 CPUtime=1.24 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 2670 1251 0 0 124 0 0 0 25 0 9 0 721233363 273965056 28102 33554432000 4194304 4417452 140737023404832 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=267544 CPUtime=1.32 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 2710 1251 0 0 132 0 0 0 19 0 9 0 721233363 273965056 28102 33554432000 4194304 4417452 140737023404832 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 10.63
Current children cumulated vsize (KiB) 267544

[startup+3.10036 s]
/proc/loadavg: 7.47 7.92 7.96 9/526 12849
/proc/meminfo: memFree=10005884/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=245636 CPUtime=23.41 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 45830 1251 0 0 2331 10 0 0 19 0 9 0 721233346 251531264 22609 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 61409 22609 180 55 0 59295 0
[pid=12835/tid=12842] ppid=12833 vsize=245636 CPUtime=2.87 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 3036 1251 0 0 287 0 0 0 25 0 9 0 721233363 251531264 22609 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=245636 CPUtime=2.9 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 5264 1251 0 0 290 0 0 0 25 0 9 0 721233363 251531264 22609 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=245636 CPUtime=2.92 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 6755 1251 0 0 291 1 0 0 24 0 9 0 721233363 251531264 22609 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=245636 CPUtime=2.92 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 5608 1251 0 0 291 1 0 0 23 0 9 0 721233363 251531264 22609 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=245636 CPUtime=2.92 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 4190 1251 0 0 291 1 0 0 25 0 9 0 721233363 251531264 22609 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=245636 CPUtime=2.87 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 4507 1251 0 0 286 1 0 0 25 0 9 0 721233363 251531264 22609 33554432000 4194304 4417452 140737023404832 18446744073709551615 4250524 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=245636 CPUtime=2.85 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 3850 1251 0 0 284 1 0 0 25 0 9 0 721233363 251531264 22609 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=245636 CPUtime=2.92 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 3518 1251 0 0 292 0 0 0 25 0 9 0 721233363 251531264 22609 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 23.41
Current children cumulated vsize (KiB) 245636

[startup+6.30078 s]
/proc/loadavg: 7.52 7.92 7.96 9/526 12849
/proc/meminfo: memFree=9999932/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=275308 CPUtime=48.95 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 73892 1251 0 0 4881 14 0 0 19 0 9 0 721233346 281915392 30130 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 68827 30130 180 55 0 66713 0
[pid=12835/tid=12842] ppid=12833 vsize=275308 CPUtime=6.02 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 4772 1251 0 0 601 1 0 0 25 0 9 0 721233363 281915392 30130 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364687 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=275308 CPUtime=6.11 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 8968 1251 0 0 610 1 0 0 25 0 9 0 721233363 281915392 30130 33554432000 4194304 4417452 140737023404832 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=275308 CPUtime=6.12 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 13147 1251 0 0 610 2 0 0 25 0 9 0 721233363 281915392 30130 33554432000 4194304 4417452 140737023404832 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=275308 CPUtime=6.12 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 10257 1251 0 0 610 2 0 0 25 0 9 0 721233363 281915392 30130 33554432000 4194304 4417452 140737023404832 18446744073709551615 4366813 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=275308 CPUtime=6.12 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 6829 1251 0 0 611 1 0 0 25 0 9 0 721233363 281915392 30130 33554432000 4194304 4417452 140737023404832 18446744073709551615 4250771 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=275308 CPUtime=6.07 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 7758 1251 0 0 605 2 0 0 25 0 9 0 721233363 281915392 30130 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=275308 CPUtime=6.05 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 6810 1251 0 0 604 1 0 0 25 0 9 0 721233363 281915392 30130 33554432000 4194304 4417452 140737023404832 18446744073709551615 4241931 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=275308 CPUtime=6.11 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 6249 1251 0 0 611 0 0 0 25 0 9 0 721233363 281915392 30130 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 48.95
Current children cumulated vsize (KiB) 275308

[startup+12.7006 s]
/proc/loadavg: 7.56 7.93 7.96 9/526 12849
/proc/meminfo: memFree=9935000/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=339444 CPUtime=100.04 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 138989 1251 0 0 9980 24 0 0 19 0 9 0 721233346 347590656 46132 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 84861 46132 180 55 0 82747 0
[pid=12835/tid=12842] ppid=12833 vsize=339444 CPUtime=12.3 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 13746 1251 0 0 1228 2 0 0 25 0 9 0 721233363 347590656 46132 33554432000 4194304 4417452 140737023404832 18446744073709551615 4354524 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=339444 CPUtime=12.51 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 16546 1251 0 0 1249 2 0 0 25 0 9 0 721233363 347590656 46132 33554432000 4194304 4417452 140737023404832 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=339444 CPUtime=12.52 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 25910 1251 0 0 1248 4 0 0 25 0 9 0 721233363 347590656 46132 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=339444 CPUtime=12.51 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 16464 1251 0 0 1249 2 0 0 25 0 9 0 721233363 347590656 46132 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=339444 CPUtime=12.52 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 13224 1251 0 0 1250 2 0 0 25 0 9 0 721233363 347590656 46132 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=339444 CPUtime=12.47 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 18214 1251 0 0 1243 4 0 0 25 0 9 0 721233363 347590656 46132 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364791 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=339444 CPUtime=12.44 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 12344 1251 0 0 1243 1 0 0 25 0 9 0 721233363 347590656 46132 33554432000 4194304 4417452 140737023404832 18446744073709551615 4357213 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=339444 CPUtime=12.51 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 13439 1251 0 0 1250 1 0 0 25 0 9 0 721233363 347590656 46132 33554432000 4194304 4417452 140737023404832 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 100.04
Current children cumulated vsize (KiB) 339444

[startup+25.5013 s]
/proc/loadavg: 7.65 7.93 7.96 9/526 12850
/proc/meminfo: memFree=9877040/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=389508 CPUtime=202.19 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 206458 1251 0 0 20185 34 0 0 19 0 9 0 721233346 398856192 58648 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 97377 58648 180 55 0 95263 0
[pid=12835/tid=12842] ppid=12833 vsize=389508 CPUtime=24.88 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 29383 1251 0 0 2483 5 0 0 25 0 9 0 721233363 398856192 58648 33554432000 4194304 4417452 140737023404832 18446744073709551615 4320914 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=389508 CPUtime=25.31 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 30616 1251 0 0 2527 4 0 0 25 0 9 0 721233363 398856192 58648 33554432000 4194304 4417452 140737023404832 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=389508 CPUtime=25.32 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 32497 1251 0 0 2527 5 0 0 25 0 9 0 721233363 398856192 58648 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=389508 CPUtime=25.32 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 24493 1251 0 0 2528 4 0 0 25 0 9 0 721233363 398856192 58648 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=389508 CPUtime=25.32 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 21585 1251 0 0 2528 4 0 0 25 0 9 0 721233363 398856192 58648 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=389508 CPUtime=25.28 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 23977 1251 0 0 2523 5 0 0 25 0 9 0 721233363 398856192 58648 33554432000 4194304 4417452 140737023404832 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=389508 CPUtime=25.25 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 15081 1251 0 0 2523 2 0 0 25 0 9 0 721233363 398856192 58648 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=389508 CPUtime=25.31 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 19724 1251 0 0 2529 2 0 0 25 0 9 0 721233363 398856192 58648 33554432000 4194304 4417452 140737023404832 18446744073709551615 4354501 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 202.19
Current children cumulated vsize (KiB) 389508

[startup+51.1007 s]
/proc/loadavg: 7.77 7.93 7.96 9/526 12850
/proc/meminfo: memFree=9771960/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=486764 CPUtime=406.54 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 373249 1251 0 0 40591 63 0 0 19 0 9 0 721233346 498446336 82966 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 121691 82966 180 55 0 119577 0
[pid=12835/tid=12842] ppid=12833 vsize=486764 CPUtime=50.04 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 50654 1251 0 0 4996 8 0 0 25 0 9 0 721233363 498446336 82966 33554432000 4194304 4417452 140737023404832 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=486764 CPUtime=50.91 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 56693 1251 0 0 5084 7 0 0 25 0 9 0 721233363 498446336 82966 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=486764 CPUtime=50.91 cores=0-7

################
# More data... #
################


[startup+4722.32 s]
/proc/loadavg: 8.03 8.05 8.00 9/526 12987
/proc/meminfo: memFree=5292524/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=4964560 CPUtime=37693.6 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 16719450 1251 0 0 3765724 3638 0 0 19 0 9 0 721233346 5083709440 1202411 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 1241140 1202411 180 55 0 1239026 0
[pid=12835/tid=12842] ppid=12833 vsize=4964560 CPUtime=4719.34 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 2648979 1251 0 0 471453 481 0 0 25 0 9 0 721233363 5083709440 1202411 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=4964560 CPUtime=4643.04 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 1652651 1251 0 0 463975 329 0 0 25 0 9 0 721233363 5083709440 1202411 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=4964560 CPUtime=4722.26 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 2540247 1251 0 0 471734 492 0 0 25 0 9 0 721233363 5083709440 1202411 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=4964560 CPUtime=4722.26 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 451343 1251 0 0 472095 131 0 0 25 0 9 0 721233363 5083709440 1202411 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=4964560 CPUtime=4722.23 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 2197371 1251 0 0 471758 465 0 0 25 0 9 0 721233363 5083709440 1202411 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=4964560 CPUtime=4720.11 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 2297131 1251 0 0 471476 535 0 0 25 0 9 0 721233363 5083709440 1202411 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=4964560 CPUtime=4722.15 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 2233710 1251 0 0 471679 536 0 0 25 0 9 0 721233363 5083709440 1202411 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=4964560 CPUtime=4721.96 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 2688916 1251 0 0 471533 663 0 0 25 0 9 0 721233363 5083709440 1202411 33554432000 4194304 4417452 140737023404832 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37693.6
Current children cumulated vsize (KiB) 4964560

[startup+4782.3 s]
/proc/loadavg: 8.07 8.05 8.00 9/526 12989
/proc/meminfo: memFree=4725908/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=5530096 CPUtime=38172.4 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 17016536 1251 0 0 3813535 3708 0 0 19 0 9 0 721233346 5662818304 1343795 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 1382524 1343795 180 55 0 1380410 0
[pid=12835/tid=12842] ppid=12833 vsize=5530096 CPUtime=4779.33 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 2682066 1251 0 0 477442 491 0 0 25 0 9 0 721233363 5662818304 1343795 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=5530096 CPUtime=4701.99 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 1652651 1251 0 0 469870 329 0 0 25 0 9 0 721233363 5662818304 1343795 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=5530096 CPUtime=4782.25 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 2576317 1251 0 0 477725 500 0 0 25 0 9 0 721233363 5662818304 1343795 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=5530096 CPUtime=4782.26 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 451343 1251 0 0 478094 132 0 0 25 0 9 0 721233363 5662818304 1343795 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=5530096 CPUtime=4782.22 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 2350795 1251 0 0 477724 498 0 0 25 0 9 0 721233363 5662818304 1343795 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=5530096 CPUtime=4780.08 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 2311862 1251 0 0 477469 539 0 0 25 0 9 0 721233363 5662818304 1343795 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=5530096 CPUtime=4782.13 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 2275468 1251 0 0 477668 545 0 0 25 0 9 0 721233363 5662818304 1343795 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=5530096 CPUtime=4781.94 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 2706932 1251 0 0 477525 669 0 0 25 0 9 0 721233363 5662818304 1343795 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38172.4
Current children cumulated vsize (KiB) 5530096

[startup+4842.3 s]
/proc/loadavg: 8.08 8.06 8.00 9/526 12990
/proc/meminfo: memFree=5046116/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=5226860 CPUtime=38651.4 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 17409386 1251 0 0 3861352 3783 0 0 19 0 9 0 721233346 5352304640 1267986 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 1306715 1267986 180 55 0 1304601 0
[pid=12835/tid=12842] ppid=12833 vsize=5226860 CPUtime=4839.33 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 2707316 1251 0 0 483437 496 0 0 25 0 9 0 721233363 5352304640 1267986 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=5226860 CPUtime=4760.95 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 1664200 1251 0 0 475764 331 0 0 25 0 9 0 721233363 5352304640 1267986 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=5226860 CPUtime=4842.25 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 2683024 1251 0 0 483705 520 0 0 25 0 9 0 721233363 5352304640 1267986 33554432000 4194304 4417452 140737023404832 18446744073709551615 4343748 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=5226860 CPUtime=4842.26 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 451343 1251 0 0 484094 132 0 0 25 0 9 0 721233363 5352304640 1267986 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=5226860 CPUtime=4842.21 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 2532999 1251 0 0 483697 524 0 0 25 0 9 0 721233363 5352304640 1267986 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=5226860 CPUtime=4840.05 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 2335180 1251 0 0 483457 548 0 0 25 0 9 0 721233363 5352304640 1267986 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=5226860 CPUtime=4842.13 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 2275468 1251 0 0 483668 545 0 0 25 0 9 0 721233363 5352304640 1267986 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=5226860 CPUtime=4841.94 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 2750754 1251 0 0 483511 683 0 0 25 0 9 0 721233363 5352304640 1267986 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38651.3
Current children cumulated vsize (KiB) 5226860

[startup+4902.3 s]
/proc/loadavg: 8.13 8.08 8.01 9/526 12992
/proc/meminfo: memFree=5419172/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=4840740 CPUtime=39130.3 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 17528232 1251 0 0 3909219 3812 0 0 19 0 9 0 721233346 4956917760 1171456 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 1210185 1171456 180 55 0 1208071 0
[pid=12835/tid=12842] ppid=12833 vsize=4840740 CPUtime=4899.33 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 2752141 1251 0 0 489428 505 0 0 25 0 9 0 721233363 4956917760 1171456 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=4840740 CPUtime=4819.91 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 1664200 1251 0 0 481660 331 0 0 25 0 9 0 721233363 4956917760 1171456 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=4840740 CPUtime=4902.25 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 2683024 1251 0 0 489705 520 0 0 25 0 9 0 721233363 4956917760 1171456 33554432000 4194304 4417452 140737023404832 18446744073709551615 4357232 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=4840740 CPUtime=4902.26 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 451343 1251 0 0 490094 132 0 0 25 0 9 0 721233363 4956917760 1171456 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=4840740 CPUtime=4902.21 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 2532999 1251 0 0 489697 524 0 0 25 0 9 0 721233363 4956917760 1171456 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=4840740 CPUtime=4900.04 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 2397213 1251 0 0 489439 565 0 0 25 0 9 0 721233363 4956917760 1171456 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=4840740 CPUtime=4902.13 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 2287456 1251 0 0 489665 548 0 0 25 0 9 0 721233363 4956917760 1171456 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=4840740 CPUtime=4901.94 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 2750754 1251 0 0 489511 683 0 0 25 0 9 0 721233363 4956917760 1171456 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39130.3
Current children cumulated vsize (KiB) 4840740

[startup+4962.3 s]
/proc/loadavg: 8.15 8.09 8.01 9/526 12993
/proc/meminfo: memFree=5261704/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=4998584 CPUtime=39609.3 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 17731749 1251 0 0 3957072 3854 0 0 19 0 9 0 721233346 5118550016 1210919 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 1249646 1210919 180 55 0 1247532 0
[pid=12835/tid=12842] ppid=12833 vsize=4998584 CPUtime=4959.32 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 2779089 1251 0 0 495425 507 0 0 25 0 9 0 721233363 5118550016 1210919 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=4998584 CPUtime=4878.86 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 1664200 1251 0 0 487555 331 0 0 25 0 9 0 721233363 5118550016 1210919 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=4998584 CPUtime=4962.25 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 2690499 1251 0 0 495703 522 0 0 25 0 9 0 721233363 5118550016 1210919 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=4998584 CPUtime=4962.26 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 451343 1251 0 0 496094 132 0 0 25 0 9 0 721233363 5118550016 1210919 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=4998584 CPUtime=4962.22 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 2556738 1251 0 0 495695 527 0 0 25 0 9 0 721233363 5118550016 1210919 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=4998584 CPUtime=4960.03 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 2449949 1251 0 0 495426 577 0 0 25 0 9 0 721233363 5118550016 1210919 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=4998584 CPUtime=4962.14 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 2322554 1251 0 0 495659 555 0 0 25 0 9 0 721233363 5118550016 1210919 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=4998584 CPUtime=4961.95 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 2808275 1251 0 0 495496 699 0 0 25 0 9 0 721233363 5118550016 1210919 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39609.3
Current children cumulated vsize (KiB) 4998584



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.3 s]
/proc/loadavg: 8.06 8.07 8.01 9/526 12995
/proc/meminfo: memFree=5542632/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=4715116 CPUtime=40000.5 cores=0-7
/proc/12835/stat : 12835 (plingeling) S 12833 12835 12622 0 -1 4202496 17832956 1251 0 0 3996168 3878 0 0 19 0 9 0 721233346 4828278784 1140052 33554432000 4194304 4417452 140737023404832 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 1178779 1140052 180 55 0 1176665 0
[pid=12835/tid=12842] ppid=12833 vsize=4715116 CPUtime=5008.34 cores=0-7
/proc/12835/task/12842/stat : 12842 (plingeling) R 12833 12835 12622 0 -1 4202560 2791597 1251 0 0 500324 510 0 0 25 0 9 0 721233363 4828278784 1140052 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=4715116 CPUtime=4927.02 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4202560 1664200 1251 0 0 492371 331 0 0 25 0 9 0 721233363 4828278784 1140052 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12835/tid=12844] ppid=12833 vsize=4715116 CPUtime=5011.27 cores=0-7
/proc/12835/task/12844/stat : 12844 (plingeling) R 12833 12835 12622 0 -1 4202560 2690499 1251 0 0 500605 522 0 0 25 0 9 0 721233363 4828278784 1140052 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12835/tid=12845] ppid=12833 vsize=4715116 CPUtime=5011.28 cores=0-7
/proc/12835/task/12845/stat : 12845 (plingeling) R 12833 12835 12622 0 -1 4202560 451343 1251 0 0 500996 132 0 0 25 0 9 0 721233363 4828278784 1140052 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12835/tid=12846] ppid=12833 vsize=4715116 CPUtime=5011.24 cores=0-7
/proc/12835/task/12846/stat : 12846 (plingeling) R 12833 12835 12622 0 -1 4202560 2580767 1251 0 0 500589 535 0 0 25 0 9 0 721233363 4828278784 1140052 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12835/tid=12847] ppid=12833 vsize=4715116 CPUtime=5009.02 cores=0-7
/proc/12835/task/12847/stat : 12847 (plingeling) R 12833 12835 12622 0 -1 4202560 2484641 1251 0 0 500318 584 0 0 25 0 9 0 721233363 4828278784 1140052 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12835/tid=12848] ppid=12833 vsize=4715116 CPUtime=5011.16 cores=0-7
/proc/12835/task/12848/stat : 12848 (plingeling) R 12833 12835 12622 0 -1 4202560 2341071 1251 0 0 500558 558 0 0 25 0 9 0 721233363 4828278784 1140052 33554432000 4194304 4417452 140737023404832 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12835/tid=12849] ppid=12833 vsize=4715116 CPUtime=5010.97 cores=0-7
/proc/12835/task/12849/stat : 12849 (plingeling) R 12833 12835 12622 0 -1 4202560 2819736 1251 0 0 500395 702 0 0 25 0 9 0 721233363 4828278784 1140052 33554432000 4194304 4417452 140737023404832 18446744073709551615 4320823 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 4715116

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.43 s]
/proc/loadavg: 8.06 8.07 8.01 9/526 12995
/proc/meminfo: memFree=5542632/32951124 swapFree=62248548/67111528
[pid=12835] ppid=12833 vsize=0 CPUtime=40000.7 cores=0-7
/proc/12835/stat : 12835 (plingeling) Z 12833 12835 12622 0 -1 4203548 17832956 1251 0 0 3996181 3888 0 0 18 0 2 0 721233346 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/12835/statm: 0 0 0 0 0 0 0
[pid=12835/tid=12843] ppid=12833 vsize=0 CPUtime=4927.13 cores=0-7
/proc/12835/task/12843/stat : 12843 (plingeling) R 12833 12835 12622 0 -1 4203588 1664200 1251 0 0 492372 341 0 0 25 0 2 0 721233363 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.48
CPU time (s): 40000.8
CPU user time (s): 39961.8
CPU system time (s): 38.9451
CPU usage (%): 798.182
Max. virtual memory (cumulated for all children) (KiB): 6228292

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39961.8
system time used= 38.9451
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17834207
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 508
involuntary context switches= 192359

runsolver used 24.3613 second user time and 62.6755 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-22 22:32:36
IDJOB=3394446
IDBENCH=83167
IDSOLVER=1851
FILE ID=node137/3394446-1306096356
RUNJOBID= node137-1306091342-12636
PBS_JOBID= 13387939
Free space on /tmp= 73292 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x14.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394446-1306096356/watcher-3394446-1306096356 -o /tmp/evaluation-result-3394446-1306096356/solver-3394446-1306096356 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394446-1306096356.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f76302f2442dfc7cabc2315e61e55fea
RANDOM SEED=851974281

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10111004 kB
Buffers:        361988 kB
Cached:        8835840 kB
SwapCached:      25068 kB
Active:       11431276 kB
Inactive:     11103012 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10111004 kB
SwapTotal:    67111528 kB
SwapFree:     62248548 kB
Dirty:            1980 kB
Writeback:           0 kB
AnonPages:    13321836 kB
Mapped:          35244 kB
Slab:           159444 kB
PageTables:      74468 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 162514372 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73292 MiB
End job on node137 at 2011-05-22 23:56:10