Trace number 3394618

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.8 5009.35

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-18_312.cnf
MD5SUM1144bbd60c180aa5e72d35b74e9676cb
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables312
Number of clauses26889
Sum of the clauses size121302
Maximum clause length18
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 324180
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52709

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394618-1306100419/watcher-3394618-1306100419 -o /tmp/evaluation-result-3394618-1306100419/solver-3394618-1306100419 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394618-1306100419.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.61 7.99 7.99 2/436 11875
/proc/meminfo: memFree=17357644/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=10852 CPUtime=0 cores=0-7
/proc/11875/stat : 11875 (plingeling) R 11873 11875 11612 0 -1 4202496 885 1260 0 0 0 0 0 0 25 0 1 0 800272575 11112448 737 33554432000 4194304 4417452 140734005348448 18446744073709551615 231895490304 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/11875/statm: 2713 737 149 55 0 599 0

[startup+0.111191 s]
/proc/loadavg: 7.61 7.99 7.99 2/436 11875
/proc/meminfo: memFree=17357644/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=181708 CPUtime=0.28 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 7168 1260 0 0 28 0 0 0 25 0 9 0 800272575 186068992 6632 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 45427 6632 176 55 0 43313 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 181708

[startup+0.200175 s]
/proc/loadavg: 7.61 7.99 7.99 2/436 11875
/proc/meminfo: memFree=17357644/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=178772 CPUtime=0.99 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 7257 1260 0 0 99 0 0 0 25 0 9 0 800272575 183062528 5869 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 44693 5869 179 55 0 42579 0
Current children cumulated CPU time (s) 0.99
Current children cumulated vsize (KiB) 178772

[startup+0.300158 s]
/proc/loadavg: 7.61 7.99 7.99 2/436 11875
/proc/meminfo: memFree=17357644/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=177296 CPUtime=1.79 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 7617 1260 0 0 179 0 0 0 25 0 9 0 800272575 181551104 5658 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 44324 5658 179 55 0 42210 0
Current children cumulated CPU time (s) 1.79
Current children cumulated vsize (KiB) 177296

[startup+0.701083 s]
/proc/loadavg: 7.61 7.99 7.99 2/436 11875
/proc/meminfo: memFree=17357644/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=179700 CPUtime=4.99 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 8263 1260 0 0 499 0 0 0 25 0 9 0 800272575 184012800 6267 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 44925 6267 179 55 0 42811 0
Current children cumulated CPU time (s) 4.99
Current children cumulated vsize (KiB) 179700

[startup+1.50093 s]
/proc/loadavg: 7.61 7.99 7.99 9/445 11889
/proc/meminfo: memFree=17327992/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=189720 CPUtime=11.38 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 10977 1260 0 0 1137 1 0 0 25 0 9 0 800272575 194273280 8777 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 47430 8777 179 55 0 45316 0
[pid=11875/tid=11882] ppid=11873 vsize=189720 CPUtime=1.42 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 603 1260 0 0 142 0 0 0 20 0 9 0 800272583 194273280 8777 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=189720 CPUtime=1.41 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 827 1260 0 0 141 0 0 0 20 0 9 0 800272583 194273280 8777 33554432000 4194304 4417452 140734005348448 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=189720 CPUtime=1.42 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 651 1260 0 0 142 0 0 0 25 0 9 0 800272583 194273280 8777 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=189720 CPUtime=1.41 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 1228 1260 0 0 141 0 0 0 25 0 9 0 800272583 194273280 8777 33554432000 4194304 4417452 140734005348448 18446744073709551615 4358951 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=189720 CPUtime=1.4 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 602 1260 0 0 140 0 0 0 19 0 9 0 800272583 194273280 8777 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=189720 CPUtime=1.41 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 705 1260 0 0 141 0 0 0 19 0 9 0 800272584 194273280 8777 33554432000 4194304 4417452 140734005348448 18446744073709551615 18446744073699065904 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=189720 CPUtime=1.41 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 675 1260 0 0 141 0 0 0 25 0 9 0 800272584 194273280 8777 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=189720 CPUtime=1.38 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 514 1260 0 0 138 0 0 0 25 0 9 0 800272584 194273280 8777 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.38
Current children cumulated vsize (KiB) 189720

[startup+3.10063 s]
/proc/loadavg: 7.61 7.99 7.99 9/445 11889
/proc/meminfo: memFree=17315096/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=195268 CPUtime=24.15 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 14186 1260 0 0 2414 1 0 0 25 0 9 0 800272575 199954432 10199 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 48817 10199 179 55 0 46703 0
[pid=11875/tid=11882] ppid=11873 vsize=195268 CPUtime=3.02 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 738 1260 0 0 302 0 0 0 25 0 9 0 800272583 199954432 10199 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366126 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=195268 CPUtime=3.01 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 1111 1260 0 0 301 0 0 0 25 0 9 0 800272583 199954432 10199 33554432000 4194304 4417452 140734005348448 18446744073709551615 4356796 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=195268 CPUtime=3.02 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 876 1260 0 0 302 0 0 0 25 0 9 0 800272583 199954432 10199 33554432000 4194304 4417452 140734005348448 18446744073709551615 4353699 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=195268 CPUtime=3 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 2486 1260 0 0 300 0 0 0 25 0 9 0 800272583 199954432 10199 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=195268 CPUtime=3 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 861 1260 0 0 300 0 0 0 24 0 9 0 800272583 199954432 10199 33554432000 4194304 4417452 140734005348448 18446744073709551615 4365984 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=195268 CPUtime=3.01 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 1090 1260 0 0 301 0 0 0 25 0 9 0 800272584 199954432 10199 33554432000 4194304 4417452 140734005348448 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=195268 CPUtime=3.01 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 1087 1260 0 0 301 0 0 0 25 0 9 0 800272584 199954432 10199 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=195268 CPUtime=2.97 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 765 1260 0 0 297 0 0 0 25 0 9 0 800272584 199954432 10199 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366102 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.15
Current children cumulated vsize (KiB) 195268

[startup+6.30103 s]
/proc/loadavg: 7.64 7.99 7.99 9/445 11889
/proc/meminfo: memFree=17306964/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=207888 CPUtime=49.71 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 20041 1260 0 0 4969 2 0 0 25 0 9 0 800272575 212877312 13193 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 51972 13193 179 55 0 49858 0
[pid=11875/tid=11882] ppid=11873 vsize=207888 CPUtime=6.21 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 1443 1260 0 0 621 0 0 0 25 0 9 0 800272583 212877312 13193 33554432000 4194304 4417452 140734005348448 18446744073709551615 4331850 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=207888 CPUtime=6.21 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 1390 1260 0 0 621 0 0 0 25 0 9 0 800272583 212877312 13193 33554432000 4194304 4417452 140734005348448 18446744073709551615 4258394 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=207888 CPUtime=6.22 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 952 1260 0 0 622 0 0 0 25 0 9 0 800272583 212877312 13193 33554432000 4194304 4417452 140734005348448 18446744073709551615 4249976 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=207888 CPUtime=6.2 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 5899 1260 0 0 620 0 0 0 25 0 9 0 800272583 212877312 13193 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366102 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=207888 CPUtime=6.2 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 1059 1260 0 0 620 0 0 0 25 0 9 0 800272583 212877312 13193 33554432000 4194304 4417452 140734005348448 18446744073709551615 4248242 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=207888 CPUtime=6.21 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 1744 1260 0 0 621 0 0 0 25 0 9 0 800272584 212877312 13193 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=207888 CPUtime=6.21 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 1180 1260 0 0 621 0 0 0 25 0 9 0 800272584 212877312 13193 33554432000 4194304 4417452 140734005348448 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=207888 CPUtime=6.12 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 1202 1260 0 0 612 0 0 0 25 0 9 0 800272584 212877312 13193 33554432000 4194304 4417452 140734005348448 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.71
Current children cumulated vsize (KiB) 207888

[startup+12.7008 s]
/proc/loadavg: 7.67 7.99 7.99 9/445 11889
/proc/meminfo: memFree=17291356/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=218932 CPUtime=100.81 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 40897 1260 0 0 10075 6 0 0 25 0 9 0 800272575 224186368 15987 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 54733 15987 179 55 0 52619 0
[pid=11875/tid=11882] ppid=11873 vsize=218932 CPUtime=12.61 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 3198 1260 0 0 1261 0 0 0 25 0 9 0 800272583 224186368 15987 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=218932 CPUtime=12.61 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 4200 1260 0 0 1261 0 0 0 25 0 9 0 800272583 224186368 15987 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=218932 CPUtime=12.61 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 3413 1260 0 0 1261 0 0 0 25 0 9 0 800272583 224186368 15987 33554432000 4194304 4417452 140734005348448 18446744073709551615 4344164 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=218932 CPUtime=12.6 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 11269 1260 0 0 1258 2 0 0 25 0 9 0 800272583 224186368 15987 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366806 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=218932 CPUtime=12.59 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 3523 1260 0 0 1259 0 0 0 25 0 9 0 800272583 224186368 15987 33554432000 4194304 4417452 140734005348448 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=218932 CPUtime=12.61 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 2637 1260 0 0 1261 0 0 0 25 0 9 0 800272584 224186368 15987 33554432000 4194304 4417452 140734005348448 18446744073709551615 4251104 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=218932 CPUtime=12.61 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 3718 1260 0 0 1261 0 0 0 25 0 9 0 800272584 224186368 15987 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=218932 CPUtime=12.42 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 3767 1260 0 0 1242 0 0 0 25 0 9 0 800272584 224186368 15987 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.81
Current children cumulated vsize (KiB) 218932

[startup+25.5014 s]
/proc/loadavg: 7.82 8.01 8.00 9/445 11890
/proc/meminfo: memFree=17256660/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=253488 CPUtime=203.04 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 113538 1260 0 0 20282 22 0 0 25 0 9 0 800272575 259571712 24629 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 63372 24629 179 55 0 61258 0
[pid=11875/tid=11882] ppid=11873 vsize=253488 CPUtime=25.41 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 11631 1260 0 0 2539 2 0 0 25 0 9 0 800272583 259571712 24629 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=253488 CPUtime=25.42 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 11800 1260 0 0 2540 2 0 0 25 0 9 0 800272583 259571712 24629 33554432000 4194304 4417452 140734005348448 18446744073709551615 4251167 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=253488 CPUtime=25.41 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 10183 1260 0 0 2540 1 0 0 25 0 9 0 800272583 259571712 24629 33554432000 4194304 4417452 140734005348448 18446744073709551615 4365949 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=253488 CPUtime=25.4 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 23810 1260 0 0 2535 5 0 0 25 0 9 0 800272583 259571712 24629 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=253488 CPUtime=25.39 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 14551 1260 0 0 2537 2 0 0 25 0 9 0 800272583 259571712 24629 33554432000 4194304 4417452 140734005348448 18446744073709551615 4365181 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=253488 CPUtime=25.41 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 10942 1260 0 0 2539 2 0 0 25 0 9 0 800272584 259571712 24629 33554432000 4194304 4417452 140734005348448 18446744073709551615 4344164 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=253488 CPUtime=25.41 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 15247 1260 0 0 2539 2 0 0 25 0 9 0 800272584 259571712 24629 33554432000 4194304 4417452 140734005348448 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=253488 CPUtime=25.04 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 10202 1260 0 0 2503 1 0 0 25 0 9 0 800272584 259571712 24629 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.04
Current children cumulated vsize (KiB) 253488

[startup+51.1006 s]
/proc/loadavg: 7.88 8.01 8.00 9/445 11890
/proc/meminfo: memFree=17243920/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=277792 CPUtime=407.48 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 259576 1260 0 0 40694 54 0 0 25 0 9 0 800272575 284459008 30703 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 69448 30703 179 55 0 67334 0
[pid=11875/tid=11882] ppid=11873 vsize=277792 CPUtime=51.01 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 28082 1260 0 0 5096 5 0 0 25 0 9 0 800272583 284459008 30703 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=277792 CPUtime=51.01 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 26900 1260 0 0 5096 5 0 0 25 0 9 0 800272583 284459008 30703 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=277792 CPUtime=51.01 cores=0-7

################
# More data... #
################

/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 2327135 1260 0 0 465730 395 0 0 25 0 9 0 800272583 763179008 147565 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=745292 CPUtime=4662.33 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 1588477 1260 0 0 465958 275 0 0 25 0 9 0 800272583 763179008 147565 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=745292 CPUtime=4598.7 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 1673012 1260 0 0 459561 309 0 0 25 0 9 0 800272584 763179008 147565 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=745292 CPUtime=4661.54 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 1605697 1260 0 0 465864 290 0 0 25 0 9 0 800272584 763179008 147565 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=745292 CPUtime=4658.79 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 1549908 1260 0 0 465602 277 0 0 25 0 9 0 800272584 763179008 147565 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37229.7
Current children cumulated vsize (KiB) 745292

[startup+4722.3 s]
/proc/loadavg: 8.04 8.02 8.00 9/445 12027
/proc/meminfo: memFree=16734652/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=776348 CPUtime=37708.9 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 13747916 1260 0 0 3768467 2424 0 0 25 0 9 0 800272575 794980352 155330 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 194087 155330 179 55 0 191973 0
[pid=11875/tid=11882] ppid=11873 vsize=776348 CPUtime=4722.37 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 1607015 1260 0 0 471953 284 0 0 25 0 9 0 800272583 794980352 155330 33554432000 4194304 4417452 140734005348448 18446744073709551615 4343993 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=776348 CPUtime=4722.27 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 1625228 1260 0 0 471932 295 0 0 25 0 9 0 800272583 794980352 155330 33554432000 4194304 4417452 140734005348448 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=776348 CPUtime=4722.36 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 1708741 1260 0 0 471948 288 0 0 25 0 9 0 800272583 794980352 155330 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=776348 CPUtime=4721.26 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 2338576 1260 0 0 471730 396 0 0 25 0 9 0 800272583 794980352 155330 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=776348 CPUtime=4722.35 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 1598198 1260 0 0 471958 277 0 0 25 0 9 0 800272583 794980352 155330 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=776348 CPUtime=4657.84 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 1683033 1260 0 0 465473 311 0 0 25 0 9 0 800272584 794980352 155330 33554432000 4194304 4417452 140734005348448 18446744073709551615 4343748 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=776348 CPUtime=4721.55 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 1622002 1260 0 0 471863 292 0 0 25 0 9 0 800272584 794980352 155330 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=776348 CPUtime=4718.8 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 1559951 1260 0 0 471602 278 0 0 25 0 9 0 800272584 794980352 155330 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37708.9
Current children cumulated vsize (KiB) 776348

[startup+4782.3 s]
/proc/loadavg: 8.05 8.03 8.00 9/445 12029
/proc/meminfo: memFree=16729548/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=781608 CPUtime=38188 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 13848247 1260 0 0 3816354 2442 0 0 25 0 9 0 800272575 800366592 156631 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 195402 156631 179 55 0 193288 0
[pid=11875/tid=11882] ppid=11873 vsize=781608 CPUtime=4782.37 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 1613784 1260 0 0 477951 286 0 0 25 0 9 0 800272583 800366592 156631 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=781608 CPUtime=4782.26 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 1642900 1260 0 0 477927 299 0 0 25 0 9 0 800272583 800366592 156631 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=781608 CPUtime=4782.35 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 1720222 1260 0 0 477945 290 0 0 25 0 9 0 800272583 800366592 156631 33554432000 4194304 4417452 140734005348448 18446744073709551615 4250571 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=781608 CPUtime=4781.22 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 2359867 1260 0 0 477723 399 0 0 25 0 9 0 800272583 800366592 156631 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=781608 CPUtime=4782.34 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 1606427 1260 0 0 477956 278 0 0 25 0 9 0 800272583 800366592 156631 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=781608 CPUtime=4716.96 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 1694482 1260 0 0 471383 313 0 0 25 0 9 0 800272584 800366592 156631 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=781608 CPUtime=4781.54 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 1633920 1260 0 0 477860 294 0 0 25 0 9 0 800272584 800366592 156631 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=781608 CPUtime=4778.79 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 1571473 1260 0 0 477598 281 0 0 25 0 9 0 800272584 800366592 156631 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38188
Current children cumulated vsize (KiB) 781608

[startup+4842.32 s]
/proc/loadavg: 8.05 8.03 8.00 9/446 12031
/proc/meminfo: memFree=16730660/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=779620 CPUtime=38667.2 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 13983360 1260 0 0 3864257 2464 0 0 25 0 9 0 800272575 798330880 156134 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 194905 156134 179 55 0 192791 0
[pid=11875/tid=11882] ppid=11873 vsize=779620 CPUtime=4842.39 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 1629907 1260 0 0 483950 289 0 0 25 0 9 0 800272583 798330880 156134 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=779620 CPUtime=4842.27 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 1662083 1260 0 0 483925 302 0 0 25 0 9 0 800272583 798330880 156134 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=779620 CPUtime=4842.36 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 1736868 1260 0 0 483944 292 0 0 25 0 9 0 800272583 798330880 156134 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=779620 CPUtime=4841.23 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 2381696 1260 0 0 483721 402 0 0 25 0 9 0 800272583 798330880 156134 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=779620 CPUtime=4842.36 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 1624953 1260 0 0 483955 281 0 0 25 0 9 0 800272583 798330880 156134 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=779620 CPUtime=4776.1 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 1704605 1260 0 0 477296 314 0 0 25 0 9 0 800272584 798330880 156134 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=779620 CPUtime=4841.56 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 1652212 1260 0 0 483859 297 0 0 25 0 9 0 800272584 798330880 156134 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=779620 CPUtime=4838.8 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 1585864 1260 0 0 483597 283 0 0 25 0 9 0 800272584 798330880 156134 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38667.2
Current children cumulated vsize (KiB) 779620

[startup+4902.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/445 12041
/proc/meminfo: memFree=16674756/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=840220 CPUtime=39146.2 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 14106976 1260 0 0 3912133 2486 0 0 25 0 9 0 800272575 860385280 171283 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 210055 171283 179 55 0 207941 0
[pid=11875/tid=11882] ppid=11873 vsize=840220 CPUtime=4902.36 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 1641278 1260 0 0 489946 290 0 0 25 0 9 0 800272583 860385280 171283 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=840220 CPUtime=4902.26 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 1675683 1260 0 0 489921 305 0 0 25 0 9 0 800272583 860385280 171283 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=840220 CPUtime=4902.33 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 1749328 1260 0 0 489937 296 0 0 25 0 9 0 800272583 860385280 171283 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=840220 CPUtime=4901.21 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 2396031 1260 0 0 489717 404 0 0 25 0 9 0 800272583 860385280 171283 33554432000 4194304 4417452 140734005348448 18446744073709551615 4356934 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=840220 CPUtime=4902.34 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 1646270 1260 0 0 489950 284 0 0 25 0 9 0 800272583 860385280 171283 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364850 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=840220 CPUtime=4835.22 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 1722123 1260 0 0 483205 317 0 0 25 0 9 0 800272584 860385280 171283 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=840220 CPUtime=4901.54 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 1664462 1260 0 0 489855 299 0 0 25 0 9 0 800272584 860385280 171283 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=840220 CPUtime=4898.79 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 1606629 1260 0 0 489591 288 0 0 25 0 9 0 800272584 860385280 171283 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39146.2
Current children cumulated vsize (KiB) 840220

[startup+4962.3 s]
/proc/loadavg: 8.12 8.05 8.01 9/445 12042
/proc/meminfo: memFree=16753976/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=762476 CPUtime=39625.3 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 14226280 1260 0 0 3960023 2507 0 0 25 0 9 0 800272575 780775424 151848 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 190619 151848 179 55 0 188505 0
[pid=11875/tid=11882] ppid=11873 vsize=762476 CPUtime=4962.37 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 1661279 1260 0 0 495943 294 0 0 25 0 9 0 800272583 780775424 151848 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=762476 CPUtime=4962.26 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 1687419 1260 0 0 495919 307 0 0 25 0 9 0 800272583 780775424 151848 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=762476 CPUtime=4962.33 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 1765610 1260 0 0 495934 299 0 0 25 0 9 0 800272583 780775424 151848 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=762476 CPUtime=4961.19 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 2420331 1260 0 0 495711 408 0 0 25 0 9 0 800272583 780775424 151848 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=762476 CPUtime=4962.34 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 1657188 1260 0 0 495948 286 0 0 25 0 9 0 800272583 780775424 151848 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364597 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=762476 CPUtime=4894.35 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 1736074 1260 0 0 489115 320 0 0 25 0 9 0 800272584 780775424 151848 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=762476 CPUtime=4961.54 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 1676295 1260 0 0 495854 300 0 0 25 0 9 0 800272584 780775424 151848 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=762476 CPUtime=4958.79 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 1616912 1260 0 0 495590 289 0 0 25 0 9 0 800272584 780775424 151848 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39625.3
Current children cumulated vsize (KiB) 762476



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/445 12044
/proc/meminfo: memFree=16647848/32950928 swapFree=60044444/67111528
[pid=11875] ppid=11873 vsize=862816 CPUtime=40000.7 cores=0-7
/proc/11875/stat : 11875 (plingeling) S 11873 11875 11612 0 -1 4202496 14327496 1260 0 0 3997542 2527 0 0 25 0 9 0 800272575 883523584 176933 33554432000 4194304 4417452 140734005348448 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/11875/statm: 215704 176933 179 55 0 213590 0
[pid=11875/tid=11882] ppid=11873 vsize=862816 CPUtime=5009.39 cores=0-7
/proc/11875/task/11882/stat : 11882 (plingeling) R 11873 11875 11612 0 -1 4202560 1675964 1260 0 0 500642 297 0 0 25 0 9 0 800272583 883523584 176933 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=11875/tid=11883] ppid=11873 vsize=862816 CPUtime=5009.28 cores=0-7
/proc/11875/task/11883/stat : 11883 (plingeling) R 11873 11875 11612 0 -1 4202560 1700636 1260 0 0 500619 309 0 0 25 0 9 0 800272583 883523584 176933 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11875/tid=11884] ppid=11873 vsize=862816 CPUtime=5009.35 cores=0-7
/proc/11875/task/11884/stat : 11884 (plingeling) R 11873 11875 11612 0 -1 4202560 1772140 1260 0 0 500634 301 0 0 25 0 9 0 800272583 883523584 176933 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=11875/tid=11885] ppid=11873 vsize=862816 CPUtime=5008.19 cores=0-7
/proc/11875/task/11885/stat : 11885 (plingeling) R 11873 11875 11612 0 -1 4202560 2426242 1260 0 0 500409 410 0 0 25 0 9 0 800272583 883523584 176933 33554432000 4194304 4417452 140734005348448 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=11875/tid=11886] ppid=11873 vsize=862816 CPUtime=5009.36 cores=0-7
/proc/11875/task/11886/stat : 11886 (plingeling) R 11873 11875 11612 0 -1 4202560 1666653 1260 0 0 500648 288 0 0 25 0 9 0 800272583 883523584 176933 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11875/tid=11887] ppid=11873 vsize=862816 CPUtime=4940.67 cores=0-7
/proc/11875/task/11887/stat : 11887 (plingeling) R 11873 11875 11612 0 -1 4202560 1747328 1260 0 0 493745 322 0 0 25 0 9 0 800272584 883523584 176933 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11875/tid=11888] ppid=11873 vsize=862816 CPUtime=5008.56 cores=0-7
/proc/11875/task/11888/stat : 11888 (plingeling) R 11873 11875 11612 0 -1 4202560 1697468 1260 0 0 500552 304 0 0 25 0 9 0 800272584 883523584 176933 33554432000 4194304 4417452 140734005348448 18446744073709551615 18446744073699065904 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11875/tid=11889] ppid=11873 vsize=862816 CPUtime=5005.81 cores=0-7
/proc/11875/task/11889/stat : 11889 (plingeling) R 11873 11875 11612 0 -1 4202560 1635893 1260 0 0 500287 294 0 0 25 0 9 0 800272584 883523584 176933 33554432000 4194304 4417452 140734005348448 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 862816

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5009.35
CPU time (s): 40000.8
CPU user time (s): 39975.5
CPU system time (s): 25.3102
CPU usage (%): 798.523
Max. virtual memory (cumulated for all children) (KiB): 894640

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39975.5
system time used= 25.3102
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14328757
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 802
involuntary context switches= 186972

runsolver used 20.5699 second user time and 51.7191 second system time

The end

Launcher Data 

Begin job on node114 at 2011-05-22 23:40:19
IDJOB=3394618
IDBENCH=83335
IDSOLVER=1851
FILE ID=node114/3394618-1306100419
RUNJOBID= node114-1306095115-11626
PBS_JOBID= 13387972
Free space on /tmp= 73100 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-18_312.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394618-1306100419/watcher-3394618-1306100419 -o /tmp/evaluation-result-3394618-1306100419/solver-3394618-1306100419 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394618-1306100419.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1144bbd60c180aa5e72d35b74e9676cb
RANDOM SEED=834894572

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17357800 kB
Buffers:        219696 kB
Cached:        5247256 kB
SwapCached:      48888 kB
Active:        4049972 kB
Inactive:     11288660 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17357800 kB
SwapTotal:    67111528 kB
SwapFree:     60044444 kB
Dirty:             800 kB
Writeback:           0 kB
AnonPages:     9829828 kB
Mapped:          27816 kB
Slab:           123548 kB
PageTables:      61984 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 108155392 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73096 MiB
End job on node114 at 2011-05-23 01:03:50