Trace number 3371056

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.13 1203.93

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-14_186.cnf
MD5SUM642fce7e30a701c3223fa5771c2e57dc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables186
Number of clauses9795
Sum of the clauses size43014
Maximum clause length14
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 38556
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51239

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371056-1305428668/watcher-3371056-1305428668 -o /tmp/evaluation-result-3371056-1305428668/solver-3371056-1305428668 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371056-1305428668.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 1.35 1.71 3/363 16127
/proc/meminfo: memFree=30210244/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 214 0 0 0 0 0 0 0 20 0 1 0 635283090 8937472 146 33554432000 4194304 4417452 140735766314112 18446744073709551615 212039655168 0 0 4096 0 18446744071562362840 0 0 17 0 0 0 0
/proc/16125/statm: 2182 146 122 55 0 68 0

[startup+0.158108 s]
/proc/loadavg: 0.92 1.35 1.71 3/363 16127
/proc/meminfo: memFree=30210244/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=54416 CPUtime=0.22 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1545 1248 0 2 22 0 0 0 20 0 5 0 635283090 55721984 1357 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 13604 1357 177 55 0 11490 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 54416

[startup+0.201121 s]
/proc/loadavg: 0.92 1.35 1.71 3/363 16127
/proc/meminfo: memFree=30210244/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=54012 CPUtime=0.34 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1592 1248 0 2 34 0 0 0 20 0 5 0 635283090 55308288 1303 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 13503 1303 178 55 0 11389 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 54012

[startup+0.301055 s]
/proc/loadavg: 0.92 1.35 1.71 3/363 16127
/proc/meminfo: memFree=30210244/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=54964 CPUtime=0.64 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1815 1248 0 2 64 0 0 0 20 0 5 0 635283090 56283136 1526 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 13741 1526 178 55 0 11627 0
Current children cumulated CPU time (s) 0.64
Current children cumulated vsize (KiB) 54964

[startup+0.700985 s]
/proc/loadavg: 0.92 1.35 1.71 3/363 16127
/proc/meminfo: memFree=30210244/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=58360 CPUtime=2.19 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 3042 1248 0 2 219 0 0 0 20 0 5 0 635283090 59760640 2375 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 14590 2375 178 55 0 12476 0
Current children cumulated CPU time (s) 2.19
Current children cumulated vsize (KiB) 58360

[startup+1.50084 s]
/proc/loadavg: 0.92 1.35 1.71 10/373 16147
/proc/meminfo: memFree=30185000/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=60876 CPUtime=5.38 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 5481 1248 0 2 538 0 0 0 20 0 5 0 635283090 62337024 3037 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 15219 3037 179 55 0 13105 0
[pid=16125/tid=16140] ppid=16122 vsize=60876 CPUtime=1.31 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 934 1248 0 2 131 0 0 0 25 0 5 0 635283095 62337024 3037 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=60876 CPUtime=1.27 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 641 1248 0 2 127 0 0 0 25 0 5 0 635283095 62337024 3037 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=60876 CPUtime=1.34 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 1232 1248 0 2 134 0 0 0 25 0 5 0 635283095 62337024 3037 33554432000 4194304 4417452 140735766314112 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=60876 CPUtime=1.43 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 1680 1248 0 2 143 0 0 0 25 0 5 0 635283095 62337024 3037 33554432000 4194304 4417452 140735766314112 18446744073709551615 4354168 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.38
Current children cumulated vsize (KiB) 60876

[startup+3.10056 s]
/proc/loadavg: 0.92 1.35 1.71 10/373 16147
/proc/meminfo: memFree=30176196/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=62620 CPUtime=11.77 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 10568 1248 0 2 1175 2 0 0 20 0 5 0 635283090 64122880 3473 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 15655 3473 179 55 0 13541 0
[pid=16125/tid=16140] ppid=16122 vsize=62620 CPUtime=2.9 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 1750 1248 0 2 290 0 0 0 25 0 5 0 635283095 64122880 3473 33554432000 4194304 4417452 140735766314112 18446744073709551615 4246946 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=62620 CPUtime=2.87 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 1493 1248 0 2 287 0 0 0 25 0 5 0 635283095 64122880 3473 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=62620 CPUtime=2.94 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 2845 1248 0 2 294 0 0 0 25 0 5 0 635283095 64122880 3473 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=62620 CPUtime=3.01 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 3486 1248 0 2 301 0 0 0 25 0 5 0 635283095 64122880 3473 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.77
Current children cumulated vsize (KiB) 62620

[startup+6.30099 s]
/proc/loadavg: 1.49 1.46 1.74 10/373 16147
/proc/meminfo: memFree=30155900/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=68824 CPUtime=24.53 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 24566 1248 0 2 2449 4 0 0 20 0 5 0 635283090 70475776 5019 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 17206 5019 179 55 0 15092 0
[pid=16125/tid=16140] ppid=16122 vsize=68824 CPUtime=6.1 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 4687 1248 0 2 610 0 0 0 25 0 5 0 635283095 70475776 5019 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=68824 CPUtime=6.07 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 5209 1248 0 2 606 1 0 0 25 0 5 0 635283095 70475776 5019 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=68824 CPUtime=6.14 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 6807 1248 0 2 614 0 0 0 25 0 5 0 635283095 70475776 5019 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=68824 CPUtime=6.17 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 6869 1248 0 2 616 1 0 0 25 0 5 0 635283095 70475776 5019 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.53
Current children cumulated vsize (KiB) 68824

[startup+12.7008 s]
/proc/loadavg: 2.01 1.57 1.78 10/373 16147
/proc/meminfo: memFree=30135092/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=77560 CPUtime=50.05 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 46553 1248 0 2 4997 8 0 0 20 0 5 0 635283090 79421440 7203 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 19390 7203 179 55 0 17276 0
[pid=16125/tid=16140] ppid=16122 vsize=77560 CPUtime=12.5 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 9864 1248 0 2 1249 1 0 0 25 0 5 0 635283095 79421440 7203 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=77560 CPUtime=12.47 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 11010 1248 0 2 1245 2 0 0 25 0 5 0 635283095 79421440 7203 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=77560 CPUtime=12.54 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 12323 1248 0 2 1253 1 0 0 25 0 5 0 635283095 79421440 7203 33554432000 4194304 4417452 140735766314112 18446744073709551615 4250771 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=77560 CPUtime=12.49 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 12362 1248 0 2 1247 2 0 0 25 0 5 0 635283095 79421440 7203 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.05
Current children cumulated vsize (KiB) 77560

[startup+25.5006 s]
/proc/loadavg: 3.34 1.88 1.88 10/373 16148
/proc/meminfo: memFree=30117308/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=149220 CPUtime=101.09 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 88821 1248 0 2 10093 16 0 0 20 0 5 0 635283090 152801280 8767 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 37305 8767 179 55 0 35191 0
[pid=16125/tid=16140] ppid=16122 vsize=149220 CPUtime=25.3 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 20152 1248 0 2 2527 3 0 0 25 0 5 0 635283095 152801280 8767 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=149220 CPUtime=25.27 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 22103 1248 0 2 2523 4 0 0 25 0 5 0 635283095 152801280 8767 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=149220 CPUtime=25.33 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 21766 1248 0 2 2531 2 0 0 25 0 5 0 635283095 152801280 8767 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=149220 CPUtime=25.13 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 23806 1248 0 2 2509 4 0 0 25 0 5 0 635283095 152801280 8767 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.09
Current children cumulated vsize (KiB) 149220

[startup+51.101 s]
/proc/loadavg: 5.08 2.40 2.05 10/373 16148
/proc/meminfo: memFree=30087008/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=155512 CPUtime=203.18 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 169706 1248 0 2 20289 29 0 0 20 0 5 0 635283090 159244288 10313 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 38878 10313 179 55 0 36764 0
[pid=16125/tid=16140] ppid=16122 vsize=155512 CPUtime=50.89 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 40256 1248 0 2 5082 7 0 0 25 0 5 0 635283095 159244288 10313 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=155512 CPUtime=50.87 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 43304 1248 0 2 5080 7 0 0 25 0 5 0 635283095 159244288 10313 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=155512 CPUtime=50.94 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 41023 1248 0 2 5088 6 0 0 25 0 5 0 635283095 159244288 10313 33554432000 4194304 4417452 140735766314112 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=155512 CPUtime=50.43 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 44129 1248 0 2 5036 7 0 0 25 0 5 0 635283095 159244288 10313 33554432000 4194304 4417452 140735766314112 18446744073709551615 4232674 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.18
Current children cumulated vsize (KiB) 155512

[startup+102.301 s]
/proc/loadavg: 7.05 3.33 2.38 10/373 16150
/proc/meminfo: memFree=30054616/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=169988 CPUtime=407.39 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 292338 1248 0 2 40691 48 0 0 20 0 5 0 635283090 174067712 13932 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 42497 13932 179 55 0 40383 0
[pid=16125/tid=16140] ppid=16122 vsize=169988 CPUtime=102.11 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 71345 1248 0 2 10199 12 0 0 25 0 5 0 635283095 174067712 13932 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=169988 CPUtime=102.08 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 74185 1248 0 2 10197 11 0 0 25 0 5 0 635283095 174067712 13932 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=169988 CPUtime=102.15 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 71661 1248 0 2 10204 11 0 0 25 0 5 0 635283095 174067712 13932 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=169988 CPUtime=101.01 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 74153 1248 0 2 10089 12 0 0 25 0 5 0 635283095 174067712 13932 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 407.39
Current children cumulated vsize (KiB) 169988

[startup+162.301 s]
/proc/loadavg: 7.65 4.18 2.73 10/373 16151
/proc/meminfo: memFree=30021220/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=180492 CPUtime=646.62 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 411157 1248 0 2 64595 67 0 0 20 0 5 0 635283090 184823808 16590 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 45123 16590 179 55 0 43009 0
[pid=16125/tid=16140] ppid=16122 vsize=180492 CPUtime=162.08 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 97974 1248 0 2 16193 15 0 0 25 0 5 0 635283095 184823808 16590 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=180492 CPUtime=162.07 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 100866 1248 0 2 16192 15 0 0 25 0 5 0 635283095 184823808 16590 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=180492 CPUtime=162.13 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 98682 1248 0 2 16198 15 0 0 25 0 5 0 635283095 184823808 16590 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=180492 CPUtime=160.28 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 112641 1248 0 2 16009 19 0 0 25 0 5 0 635283095 184823808 16590 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 646.62
Current children cumulated vsize (KiB) 180492


################
# More data... #
################

[pid=16125/tid=16141] ppid=16122 vsize=226328 CPUtime=702.09 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 294846 1248 0 2 70163 46 0 0 25 0 5 0 635283095 231759872 28038 33554432000 4194304 4417452 140735766314112 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=226328 CPUtime=702.14 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 308923 1248 0 2 70165 49 0 0 25 0 5 0 635283095 231759872 28038 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=226328 CPUtime=693.64 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 329773 1248 0 2 69312 52 0 0 25 0 5 0 635283095 231759872 28038 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2799.91
Current children cumulated vsize (KiB) 226328

[startup+762.301 s]
/proc/loadavg: 8.14 7.59 5.27 10/373 16167
/proc/meminfo: memFree=29919252/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=230512 CPUtime=3039.2 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1306028 1248 0 2 303714 206 0 0 20 0 5 0 635283090 236044288 29070 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 57628 29070 179 55 0 55514 0
[pid=16125/tid=16140] ppid=16122 vsize=230512 CPUtime=762 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 322852 1248 0 2 76150 50 0 0 25 0 5 0 635283095 236044288 29070 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=230512 CPUtime=762.1 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 307479 1248 0 2 76162 48 0 0 25 0 5 0 635283095 236044288 29070 33554432000 4194304 4417452 140735766314112 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=230512 CPUtime=762.15 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 323211 1248 0 2 76164 51 0 0 25 0 5 0 635283095 236044288 29070 33554432000 4194304 4417452 140735766314112 18446744073709551615 4343625 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=230512 CPUtime=752.91 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 351492 1248 0 2 75236 55 0 0 25 0 5 0 635283095 236044288 29070 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3039.2
Current children cumulated vsize (KiB) 230512

[startup+822.301 s]
/proc/loadavg: 8.05 7.66 5.44 9/373 16169
/proc/meminfo: memFree=29900620/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=240616 CPUtime=3278.42 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1389309 1248 0 2 327623 219 0 0 20 0 5 0 635283090 246390784 31602 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 60154 31602 179 55 0 58040 0
[pid=16125/tid=16140] ppid=16122 vsize=240616 CPUtime=821.98 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 344590 1248 0 2 82144 54 0 0 25 0 5 0 635283095 246390784 31602 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=240616 CPUtime=822.09 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 321470 1248 0 2 82159 50 0 0 25 0 5 0 635283095 246390784 31602 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=240616 CPUtime=822.14 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 347106 1248 0 2 82159 55 0 0 25 0 5 0 635283095 246390784 31602 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=240616 CPUtime=812.18 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 375149 1248 0 2 81159 59 0 0 25 0 5 0 635283095 246390784 31602 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3278.42
Current children cumulated vsize (KiB) 240616

[startup+882.314 s]
/proc/loadavg: 8.02 7.72 5.60 10/373 16170
/proc/meminfo: memFree=29874408/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=241904 CPUtime=3517.73 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1457368 1248 0 2 351544 229 0 0 20 0 5 0 635283090 247709696 31940 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 60476 31940 179 55 0 58362 0
[pid=16125/tid=16140] ppid=16122 vsize=241904 CPUtime=881.99 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 364205 1248 0 2 88142 57 0 0 25 0 5 0 635283095 247709696 31940 33554432000 4194304 4417452 140735766314112 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=241904 CPUtime=882.11 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 335533 1248 0 2 88159 52 0 0 25 0 5 0 635283095 247709696 31940 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=241904 CPUtime=882.15 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 363307 1248 0 2 88158 57 0 0 25 0 5 0 635283095 247709696 31940 33554432000 4194304 4417452 140735766314112 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=241904 CPUtime=871.45 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 393329 1248 0 2 87084 61 0 0 25 0 5 0 635283095 247709696 31940 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3517.73
Current children cumulated vsize (KiB) 241904

[startup+942.301 s]
/proc/loadavg: 8.07 7.80 5.76 10/373 16172
/proc/meminfo: memFree=29855528/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=260804 CPUtime=3756.93 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1514384 1248 0 2 375456 237 0 0 20 0 5 0 635283090 267063296 36665 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 65201 36665 179 55 0 63087 0
[pid=16125/tid=16140] ppid=16122 vsize=260804 CPUtime=941.96 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 375095 1248 0 2 94137 59 0 0 25 0 5 0 635283095 267063296 36665 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=260804 CPUtime=942.09 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 345476 1248 0 2 94156 53 0 0 25 0 5 0 635283095 267063296 36665 33554432000 4194304 4417452 140735766314112 18446744073709551615 4343986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=260804 CPUtime=942.13 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 378631 1248 0 2 94154 59 0 0 25 0 5 0 635283095 267063296 36665 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=260804 CPUtime=930.7 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 414188 1248 0 2 93005 65 0 0 25 0 5 0 635283095 267063296 36665 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3756.93
Current children cumulated vsize (KiB) 260804

[startup+1002.3 s]
/proc/loadavg: 8.09 7.86 5.90 10/373 16174
/proc/meminfo: memFree=29882024/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=241092 CPUtime=3996.17 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1578147 1248 0 2 399370 247 0 0 20 0 5 0 635283090 246878208 31718 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 60273 31718 179 55 0 58159 0
[pid=16125/tid=16140] ppid=16122 vsize=241092 CPUtime=1001.95 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 389511 1248 0 2 100135 60 0 0 25 0 5 0 635283095 246878208 31718 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=241092 CPUtime=1002.1 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 364800 1248 0 2 100153 57 0 0 25 0 5 0 635283095 246878208 31718 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=241092 CPUtime=1002.13 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 388898 1248 0 2 100153 60 0 0 25 0 5 0 635283095 246878208 31718 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=241092 CPUtime=989.95 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 433944 1248 0 2 98927 68 0 0 25 0 5 0 635283095 246878208 31718 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3996.17
Current children cumulated vsize (KiB) 241092

[startup+1062.3 s]
/proc/loadavg: 8.10 7.90 6.04 10/373 16175
/proc/meminfo: memFree=29847516/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=254360 CPUtime=4235.44 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1637574 1248 0 2 423286 258 0 0 20 0 5 0 635283090 260464640 35025 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 63590 35025 179 55 0 61476 0
[pid=16125/tid=16140] ppid=16122 vsize=254360 CPUtime=1061.94 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 403227 1248 0 2 106131 63 0 0 25 0 5 0 635283095 260464640 35025 33554432000 4194304 4417452 140735766314112 18446744073709551615 4354448 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=254360 CPUtime=1062.09 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 376031 1248 0 2 106151 58 0 0 25 0 5 0 635283095 260464640 35025 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=254360 CPUtime=1062.13 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 405286 1248 0 2 106150 63 0 0 25 0 5 0 635283095 260464640 35025 33554432000 4194304 4417452 140735766314112 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=254360 CPUtime=1049.22 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 452036 1248 0 2 104851 71 0 0 25 0 5 0 635283095 260464640 35025 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4235.44
Current children cumulated vsize (KiB) 254360

[startup+1122.3 s]
/proc/loadavg: 8.17 7.95 6.17 10/373 16177
/proc/meminfo: memFree=29848336/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=268304 CPUtime=4474.67 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1692388 1248 0 2 447201 266 0 0 20 0 5 0 635283090 274743296 38511 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 67076 38511 179 55 0 64962 0
[pid=16125/tid=16140] ppid=16122 vsize=268304 CPUtime=1121.93 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 413469 1248 0 2 112128 65 0 0 25 0 5 0 635283095 274743296 38511 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=268304 CPUtime=1122.1 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 389544 1248 0 2 112150 60 0 0 25 0 5 0 635283095 274743296 38511 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=268304 CPUtime=1122.14 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 420878 1248 0 2 112148 66 0 0 25 0 5 0 635283095 274743296 38511 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=268304 CPUtime=1108.46 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 467503 1248 0 2 110773 73 0 0 25 0 5 0 635283095 274743296 38511 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4474.67
Current children cumulated vsize (KiB) 268304

[startup+1182.3 s]
/proc/loadavg: 8.18 7.99 6.29 10/373 16178
/proc/meminfo: memFree=29825728/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=280404 CPUtime=4713.92 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1755782 1248 0 2 471117 275 0 0 20 0 5 0 635283090 287133696 41563 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 70101 41563 179 55 0 67987 0
[pid=16125/tid=16140] ppid=16122 vsize=280404 CPUtime=1181.92 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 428762 1248 0 2 118125 67 0 0 25 0 5 0 635283095 287133696 41563 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=280404 CPUtime=1182.1 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 403983 1248 0 2 118148 62 0 0 25 0 5 0 635283095 287133696 41563 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=280404 CPUtime=1182.13 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 435575 1248 0 2 118145 68 0 0 25 0 5 0 635283095 287133696 41563 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=280404 CPUtime=1167.73 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 486468 1248 0 2 116697 76 0 0 25 0 5 0 635283095 287133696 41563 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4713.92
Current children cumulated vsize (KiB) 280404



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.9 s]
/proc/loadavg: 8.12 7.99 6.33 10/373 16179
/proc/meminfo: memFree=29845936/32951124 swapFree=51873460/67111528
[pid=16125] ppid=16122 vsize=268828 CPUtime=4800.08 cores=0,2,4,6
/proc/16125/stat : 16125 (plingeling) S 16122 16125 8955 0 -1 4202496 1780208 1248 0 2 479729 279 0 0 20 0 5 0 635283090 275279872 38642 33554432000 4194304 4417452 140735766314112 18446744073709551615 212051458021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/16125/statm: 67207 38642 179 55 0 65093 0
[pid=16125/tid=16140] ppid=16122 vsize=268828 CPUtime=1203.54 cores=0,2,4,6
/proc/16125/task/16140/stat : 16140 (plingeling) R 16122 16125 8955 0 -1 4202560 438840 1248 0 2 120285 69 0 0 25 0 5 0 635283095 275279872 38642 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16125/tid=16141] ppid=16122 vsize=268828 CPUtime=1203.72 cores=0,2,4,6
/proc/16125/task/16141/stat : 16141 (plingeling) R 16122 16125 8955 0 -1 4202560 406662 1248 0 2 120309 63 0 0 25 0 5 0 635283095 275279872 38642 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16125/tid=16142] ppid=16122 vsize=268828 CPUtime=1203.75 cores=0,2,4,6
/proc/16125/task/16142/stat : 16142 (plingeling) R 16122 16125 8955 0 -1 4202560 443007 1248 0 2 120306 69 0 0 25 0 5 0 635283095 275279872 38642 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16125/tid=16143] ppid=16122 vsize=268828 CPUtime=1189.05 cores=0,2,4,6
/proc/16125/task/16143/stat : 16143 (plingeling) R 16122 16125 8955 0 -1 4202560 490705 1248 0 2 118828 77 0 0 25 0 5 0 635283095 275279872 38642 33554432000 4194304 4417452 140735766314112 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.08
Current children cumulated vsize (KiB) 268828

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.93
CPU time (s): 4800.13
CPU user time (s): 4797.33
CPU system time (s): 2.80857
CPU usage (%): 398.706
Max. virtual memory (cumulated for all children) (KiB): 295612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.33
system time used= 2.80857
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1781456
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 160
involuntary context switches= 52116

runsolver used 4.21036 second user time and 10.6294 second system time

The end

Launcher Data 

Begin job on node146 at 2011-05-15 05:04:28
IDJOB=3371056
IDBENCH=83356
IDSOLVER=1848
FILE ID=node146/3371056-1305428668
RUNJOBID= node146-1305428668-16108
PBS_JOBID= 13324589
Free space on /tmp= 73336 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-14_186.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371056-1305428668/watcher-3371056-1305428668 -o /tmp/evaluation-result-3371056-1305428668/solver-3371056-1305428668 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371056-1305428668.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 642fce7e30a701c3223fa5771c2e57dc
RANDOM SEED=2107269698

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30210680 kB
Buffers:         99628 kB
Cached:         169576 kB
SwapCached:      56148 kB
Active:         767108 kB
Inactive:      1744276 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30210680 kB
SwapTotal:    67111528 kB
SwapFree:     51873460 kB
Dirty:            1224 kB
Writeback:           8 kB
AnonPages:     2192940 kB
Mapped:          16632 kB
Slab:           104092 kB
PageTables:      58412 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 81755236 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73336 MiB
End job on node146 at 2011-05-15 05:24:34