Trace number 3394542

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.4 5010.34

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-15-15-unsat.cnf
MD5SUM647576009a3d34cc33c6dfd3ecb1a2ef
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables225
Number of clauses1800
Sum of the clauses size6525
Maximum clause length15
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21575
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5225

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394542-1306099260/watcher-3394542-1306099260 -o /tmp/evaluation-result-3394542-1306099260/solver-3394542-1306099260 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394542-1306099260.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.03 8.05 8.07 1/474 4209
/proc/meminfo: memFree=28914880/32951124 swapFree=38422216/67111528
[pid=4209] ppid=4207 vsize=9260 CPUtime=0 cores=0-7
/proc/4209/stat : 4209 (plingeling) R 4207 4209 3728 0 -1 4202496 388 1259 0 0 0 0 0 0 25 0 1 0 721528338 9482240 318 33554432000 4194304 4417452 140736501501312 18446744073709551615 212435713803 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/4209/statm: 2315 318 147 55 0 201 0
[pid=4209/tid=4215] ppid=4207 vsize=157328 CPUtime=0.01 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 46 1259 0 0 1 0 0 0 25 0 9 0 721528339 161103872 501 33554432000 4194304 4417452 140736501501312 18446744073709551615 4235398 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=157328 CPUtime=0 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 5 1259 0 0 0 0 0 0 25 0 9 0 721528339 161103872 501 33554432000 4194304 4417452 140736501501312 18446744073709551615 4275652 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=157328 CPUtime=0 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 1 1259 0 0 0 0 0 0 25 0 9 0 721528339 161103872 501 33554432000 4194304 4417452 140736501501312 18446744073709551615 212436122094 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=157328 CPUtime=0 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 38 1259 0 0 0 0 0 0 25 0 9 0 721528339 161103872 501 33554432000 4194304 4417452 140736501501312 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=157328 CPUtime=0 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 21 1259 0 0 0 0 0 0 25 0 9 0 721528339 161103872 501 33554432000 4194304 4417452 140736501501312 18446744073709551615 4236495 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=157328 CPUtime=0 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 18 1259 0 0 0 0 0 0 25 0 9 0 721528339 161103872 501 33554432000 4194304 4417452 140736501501312 18446744073709551615 4254810 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=157328 CPUtime=0 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 5 1259 0 0 0 0 0 0 25 0 9 0 721528339 161103872 501 33554432000 4194304 4417452 140736501501312 18446744073709551615 212436122094 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=157328 CPUtime=0 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 17 1259 0 0 0 0 0 0 25 0 9 0 721528339 161103872 501 33554432000 4194304 4417452 140736501501312 18446744073709551615 4254888 0 0 4096 17442 0 0 0 -1 1 0 0 0

[startup+0.120666 s]
/proc/loadavg: 8.03 8.05 8.07 1/474 4209
/proc/meminfo: memFree=28914880/32951124 swapFree=38422216/67111528
[pid=4209] ppid=4207 vsize=173768 CPUtime=4.35 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 13154 1259 0 0 432 3 0 0 25 0 9 0 721528338 177938432 4662 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 43442 4662 180 55 0 41328 0
[pid=4209/tid=4215] ppid=4207 vsize=173768 CPUtime=0.54 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 1480 1259 0 0 54 0 0 0 25 0 9 0 721528339 177938432 4662 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=173768 CPUtime=0.53 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 1111 1259 0 0 53 0 0 0 18 0 9 0 721528339 177938432 4662 33554432000 4194304 4417452 140736501501312 18446744073709551615 212436074922 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=173768 CPUtime=0.52 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 1567 1259 0 0 52 0 0 0 25 0 9 0 721528339 177938432 4662 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=174280 CPUtime=0.53 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 2447 1259 0 0 53 0 0 0 25 0 9 0 721528339 178462720 4662 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=180352 CPUtime=0.67 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 2203 1259 0 0 67 0 0 0 25 0 9 0 721528339 184680448 6235 33554432000 4194304 4417452 140736501501312 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=177740 CPUtime=0.79 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 2341 1259 0 0 79 0 0 0 25 0 9 0 721528339 182005760 5596 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=176664 CPUtime=0.79 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 2311 1259 0 0 79 0 0 0 19 0 9 0 721528339 180903936 5386 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364885 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=176664 CPUtime=0.8 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 2197 1259 0 0 80 0 0 0 19 0 9 0 721528339 180903936 5386 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4.35
Current children cumulated vsize (KiB) 173768

[startup+0.916663 s]
/proc/loadavg: 8.03 8.05 8.07 1/474 4209
/proc/meminfo: memFree=28914880/32951124 swapFree=38422216/67111528
[pid=4209] ppid=4207 vsize=179488 CPUtime=7.23 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 23184 1259 0 0 718 5 0 0 25 0 9 0 721528338 183795712 6092 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 44872 6092 180 55 0 42758 0
[pid=4209/tid=4215] ppid=4207 vsize=179488 CPUtime=0.9 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 2755 1259 0 0 90 0 0 0 25 0 9 0 721528339 183795712 6092 33554432000 4194304 4417452 140736501501312 18446744073709551615 4311315 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=179488 CPUtime=0.89 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 2422 1259 0 0 89 0 0 0 19 0 9 0 721528339 183795712 6092 33554432000 4194304 4417452 140736501501312 18446744073709551615 4308786 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=179488 CPUtime=0.88 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 2634 1259 0 0 88 0 0 0 25 0 9 0 721528339 183795712 6092 33554432000 4194304 4417452 140736501501312 18446744073709551615 4321595 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=179488 CPUtime=0.9 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 3890 1259 0 0 89 1 0 0 25 0 9 0 721528339 183795712 6092 33554432000 4194304 4417452 140736501501312 18446744073709551615 4250464 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=179488 CPUtime=0.89 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 2921 1259 0 0 89 0 0 0 25 0 9 0 721528339 183795712 6092 33554432000 4194304 4417452 140736501501312 18446744073709551615 4311324 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=179488 CPUtime=0.89 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 2883 1259 0 0 89 0 0 0 25 0 9 0 721528339 183795712 6092 33554432000 4194304 4417452 140736501501312 18446744073709551615 4310513 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=179488 CPUtime=0.89 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 2695 1259 0 0 89 0 0 0 19 0 9 0 721528339 183795712 6092 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=179488 CPUtime=0.9 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 2560 1259 0 0 90 0 0 0 19 0 9 0 721528339 183795712 6092 33554432000 4194304 4417452 140736501501312 18446744073709551615 18446744073699065863 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 7.23
Current children cumulated vsize (KiB) 179488

[startup+1.01664 s]
/proc/loadavg: 8.03 8.05 8.07 1/474 4209
/proc/meminfo: memFree=28914880/32951124 swapFree=38422216/67111528
[pid=4209] ppid=4207 vsize=179252 CPUtime=8.02 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 24765 1259 0 0 797 5 0 0 25 0 9 0 721528338 183554048 6001 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 44813 6001 180 55 0 42699 0
[pid=4209/tid=4215] ppid=4207 vsize=179252 CPUtime=1 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 2755 1259 0 0 100 0 0 0 25 0 9 0 721528339 183554048 6001 33554432000 4194304 4417452 140736501501312 18446744073709551615 4305879 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=179252 CPUtime=0.99 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 2757 1259 0 0 99 0 0 0 19 0 9 0 721528339 183554048 6001 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=179252 CPUtime=0.98 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 3101 1259 0 0 98 0 0 0 25 0 9 0 721528339 183554048 6001 33554432000 4194304 4417452 140736501501312 18446744073709551615 4251258 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=179252 CPUtime=1 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 3890 1259 0 0 99 1 0 0 25 0 9 0 721528339 183554048 6001 33554432000 4194304 4417452 140736501501312 18446744073709551615 212436074922 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=179252 CPUtime=0.99 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 2921 1259 0 0 99 0 0 0 25 0 9 0 721528339 183554048 6001 33554432000 4194304 4417452 140736501501312 18446744073709551615 4248212 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=179252 CPUtime=0.99 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 2883 1259 0 0 99 0 0 0 25 0 9 0 721528339 183554048 6001 33554432000 4194304 4417452 140736501501312 18446744073709551615 4307411 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=179252 CPUtime=0.99 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 2983 1259 0 0 99 0 0 0 19 0 9 0 721528339 183554048 6001 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=179252 CPUtime=1 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 3051 1259 0 0 100 0 0 0 18 0 9 0 721528339 183554048 6001 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 8.02
Current children cumulated vsize (KiB) 179252

[startup+1.11662 s]
/proc/loadavg: 8.03 8.05 8.07 1/474 4209
/proc/meminfo: memFree=28914880/32951124 swapFree=38422216/67111528
[pid=4209] ppid=4207 vsize=179964 CPUtime=8.82 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 28151 1259 0 0 876 6 0 0 25 0 9 0 721528338 184283136 6179 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 44991 6179 180 55 0 42877 0
[pid=4209/tid=4215] ppid=4207 vsize=179964 CPUtime=1.1 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 3277 1259 0 0 110 0 0 0 25 0 9 0 721528339 184283136 6179 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=179964 CPUtime=1.09 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 3262 1259 0 0 109 0 0 0 19 0 9 0 721528339 184283136 6179 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=179964 CPUtime=1.08 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 3425 1259 0 0 108 0 0 0 25 0 9 0 721528339 184283136 6179 33554432000 4194304 4417452 140736501501312 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=179964 CPUtime=1.1 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 4581 1259 0 0 109 1 0 0 25 0 9 0 721528339 184283136 6179 33554432000 4194304 4417452 140736501501312 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=180476 CPUtime=1.09 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 3396 1259 0 0 109 0 0 0 25 0 9 0 721528339 184807424 6180 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=180476 CPUtime=1.09 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 2883 1259 0 0 109 0 0 0 25 0 9 0 721528339 184807424 6200 33554432000 4194304 4417452 140736501501312 18446744073709551615 4302930 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=180476 CPUtime=1.09 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 3293 1259 0 0 109 0 0 0 19 0 9 0 721528339 184807424 6220 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364958 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=180476 CPUtime=1.09 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 3610 1259 0 0 109 0 0 0 18 0 9 0 721528339 184807424 6239 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 8.82
Current children cumulated vsize (KiB) 179964

[startup+1.53016 s]
/proc/loadavg: 8.03 8.05 8.07 1/474 4209
/proc/meminfo: memFree=28914880/32951124 swapFree=38422216/67111528
[pid=4209] ppid=4207 vsize=180464 CPUtime=12.13 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 42493 1259 0 0 1205 8 0 0 25 0 9 0 721528338 184795136 6265 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 45116 6265 180 55 0 43002 0
[pid=4209/tid=4215] ppid=4207 vsize=180464 CPUtime=1.51 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 5162 1259 0 0 151 0 0 0 25 0 9 0 721528339 184795136 6265 33554432000 4194304 4417452 140736501501312 18446744073709551615 4321570 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=180464 CPUtime=1.51 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 5187 1259 0 0 150 1 0 0 20 0 9 0 721528339 184795136 6265 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=180464 CPUtime=1.49 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 5389 1259 0 0 149 0 0 0 25 0 9 0 721528339 184795136 6265 33554432000 4194304 4417452 140736501501312 18446744073709551615 212435710952 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=180464 CPUtime=1.51 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 5838 1259 0 0 150 1 0 0 25 0 9 0 721528339 184795136 6265 33554432000 4194304 4417452 140736501501312 18446744073709551615 4356843 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=180464 CPUtime=1.51 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) D 4207 4209 3728 0 -1 4202560 5164 1259 0 0 150 1 0 0 25 0 9 0 721528339 184795136 6265 33554432000 4194304 4417452 140736501501312 18446744073709551615 212436074922 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=180464 CPUtime=1.51 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 4897 1259 0 0 150 1 0 0 25 0 9 0 721528339 184795136 6265 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=180464 CPUtime=1.5 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 5119 1259 0 0 150 0 0 0 18 0 9 0 721528339 184795136 6265 33554432000 4194304 4417452 140736501501312 18446744073709551615 212435710937 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=180464 CPUtime=1.51 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 5313 1259 0 0 151 0 0 0 18 0 9 0 721528339 184795136 6265 33554432000 4194304 4417452 140736501501312 18446744073709551615 4250697 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.13
Current children cumulated vsize (KiB) 180464

[startup+3.10125 s]
/proc/loadavg: 8.03 8.05 8.07 9/483 4223
/proc/meminfo: memFree=28876156/32951124 swapFree=38422216/67111528
[pid=4209] ppid=4207 vsize=192348 CPUtime=24.71 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 93539 1259 0 0 2454 17 0 0 25 0 9 0 721528338 196964352 9275 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 48087 9275 180 55 0 45973 0
[pid=4209/tid=4215] ppid=4207 vsize=191836 CPUtime=3.1 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 11955 1259 0 0 308 2 0 0 25 0 9 0 721528339 196440064 9147 33554432000 4194304 4417452 140736501501312 18446744073709551615 4353504 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=191836 CPUtime=3.09 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 12605 1259 0 0 307 2 0 0 25 0 9 0 721528339 196440064 9147 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=191836 CPUtime=3.08 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 11037 1259 0 0 307 1 0 0 25 0 9 0 721528339 196440064 9147 33554432000 4194304 4417452 140736501501312 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=191836 CPUtime=3.1 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 9439 1259 0 0 308 2 0 0 25 0 9 0 721528339 196440064 9147 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=191836 CPUtime=3.09 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 12767 1259 0 0 307 2 0 0 25 0 9 0 721528339 196440064 9147 33554432000 4194304 4417452 140736501501312 18446744073709551615 4366074 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=191836 CPUtime=3.1 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 11488 1259 0 0 308 2 0 0 25 0 9 0 721528339 196440064 9147 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364693 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=191836 CPUtime=3.05 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 11773 1259 0 0 304 1 0 0 20 0 9 0 721528339 196440064 9147 33554432000 4194304 4417452 140736501501312 18446744073709551615 4262817 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=191836 CPUtime=3.09 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 12435 1259 0 0 308 1 0 0 21 0 9 0 721528339 196440064 9147 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364903 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.71
Current children cumulated vsize (KiB) 192348

[startup+6.30064 s]
/proc/loadavg: 8.02 8.05 8.07 9/483 4223
/proc/meminfo: memFree=28864996/32951124 swapFree=38422216/67111528
[pid=4209] ppid=4207 vsize=211436 CPUtime=50.21 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 210558 1259 0 0 4986 35 0 0 25 0 9 0 721528338 216510464 14047 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 52859 14047 180 55 0 50745 0

################
# More data... #
################

Current children cumulated CPU time (s) 37222.5
Current children cumulated vsize (KiB) 2544328

[startup+4722.3 s]
/proc/loadavg: 8.02 8.04 8.00 9/483 4360
/proc/meminfo: memFree=26519360/32951124 swapFree=38422220/67111528
[pid=4209] ppid=4207 vsize=2544328 CPUtime=37701.5 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 21519794 1259 0 0 3766810 3342 0 0 25 0 9 0 721528338 2605391872 597286 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 636082 597286 180 55 0 633968 0
[pid=4209/tid=4215] ppid=4207 vsize=2544328 CPUtime=4721.25 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 2457208 1259 0 0 471782 343 0 0 25 0 9 0 721528339 2605391872 597286 33554432000 4194304 4417452 140736501501312 18446744073709551615 4263086 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=2544328 CPUtime=4722.42 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 3092424 1259 0 0 471768 474 0 0 25 0 9 0 721528339 2605391872 597286 33554432000 4194304 4417452 140736501501312 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=2544328 CPUtime=4722.41 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 3108633 1259 0 0 471759 482 0 0 25 0 9 0 721528339 2605391872 597286 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364896 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=2544328 CPUtime=4721.78 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 1001875 1259 0 0 471996 182 0 0 25 0 9 0 721528339 2605391872 597286 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=2544328 CPUtime=4722.27 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 2804904 1259 0 0 471786 441 0 0 25 0 9 0 721528339 2605391872 597286 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=2544328 CPUtime=4722.4 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 2645622 1259 0 0 471842 398 0 0 25 0 9 0 721528339 2605391872 597286 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=2544328 CPUtime=4646.49 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 3320540 1259 0 0 464129 520 0 0 25 0 9 0 721528339 2605391872 597286 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=2544328 CPUtime=4722.42 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 3088164 1259 0 0 471744 498 0 0 25 0 9 0 721528339 2605391872 597286 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 37701.5
Current children cumulated vsize (KiB) 2544328

[startup+4782.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/483 4362
/proc/meminfo: memFree=26458784/32951124 swapFree=38422220/67111528
[pid=4209] ppid=4207 vsize=2604848 CPUtime=38180.6 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 21580139 1259 0 0 3814704 3353 0 0 25 0 9 0 721528338 2667364352 612416 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 651212 612416 180 55 0 649098 0
[pid=4209/tid=4215] ppid=4207 vsize=2604848 CPUtime=4781.24 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 2457208 1259 0 0 477781 343 0 0 25 0 9 0 721528339 2667364352 612416 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=2604848 CPUtime=4782.42 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 3092424 1259 0 0 477768 474 0 0 25 0 9 0 721528339 2667364352 612416 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=2604848 CPUtime=4782.42 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 3157345 1259 0 0 477750 492 0 0 25 0 9 0 721528339 2667364352 612416 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=2604848 CPUtime=4781.78 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 1001875 1259 0 0 477996 182 0 0 25 0 9 0 721528339 2667364352 612416 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=2604848 CPUtime=4782.27 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 2804904 1259 0 0 477786 441 0 0 25 0 9 0 721528339 2667364352 612416 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=2604848 CPUtime=4782.41 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 2649063 1259 0 0 477842 399 0 0 25 0 9 0 721528339 2667364352 612416 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=2604848 CPUtime=4705.54 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 3320540 1259 0 0 470034 520 0 0 25 0 9 0 721528339 2667364352 612416 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=2604848 CPUtime=4782.43 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 3096356 1259 0 0 477744 499 0 0 25 0 9 0 721528339 2667364352 612416 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38180.6
Current children cumulated vsize (KiB) 2604848

[startup+4842.3 s]
/proc/loadavg: 8.04 8.04 8.00 9/483 4364
/proc/meminfo: memFree=26395628/32951124 swapFree=38422220/67111528
[pid=4209] ppid=4207 vsize=2667584 CPUtime=38659.6 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 21634018 1259 0 0 3862597 3363 0 0 25 0 9 0 721528338 2731606016 628100 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 666896 628100 180 55 0 664782 0
[pid=4209/tid=4215] ppid=4207 vsize=2667584 CPUtime=4841.22 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 2465400 1259 0 0 483778 344 0 0 25 0 9 0 721528339 2731606016 628100 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=2667584 CPUtime=4842.43 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 3092424 1259 0 0 483769 474 0 0 25 0 9 0 721528339 2731606016 628100 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=2667584 CPUtime=4842.42 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 3173729 1259 0 0 483748 494 0 0 25 0 9 0 721528339 2731606016 628100 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=2667584 CPUtime=4841.78 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 1001875 1259 0 0 483996 182 0 0 25 0 9 0 721528339 2731606016 628100 33554432000 4194304 4417452 140736501501312 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=2667584 CPUtime=4842.28 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 2804904 1259 0 0 483787 441 0 0 25 0 9 0 721528339 2731606016 628100 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=2667584 CPUtime=4842.42 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 2649063 1259 0 0 483843 399 0 0 25 0 9 0 721528339 2731606016 628100 33554432000 4194304 4417452 140736501501312 18446744073709551615 4344176 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=2667584 CPUtime=4764.55 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 3349843 1259 0 0 475929 526 0 0 25 0 9 0 721528339 2731606016 628100 33554432000 4194304 4417452 140736501501312 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=2667584 CPUtime=4842.43 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 3096356 1259 0 0 483744 499 0 0 25 0 9 0 721528339 2731606016 628100 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 38659.6
Current children cumulated vsize (KiB) 2667584

[startup+4902.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/483 4365
/proc/meminfo: memFree=26490564/32951124 swapFree=38422220/67111528
[pid=4209] ppid=4207 vsize=2572408 CPUtime=39138.6 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 21713451 1259 0 0 3910487 3377 0 0 25 0 9 0 721528338 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 643102 604306 180 55 0 640988 0
[pid=4209/tid=4215] ppid=4207 vsize=2572408 CPUtime=4901.21 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 2465400 1259 0 0 489777 344 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=2572408 CPUtime=4902.43 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 3139089 1259 0 0 489759 484 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=2572408 CPUtime=4902.42 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 3206497 1259 0 0 489744 498 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=2572408 CPUtime=4901.78 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 1001875 1259 0 0 489996 182 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=2572408 CPUtime=4902.28 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 2804904 1259 0 0 489787 441 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=2572408 CPUtime=4902.42 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 2649063 1259 0 0 489843 399 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=2572408 CPUtime=4823.61 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 3349843 1259 0 0 481834 527 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=2572408 CPUtime=4902.43 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 3096356 1259 0 0 489744 499 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39138.6
Current children cumulated vsize (KiB) 2572408

[startup+4962.3 s]
/proc/loadavg: 8.13 8.06 8.01 9/483 4367
/proc/meminfo: memFree=26490520/32951124 swapFree=38422220/67111528
[pid=4209] ppid=4207 vsize=2572408 CPUtime=39617.7 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 21738027 1259 0 0 3958387 3380 0 0 25 0 9 0 721528338 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 643102 604306 180 55 0 640988 0
[pid=4209/tid=4215] ppid=4207 vsize=2572408 CPUtime=4961.19 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 2473592 1259 0 0 495775 344 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=2572408 CPUtime=4962.44 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 3139089 1259 0 0 495760 484 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=2572408 CPUtime=4962.42 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 3222881 1259 0 0 495742 500 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=2572408 CPUtime=4961.78 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 1001875 1259 0 0 495996 182 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=2572408 CPUtime=4962.29 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 2804904 1259 0 0 495787 442 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4344154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=2572408 CPUtime=4962.42 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 2649063 1259 0 0 495843 399 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=2572408 CPUtime=4882.62 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 3349843 1259 0 0 487735 527 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=2572408 CPUtime=4962.44 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 3096356 1259 0 0 495745 499 0 0 25 0 9 0 721528339 2634145792 604306 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39617.7
Current children cumulated vsize (KiB) 2572408



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.2 s]
/proc/loadavg: 8.05 8.05 8.00 9/483 4368
/proc/meminfo: memFree=26438884/32951124 swapFree=38422220/67111528
[pid=4209] ppid=4207 vsize=2623816 CPUtime=40000.1 cores=0-7
/proc/4209/stat : 4209 (plingeling) S 4207 4209 3728 0 -1 4202496 21798146 1259 0 0 3996623 3389 0 0 25 0 9 0 721528338 2686787584 617158 33554432000 4194304 4417452 140736501501312 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 655954 617158 180 55 0 653840 0
[pid=4209/tid=4215] ppid=4207 vsize=2623816 CPUtime=5009.09 cores=0-7
/proc/4209/task/4215/stat : 4215 (plingeling) R 4207 4209 3728 0 -1 4202560 2505354 1259 0 0 500560 349 0 0 25 0 9 0 721528339 2686787584 617158 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4209/tid=4216] ppid=4207 vsize=2623816 CPUtime=5010.35 cores=0-7
/proc/4209/task/4216/stat : 4216 (plingeling) R 4207 4209 3728 0 -1 4202560 3159254 1259 0 0 500548 487 0 0 25 0 9 0 721528339 2686787584 617158 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4209/tid=4217] ppid=4207 vsize=2623816 CPUtime=5010.34 cores=0-7
/proc/4209/task/4217/stat : 4217 (plingeling) R 4207 4209 3728 0 -1 4202560 3231073 1259 0 0 500533 501 0 0 25 0 9 0 721528339 2686787584 617158 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4209/tid=4218] ppid=4207 vsize=2623816 CPUtime=5009.7 cores=0-7
/proc/4209/task/4218/stat : 4218 (plingeling) R 4207 4209 3728 0 -1 4202560 1001875 1259 0 0 500788 182 0 0 25 0 9 0 721528339 2686787584 617158 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4209/tid=4219] ppid=4207 vsize=2623816 CPUtime=5010.21 cores=0-7
/proc/4209/task/4219/stat : 4219 (plingeling) R 4207 4209 3728 0 -1 4202560 2804904 1259 0 0 500579 442 0 0 25 0 9 0 721528339 2686787584 617158 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4209/tid=4220] ppid=4207 vsize=2623816 CPUtime=5010.34 cores=0-7
/proc/4209/task/4220/stat : 4220 (plingeling) R 4207 4209 3728 0 -1 4202560 2649063 1259 0 0 500635 399 0 0 25 0 9 0 721528339 2686787584 617158 33554432000 4194304 4417452 140736501501312 18446744073709551615 4366113 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4209/tid=4221] ppid=4207 vsize=2623816 CPUtime=4929.75 cores=0-7
/proc/4209/task/4221/stat : 4221 (plingeling) R 4207 4209 3728 0 -1 4202560 3349843 1259 0 0 492448 527 0 0 25 0 9 0 721528339 2686787584 617158 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4209/tid=4222] ppid=4207 vsize=2623816 CPUtime=5010.36 cores=0-7
/proc/4209/task/4222/stat : 4222 (plingeling) R 4207 4209 3728 0 -1 4202560 3096356 1259 0 0 500537 499 0 0 25 0 9 0 721528339 2686787584 617158 33554432000 4194304 4417452 140736501501312 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.1
Current children cumulated vsize (KiB) 2623816

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.32 s]
/proc/loadavg: 8.05 8.05 8.00 2/477 4369
/proc/meminfo: memFree=28638940/32951124 swapFree=38422220/67111528
[pid=4209] ppid=4207 vsize=0 CPUtime=40000.4 cores=0-7
/proc/4209/stat : 4209 (plingeling) Z 4207 4209 3728 0 -1 4203548 21798146 1259 0 0 3996636 3400 0 0 18 0 2 0 721528338 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 4 0 0 0
/proc/4209/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.34
CPU time (s): 40000.4
CPU user time (s): 39966.4
CPU system time (s): 34.0128
CPU usage (%): 798.356
Max. virtual memory (cumulated for all children) (KiB): 2740376

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39966.4
system time used= 34.0128
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21799405
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2597
involuntary context switches= 191493

runsolver used 22.1916 second user time and 58.2321 second system time

The end

Launcher Data 

Begin job on node102 at 2011-05-22 23:21:00
IDJOB=3394542
IDBENCH=83230
IDSOLVER=1851
FILE ID=node102/3394542-1306099260
RUNJOBID= node102-1306094037-3742
PBS_JOBID= 13387953
Free space on /tmp= 73380 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-15-15-unsat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394542-1306099260/watcher-3394542-1306099260 -o /tmp/evaluation-result-3394542-1306099260/solver-3394542-1306099260 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394542-1306099260.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 647576009a3d34cc33c6dfd3ecb1a2ef
RANDOM SEED=1434398418

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28915020 kB
Buffers:         12832 kB
Cached:          83428 kB
SwapCached:      76168 kB
Active:          64492 kB
Inactive:      3745728 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28915020 kB
SwapTotal:    67111528 kB
SwapFree:     38422216 kB
Dirty:             328 kB
Writeback:           0 kB
AnonPages:     3650208 kB
Mapped:          13088 kB
Slab:            53472 kB
PageTables:      99628 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 135451880 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73380 MiB
End job on node102 at 2011-05-23 00:44:32