Trace number 3371020

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.28 1204.5

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v945c61409g3.cnf
MD5SUM226123ce9245dfa4b876682016123861
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark12.0692
Satisfiable
(Un)Satisfiability was proved
Number of variables945
Number of clauses61409
Sum of the clauses size123673
Maximum clause length21
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 261364
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371020-1305418966/watcher-3371020-1305418966 -o /tmp/evaluation-result-3371020-1305418966/solver-3371020-1305418966 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371020-1305418966.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.08 7.63 7.63 2/410 9548
/proc/meminfo: memFree=21325520/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=9592 CPUtime=0 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) R 9546 9548 9516 0 -1 4202496 472 1250 0 0 0 0 0 0 25 0 1 0 732127381 9822208 402 33554432000 4194304 4417452 140735521333952 18446744073709551615 215988592384 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/9548/statm: 2398 402 147 55 0 284 0

[startup+0.021442 s]
/proc/loadavg: 6.08 7.63 7.63 2/410 9548
/proc/meminfo: memFree=21325520/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=12284 CPUtime=0.01 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) R 9546 9548 9516 0 -1 4202496 1024 1250 0 0 1 0 0 0 25 0 1 0 732127381 12578816 954 33554432000 4194304 4417452 140735521333952 18446744073709551615 215988286445 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/9548/statm: 3071 978 148 55 0 957 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 12284

[startup+0.147422 s]
/proc/loadavg: 6.08 7.63 7.63 2/410 9548
/proc/meminfo: memFree=21325520/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=126336 CPUtime=0.44 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 4357 1250 0 0 44 0 0 0 25 0 5 0 732127381 129368064 2911 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 31584 2911 176 55 0 29470 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 126336

[startup+0.300395 s]
/proc/loadavg: 6.08 7.63 7.63 2/410 9548
/proc/meminfo: memFree=21325520/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=129796 CPUtime=1.06 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 5691 1250 0 0 105 1 0 0 25 0 5 0 732127381 132911104 3880 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 32449 3880 180 55 0 30335 0
Current children cumulated CPU time (s) 1.06
Current children cumulated vsize (KiB) 129796

[startup+0.700326 s]
/proc/loadavg: 6.08 7.63 7.63 2/410 9548
/proc/meminfo: memFree=21325520/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=134568 CPUtime=2.66 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 7632 1250 0 0 265 1 0 0 25 0 5 0 732127381 137797632 5073 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 33642 5073 180 55 0 31528 0
Current children cumulated CPU time (s) 2.66
Current children cumulated vsize (KiB) 134568

[startup+1.50119 s]
/proc/loadavg: 6.08 7.63 7.63 9/422 9573
/proc/meminfo: memFree=21290068/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=143244 CPUtime=5.84 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 10909 1250 0 0 583 1 0 0 25 0 5 0 732127381 146681856 7242 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 35811 7242 180 55 0 33697 0
[pid=9548/tid=9570] ppid=9546 vsize=143244 CPUtime=1.45 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 1293 1250 0 0 145 0 0 0 25 0 5 0 732127385 146681856 7242 33554432000 4194304 4417452 140735521333952 18446744073709551615 4337310 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=143244 CPUtime=1.45 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 878 1250 0 0 145 0 0 0 25 0 5 0 732127386 146681856 7242 33554432000 4194304 4417452 140735521333952 18446744073709551615 4236280 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=143244 CPUtime=1.45 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 804 1250 0 0 145 0 0 0 25 0 5 0 732127386 146681856 7242 33554432000 4194304 4417452 140735521333952 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=143244 CPUtime=1.43 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 5496 1250 0 0 143 0 0 0 25 0 5 0 732127386 146681856 7242 33554432000 4194304 4417452 140735521333952 18446744073709551615 4250517 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.84
Current children cumulated vsize (KiB) 143244

[startup+3.10091 s]
/proc/loadavg: 6.08 7.63 7.63 9/422 9573
/proc/meminfo: memFree=21277916/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=144352 CPUtime=12.23 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 15036 1250 0 0 1221 2 0 0 25 0 5 0 732127381 147816448 7519 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 36088 7519 180 55 0 33974 0
[pid=9548/tid=9570] ppid=9546 vsize=144352 CPUtime=3.05 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 1293 1250 0 0 305 0 0 0 25 0 5 0 732127385 147816448 7519 33554432000 4194304 4417452 140735521333952 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=144352 CPUtime=3.05 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 878 1250 0 0 305 0 0 0 25 0 5 0 732127386 147816448 7519 33554432000 4194304 4417452 140735521333952 18446744073709551615 4250332 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=144352 CPUtime=3.05 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 1050 1250 0 0 305 0 0 0 25 0 5 0 732127386 147816448 7519 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=144352 CPUtime=3.02 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 9377 1250 0 0 301 1 0 0 25 0 5 0 732127386 147816448 7519 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.23
Current children cumulated vsize (KiB) 144352

[startup+6.30035 s]
/proc/loadavg: 6.23 7.64 7.63 9/422 9573
/proc/meminfo: memFree=21244816/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=159280 CPUtime=24.98 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 25118 1250 0 0 2494 4 0 0 25 0 5 0 732127381 163102720 11251 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 39820 11251 180 55 0 37706 0
[pid=9548/tid=9570] ppid=9546 vsize=159280 CPUtime=6.25 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 1788 1250 0 0 625 0 0 0 25 0 5 0 732127385 163102720 11251 33554432000 4194304 4417452 140735521333952 18446744073709551615 4353661 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=159280 CPUtime=6.25 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 1869 1250 0 0 625 0 0 0 25 0 5 0 732127386 163102720 11251 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=159280 CPUtime=6.25 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 1472 1250 0 0 625 0 0 0 25 0 5 0 732127386 163102720 11251 33554432000 4194304 4417452 140735521333952 18446744073709551615 4277559 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=159280 CPUtime=6.18 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 17551 1250 0 0 615 3 0 0 25 0 5 0 732127386 163102720 11251 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.98
Current children cumulated vsize (KiB) 159280

[startup+12.7002 s]
/proc/loadavg: 6.37 7.64 7.63 9/422 9574
/proc/meminfo: memFree=21219716/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=176292 CPUtime=50.5 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 40890 1250 0 0 5043 7 0 0 25 0 5 0 732127381 180523008 15504 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 44073 15504 180 55 0 41959 0
[pid=9548/tid=9570] ppid=9546 vsize=176292 CPUtime=12.65 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 2959 1250 0 0 1265 0 0 0 25 0 5 0 732127385 180523008 15504 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=176292 CPUtime=12.64 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 4227 1250 0 0 1264 0 0 0 25 0 5 0 732127386 180523008 15504 33554432000 4194304 4417452 140735521333952 18446744073709551615 4366407 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=176292 CPUtime=12.65 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 3413 1250 0 0 1265 0 0 0 25 0 5 0 732127386 180523008 15504 33554432000 4194304 4417452 140735521333952 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=176292 CPUtime=12.48 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 27853 1250 0 0 1243 5 0 0 25 0 5 0 732127386 180523008 15504 33554432000 4194304 4417452 140735521333952 18446744073709551615 4265443 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.5
Current children cumulated vsize (KiB) 176292

[startup+25.501 s]
/proc/loadavg: 6.73 7.66 7.64 9/422 9574
/proc/meminfo: memFree=21167860/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=215476 CPUtime=101.51 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 91846 1250 0 0 10136 15 0 0 25 0 5 0 732127381 220647424 25300 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 53869 25300 180 55 0 51755 0
[pid=9548/tid=9570] ppid=9546 vsize=215476 CPUtime=25.45 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 12241 1250 0 0 2544 1 0 0 25 0 5 0 732127385 220647424 25300 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=215476 CPUtime=25.45 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 12948 1250 0 0 2543 2 0 0 25 0 5 0 732127386 220647424 25300 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364903 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=215476 CPUtime=25.45 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 17065 1250 0 0 2543 2 0 0 25 0 5 0 732127386 220647424 25300 33554432000 4194304 4417452 140735521333952 18446744073709551615 4232595 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=215476 CPUtime=25.1 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 47154 1250 0 0 2502 8 0 0 25 0 5 0 732127386 220647424 25300 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.51
Current children cumulated vsize (KiB) 215476

[startup+51.1005 s]
/proc/loadavg: 7.30 7.72 7.66 9/422 9575
/proc/meminfo: memFree=21074324/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=272344 CPUtime=203.56 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 167584 1250 0 0 20330 26 0 0 25 0 5 0 732127381 278880256 39517 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 68086 39517 180 55 0 65972 0
[pid=9548/tid=9570] ppid=9546 vsize=272344 CPUtime=51.05 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 28201 1250 0 0 5102 3 0 0 25 0 5 0 732127385 278880256 39517 33554432000 4194304 4417452 140735521333952 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=272344 CPUtime=51.04 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 29943 1250 0 0 5100 4 0 0 25 0 5 0 732127386 278880256 39517 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=272344 CPUtime=51.05 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 32308 1250 0 0 5101 4 0 0 25 0 5 0 732127386 278880256 39517 33554432000 4194304 4417452 140735521333952 18446744073709551615 4354524 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=272344 CPUtime=50.35 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 74694 1250 0 0 5022 13 0 0 25 0 5 0 732127386 278880256 39517 33554432000 4194304 4417452 140735521333952 18446744073709551615 4357947 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.56
Current children cumulated vsize (KiB) 272344

[startup+102.316 s]
/proc/loadavg: 7.69 7.76 7.67 9/422 9612
/proc/meminfo: memFree=20988604/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=322632 CPUtime=407.72 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 291026 1250 0 0 40726 46 0 0 25 0 5 0 732127381 330375168 52089 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 80658 52089 180 55 0 78544 0
[pid=9548/tid=9570] ppid=9546 vsize=322632 CPUtime=102.26 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 55192 1250 0 0 10219 7 0 0 25 0 5 0 732127385 330375168 52089 33554432000 4194304 4417452 140735521333952 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=322632 CPUtime=102.26 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 59594 1250 0 0 10218 8 0 0 25 0 5 0 732127386 330375168 52089 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=322632 CPUtime=102.27 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 60329 1250 0 0 10218 9 0 0 25 0 5 0 732127386 330375168 52089 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=322632 CPUtime=100.85 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 113473 1250 0 0 10066 19 0 0 25 0 5 0 732127386 330375168 52089 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 407.72
Current children cumulated vsize (KiB) 322632

[startup+162.301 s]
/proc/loadavg: 8.07 7.85 7.70 9/422 9614
/proc/meminfo: memFree=20931652/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=309848 CPUtime=646.84 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 405352 1250 0 0 64618 66 0 0 25 0 5 0 732127381 317284352 48893 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 77462 48893 180 55 0 75348 0
[pid=9548/tid=9570] ppid=9546 vsize=309848 CPUtime=162.25 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 78428 1250 0 0 16213 12 0 0 25 0 5 0 732127385 317284352 48893 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=309848 CPUtime=162.24 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 90149 1250 0 0 16211 13 0 0 25 0 5 0 732127386 317284352 48893 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364885 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=309848 CPUtime=162.25 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 90782 1250 0 0 16210 15 0 0 25 0 5 0 732127386 317284352 48893 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=309848 CPUtime=160.01 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 143555 1250 0 0 15977 24 0 0 25 0 5 0 732127386 317284352 48893 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 646.84
Current children cumulated vsize (KiB) 309848


################
# More data... #
################

[pid=9548/tid=9571] ppid=9546 vsize=629548 CPUtime=702.26 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 246265 1250 0 0 70190 36 0 0 25 0 5 0 732127386 644657152 128850 33554432000 4194304 4417452 140735521333952 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=629548 CPUtime=702.26 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 273154 1250 0 0 70185 41 0 0 25 0 5 0 732127386 644657152 128850 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=629548 CPUtime=692.55 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 331370 1250 0 0 69197 58 0 0 25 0 5 0 732127386 644657152 128850 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2799.41
Current children cumulated vsize (KiB) 629548

[startup+762.316 s]
/proc/loadavg: 8.04 8.06 7.88 9/422 9630
/proc/meminfo: memFree=19601448/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=794036 CPUtime=3038.64 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 1153756 1250 0 0 303681 183 0 0 25 0 5 0 732127381 813092864 169940 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 198509 169940 180 55 0 196395 0
[pid=9548/tid=9570] ppid=9546 vsize=794036 CPUtime=762.28 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 261141 1250 0 0 76187 41 0 0 25 0 5 0 732127385 813092864 169940 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=794036 CPUtime=762.28 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 246265 1250 0 0 76192 36 0 0 25 0 5 0 732127386 813092864 169940 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=794036 CPUtime=762.28 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 286921 1250 0 0 76184 44 0 0 25 0 5 0 732127386 813092864 169940 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=794036 CPUtime=751.74 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 356991 1250 0 0 75113 61 0 0 25 0 5 0 732127386 813092864 169940 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3038.64
Current children cumulated vsize (KiB) 794036

[startup+822.301 s]
/proc/loadavg: 8.16 8.09 7.90 9/422 9631
/proc/meminfo: memFree=19793232/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=904748 CPUtime=3277.76 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 1188856 1250 0 0 327589 187 0 0 25 0 5 0 732127381 926461952 197618 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 226187 197618 180 55 0 224073 0
[pid=9548/tid=9570] ppid=9546 vsize=904748 CPUtime=822.27 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 261141 1250 0 0 82186 41 0 0 25 0 5 0 732127385 926461952 197618 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=904748 CPUtime=822.26 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 265808 1250 0 0 82188 38 0 0 25 0 5 0 732127386 926461952 197618 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=904748 CPUtime=822.27 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 302478 1250 0 0 82181 46 0 0 25 0 5 0 732127386 926461952 197618 33554432000 4194304 4417452 140735521333952 18446744073709551615 4343748 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=904748 CPUtime=810.9 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 356991 1250 0 0 81029 61 0 0 25 0 5 0 732127386 926461952 197618 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3277.76
Current children cumulated vsize (KiB) 904748

[startup+882.301 s]
/proc/loadavg: 8.06 8.07 7.91 9/422 9633
/proc/meminfo: memFree=19711996/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=926764 CPUtime=3516.93 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 1253959 1250 0 0 351494 199 0 0 25 0 5 0 732127381 949006336 203122 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 231691 203122 180 55 0 229577 0
[pid=9548/tid=9570] ppid=9546 vsize=926764 CPUtime=882.27 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 277381 1250 0 0 88184 43 0 0 25 0 5 0 732127385 949006336 203122 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=926764 CPUtime=882.26 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 305049 1250 0 0 88180 46 0 0 25 0 5 0 732127386 949006336 203122 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=926764 CPUtime=882.27 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 302478 1250 0 0 88181 46 0 0 25 0 5 0 732127386 949006336 203122 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=926764 CPUtime=870.06 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 366613 1250 0 0 86943 63 0 0 25 0 5 0 732127386 949006336 203122 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3516.93
Current children cumulated vsize (KiB) 926764

[startup+942.301 s]
/proc/loadavg: 8.16 8.10 7.92 9/422 9634
/proc/meminfo: memFree=19765776/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=906276 CPUtime=3756.11 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 1325230 1250 0 0 375401 210 0 0 25 0 5 0 732127381 928026624 198000 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 226569 198000 180 55 0 224455 0
[pid=9548/tid=9570] ppid=9546 vsize=906276 CPUtime=942.27 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 303137 1250 0 0 94180 47 0 0 25 0 5 0 732127385 928026624 198000 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=906276 CPUtime=942.26 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 317828 1250 0 0 94179 47 0 0 25 0 5 0 732127386 928026624 198000 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=906276 CPUtime=942.27 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 318797 1250 0 0 94179 48 0 0 25 0 5 0 732127386 928026624 198000 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=906276 CPUtime=929.24 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 383030 1250 0 0 92858 66 0 0 25 0 5 0 732127386 928026624 198000 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3756.11
Current children cumulated vsize (KiB) 906276

[startup+1002.3 s]
/proc/loadavg: 8.37 8.16 7.95 9/422 9639
/proc/meminfo: memFree=19587876/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=945768 CPUtime=3994.47 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 1349246 1250 0 0 399233 214 0 0 25 0 5 0 732127381 968466432 207873 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 236442 207873 180 55 0 234328 0
[pid=9548/tid=9570] ppid=9546 vsize=945768 CPUtime=1002.27 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 306235 1250 0 0 100180 47 0 0 25 0 5 0 732127385 968466432 207873 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=945768 CPUtime=1001.46 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 317828 1250 0 0 100098 48 0 0 25 0 5 0 732127386 968466432 207873 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=945768 CPUtime=1002.27 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 336443 1250 0 0 100177 50 0 0 25 0 5 0 732127386 968466432 207873 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=945768 CPUtime=988.41 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 386302 1250 0 0 98773 68 0 0 25 0 5 0 732127386 968466432 207873 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3994.47
Current children cumulated vsize (KiB) 945768

[startup+1062.3 s]
/proc/loadavg: 8.20 8.14 7.96 9/422 9641
/proc/meminfo: memFree=19299624/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=1225324 CPUtime=4233.65 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 1427660 1250 0 0 423136 229 0 0 25 0 5 0 732127381 1254731776 277762 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 306331 277762 180 55 0 304217 0
[pid=9548/tid=9570] ppid=9546 vsize=1225324 CPUtime=1062.27 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 331573 1250 0 0 106176 51 0 0 25 0 5 0 732127385 1254731776 277762 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=1225324 CPUtime=1061.46 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 341686 1250 0 0 106094 52 0 0 25 0 5 0 732127386 1254731776 277762 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=1225324 CPUtime=1062.27 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 336443 1250 0 0 106177 50 0 0 25 0 5 0 732127386 1254731776 277762 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=1225324 CPUtime=1047.59 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 415520 1250 0 0 104685 74 0 0 25 0 5 0 732127386 1254731776 277762 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4233.65
Current children cumulated vsize (KiB) 1225324

[startup+1122.3 s]
/proc/loadavg: 8.07 8.11 7.96 9/422 9642
/proc/meminfo: memFree=19258700/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=1247840 CPUtime=4472.82 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 1446975 1250 0 0 447049 233 0 0 25 0 5 0 732127381 1277788160 283391 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 311960 283391 180 55 0 309846 0
[pid=9548/tid=9570] ppid=9546 vsize=1247840 CPUtime=1122.27 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 331573 1250 0 0 112176 51 0 0 25 0 5 0 732127385 1277788160 283391 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=1247840 CPUtime=1121.46 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 341686 1250 0 0 112094 52 0 0 25 0 5 0 732127386 1277788160 283391 33554432000 4194304 4417452 140735521333952 18446744073709551615 4357159 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=1247840 CPUtime=1122.27 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 355758 1250 0 0 112173 54 0 0 25 0 5 0 732127386 1277788160 283391 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=1247840 CPUtime=1106.75 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 415520 1250 0 0 110601 74 0 0 25 0 5 0 732127386 1277788160 283391 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4472.82
Current children cumulated vsize (KiB) 1247840

[startup+1182.3 s]
/proc/loadavg: 8.15 8.12 7.97 9/422 9644
/proc/meminfo: memFree=18991688/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=1325492 CPUtime=4712 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 1487533 1250 0 0 470959 241 0 0 25 0 5 0 732127381 1357303808 302804 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 331373 302804 180 55 0 329259 0
[pid=9548/tid=9570] ppid=9546 vsize=1325492 CPUtime=1182.27 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 331573 1250 0 0 118176 51 0 0 25 0 5 0 732127385 1357303808 302804 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=1325492 CPUtime=1181.46 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 374052 1250 0 0 118088 58 0 0 25 0 5 0 732127386 1357303808 302804 33554432000 4194304 4417452 140735521333952 18446744073709551615 4346501 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=1325492 CPUtime=1182.27 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 355758 1250 0 0 118173 54 0 0 25 0 5 0 732127386 1357303808 302804 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=1325492 CPUtime=1165.93 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 423712 1250 0 0 116517 76 0 0 25 0 5 0 732127386 1357303808 302804 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4712
Current children cumulated vsize (KiB) 1325492



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.4 s]
/proc/loadavg: 8.10 8.11 7.97 10/422 9644
/proc/meminfo: memFree=18999736/32950940 swapFree=67111356/67111528
[pid=9548] ppid=9546 vsize=1335432 CPUtime=4800.15 cores=0,2,4,6
/proc/9548/stat : 9548 (plingeling) S 9546 9548 9516 0 -1 4202496 1521501 1250 0 0 479769 246 0 0 25 0 5 0 732127381 1367482368 305289 33554432000 4194304 4417452 140735521333952 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9548/statm: 333858 305289 180 55 0 331744 0
[pid=9548/tid=9570] ppid=9546 vsize=1335432 CPUtime=1204.4 cores=0,2,4,6
/proc/9548/task/9570/stat : 9570 (plingeling) R 9546 9548 9516 0 -1 4202560 331573 1250 0 0 120389 51 0 0 25 0 5 0 732127385 1367482368 305289 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9548/tid=9571] ppid=9546 vsize=1335432 CPUtime=1203.59 cores=0,2,4,6
/proc/9548/task/9571/stat : 9571 (plingeling) R 9546 9548 9516 0 -1 4202560 407302 1250 0 0 120296 63 0 0 25 0 5 0 732127386 1367482368 305289 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9548/tid=9572] ppid=9546 vsize=1335432 CPUtime=1204.4 cores=0,2,4,6
/proc/9548/task/9572/stat : 9572 (plingeling) R 9546 9548 9516 0 -1 4202560 355758 1250 0 0 120386 54 0 0 25 0 5 0 732127386 1367482368 305289 33554432000 4194304 4417452 140735521333952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9548/tid=9573] ppid=9546 vsize=1335432 CPUtime=1187.72 cores=0,2,4,6
/proc/9548/task/9573/stat : 9573 (plingeling) R 9546 9548 9516 0 -1 4202560 424430 1250 0 0 118696 76 0 0 25 0 5 0 732127386 1367482368 305289 33554432000 4194304 4417452 140735521333952 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.15
Current children cumulated vsize (KiB) 1335432

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.5
CPU time (s): 4800.28
CPU user time (s): 4797.75
CPU system time (s): 2.53161
CPU usage (%): 398.53
Max. virtual memory (cumulated for all children) (KiB): 1358260

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.75
system time used= 2.53161
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1522751
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 60
involuntary context switches= 24403

runsolver used 4.84426 second user time and 11.5942 second system time

The end

Launcher Data 

Begin job on node117 at 2011-05-15 02:22:46
IDJOB=3371020
IDBENCH=71301
IDSOLVER=1848
FILE ID=node117/3371020-1305418966
RUNJOBID= node117-1305418966-9534
PBS_JOBID= 13324567
Free space on /tmp= 73416 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v945c61409g3.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371020-1305418966/watcher-3371020-1305418966 -o /tmp/evaluation-result-3371020-1305418966/solver-3371020-1305418966 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371020-1305418966.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 226123ce9245dfa4b876682016123861
RANDOM SEED=1031771834

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      21325932 kB
Buffers:        301800 kB
Cached:        3087676 kB
SwapCached:          0 kB
Active:        9381804 kB
Inactive:      1888108 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      21325932 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:             820 kB
Writeback:           0 kB
AnonPages:     7881420 kB
Mapped:          31108 kB
Slab:           243628 kB
PageTables:      44864 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 100410720 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73412 MiB
End job on node117 at 2011-05-15 02:42:53