Trace number 3371036

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.21 1203.64

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_60_24_40_2-log.shuffled-as.sat03-119.cnf
MD5SUMcf96a8eea16f98b3cec72117cedd0285
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables120
Number of clauses48342
Sum of the clauses size483180
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 548
Number of clauses of size over 548294

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371036-1305429496/watcher-3371036-1305429496 -o /tmp/evaluation-result-3371036-1305429496/solver-3371036-1305429496 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371036-1305429496.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.19 8.13 7.63 5/358 21648
/proc/meminfo: memFree=21113844/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=9200 CPUtime=0 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) R 21646 21648 21414 0 -1 4202496 393 1259 0 0 0 0 0 0 25 0 1 0 654547284 9420800 322 33554432000 4194304 4417452 140735297082480 18446744073709551615 218905730816 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/21648/statm: 2348 331 147 55 0 234 0

[startup+0.0472151 s]
/proc/loadavg: 8.19 8.13 7.63 5/358 21648
/proc/meminfo: memFree=21113844/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=17040 CPUtime=0.04 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) R 21646 21648 21414 0 -1 4202496 2498 1259 0 0 4 0 0 0 25 0 1 0 654547284 17448960 2283 33554432000 4194304 4417452 140735297082480 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/21648/statm: 4260 2283 148 55 0 2146 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 17040

[startup+0.100241 s]
/proc/loadavg: 8.19 8.13 7.63 5/358 21648
/proc/meminfo: memFree=21113844/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=25232 CPUtime=0.09 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) R 21646 21648 21414 0 -1 4202496 4546 1259 0 0 9 0 0 0 25 0 1 0 654547284 25837568 4331 33554432000 4194304 4417452 140735297082480 18446744073709551615 218905730816 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/21648/statm: 6308 4331 148 55 0 4194 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25232

[startup+0.30019 s]
/proc/loadavg: 8.19 8.13 7.63 5/358 21648
/proc/meminfo: memFree=21113844/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=79704 CPUtime=0.83 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 9981 1259 0 0 82 1 0 0 25 0 5 0 654547284 81616896 7710 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 19926 7710 177 55 0 17812 0
Current children cumulated CPU time (s) 0.83
Current children cumulated vsize (KiB) 79704

[startup+0.701114 s]
/proc/loadavg: 8.19 8.13 7.63 5/358 21648
/proc/meminfo: memFree=21113844/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=76416 CPUtime=2.44 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 12716 1259 0 0 242 2 0 0 25 0 5 0 654547284 78249984 6889 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 19104 6889 178 55 0 16990 0
Current children cumulated CPU time (s) 2.44
Current children cumulated vsize (KiB) 76416

[startup+1.50097 s]
/proc/loadavg: 7.86 8.06 7.61 5/357 21659
/proc/meminfo: memFree=21230412/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=79600 CPUtime=5.62 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 15725 1259 0 0 560 2 0 0 25 0 5 0 654547284 81510400 7685 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 19900 7685 178 55 0 17786 0
[pid=21648/tid=21656] ppid=21646 vsize=79600 CPUtime=1.37 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 2199 1259 0 0 137 0 0 0 25 0 5 0 654547296 81510400 7685 33554432000 4194304 4417452 140735297082480 18446744073709551615 4357269 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=79600 CPUtime=1.36 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 2290 1259 0 0 136 0 0 0 25 0 5 0 654547296 81510400 7685 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=79600 CPUtime=1.37 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 2652 1259 0 0 137 0 0 0 25 0 5 0 654547296 81510400 7685 33554432000 4194304 4417452 140735297082480 18446744073709551615 4366105 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=79600 CPUtime=1.38 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 1978 1259 0 0 138 0 0 0 25 0 5 0 654547296 81510400 7685 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.62
Current children cumulated vsize (KiB) 79600

[startup+3.10062 s]
/proc/loadavg: 7.86 8.06 7.61 6/355 21660
/proc/meminfo: memFree=21230776/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=83736 CPUtime=12.02 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 22281 1259 0 0 1198 4 0 0 25 0 5 0 654547284 85745664 8741 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 20934 8741 178 55 0 18820 0
[pid=21648/tid=21656] ppid=21646 vsize=83736 CPUtime=2.97 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 3918 1259 0 0 297 0 0 0 25 0 5 0 654547296 85745664 8741 33554432000 4194304 4417452 140735297082480 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=83736 CPUtime=2.95 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 3738 1259 0 0 295 0 0 0 25 0 5 0 654547296 85745664 8741 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=83736 CPUtime=2.97 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 4665 1259 0 0 297 0 0 0 25 0 5 0 654547296 85745664 8741 33554432000 4194304 4417452 140735297082480 18446744073709551615 4321005 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=83736 CPUtime=2.97 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 3354 1259 0 0 297 0 0 0 25 0 5 0 654547296 85745664 8741 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364687 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.02
Current children cumulated vsize (KiB) 83736

[startup+6.30105 s]
/proc/loadavg: 7.86 8.06 7.61 9/363 21698
/proc/meminfo: memFree=21183432/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=88964 CPUtime=24.78 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 34192 1259 0 0 2473 5 0 0 25 0 5 0 654547284 91099136 10045 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 22241 10045 178 55 0 20127 0
[pid=21648/tid=21656] ppid=21646 vsize=88964 CPUtime=6.18 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 6941 1259 0 0 617 1 0 0 25 0 5 0 654547296 91099136 10045 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=88964 CPUtime=6.11 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 6561 1259 0 0 611 0 0 0 25 0 5 0 654547296 91099136 10045 33554432000 4194304 4417452 140735297082480 18446744073709551615 4356472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=88964 CPUtime=6.18 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 7684 1259 0 0 617 1 0 0 25 0 5 0 654547296 91099136 10045 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=88964 CPUtime=6.18 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 6400 1259 0 0 617 1 0 0 25 0 5 0 654547296 91099136 10045 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.78
Current children cumulated vsize (KiB) 88964

[startup+12.7009 s]
/proc/loadavg: 7.96 8.07 7.62 9/363 21698
/proc/meminfo: memFree=21152860/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=92008 CPUtime=50.31 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 56090 1259 0 0 5022 9 0 0 25 0 5 0 654547284 94216192 10787 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 23002 10787 178 55 0 20888 0
[pid=21648/tid=21656] ppid=21646 vsize=92008 CPUtime=12.58 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 13248 1259 0 0 1256 2 0 0 25 0 5 0 654547296 94216192 10787 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=92008 CPUtime=12.44 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 11831 1259 0 0 1243 1 0 0 25 0 5 0 654547296 94216192 10787 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=92008 CPUtime=12.58 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 13127 1259 0 0 1256 2 0 0 25 0 5 0 654547296 94216192 10787 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=92008 CPUtime=12.58 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 11278 1259 0 0 1256 2 0 0 25 0 5 0 654547296 94216192 10787 33554432000 4194304 4417452 140735297082480 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.31
Current children cumulated vsize (KiB) 92008

[startup+25.5006 s]
/proc/loadavg: 7.97 8.07 7.63 9/363 21699
/proc/meminfo: memFree=21080952/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=95728 CPUtime=101.35 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 92803 1259 0 0 10119 16 0 0 25 0 5 0 654547284 98025472 11717 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 23932 11717 178 55 0 21818 0
[pid=21648/tid=21656] ppid=21646 vsize=95728 CPUtime=25.37 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 23400 1259 0 0 2534 3 0 0 25 0 5 0 654547296 98025472 11717 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=95728 CPUtime=25.09 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 21024 1259 0 0 2506 3 0 0 25 0 5 0 654547296 98025472 11717 33554432000 4194304 4417452 140735297082480 18446744073709551615 4366082 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=95728 CPUtime=25.37 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 22003 1259 0 0 2533 4 0 0 25 0 5 0 654547296 98025472 11717 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=95728 CPUtime=25.38 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 19770 1259 0 0 2534 4 0 0 25 0 5 0 654547296 98025472 11717 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.35
Current children cumulated vsize (KiB) 95728

[startup+51.1009 s]
/proc/loadavg: 7.98 8.06 7.64 9/363 21699
/proc/meminfo: memFree=20987920/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=127224 CPUtime=203.48 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 157494 1259 0 0 20323 25 0 0 25 0 5 0 654547284 130277376 19591 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 31806 19591 178 55 0 29692 0
[pid=21648/tid=21656] ppid=21646 vsize=127224 CPUtime=50.97 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 40944 1259 0 0 5092 5 0 0 25 0 5 0 654547296 130277376 19591 33554432000 4194304 4417452 140735297082480 18446744073709551615 4242768 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=127224 CPUtime=50.42 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 38340 1259 0 0 5036 6 0 0 25 0 5 0 654547296 130277376 19591 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=127224 CPUtime=50.97 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 37352 1259 0 0 5091 6 0 0 25 0 5 0 654547296 130277376 19591 33554432000 4194304 4417452 140735297082480 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=127224 CPUtime=50.97 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 34252 1259 0 0 5092 5 0 0 25 0 5 0 654547296 130277376 19591 33554432000 4194304 4417452 140735297082480 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 203.48
Current children cumulated vsize (KiB) 127224

[startup+102.314 s]
/proc/loadavg: 8.11 8.08 7.66 9/363 21701
/proc/meminfo: memFree=20843056/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=160092 CPUtime=407.75 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 241865 1259 0 0 40737 38 0 0 25 0 5 0 654547284 163934208 27836 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 40023 27836 178 55 0 37909 0
[pid=21648/tid=21656] ppid=21646 vsize=160092 CPUtime=102.19 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 64824 1259 0 0 10210 9 0 0 25 0 5 0 654547296 163934208 27836 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=160092 CPUtime=101.05 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 62538 1259 0 0 10095 10 0 0 25 0 5 0 654547296 163934208 27836 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=160092 CPUtime=102.17 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 57754 1259 0 0 10209 8 0 0 25 0 5 0 654547296 163934208 27836 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=160092 CPUtime=102.19 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 50143 1259 0 0 10211 8 0 0 25 0 5 0 654547296 163934208 27836 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 407.75
Current children cumulated vsize (KiB) 160092

[startup+162.301 s]
/proc/loadavg: 8.12 8.09 7.69 9/363 21702
/proc/meminfo: memFree=20762180/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=185488 CPUtime=647.01 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 317612 1259 0 0 64651 50 0 0 25 0 5 0 654547284 189939712 34164 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 46372 34164 178 55 0 44258 0
[pid=21648/tid=21656] ppid=21646 vsize=185488 CPUtime=162.18 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 88612 1259 0 0 16205 13 0 0 25 0 5 0 654547296 189939712 34164 33554432000 4194304 4417452 140735297082480 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=185488 CPUtime=160.37 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 83879 1259 0 0 16023 14 0 0 25 0 5 0 654547296 189939712 34164 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=185488 CPUtime=162.14 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 78559 1259 0 0 16203 11 0 0 25 0 5 0 654547296 189939712 34164 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=185488 CPUtime=162.18 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 59956 1259 0 0 16208 10 0 0 25 0 5 0 654547296 189939712 34164 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 647.01
Current children cumulated vsize (KiB) 185488


################
# More data... #
################

[pid=21648/tid=21657] ppid=21646 vsize=468732 CPUtime=694.19 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 145484 1259 0 0 69392 27 0 0 25 0 5 0 654547296 479981568 104968 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=468732 CPUtime=702.05 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 148388 1259 0 0 70182 23 0 0 25 0 5 0 654547296 479981568 104968 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=468732 CPUtime=702.18 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 139954 1259 0 0 70195 23 0 0 25 0 5 0 654547296 479981568 104968 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2800.76
Current children cumulated vsize (KiB) 468732

[startup+762.313 s]
/proc/loadavg: 8.08 8.10 7.87 9/363 21720
/proc/meminfo: memFree=19919028/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=535884 CPUtime=3040.11 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 719261 1259 0 0 303899 112 0 0 25 0 5 0 654547284 548745216 121756 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 133971 121756 178 55 0 131857 0
[pid=21648/tid=21656] ppid=21646 vsize=535884 CPUtime=762.21 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 255236 1259 0 0 76188 33 0 0 25 0 5 0 654547296 548745216 121756 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=535884 CPUtime=753.52 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 157850 1259 0 0 75323 29 0 0 25 0 5 0 654547296 548745216 121756 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=535884 CPUtime=762.05 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 157874 1259 0 0 76181 24 0 0 25 0 5 0 654547296 548745216 121756 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=535884 CPUtime=762.19 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 141695 1259 0 0 76196 23 0 0 25 0 5 0 654547296 548745216 121756 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3040.11
Current children cumulated vsize (KiB) 535884

[startup+822.301 s]
/proc/loadavg: 8.08 8.09 7.88 9/363 21722
/proc/meminfo: memFree=19852644/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=537656 CPUtime=3279.37 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 729681 1259 0 0 327823 114 0 0 25 0 5 0 654547284 550559744 122199 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 134414 122199 178 55 0 132300 0
[pid=21648/tid=21656] ppid=21646 vsize=537656 CPUtime=822.2 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 264034 1259 0 0 82185 35 0 0 25 0 5 0 654547296 550559744 122199 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=537656 CPUtime=812.81 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 159472 1259 0 0 81252 29 0 0 25 0 5 0 654547296 550559744 122199 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=537656 CPUtime=822.04 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 157874 1259 0 0 82179 25 0 0 25 0 5 0 654547296 550559744 122199 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=537656 CPUtime=822.18 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 141695 1259 0 0 82195 23 0 0 25 0 5 0 654547296 550559744 122199 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3279.37
Current children cumulated vsize (KiB) 537656

[startup+882.301 s]
/proc/loadavg: 8.07 8.09 7.89 9/363 21725
/proc/meminfo: memFree=19750912/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=554600 CPUtime=3518.66 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 769784 1259 0 0 351746 120 0 0 25 0 5 0 654547284 567910400 126434 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 138650 126434 178 55 0 136536 0
[pid=21648/tid=21656] ppid=21646 vsize=554600 CPUtime=882.2 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 271981 1259 0 0 88184 36 0 0 25 0 5 0 654547296 567910400 126434 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=554600 CPUtime=872.12 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 171762 1259 0 0 87180 32 0 0 25 0 5 0 654547296 567910400 126434 33554432000 4194304 4417452 140735297082480 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=554600 CPUtime=882.03 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 166066 1259 0 0 88177 26 0 0 25 0 5 0 654547296 567910400 126434 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=554600 CPUtime=882.18 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 153369 1259 0 0 88193 25 0 0 25 0 5 0 654547296 567910400 126434 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3518.66
Current children cumulated vsize (KiB) 554600

[startup+942.301 s]
/proc/loadavg: 8.11 8.10 7.91 9/363 21726
/proc/meminfo: memFree=19666668/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=558784 CPUtime=3757.97 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 779809 1259 0 0 375675 122 0 0 25 0 5 0 654547284 572194816 127481 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 139696 127481 178 55 0 137582 0
[pid=21648/tid=21656] ppid=21646 vsize=558784 CPUtime=942.2 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 281461 1259 0 0 94183 37 0 0 25 0 5 0 654547296 572194816 127481 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=558784 CPUtime=931.43 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 172307 1259 0 0 93111 32 0 0 25 0 5 0 654547296 572194816 127481 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=558784 CPUtime=942.02 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 166066 1259 0 0 94176 26 0 0 25 0 5 0 654547296 572194816 127481 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=558784 CPUtime=942.18 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 153369 1259 0 0 94193 25 0 0 25 0 5 0 654547296 572194816 127481 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3757.97
Current children cumulated vsize (KiB) 558784

[startup+1002.3 s]
/proc/loadavg: 8.12 8.11 7.92 9/363 21729
/proc/meminfo: memFree=19616036/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=604196 CPUtime=3997.28 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 800556 1259 0 0 399603 125 0 0 25 0 5 0 654547284 618696704 138834 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 151049 138834 178 55 0 148935 0
[pid=21648/tid=21656] ppid=21646 vsize=604196 CPUtime=1002.2 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 290683 1259 0 0 100182 38 0 0 25 0 5 0 654547296 618696704 138834 33554432000 4194304 4417452 140735297082480 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=604196 CPUtime=990.75 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 172307 1259 0 0 99043 32 0 0 25 0 5 0 654547296 618696704 138834 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=604196 CPUtime=1002.01 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 166066 1259 0 0 100175 26 0 0 25 0 5 0 654547296 618696704 138834 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=604196 CPUtime=1002.17 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 164894 1259 0 0 100190 27 0 0 25 0 5 0 654547296 618696704 138834 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3997.28
Current children cumulated vsize (KiB) 604196

[startup+1062.3 s]
/proc/loadavg: 8.12 8.11 7.93 9/363 21730
/proc/meminfo: memFree=19644896/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=657040 CPUtime=4236.6 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 825496 1259 0 0 423530 130 0 0 25 0 5 0 654547284 672808960 152045 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 164260 152045 178 55 0 162146 0
[pid=21648/tid=21656] ppid=21646 vsize=657040 CPUtime=1062.2 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 302392 1259 0 0 106181 39 0 0 25 0 5 0 654547296 672808960 152045 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=657040 CPUtime=1050.08 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 180499 1259 0 0 104974 34 0 0 25 0 5 0 654547296 672808960 152045 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=657040 CPUtime=1061.99 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 171105 1259 0 0 106173 26 0 0 25 0 5 0 654547296 672808960 152045 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=657040 CPUtime=1062.17 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 164894 1259 0 0 106190 27 0 0 25 0 5 0 654547296 672808960 152045 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4236.6
Current children cumulated vsize (KiB) 657040

[startup+1122.3 s]
/proc/loadavg: 8.11 8.12 7.94 9/363 21732
/proc/meminfo: memFree=19591648/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=676468 CPUtime=4475.88 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 859354 1259 0 0 447454 134 0 0 25 0 5 0 654547284 692703232 156902 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 169117 156902 178 55 0 167003 0
[pid=21648/tid=21656] ppid=21646 vsize=676468 CPUtime=1122.2 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 309343 1259 0 0 112180 40 0 0 25 0 5 0 654547296 692703232 156902 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=676468 CPUtime=1109.36 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 193270 1259 0 0 110901 35 0 0 25 0 5 0 654547296 692703232 156902 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=676468 CPUtime=1121.98 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 185241 1259 0 0 112170 28 0 0 25 0 5 0 654547296 692703232 156902 33554432000 4194304 4417452 140735297082480 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=676468 CPUtime=1122.17 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 164894 1259 0 0 112190 27 0 0 25 0 5 0 654547296 692703232 156902 33554432000 4194304 4417452 140735297082480 18446744073709551615 4357168 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4475.88
Current children cumulated vsize (KiB) 676468

[startup+1182.3 s]
/proc/loadavg: 8.11 8.12 7.95 9/363 21734
/proc/meminfo: memFree=19590604/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=644072 CPUtime=4715.17 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 868924 1259 0 0 471382 135 0 0 25 0 5 0 654547284 659529728 148803 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 161018 148803 178 55 0 158904 0
[pid=21648/tid=21656] ppid=21646 vsize=644072 CPUtime=1182.2 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 318913 1259 0 0 118179 41 0 0 25 0 5 0 654547296 659529728 148803 33554432000 4194304 4417452 140735297082480 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=644072 CPUtime=1168.67 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 193270 1259 0 0 116832 35 0 0 25 0 5 0 654547296 659529728 148803 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=644072 CPUtime=1181.97 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 185241 1259 0 0 118169 28 0 0 25 0 5 0 654547296 659529728 148803 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=644072 CPUtime=1182.17 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 164894 1259 0 0 118190 27 0 0 25 0 5 0 654547296 659529728 148803 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4715.17
Current children cumulated vsize (KiB) 644072



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.6 s]
/proc/loadavg: 8.14 8.13 7.96 9/363 21734
/proc/meminfo: memFree=19454180/32951124 swapFree=65581052/67111528
[pid=21648] ppid=21646 vsize=644028 CPUtime=4800.13 cores=0,2,4,6
/proc/21648/stat : 21648 (plingeling) S 21646 21648 21414 0 -1 4202496 872430 1259 0 0 479877 136 0 0 25 0 5 0 654547284 659484672 148792 33554432000 4194304 4417452 140735297082480 18446744073709551615 218917533669 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/21648/statm: 161007 148792 178 55 0 158893 0
[pid=21648/tid=21656] ppid=21646 vsize=644028 CPUtime=1203.52 cores=0,2,4,6
/proc/21648/task/21656/stat : 21656 (plingeling) R 21646 21648 21414 0 -1 4202560 322419 1259 0 0 120310 42 0 0 25 0 5 0 654547296 659484672 148792 33554432000 4194304 4417452 140735297082480 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21648/tid=21657] ppid=21646 vsize=644028 CPUtime=1189.71 cores=0,2,4,6
/proc/21648/task/21657/stat : 21657 (plingeling) R 21646 21648 21414 0 -1 4202560 193270 1259 0 0 118936 35 0 0 25 0 5 0 654547296 659484672 148792 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21648/tid=21658] ppid=21646 vsize=644028 CPUtime=1203.28 cores=0,2,4,6
/proc/21648/task/21658/stat : 21658 (plingeling) R 21646 21648 21414 0 -1 4202560 185241 1259 0 0 120300 28 0 0 25 0 5 0 654547296 659484672 148792 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21648/tid=21659] ppid=21646 vsize=644028 CPUtime=1203.49 cores=0,2,4,6
/proc/21648/task/21659/stat : 21659 (plingeling) R 21646 21648 21414 0 -1 4202560 164894 1259 0 0 120322 27 0 0 25 0 5 0 654547296 659484672 148792 33554432000 4194304 4417452 140735297082480 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.13
Current children cumulated vsize (KiB) 644028

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.64
CPU time (s): 4800.21
CPU user time (s): 4798.82
CPU system time (s): 1.38979
CPU usage (%): 398.806
Max. virtual memory (cumulated for all children) (KiB): 708332

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.82
system time used= 1.38979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 873689
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 66
involuntary context switches= 21642

runsolver used 3.9584 second user time and 9.8625 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-15 05:18:16
IDJOB=3371036
IDBENCH=83894
IDSOLVER=1848
FILE ID=node137/3371036-1305429496
RUNJOBID= node137-1305427084-21432
PBS_JOBID= 13324606
Free space on /tmp= 73796 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_60_24_40_2-log.shuffled-as.sat03-119.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371036-1305429496/watcher-3371036-1305429496 -o /tmp/evaluation-result-3371036-1305429496/solver-3371036-1305429496 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371036-1305429496.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cf96a8eea16f98b3cec72117cedd0285
RANDOM SEED=415495364

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21114000 kB
Buffers:        291528 kB
Cached:        3731400 kB
SwapCached:      36328 kB
Active:        1784820 kB
Inactive:      9827648 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21114000 kB
SwapTotal:    67111528 kB
SwapFree:     65581052 kB
Dirty:            1972 kB
Writeback:           0 kB
AnonPages:     7562748 kB
Mapped:          19536 kB
Slab:           120936 kB
PageTables:      39180 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 76107272 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73796 MiB
End job on node137 at 2011-05-15 05:38:21