Trace number 3249624

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.34 1202.09

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-6x40.cnf
MD5SUM3a7a68cedc6ab84c0df9c27d166b0b6b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables960
Number of clauses48480
Sum of the clauses size191040
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21440
Number of clauses of size 30
Number of clauses of size 447040
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3249624-1304087278/watcher-3249624-1304087278 -o /tmp/evaluation-result-3249624-1304087278/solver-3249624-1304087278 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3249624-1304087278.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.45 5.20 6.79 2/174 20625
/proc/meminfo: memFree=30896632/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 216 0 0 0 0 0 0 0 22 0 1 0 598958416 8937472 146 33554432000 4194304 4417332 140734975720352 18446744073709551615 260020395776 0 0 4096 0 18446744071562362840 0 0 17 0 0 0 0
/proc/20625/statm: 2182 146 122 55 0 68 0

[startup+0.0905189 s]
/proc/loadavg: 3.45 5.20 6.79 2/174 20625
/proc/meminfo: memFree=30896632/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=12232 CPUtime=0.01 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) R 20623 20625 19459 0 -1 4202496 1283 1245 0 5 1 0 0 0 22 0 1 0 598958416 12525568 1080 33554432000 4194304 4417332 140734975720352 18446744073709551615 260020395776 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20625/statm: 3058 1080 147 55 0 944 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 12232

[startup+0.100515 s]
/proc/loadavg: 3.45 5.20 6.79 2/174 20625
/proc/meminfo: memFree=30896632/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=15304 CPUtime=0.02 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) R 20623 20625 19459 0 -1 4202496 2051 1245 0 5 2 0 0 0 22 0 1 0 598958416 15671296 1848 33554432000 4194304 4417332 140734975720352 18446744073709551615 4259889 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20625/statm: 3826 1848 147 55 0 1712 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 15304

[startup+0.300416 s]
/proc/loadavg: 3.45 5.20 6.79 2/174 20625
/proc/meminfo: memFree=30896632/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=72932 CPUtime=0.72 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 6463 1245 0 5 72 0 0 0 22 0 5 0 598958416 74682368 6039 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 18233 6039 179 55 0 16119 0
Current children cumulated CPU time (s) 0.72
Current children cumulated vsize (KiB) 72932

[startup+0.700372 s]
/proc/loadavg: 3.45 5.20 6.79 2/174 20625
/proc/meminfo: memFree=30896632/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=80752 CPUtime=2.32 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 9287 1245 0 5 231 1 0 0 22 0 5 0 598958416 82690048 7974 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 20188 7974 179 55 0 18074 0
Current children cumulated CPU time (s) 2.32
Current children cumulated vsize (KiB) 80752

[startup+1.50119 s]
/proc/loadavg: 3.45 5.20 6.79 6/182 20682
/proc/meminfo: memFree=30838052/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=87800 CPUtime=5.52 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 17326 1245 0 5 550 2 0 0 22 0 5 0 598958416 89907200 9736 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 21950 9736 179 55 0 19836 0
[pid=20625/tid=20647] ppid=20623 vsize=87800 CPUtime=1.36 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 2579 1245 0 5 136 0 0 0 25 0 5 0 598958429 89907200 9736 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364512 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=87800 CPUtime=1.36 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 1702 1245 0 5 136 0 0 0 25 0 5 0 598958429 89907200 9736 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=87800 CPUtime=1.35 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 3895 1245 0 5 135 0 0 0 25 0 5 0 598958429 89907200 9736 33554432000 4194304 4417332 140734975720352 18446744073709551615 4245679 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=87800 CPUtime=1.36 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 5551 1245 0 5 136 0 0 0 25 0 5 0 598958429 89907200 9736 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.52
Current children cumulated vsize (KiB) 87800

[startup+3.1009 s]
/proc/loadavg: 3.45 5.20 6.79 9/186 20686
/proc/meminfo: memFree=30748492/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=104608 CPUtime=11.91 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 34231 1245 0 5 1186 5 0 0 22 0 5 0 598958416 107118592 13938 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 26152 13938 179 55 0 24038 0
[pid=20625/tid=20647] ppid=20623 vsize=104608 CPUtime=2.96 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 6819 1245 0 5 295 1 0 0 25 0 5 0 598958429 107118592 13938 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=104608 CPUtime=2.96 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 4008 1245 0 5 296 0 0 0 25 0 5 0 598958429 107118592 13938 33554432000 4194304 4417332 140734975720352 18446744073709551615 4258176 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=104608 CPUtime=2.95 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 8700 1245 0 5 294 1 0 0 25 0 5 0 598958429 107118592 13938 33554432000 4194304 4417332 140734975720352 18446744073709551615 4249627 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=104608 CPUtime=2.96 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 11105 1245 0 5 295 1 0 0 25 0 5 0 598958429 107118592 13938 33554432000 4194304 4417332 140734975720352 18446744073709551615 4366592 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.91
Current children cumulated vsize (KiB) 104608

[startup+6.30031 s]
/proc/loadavg: 3.82 5.25 6.80 9/186 20687
/proc/meminfo: memFree=30657692/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=158432 CPUtime=24.69 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 70610 1245 0 5 2458 11 0 0 22 0 5 0 598958416 162234368 27395 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 39608 27395 180 55 0 37494 0
[pid=20625/tid=20647] ppid=20623 vsize=158432 CPUtime=6.16 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 19251 1245 0 5 613 3 0 0 25 0 5 0 598958429 162234368 27395 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364599 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=158432 CPUtime=6.16 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 11212 1245 0 5 614 2 0 0 25 0 5 0 598958429 162234368 27395 33554432000 4194304 4417332 140734975720352 18446744073709551615 4357641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=158432 CPUtime=6.13 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 20097 1245 0 5 610 3 0 0 25 0 5 0 598958429 162234368 27395 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=158432 CPUtime=6.16 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 16451 1245 0 5 614 2 0 0 25 0 5 0 598958429 162234368 27395 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.69
Current children cumulated vsize (KiB) 158432

[startup+12.7011 s]
/proc/loadavg: 4.15 5.30 6.81 9/186 20687
/proc/meminfo: memFree=30597272/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=205192 CPUtime=50.26 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 118589 1245 0 5 5007 19 0 0 22 0 5 0 598958416 210116608 39085 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 51298 39085 180 55 0 49184 0
[pid=20625/tid=20647] ppid=20623 vsize=205192 CPUtime=12.56 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 38360 1245 0 5 1250 6 0 0 25 0 5 0 598958429 210116608 39085 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=205192 CPUtime=12.55 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 17410 1245 0 5 1253 2 0 0 25 0 5 0 598958429 210116608 39085 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=205192 CPUtime=12.5 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 35928 1245 0 5 1244 6 0 0 25 0 5 0 598958429 210116608 39085 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=205192 CPUtime=12.56 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 23292 1245 0 5 1253 3 0 0 25 0 5 0 598958429 210116608 39085 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.26
Current children cumulated vsize (KiB) 205192

[startup+25.5008 s]
/proc/loadavg: 5.07 5.44 6.83 9/186 20687
/proc/meminfo: memFree=30388136/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=376012 CPUtime=101.39 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 196474 1245 0 5 10107 32 0 0 22 0 5 0 598958416 385036288 81790 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 94003 81790 180 55 0 91889 0
[pid=20625/tid=20647] ppid=20623 vsize=376012 CPUtime=25.36 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 66973 1245 0 5 2526 10 0 0 25 0 5 0 598958429 385036288 81790 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=376012 CPUtime=25.36 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 23222 1245 0 5 2533 3 0 0 25 0 5 0 598958429 385036288 81790 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=376012 CPUtime=25.23 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 64077 1245 0 5 2512 11 0 0 25 0 5 0 598958429 385036288 81790 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=376012 CPUtime=25.35 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 38603 1245 0 5 2530 5 0 0 25 0 5 0 598958429 385036288 81790 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.39
Current children cumulated vsize (KiB) 376012

[startup+51.1011 s]
/proc/loadavg: 6.07 5.65 6.86 9/186 20688
/proc/meminfo: memFree=30145200/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=455272 CPUtime=203.65 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 283466 1245 0 5 20319 46 0 0 22 0 5 0 598958416 466198528 101605 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 113818 101605 180 55 0 111704 0
[pid=20625/tid=20647] ppid=20623 vsize=455272 CPUtime=50.96 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 87271 1245 0 5 5082 14 0 0 25 0 5 0 598958429 466198528 101605 33554432000 4194304 4417332 140734975720352 18446744073709551615 4357975 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=455272 CPUtime=50.96 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 38800 1245 0 5 5091 5 0 0 25 0 5 0 598958429 466198528 101605 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=455272 CPUtime=50.69 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 89936 1245 0 5 5053 16 0 0 25 0 5 0 598958429 466198528 101605 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=455272 CPUtime=50.96 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 63860 1245 0 5 5087 9 0 0 25 0 5 0 598958429 466198528 101605 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.65
Current children cumulated vsize (KiB) 455272

[startup+102.307 s]
/proc/loadavg: 7.21 6.02 6.92 9/186 20689
/proc/meminfo: memFree=29659572/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=695980 CPUtime=408.2 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 561523 1245 0 5 40732 88 0 0 22 0 5 0 598958416 712683520 161782 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 173995 161782 180 55 0 171881 0
[pid=20625/tid=20647] ppid=20623 vsize=695980 CPUtime=102.16 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 206572 1245 0 5 10184 32 0 0 25 0 5 0 598958429 712683520 161782 33554432000 4194304 4417332 140734975720352 18446744073709551615 4354419 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=695980 CPUtime=102.17 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 87649 1245 0 5 10206 11 0 0 25 0 5 0 598958429 712683520 161782 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=695980 CPUtime=101.61 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 162913 1245 0 5 10133 28 0 0 25 0 5 0 598958429 712683520 161782 33554432000 4194304 4417332 140734975720352 18446744073709551615 4365007 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=695980 CPUtime=102.17 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 100790 1245 0 5 10202 15 0 0 25 0 5 0 598958429 712683520 161782 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 408.2
Current children cumulated vsize (KiB) 695980

[startup+162.301 s]
/proc/loadavg: 7.80 6.41 7.00 9/186 20691
/proc/meminfo: memFree=29404924/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=907852 CPUtime=647.85 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 873355 1245 0 5 64642 143 0 0 22 0 5 0 598958416 929640448 214750 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 226963 214750 180 55 0 224849 0
[pid=20625/tid=20647] ppid=20623 vsize=907852 CPUtime=162.16 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 297452 1245 0 5 16167 49 0 0 25 0 5 0 598958429 929640448 214750 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=907852 CPUtime=162.17 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 180521 1245 0 5 16192 25 0 0 25 0 5 0 598958429 929640448 214750 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=907852 CPUtime=161.28 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 254831 1245 0 5 16083 45 0 0 25 0 5 0 598958429 929640448 214750 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=907852 CPUtime=162.16 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 136952 1245 0 5 16194 22 0 0 25 0 5 0 598958429 929640448 214750 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.85
Current children cumulated vsize (KiB) 907852


################
# More data... #
################

[pid=20625/tid=20648] ppid=20623 vsize=1487496 CPUtime=702.18 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 567457 1245 0 5 70137 81 0 0 25 0 5 0 598958429 1523195904 359661 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=1487496 CPUtime=697.51 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 1084825 1245 0 5 69572 179 0 0 25 0 5 0 598958429 1523195904 359661 33554432000 4194304 4417332 140734975720352 18446744073709551615 4270167 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=1487496 CPUtime=702.17 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 338039 1245 0 5 70160 57 0 0 25 0 5 0 598958429 1523195904 359661 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2804.12
Current children cumulated vsize (KiB) 1487496

[startup+762.307 s]
/proc/loadavg: 8.18 7.95 7.54 9/186 20710
/proc/meminfo: memFree=27733660/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=1551452 CPUtime=3043.82 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 3041479 1245 0 5 303890 492 0 0 22 0 5 0 598958416 1588686848 375649 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 387863 375649 180 55 0 385749 0
[pid=20625/tid=20647] ppid=20623 vsize=1551452 CPUtime=762.19 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 953414 1245 0 5 76061 158 0 0 25 0 5 0 598958429 1588686848 375649 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=1551452 CPUtime=762.19 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 603245 1245 0 5 76134 85 0 0 25 0 5 0 598958429 1588686848 375649 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=1551452 CPUtime=757.17 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 1143182 1245 0 5 75528 189 0 0 25 0 5 0 598958429 1588686848 375649 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=1551452 CPUtime=762.18 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 338039 1245 0 5 76161 57 0 0 25 0 5 0 598958429 1588686848 375649 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3043.82
Current children cumulated vsize (KiB) 1551452

[startup+822.301 s]
/proc/loadavg: 8.11 7.97 7.57 9/186 20711
/proc/meminfo: memFree=27886108/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=1595180 CPUtime=3283.47 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 3198416 1245 0 5 327834 513 0 0 22 0 5 0 598958416 1633464320 386582 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 398795 386582 180 55 0 396681 0
[pid=20625/tid=20647] ppid=20623 vsize=1595180 CPUtime=822.18 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 985543 1245 0 5 82056 162 0 0 25 0 5 0 598958429 1633464320 386582 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=1595180 CPUtime=822.18 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 639860 1245 0 5 82128 90 0 0 25 0 5 0 598958429 1633464320 386582 33554432000 4194304 4417332 140734975720352 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=1595180 CPUtime=816.84 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 1224134 1245 0 5 81483 201 0 0 25 0 5 0 598958429 1633464320 386582 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=1595180 CPUtime=822.18 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 345280 1245 0 5 82160 58 0 0 25 0 5 0 598958429 1633464320 386582 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3283.47
Current children cumulated vsize (KiB) 1595180

[startup+882.301 s]
/proc/loadavg: 8.08 7.99 7.60 9/186 20713
/proc/meminfo: memFree=27643876/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=1604464 CPUtime=3523.14 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 3246878 1245 0 5 351792 522 0 0 22 0 5 0 598958416 1642971136 388903 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 401116 388903 180 55 0 399002 0
[pid=20625/tid=20647] ppid=20623 vsize=1604464 CPUtime=882.18 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 1007421 1245 0 5 88053 165 0 0 25 0 5 0 598958429 1642971136 388903 33554432000 4194304 4417332 140734975720352 18446744073709551615 4277945 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=1604464 CPUtime=882.18 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 666444 1245 0 5 88123 95 0 0 25 0 5 0 598958429 1642971136 388903 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=1604464 CPUtime=876.5 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 1224134 1245 0 5 87449 201 0 0 25 0 5 0 598958429 1642971136 388903 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=1604464 CPUtime=882.18 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 345280 1245 0 5 88160 58 0 0 25 0 5 0 598958429 1642971136 388903 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3523.14
Current children cumulated vsize (KiB) 1604464

[startup+942.301 s]
/proc/loadavg: 8.07 8.00 7.63 9/186 20715
/proc/meminfo: memFree=27617648/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=1785400 CPUtime=3762.82 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 3347015 1245 0 5 375744 538 0 0 22 0 5 0 598958416 1828249600 434137 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 446350 434137 180 55 0 444236 0
[pid=20625/tid=20647] ppid=20623 vsize=1785400 CPUtime=942.18 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 1031106 1245 0 5 94050 168 0 0 25 0 5 0 598958429 1828249600 434137 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=1785400 CPUtime=942.18 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 692166 1245 0 5 94118 100 0 0 25 0 5 0 598958429 1828249600 434137 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=1785400 CPUtime=936.18 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 1236712 1245 0 5 93414 204 0 0 25 0 5 0 598958429 1828249600 434137 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=1785400 CPUtime=942.17 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 383432 1245 0 5 94154 63 0 0 25 0 5 0 598958429 1828249600 434137 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3762.82
Current children cumulated vsize (KiB) 1785400

[startup+1002.3 s]
/proc/loadavg: 8.06 8.01 7.65 9/186 20716
/proc/meminfo: memFree=28023056/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=1590304 CPUtime=4002.49 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 3473517 1245 0 5 399688 561 0 0 22 0 5 0 598958416 1628471296 385363 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 397576 385363 180 55 0 395462 0
[pid=20625/tid=20647] ppid=20623 vsize=1590304 CPUtime=1002.19 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 1039763 1245 0 5 100048 171 0 0 25 0 5 0 598958429 1628471296 385363 33554432000 4194304 4417332 140734975720352 18446744073709551615 4344093 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=1590304 CPUtime=1002.19 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 735268 1245 0 5 100113 106 0 0 25 0 5 0 598958429 1628471296 385363 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=1590304 CPUtime=995.85 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 1311455 1245 0 5 99366 219 0 0 25 0 5 0 598958429 1628471296 385363 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=1590304 CPUtime=1002.17 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 383432 1245 0 5 100154 63 0 0 25 0 5 0 598958429 1628471296 385363 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4002.49
Current children cumulated vsize (KiB) 1590304

[startup+1062.3 s]
/proc/loadavg: 8.10 8.04 7.68 9/186 20718
/proc/meminfo: memFree=27752672/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=1562596 CPUtime=4242.17 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 3589524 1245 0 5 423633 584 0 0 22 0 5 0 598958416 1600098304 378436 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 390649 378436 180 55 0 388535 0
[pid=20625/tid=20647] ppid=20623 vsize=1562596 CPUtime=1062.18 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 1087382 1245 0 5 106040 178 0 0 25 0 5 0 598958429 1600098304 378436 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=1562596 CPUtime=1062.19 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 781506 1245 0 5 106103 116 0 0 25 0 5 0 598958429 1600098304 378436 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=1562596 CPUtime=1055.51 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 1311455 1245 0 5 105332 219 0 0 25 0 5 0 598958429 1600098304 378436 33554432000 4194304 4417332 140734975720352 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=1562596 CPUtime=1062.18 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 405582 1245 0 5 106150 68 0 0 25 0 5 0 598958429 1600098304 378436 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4242.17
Current children cumulated vsize (KiB) 1562596

[startup+1122.3 s]
/proc/loadavg: 8.07 8.04 7.70 9/186 20719
/proc/meminfo: memFree=27755080/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=1687116 CPUtime=4481.84 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 3659045 1245 0 5 447589 595 0 0 22 0 5 0 598958416 1727606784 409566 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 421779 409566 180 55 0 419665 0
[pid=20625/tid=20647] ppid=20623 vsize=1687116 CPUtime=1122.19 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 1088377 1245 0 5 112040 179 0 0 25 0 5 0 598958429 1727606784 409566 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=1687116 CPUtime=1122.19 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 796318 1245 0 5 112100 119 0 0 25 0 5 0 598958429 1727606784 409566 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=1687116 CPUtime=1115.18 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 1365169 1245 0 5 111291 227 0 0 25 0 5 0 598958429 1727606784 409566 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=1687116 CPUtime=1122.18 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 405582 1245 0 5 112150 68 0 0 25 0 5 0 598958429 1727606784 409566 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4481.84
Current children cumulated vsize (KiB) 1687116

[startup+1182.3 s]
/proc/loadavg: 8.06 8.05 7.73 9/186 20721
/proc/meminfo: memFree=27640036/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=1702112 CPUtime=4721.52 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 3834486 1245 0 5 471533 619 0 0 22 0 5 0 598958416 1742962688 413315 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 425528 413315 180 55 0 423414 0
[pid=20625/tid=20647] ppid=20623 vsize=1702112 CPUtime=1182.19 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 1153008 1245 0 5 118032 187 0 0 25 0 5 0 598958429 1742962688 413315 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=1702112 CPUtime=1182.2 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 843955 1245 0 5 118094 126 0 0 25 0 5 0 598958429 1742962688 413315 33554432000 4194304 4417332 140734975720352 18446744073709551615 4232787 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=1702112 CPUtime=1174.86 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 1428342 1245 0 5 117250 236 0 0 25 0 5 0 598958429 1742962688 413315 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=1702112 CPUtime=1182.19 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 405582 1245 0 5 118151 68 0 0 25 0 5 0 598958429 1742962688 413315 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4721.52
Current children cumulated vsize (KiB) 1702112



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202 s]
/proc/loadavg: 8.04 8.04 7.73 9/186 20721
/proc/meminfo: memFree=28018572/32951124 swapFree=67111464/67111528
[pid=20625] ppid=20623 vsize=1752536 CPUtime=4800.23 cores=0,2,4,6
/proc/20625/stat : 20625 (plingeling) S 20623 20625 19459 0 -1 4202496 3847092 1245 0 5 479402 621 0 0 22 0 5 0 598958416 1794596864 425921 33554432000 4194304 4417332 140734975720352 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20625/statm: 438134 425921 180 55 0 436020 0
[pid=20625/tid=20647] ppid=20623 vsize=1752536 CPUtime=1201.9 cores=0,2,4,6
/proc/20625/task/20647/stat : 20647 (plingeling) R 20623 20625 19459 0 -1 4202560 1155319 1245 0 5 120002 188 0 0 25 0 5 0 598958429 1794596864 425921 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20625/tid=20648] ppid=20623 vsize=1752536 CPUtime=1201.9 cores=0,2,4,6
/proc/20625/task/20648/stat : 20648 (plingeling) R 20623 20625 19459 0 -1 4202560 843955 1245 0 5 120064 126 0 0 25 0 5 0 598958429 1794596864 425921 33554432000 4194304 4417332 140734975720352 18446744073709551615 4251289 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20625/tid=20649] ppid=20623 vsize=1752536 CPUtime=1194.45 cores=0,2,4,6
/proc/20625/task/20649/stat : 20649 (plingeling) R 20623 20625 19459 0 -1 4202560 1438637 1245 0 5 119207 238 0 0 25 0 5 0 598958429 1794596864 425921 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20625/tid=20650] ppid=20623 vsize=1752536 CPUtime=1201.89 cores=0,2,4,6
/proc/20625/task/20650/stat : 20650 (plingeling) R 20623 20625 19459 0 -1 4202560 405582 1245 0 5 120121 68 0 0 25 0 5 0 598958429 1794596864 425921 33554432000 4194304 4417332 140734975720352 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 1752536

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.09
CPU time (s): 4800.34
CPU user time (s): 4794.04
CPU system time (s): 6.29904
CPU usage (%): 399.333
Max. virtual memory (cumulated for all children) (KiB): 2037220

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.04
system time used= 6.29904
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3848337
page faults= 5
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 119
involuntary context switches= 21627

runsolver used 1.9847 second user time and 4.54531 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-29 16:27:58
IDJOB=3249624
IDBENCH=83178
IDSOLVER=1605
FILE ID=node110/3249624-1304087278
RUNJOBID= node110-1304087278-20611
PBS_JOBID= 13170503
Free space on /tmp= 72840 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-6x40.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3249624-1304087278/watcher-3249624-1304087278 -o /tmp/evaluation-result-3249624-1304087278/solver-3249624-1304087278 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3249624-1304087278.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3a7a68cedc6ab84c0df9c27d166b0b6b
RANDOM SEED=1122693718

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30897656 kB
Buffers:        893404 kB
Cached:         690532 kB
SwapCached:         64 kB
Active:         117016 kB
Inactive:      1531700 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30897656 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:            1280 kB
Writeback:           0 kB
AnonPages:       64008 kB
Mapped:          14488 kB
Slab:           341868 kB
PageTables:       4344 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   191640 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72832 MiB
End job on node110 at 2011-04-29 16:48:02