Trace number 3370942

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.45 1207.37

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-14x38.cnf
MD5SUM56980124bab6f1dbe07ec523b7d59019
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2128
Number of clauses259616
Sum of the clauses size1032080
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23192
Number of clauses of size 30
Number of clauses of size 4256424
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3370942-1305425793/watcher-3370942-1305425793 -o /tmp/evaluation-result-3370942-1305425793/solver-3370942-1305425793 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3370942-1305425793.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.43 7.98 7.84 6/354 24422
/proc/meminfo: memFree=24070196/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=11612 CPUtime=0 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) R 24420 24422 23744 0 -1 4202496 998 1253 0 0 0 0 0 0 25 0 1 0 654176018 11890688 927 33554432000 4194304 4417452 140735452197536 18446744073709551615 254500691712 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/24422/statm: 2903 927 148 55 0 789 0

[startup+0.063837 s]
/proc/loadavg: 7.43 7.98 7.84 6/354 24422
/proc/meminfo: memFree=24070196/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=22508 CPUtime=0.05 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) R 24420 24422 23744 0 -1 4202496 3818 1253 0 0 5 0 0 0 25 0 1 0 654176018 23048192 3651 33554432000 4194304 4417452 140735452197536 18446744073709551615 254500691712 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/24422/statm: 5627 3651 148 55 0 3513 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 22508

[startup+0.100834 s]
/proc/loadavg: 7.43 7.98 7.84 6/354 24422
/proc/meminfo: memFree=24070196/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=26604 CPUtime=0.09 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) R 24420 24422 23744 0 -1 4202496 4842 1253 0 0 9 0 0 0 25 0 1 0 654176018 27242496 4675 33554432000 4194304 4417452 140735452197536 18446744073709551615 4323376 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/24422/statm: 6651 4675 148 55 0 4537 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26604

[startup+0.300792 s]
/proc/loadavg: 7.43 7.98 7.84 6/354 24422
/proc/meminfo: memFree=24070196/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=75756 CPUtime=0.29 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) R 24420 24422 23744 0 -1 4202496 17130 1253 0 0 28 1 0 0 25 0 1 0 654176018 77574144 16963 33554432000 4194304 4417452 140735452197536 18446744073709551615 4320814 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/24422/statm: 18939 16963 148 55 0 16825 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 75756

[startup+0.700649 s]
/proc/loadavg: 7.43 7.98 7.84 6/354 24422
/proc/meminfo: memFree=24070196/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=187372 CPUtime=1.78 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 22447 1253 0 0 176 2 0 0 25 0 5 0 654176018 191868928 18305 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 46843 18305 176 55 0 44729 0
Current children cumulated CPU time (s) 1.78
Current children cumulated vsize (KiB) 187372

[startup+1.50049 s]
/proc/loadavg: 7.43 7.98 7.84 9/359 24432
/proc/meminfo: memFree=23969920/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=204536 CPUtime=4.97 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 28903 1253 0 0 494 3 0 0 25 0 5 0 654176018 209444864 22568 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 51134 22568 180 55 0 49020 0
[pid=24422/tid=24429] ppid=24420 vsize=204536 CPUtime=1.15 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 2339 1253 0 0 115 0 0 0 25 0 5 0 654176051 209444864 22568 33554432000 4194304 4417452 140735452197536 18446744073709551615 4260675 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=204536 CPUtime=1.16 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 2332 1253 0 0 116 0 0 0 25 0 5 0 654176051 209444864 22568 33554432000 4194304 4417452 140735452197536 18446744073709551615 4331850 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=204536 CPUtime=1.16 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 3314 1253 0 0 116 0 0 0 19 0 5 0 654176051 209444864 22568 33554432000 4194304 4417452 140735452197536 18446744073709551615 4239401 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=204536 CPUtime=1.15 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 3776 1253 0 0 115 0 0 0 25 0 5 0 654176051 209444864 22568 33554432000 4194304 4417452 140735452197536 18446744073709551615 4251272 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4.97
Current children cumulated vsize (KiB) 204536

[startup+3.10117 s]
/proc/loadavg: 7.43 7.98 7.84 9/359 24432
/proc/meminfo: memFree=23932968/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=252552 CPUtime=11.37 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 42719 1253 0 0 1131 6 0 0 25 0 5 0 654176018 258613248 34572 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 63138 34572 180 55 0 61024 0
[pid=24422/tid=24429] ppid=24420 vsize=252552 CPUtime=2.73 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 6095 1253 0 0 273 0 0 0 25 0 5 0 654176051 258613248 34572 33554432000 4194304 4417452 140735452197536 18446744073709551615 4239418 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=252552 CPUtime=2.75 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 6088 1253 0 0 275 0 0 0 25 0 5 0 654176051 258613248 34572 33554432000 4194304 4417452 140735452197536 18446744073709551615 4239598 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=252552 CPUtime=2.76 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 5818 1253 0 0 275 1 0 0 23 0 5 0 654176051 258613248 34572 33554432000 4194304 4417452 140735452197536 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=252552 CPUtime=2.76 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 7576 1253 0 0 275 1 0 0 25 0 5 0 654176051 258613248 34572 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.37
Current children cumulated vsize (KiB) 252552

[startup+6.30053 s]
/proc/loadavg: 7.47 7.98 7.84 9/359 24432
/proc/meminfo: memFree=23846808/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=274988 CPUtime=24.13 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 51558 1253 0 0 2406 7 0 0 25 0 5 0 654176018 281587712 40156 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 68747 40156 180 55 0 66633 0
[pid=24422/tid=24429] ppid=24420 vsize=274988 CPUtime=5.89 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 6095 1253 0 0 589 0 0 0 25 0 5 0 654176051 281587712 40156 33554432000 4194304 4417452 140735452197536 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=274988 CPUtime=5.95 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 6088 1253 0 0 595 0 0 0 25 0 5 0 654176051 281587712 40156 33554432000 4194304 4417452 140735452197536 18446744073709551615 4250080 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=274988 CPUtime=5.96 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 5818 1253 0 0 595 1 0 0 25 0 5 0 654176051 281587712 40156 33554432000 4194304 4417452 140735452197536 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=274988 CPUtime=5.96 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 16415 1253 0 0 594 2 0 0 25 0 5 0 654176051 281587712 40156 33554432000 4194304 4417452 140735452197536 18446744073709551615 4250476 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.13
Current children cumulated vsize (KiB) 274988

[startup+12.7003 s]
/proc/loadavg: 7.52 7.98 7.84 9/359 24432
/proc/meminfo: memFree=23773664/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=259348 CPUtime=49.65 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 78154 1253 0 0 4954 11 0 0 25 0 5 0 654176018 265572352 36351 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 64837 36351 180 55 0 62723 0
[pid=24422/tid=24429] ppid=24420 vsize=259348 CPUtime=12.23 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 7676 1253 0 0 1222 1 0 0 25 0 5 0 654176051 265572352 36351 33554432000 4194304 4417452 140735452197536 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=259348 CPUtime=12.35 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 11358 1253 0 0 1234 1 0 0 25 0 5 0 654176051 265572352 36351 33554432000 4194304 4417452 140735452197536 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=259348 CPUtime=12.36 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 10920 1253 0 0 1235 1 0 0 25 0 5 0 654176051 265572352 36351 33554432000 4194304 4417452 140735452197536 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=259348 CPUtime=12.36 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 31058 1253 0 0 1231 5 0 0 25 0 5 0 654176051 265572352 36351 33554432000 4194304 4417452 140735452197536 18446744073709551615 4251109 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.65
Current children cumulated vsize (KiB) 259348

[startup+25.5007 s]
/proc/loadavg: 7.62 7.98 7.84 9/359 24432
/proc/meminfo: memFree=23635544/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=304832 CPUtime=100.71 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 127647 1253 0 0 10053 18 0 0 25 0 5 0 654176018 312147968 47740 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 76208 47740 180 55 0 74094 0
[pid=24422/tid=24429] ppid=24420 vsize=304832 CPUtime=24.88 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 12996 1253 0 0 2487 1 0 0 25 0 5 0 654176051 312147968 47740 33554432000 4194304 4417452 140735452197536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=304832 CPUtime=25.15 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 19637 1253 0 0 2513 2 0 0 25 0 5 0 654176051 312147968 47740 33554432000 4194304 4417452 140735452197536 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=304832 CPUtime=25.15 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 22499 1253 0 0 2513 2 0 0 25 0 5 0 654176051 312147968 47740 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=304832 CPUtime=25.16 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 55373 1253 0 0 2507 9 0 0 25 0 5 0 654176051 312147968 47740 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 100.71
Current children cumulated vsize (KiB) 304832

[startup+51.1006 s]
/proc/loadavg: 7.90 8.01 7.85 9/359 24433
/proc/meminfo: memFree=23246568/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=450928 CPUtime=202.83 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 249159 1253 0 0 20245 38 0 0 25 0 5 0 654176018 461750272 84579 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 112732 84579 180 55 0 110618 0
[pid=24422/tid=24429] ppid=24420 vsize=450928 CPUtime=50.21 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 40656 1253 0 0 5015 6 0 0 25 0 5 0 654176051 461750272 84579 33554432000 4194304 4417452 140735452197536 18446744073709551615 4343291 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=450928 CPUtime=50.76 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 53841 1253 0 0 5068 8 0 0 25 0 5 0 654176051 461750272 84579 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=450928 CPUtime=50.76 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 53752 1253 0 0 5069 7 0 0 25 0 5 0 654176051 461750272 84579 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=450928 CPUtime=50.75 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 83768 1253 0 0 5061 14 0 0 25 0 5 0 654176051 461750272 84579 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364958 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 202.83
Current children cumulated vsize (KiB) 450928

[startup+102.313 s]
/proc/loadavg: 7.95 8.01 7.86 9/359 24434
/proc/meminfo: memFree=22860032/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=696072 CPUtime=407.12 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 425274 1253 0 0 40646 66 0 0 25 0 5 0 654176018 712777728 146443 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 174018 146443 180 55 0 171904 0
[pid=24422/tid=24429] ppid=24420 vsize=696072 CPUtime=100.86 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 77789 1253 0 0 10075 11 0 0 25 0 5 0 654176051 712777728 146443 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=696072 CPUtime=101.98 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 105034 1253 0 0 10182 16 0 0 25 0 5 0 654176051 712777728 146443 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=696072 CPUtime=101.97 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 104497 1253 0 0 10182 15 0 0 25 0 5 0 654176051 712777728 146443 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364675 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=696072 CPUtime=101.96 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 120812 1253 0 0 10175 21 0 0 25 0 5 0 654176051 712777728 146443 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.12
Current children cumulated vsize (KiB) 696072

[startup+162.3 s]
/proc/loadavg: 8.17 8.05 7.88 9/359 24436
/proc/meminfo: memFree=22594404/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=717116 CPUtime=646.42 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 567285 1253 0 0 64554 88 0 0 25 0 5 0 654176018 734326784 152931 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 179279 152931 180 55 0 177165 0
[pid=24422/tid=24429] ppid=24420 vsize=717116 CPUtime=160.2 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 101234 1253 0 0 16007 13 0 0 25 0 5 0 654176051 734326784 152931 33554432000 4194304 4417452 140735452197536 18446744073709551615 4344176 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=717116 CPUtime=161.96 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 156706 1253 0 0 16173 23 0 0 25 0 5 0 654176051 734326784 152931 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=717116 CPUtime=161.96 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 146614 1253 0 0 16174 22 0 0 25 0 5 0 654176051 734326784 152931 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=717116 CPUtime=161.93 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 145589 1253 0 0 16167 26 0 0 25 0 5 0 654176051 734326784 152931 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 646.42
Current children cumulated vsize (KiB) 717116


################
# More data... #
################

[pid=24422/tid=24430] ppid=24420 vsize=1490632 CPUtime=756.72 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 552884 1253 0 0 75593 79 0 0 25 0 5 0 654176051 1526407168 344095 33554432000 4194304 4417452 140735452197536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=1490632 CPUtime=761.1 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 921362 1253 0 0 75965 145 0 0 25 0 5 0 654176051 1526407168 344095 33554432000 4194304 4417452 140735452197536 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=1490632 CPUtime=761.41 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 352264 1253 0 0 76078 63 0 0 25 0 5 0 654176051 1526407168 344095 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3032.65
Current children cumulated vsize (KiB) 1490632

[startup+822.301 s]
/proc/loadavg: 9.23 9.07 8.48 10/367 6368
/proc/meminfo: memFree=21080416/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=1587832 CPUtime=3270.93 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 2405226 1253 0 0 326730 363 0 0 25 0 5 0 654176018 1625939968 368395 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 396958 368395 180 55 0 394844 0
[pid=24422/tid=24429] ppid=24420 vsize=1587832 CPUtime=812.31 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 533067 1253 0 0 81160 71 0 0 25 0 5 0 654176051 1625939968 368395 33554432000 4194304 4417452 140735452197536 18446744073709551615 4264909 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=1587832 CPUtime=815.9 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 574241 1253 0 0 81509 81 0 0 25 0 5 0 654176051 1625939968 368395 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=1587832 CPUtime=821.03 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 928512 1253 0 0 81957 146 0 0 25 0 5 0 654176051 1625939968 368395 33554432000 4194304 4417452 140735452197536 18446744073709551615 4321570 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=1587832 CPUtime=821.35 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 352264 1253 0 0 82072 63 0 0 25 0 5 0 654176051 1625939968 368395 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3270.93
Current children cumulated vsize (KiB) 1587832

[startup+882.301 s]
/proc/loadavg: 9.23 9.10 8.52 11/366 8162
/proc/meminfo: memFree=20969748/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=1699028 CPUtime=3509.29 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 2598841 1253 0 0 350537 392 0 0 25 0 5 0 654176018 1739804672 396226 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 424757 396226 180 55 0 422643 0
[pid=24422/tid=24429] ppid=24420 vsize=1699028 CPUtime=871.46 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 577212 1253 0 0 87069 77 0 0 25 0 5 0 654176051 1739804672 396226 33554432000 4194304 4417452 140735452197536 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=1699028 CPUtime=875.19 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 633817 1253 0 0 87429 90 0 0 25 0 5 0 654176051 1739804672 396226 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=1699028 CPUtime=880.97 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 1018406 1253 0 0 87938 159 0 0 25 0 5 0 654176051 1739804672 396226 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=1699028 CPUtime=881.32 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 352264 1253 0 0 88069 63 0 0 25 0 5 0 654176051 1739804672 396226 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3509.29
Current children cumulated vsize (KiB) 1699028

[startup+942.3 s]
/proc/loadavg: 9.31 9.15 8.57 10/367 10032
/proc/meminfo: memFree=20950220/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=1558056 CPUtime=3747.62 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 2747252 1253 0 0 374345 417 0 0 25 0 5 0 654176018 1595449344 360983 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 389514 360983 180 55 0 387400 0
[pid=24422/tid=24429] ppid=24420 vsize=1558056 CPUtime=930.73 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 611715 1253 0 0 92990 83 0 0 25 0 5 0 654176051 1595449344 360983 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=1558056 CPUtime=934.36 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 675217 1253 0 0 93339 97 0 0 25 0 5 0 654176051 1595449344 360983 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=1558056 CPUtime=940.92 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 1077777 1253 0 0 93923 169 0 0 25 0 5 0 654176051 1595449344 360983 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=1558056 CPUtime=941.26 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 365401 1253 0 0 94061 65 0 0 25 0 5 0 654176051 1595449344 360983 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3747.62
Current children cumulated vsize (KiB) 1558056

[startup+1002.3 s]
/proc/loadavg: 9.24 9.16 8.61 10/365 11909
/proc/meminfo: memFree=21303884/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=1474700 CPUtime=3985.93 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 2856364 1253 0 0 398161 432 0 0 25 0 5 0 654176018 1510092800 340144 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 368675 340144 180 55 0 366561 0
[pid=24422/tid=24429] ppid=24420 vsize=1474700 CPUtime=989.96 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 645980 1253 0 0 98910 86 0 0 25 0 5 0 654176051 1510092800 340144 33554432000 4194304 4417452 140735452197536 18446744073709551615 4365092 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=1474700 CPUtime=993.59 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 698791 1253 0 0 99259 100 0 0 25 0 5 0 654176051 1510092800 340144 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=1474700 CPUtime=1000.83 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 1090539 1253 0 0 99911 172 0 0 25 0 5 0 654176051 1510092800 340144 33554432000 4194304 4417452 140735452197536 18446744073709551615 4236255 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=1474700 CPUtime=1001.19 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 403912 1253 0 0 100049 70 0 0 25 0 5 0 654176051 1510092800 340144 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3985.93
Current children cumulated vsize (KiB) 1474700

[startup+1062.3 s]
/proc/loadavg: 9.27 9.18 8.65 11/367 13713
/proc/meminfo: memFree=21325304/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=1341948 CPUtime=4224.3 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 2998849 1253 0 0 421978 452 0 0 25 0 5 0 654176018 1374154752 306956 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 335487 306956 180 55 0 333373 0
[pid=24422/tid=24429] ppid=24420 vsize=1341948 CPUtime=1049.24 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 668674 1253 0 0 104835 89 0 0 25 0 5 0 654176051 1374154752 306956 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=1341948 CPUtime=1052.85 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 720886 1253 0 0 105182 103 0 0 25 0 5 0 654176051 1374154752 306956 33554432000 4194304 4417452 140735452197536 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=1341948 CPUtime=1060.73 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 1182145 1253 0 0 105887 186 0 0 25 0 5 0 654176051 1374154752 306956 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=1341948 CPUtime=1061.13 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 410002 1253 0 0 106042 71 0 0 25 0 5 0 654176051 1374154752 306956 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4224.3
Current children cumulated vsize (KiB) 1341948

[startup+1122.3 s]
/proc/loadavg: 9.44 9.23 8.69 10/367 15582
/proc/meminfo: memFree=20911632/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=1540412 CPUtime=4462.63 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 3108175 1253 0 0 445798 465 0 0 25 0 5 0 654176018 1577381888 356572 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 385103 356572 180 55 0 382989 0
[pid=24422/tid=24429] ppid=24420 vsize=1540412 CPUtime=1108.41 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 724336 1253 0 0 110746 95 0 0 25 0 5 0 654176051 1577381888 356572 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=1540412 CPUtime=1112.27 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 753440 1253 0 0 111120 107 0 0 25 0 5 0 654176051 1577381888 356572 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=1540412 CPUtime=1120.58 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 1192411 1253 0 0 111871 187 0 0 25 0 5 0 654176051 1577381888 356572 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=1540412 CPUtime=1121.02 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 420846 1253 0 0 112030 72 0 0 25 0 5 0 654176051 1577381888 356572 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4462.63
Current children cumulated vsize (KiB) 1540412

[startup+1182.3 s]
/proc/loadavg: 9.47 9.26 8.74 10/367 17462
/proc/meminfo: memFree=21110968/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=1524516 CPUtime=4701.01 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 3234538 1253 0 0 469617 484 0 0 25 0 5 0 654176018 1561104384 352566 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 381129 352566 180 55 0 379015 0
[pid=24422/tid=24429] ppid=24420 vsize=1524516 CPUtime=1167.67 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 764515 1253 0 0 116668 99 0 0 25 0 5 0 654176051 1561104384 352566 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=1524516 CPUtime=1171.5 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 799321 1253 0 0 117035 115 0 0 25 0 5 0 654176051 1561104384 352566 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=1524516 CPUtime=1180.49 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 1232714 1253 0 0 117856 193 0 0 25 0 5 0 654176051 1561104384 352566 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=1524516 CPUtime=1180.98 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 420846 1253 0 0 118026 72 0 0 25 0 5 0 654176051 1561104384 352566 33554432000 4194304 4417452 140735452197536 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4701.01
Current children cumulated vsize (KiB) 1524516



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.3 s]
/proc/loadavg: 9.31 9.24 8.74 6/359 19634
/proc/meminfo: memFree=22919356/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=1290432 CPUtime=4800.37 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 3252135 1253 0 0 479550 487 0 0 25 0 5 0 654176018 1321402368 294045 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 322608 294045 180 55 0 320494 0
[pid=24422/tid=24429] ppid=24420 vsize=1290432 CPUtime=1192.35 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 767302 1253 0 0 119134 101 0 0 25 0 5 0 654176051 1321402368 294045 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=1290432 CPUtime=1196.31 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 812235 1253 0 0 119514 117 0 0 25 0 5 0 654176051 1321402368 294045 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=1290432 CPUtime=1205.44 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 1234610 1253 0 0 120350 194 0 0 25 0 5 0 654176051 1321402368 294045 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=1290432 CPUtime=1205.92 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 420846 1253 0 0 120520 72 0 0 25 0 5 0 654176051 1321402368 294045 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.37
Current children cumulated vsize (KiB) 1290432

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.3 s]
/proc/loadavg: 9.31 9.24 8.74 6/359 19634
/proc/meminfo: memFree=22919356/32950928 swapFree=45937192/67111528
[pid=24422] ppid=24420 vsize=1290432 CPUtime=4800.37 cores=0,2,4,6
/proc/24422/stat : 24422 (plingeling) S 24420 24422 23744 0 -1 4202496 3252135 1253 0 0 479550 487 0 0 25 0 5 0 654176018 1321402368 294045 33554432000 4194304 4417452 140735452197536 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/24422/statm: 322608 294045 180 55 0 320494 0
[pid=24422/tid=24429] ppid=24420 vsize=1290432 CPUtime=1192.35 cores=0,2,4,6
/proc/24422/task/24429/stat : 24429 (plingeling) R 24420 24422 23744 0 -1 4202560 767302 1253 0 0 119134 101 0 0 25 0 5 0 654176051 1321402368 294045 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24422/tid=24430] ppid=24420 vsize=1290432 CPUtime=1196.31 cores=0,2,4,6
/proc/24422/task/24430/stat : 24430 (plingeling) R 24420 24422 23744 0 -1 4202560 812235 1253 0 0 119514 117 0 0 25 0 5 0 654176051 1321402368 294045 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=24422/tid=24431] ppid=24420 vsize=1290432 CPUtime=1205.44 cores=0,2,4,6
/proc/24422/task/24431/stat : 24431 (plingeling) R 24420 24422 23744 0 -1 4202560 1234610 1253 0 0 120350 194 0 0 25 0 5 0 654176051 1321402368 294045 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=24422/tid=24432] ppid=24420 vsize=1290432 CPUtime=1205.92 cores=0,2,4,6
/proc/24422/task/24432/stat : 24432 (plingeling) R 24420 24422 23744 0 -1 4202560 420846 1253 0 0 120520 72 0 0 25 0 5 0 654176051 1321402368 294045 33554432000 4194304 4417452 140735452197536 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.37
Current children cumulated vsize (KiB) 1290432

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1207.37
CPU time (s): 4800.45
CPU user time (s): 4795.53
CPU system time (s): 4.92825
CPU usage (%): 397.597
Max. virtual memory (cumulated for all children) (KiB): 1946876

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.53
system time used= 4.92825
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3253388
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 146
involuntary context switches= 49981

runsolver used 4.04239 second user time and 9.8905 second system time

The end

Launcher Data 

Begin job on node149 at 2011-05-15 04:16:33
IDJOB=3370942
IDBENCH=83180
IDSOLVER=1848
FILE ID=node149/3370942-1305425793
RUNJOBID= node149-1305424586-23762
PBS_JOBID= 13324600
Free space on /tmp= 73612 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-14x38.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3370942-1305425793/watcher-3370942-1305425793 -o /tmp/evaluation-result-3370942-1305425793/solver-3370942-1305425793 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3370942-1305425793.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 56980124bab6f1dbe07ec523b7d59019
RANDOM SEED=370149441

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      24070352 kB
Buffers:        315084 kB
Cached:        3894440 kB
SwapCached:      19984 kB
Active:        6354000 kB
Inactive:      2232752 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      24070352 kB
SwapTotal:    67111528 kB
SwapFree:     45937192 kB
Dirty:            7044 kB
Writeback:           0 kB
AnonPages:     4369064 kB
Mapped:          13812 kB
Slab:           156948 kB
PageTables:      72304 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 80288928 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73612 MiB
End job on node149 at 2011-05-15 04:36:43