Trace number 3371264

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.6 1211.28

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
MD5SUM48f03e5fbe31fc85b9a464480fc8aa5a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark752.735
Satisfiable
(Un)Satisfiability was proved
Number of variables1575206
Number of clauses8464620
Sum of the clauses size20118920
Maximum clause length982
Minimum clause length1
Number of clauses of size 1720
Number of clauses of size 28393300
Number of clauses of size 3400
Number of clauses of size 41600
Number of clauses of size 54000
Number of clauses of size over 564600

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371264-1305421379/watcher-3371264-1305421379 -o /tmp/evaluation-result-3371264-1305421379/solver-3371264-1305421379 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371264-1305421379.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.69 8.03 8.02 5/417 9787
/proc/meminfo: memFree=20067948/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 215 0 0 0 0 0 0 0 23 0 1 0 732369225 8937472 146 33554432000 4194304 4417452 140734965918400 18446744073709551615 215988592384 0 0 4096 0 18446744071562362840 0 0 17 0 0 0 0
/proc/9787/statm: 2182 146 122 55 0 68 0

[startup+0.0583951 s]
/proc/loadavg: 7.69 8.03 8.02 5/417 9787
/proc/meminfo: memFree=20067948/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=34468 CPUtime=0.04 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) R 9785 9787 9516 0 -1 4202496 6710 1252 0 0 4 0 0 0 23 0 1 0 732369225 35295232 6640 33554432000 4194304 4417452 140734965918400 18446744073709551615 215988592384 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/9787/statm: 8617 6640 148 55 0 6503 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 34468

[startup+0.100388 s]
/proc/loadavg: 7.69 8.03 8.02 5/417 9787
/proc/meminfo: memFree=20067948/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=39528 CPUtime=0.09 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) R 9785 9787 9516 0 -1 4202496 7965 1252 0 0 8 1 0 0 23 0 1 0 732369225 40476672 7890 33554432000 4194304 4417452 140734965918400 18446744073709551615 4209566 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/9787/statm: 9882 7890 149 55 0 7768 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 39528

[startup+0.300352 s]
/proc/loadavg: 7.69 8.03 8.02 5/417 9787
/proc/meminfo: memFree=20067948/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=72592 CPUtime=0.29 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) R 9785 9787 9516 0 -1 4202496 16247 1252 0 0 27 2 0 0 24 0 1 0 732369225 74334208 16172 33554432000 4194304 4417452 140734965918400 18446744073709551615 4231480 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/9787/statm: 18148 16172 149 55 0 16034 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 72592

[startup+0.700283 s]
/proc/loadavg: 7.69 8.03 8.02 5/417 9787
/proc/meminfo: memFree=20067948/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=128276 CPUtime=0.69 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) R 9785 9787 9516 0 -1 4202496 30172 1252 0 0 65 4 0 0 25 0 1 0 732369225 131354624 30061 33554432000 4194304 4417452 140734965918400 18446744073709551615 215988286557 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/9787/statm: 32069 30082 149 55 0 29955 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 128276

[startup+1.50014 s]
/proc/loadavg: 7.69 8.03 8.02 6/418 9793
/proc/meminfo: memFree=19925472/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=261336 CPUtime=1.48 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) R 9785 9787 9516 0 -1 4202496 63615 1252 0 0 141 7 0 0 25 0 1 0 732369225 267608064 63358 33554432000 4194304 4417452 140734965918400 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/9787/statm: 65334 63358 149 55 0 63220 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 261336

[startup+3.10086 s]
/proc/loadavg: 7.69 8.03 8.02 6/418 9793
/proc/meminfo: memFree=19739092/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=484568 CPUtime=3.08 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) R 9785 9787 9516 0 -1 4202496 119423 1252 0 0 293 15 0 0 25 0 1 0 732369225 496197632 119166 33554432000 4194304 4417452 140734965918400 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/9787/statm: 121142 119166 149 55 0 119028 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 484568

[startup+6.3003 s]
/proc/loadavg: 7.47 7.98 8.00 6/418 9793
/proc/meminfo: memFree=19442680/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=931032 CPUtime=6.29 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) R 9785 9787 9516 0 -1 4202496 231039 1252 0 0 599 30 0 0 25 0 1 0 732369225 953376768 230782 33554432000 4194304 4417452 140734965918400 18446744073709551615 215988592384 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/9787/statm: 232758 230782 149 55 0 230644 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 931032

[startup+12.7012 s]
/proc/loadavg: 7.52 7.98 8.00 9/422 9797
/proc/meminfo: memFree=18752692/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=1381320 CPUtime=23.29 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 454926 1252 0 0 2263 66 0 0 25 0 5 0 732369225 1414471680 333109 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 345330 333109 172 55 0 343216 0
[pid=9787/tid=9794] ppid=9785 vsize=1381320 CPUtime=3.55 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 40663 1252 0 0 349 6 0 0 25 0 5 0 732370139 1414471680 333109 33554432000 4194304 4417452 140734965918400 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=1381320 CPUtime=3.53 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 40648 1252 0 0 346 7 0 0 25 0 5 0 732370139 1414471680 333109 33554432000 4194304 4417452 140734965918400 18446744073709551615 4287720 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=1381320 CPUtime=3.53 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 40615 1252 0 0 347 6 0 0 25 0 5 0 732370139 1414471680 333109 33554432000 4194304 4417452 140734965918400 18446744073709551615 4286255 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=1381320 CPUtime=3.51 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 28221 1252 0 0 346 5 0 0 25 0 5 0 732370139 1414471680 333109 33554432000 4194304 4417452 140734965918400 18446744073709551615 4357229 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 23.29
Current children cumulated vsize (KiB) 1381320

[startup+25.501 s]
/proc/loadavg: 7.62 7.98 8.00 9/422 9797
/proc/meminfo: memFree=18762364/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=1389992 CPUtime=74.27 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 928439 1252 0 0 7284 143 0 0 25 0 5 0 732369225 1423351808 318932 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 347498 318932 178 55 0 345384 0
[pid=9787/tid=9794] ppid=9785 vsize=1389992 CPUtime=16.34 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 185534 1252 0 0 1601 33 0 0 25 0 5 0 732370139 1423351808 318932 33554432000 4194304 4417452 140734965918400 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=1389992 CPUtime=16.31 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 185117 1252 0 0 1600 31 0 0 25 0 5 0 732370139 1423351808 318932 33554432000 4194304 4417452 140734965918400 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=1389992 CPUtime=16.33 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 208245 1252 0 0 1603 30 0 0 25 0 5 0 732370139 1423351808 318932 33554432000 4194304 4417452 140734965918400 18446744073709551615 4331782 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=1389992 CPUtime=16.12 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 44764 1252 0 0 1605 7 0 0 25 0 5 0 732370139 1423351808 318932 33554432000 4194304 4417452 140734965918400 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 74.27
Current children cumulated vsize (KiB) 1389992

[startup+51.1005 s]
/proc/loadavg: 7.83 7.99 8.01 9/422 9798
/proc/meminfo: memFree=18583512/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=1617656 CPUtime=176.31 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 1012993 1252 0 0 17479 152 0 0 25 0 5 0 732369225 1656479744 375861 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 404414 375861 179 55 0 402300 0
[pid=9787/tid=9794] ppid=9785 vsize=1617656 CPUtime=41.95 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 189469 1252 0 0 4161 34 0 0 25 0 5 0 732370139 1656479744 375861 33554432000 4194304 4417452 140734965918400 18446744073709551615 4253179 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=1617656 CPUtime=41.9 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 190339 1252 0 0 4158 32 0 0 25 0 5 0 732370139 1656479744 375861 33554432000 4194304 4417452 140734965918400 18446744073709551615 4258488 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=1617656 CPUtime=41.92 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 231329 1252 0 0 4160 32 0 0 25 0 5 0 732370139 1656479744 375861 33554432000 4194304 4417452 140734965918400 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=1617656 CPUtime=41.38 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 97077 1252 0 0 4126 12 0 0 25 0 5 0 732370139 1656479744 375861 33554432000 4194304 4417452 140734965918400 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 176.31
Current children cumulated vsize (KiB) 1617656

[startup+102.316 s]
/proc/loadavg: 7.85 7.96 7.99 9/422 9837
/proc/meminfo: memFree=19321772/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=1582088 CPUtime=380.47 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 1090046 1252 0 0 37881 166 0 0 25 0 5 0 732369225 1620058112 367665 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 395522 367665 179 55 0 393408 0
[pid=9787/tid=9794] ppid=9785 vsize=1582088 CPUtime=93.16 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 197067 1252 0 0 9280 36 0 0 25 0 5 0 732370139 1620058112 367665 33554432000 4194304 4417452 140734965918400 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=1582088 CPUtime=93.12 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 194878 1252 0 0 9279 33 0 0 25 0 5 0 732370139 1620058112 367665 33554432000 4194304 4417452 140734965918400 18446744073709551615 4356867 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=1582088 CPUtime=93.13 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 235809 1252 0 0 9279 34 0 0 25 0 5 0 732370139 1620058112 367665 33554432000 4194304 4417452 140734965918400 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=1582088 CPUtime=91.9 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 157513 1252 0 0 9169 21 0 0 25 0 5 0 732370139 1620058112 367665 33554432000 4194304 4417452 140734965918400 18446744073709551615 4264994 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 380.47
Current children cumulated vsize (KiB) 1582088

[startup+162.301 s]
/proc/loadavg: 7.94 7.97 7.99 9/422 9838
/proc/meminfo: memFree=19204708/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=1642312 CPUtime=619.59 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 1273678 1252 0 0 61762 197 0 0 25 0 5 0 732369225 1681727488 382040 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 410578 382040 179 55 0 408464 0
[pid=9787/tid=9794] ppid=9785 vsize=1642312 CPUtime=153.15 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 197067 1252 0 0 15279 36 0 0 25 0 5 0 732370139 1681727488 382040 33554432000 4194304 4417452 140734965918400 18446744073709551615 4357263 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=1642312 CPUtime=153.1 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 262769 1252 0 0 15266 44 0 0 25 0 5 0 732370139 1681727488 382040 33554432000 4194304 4417452 140734965918400 18446744073709551615 4270929 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=1642312 CPUtime=153.11 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 318017 1252 0 0 15262 49 0 0 25 0 5 0 732370139 1681727488 382040 33554432000 4194304 4417452 140734965918400 18446744073709551615 4237202 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=1642312 CPUtime=151.08 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 191046 1252 0 0 15081 27 0 0 25 0 5 0 732370139 1681727488 382040 33554432000 4194304 4417452 140734965918400 18446744073709551615 4250972 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 619.59
Current children cumulated vsize (KiB) 1642312

[startup+222.301 s]
/proc/loadavg: 8.08 8.00 8.00 9/422 9840
/proc/meminfo: memFree=18882892/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=1800376 CPUtime=858.75 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 1407551 1252 0 0 85659 216 0 0 25 0 5 0 732369225 1843585024 421541 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 450094 421541 179 55 0 447980 0
[pid=9787/tid=9794] ppid=9785 vsize=1800376 CPUtime=213.15 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 281278 1252 0 0 21266 49 0 0 25 0 5 0 732370139 1843585024 421541 33554432000 4194304 4417452 140734965918400 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=1800376 CPUtime=213.11 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 275833 1252 0 0 21265 46 0 0 25 0 5 0 732370139 1843585024 421541 33554432000 4194304 4417452 140734965918400 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=1800376 CPUtime=213.09 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 318017 1252 0 0 21260 49 0 0 25 0 5 0 732370139 1843585024 421541 33554432000 4194304 4417452 140734965918400 18446744073709551615 4331729 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=1800376 CPUtime=210.26 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 227644 1252 0 0 20994 32 0 0 25 0 5 0 732370139 1843585024 421541 33554432000 4194304 4417452 140734965918400 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 858.75
Current children cumulated vsize (KiB) 1800376

[startup+282.301 s]
/proc/loadavg: 8.12 8.03 8.01 9/422 9841
/proc/meminfo: memFree=18835868/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=1833808 CPUtime=1097.93 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 1445109 1252 0 0 109573 220 0 0 25 0 5 0 732369225 1877819392 429898 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 458452 429898 179 55 0 456338 0
[pid=9787/tid=9794] ppid=9785 vsize=1833808 CPUtime=273.15 cores=0,2,4,6

################
# More data... #
################

/proc/meminfo: memFree=17773524/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=2203180 CPUtime=3011.37 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 2440946 1252 0 0 300765 372 0 0 25 0 5 0 732369225 2256056320 522155 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 550795 522155 180 55 0 548681 0
[pid=9787/tid=9794] ppid=9785 vsize=2203180 CPUtime=753.17 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 364622 1252 0 0 75251 66 0 0 25 0 5 0 732370139 2256056320 522155 33554432000 4194304 4417452 140734965918400 18446744073709551615 4250575 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=2203180 CPUtime=753.13 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 408827 1252 0 0 75250 63 0 0 25 0 5 0 732370139 2256056320 522155 33554432000 4194304 4417452 140734965918400 18446744073709551615 4237148 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=2203180 CPUtime=752.99 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 523950 1252 0 0 75226 73 0 0 25 0 5 0 732370139 2256056320 522155 33554432000 4194304 4417452 140734965918400 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=2203180 CPUtime=742.92 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 838768 1252 0 0 74164 128 0 0 25 0 5 0 732370139 2256056320 522155 33554432000 4194304 4417452 140734965918400 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3011.37
Current children cumulated vsize (KiB) 2203180

[startup+822.301 s]
/proc/loadavg: 8.12 8.09 8.02 9/422 9856
/proc/meminfo: memFree=17047576/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=2497892 CPUtime=3250.49 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 2580973 1252 0 0 324660 389 0 0 25 0 5 0 732369225 2557841408 595836 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 624473 595836 180 55 0 622359 0
[pid=9787/tid=9794] ppid=9785 vsize=2497892 CPUtime=813.16 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 430873 1252 0 0 81242 74 0 0 25 0 5 0 732370139 2557841408 595836 33554432000 4194304 4417452 140734965918400 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=2497892 CPUtime=813.12 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 408830 1252 0 0 81249 63 0 0 25 0 5 0 732370139 2557841408 595836 33554432000 4194304 4417452 140734965918400 18446744073709551615 4232612 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=2497892 CPUtime=812.97 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 527182 1252 0 0 81223 74 0 0 25 0 5 0 732370139 2557841408 595836 33554432000 4194304 4417452 140734965918400 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=2497892 CPUtime=802.1 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 909309 1252 0 0 80073 137 0 0 25 0 5 0 732370139 2557841408 595836 33554432000 4194304 4417452 140734965918400 18446744073709551615 4357595 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3250.49
Current children cumulated vsize (KiB) 2497892

[startup+882.301 s]
/proc/loadavg: 8.16 8.10 8.03 9/422 9857
/proc/meminfo: memFree=17673008/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=2157128 CPUtime=3489.67 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 2660744 1252 0 0 348565 402 0 0 25 0 5 0 732369225 2208899072 510628 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 539282 510628 180 55 0 537168 0
[pid=9787/tid=9794] ppid=9785 vsize=2157128 CPUtime=873.16 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 434881 1252 0 0 87242 74 0 0 25 0 5 0 732370139 2208899072 510628 33554432000 4194304 4417452 140734965918400 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=2157128 CPUtime=873.11 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 412779 1252 0 0 87248 63 0 0 25 0 5 0 732370139 2208899072 510628 33554432000 4194304 4417452 140734965918400 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=2157128 CPUtime=872.96 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 581171 1252 0 0 87214 82 0 0 25 0 5 0 732370139 2208899072 510628 33554432000 4194304 4417452 140734965918400 18446744073709551615 4265465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=2157128 CPUtime=861.28 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 927134 1252 0 0 85987 141 0 0 25 0 5 0 732370139 2208899072 510628 33554432000 4194304 4417452 140734965918400 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3489.67
Current children cumulated vsize (KiB) 2157128

[startup+942.301 s]
/proc/loadavg: 8.06 8.08 8.02 9/422 9859
/proc/meminfo: memFree=16340588/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=2514752 CPUtime=3728.84 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 2761554 1252 0 0 372469 415 0 0 25 0 5 0 732369225 2575106048 600051 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 628688 600051 180 55 0 626574 0
[pid=9787/tid=9794] ppid=9785 vsize=2514752 CPUtime=933.16 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 434881 1252 0 0 93242 74 0 0 25 0 5 0 732370139 2575106048 600051 33554432000 4194304 4417452 140734965918400 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=2514752 CPUtime=933.11 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 412779 1252 0 0 93248 63 0 0 25 0 5 0 732370139 2575106048 600051 33554432000 4194304 4417452 140734965918400 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=2514752 CPUtime=932.94 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 584563 1252 0 0 93211 83 0 0 25 0 5 0 732370139 2575106048 600051 33554432000 4194304 4417452 140734965918400 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=2514752 CPUtime=920.46 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 1024552 1252 0 0 91893 153 0 0 25 0 5 0 732370139 2575106048 600051 33554432000 4194304 4417452 140734965918400 18446744073709551615 4320926 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3728.84
Current children cumulated vsize (KiB) 2514752

[startup+1002.3 s]
/proc/loadavg: 8.08 8.08 8.02 9/422 9861
/proc/meminfo: memFree=17082828/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=2369692 CPUtime=3968.01 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 2846612 1252 0 0 396373 428 0 0 25 0 5 0 732369225 2426564608 563813 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 592423 563813 180 55 0 590309 0
[pid=9787/tid=9794] ppid=9785 vsize=2369692 CPUtime=993.16 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 434881 1252 0 0 99242 74 0 0 25 0 5 0 732370139 2426564608 563813 33554432000 4194304 4417452 140734965918400 18446744073709551615 4354524 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=2369692 CPUtime=993.11 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 412811 1252 0 0 99248 63 0 0 25 0 5 0 732370139 2426564608 563813 33554432000 4194304 4417452 140734965918400 18446744073709551615 4331796 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=2369692 CPUtime=992.93 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 595503 1252 0 0 99208 85 0 0 25 0 5 0 732370139 2426564608 563813 33554432000 4194304 4417452 140734965918400 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=2369692 CPUtime=979.64 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 1098638 1252 0 0 97800 164 0 0 25 0 5 0 732370139 2426564608 563813 33554432000 4194304 4417452 140734965918400 18446744073709551615 4354517 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3968.01
Current children cumulated vsize (KiB) 2369692

[startup+1062.3 s]
/proc/loadavg: 8.08 8.08 8.02 9/422 9862
/proc/meminfo: memFree=17058744/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=2678304 CPUtime=4207.2 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 2923765 1252 0 0 420279 441 0 0 25 0 5 0 732369225 2742583296 640966 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 669576 640966 180 55 0 667462 0
[pid=9787/tid=9794] ppid=9785 vsize=2678304 CPUtime=1053.16 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 434881 1252 0 0 105242 74 0 0 25 0 5 0 732370139 2742583296 640966 33554432000 4194304 4417452 140734965918400 18446744073709551615 4331831 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=2678304 CPUtime=1053.11 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 412811 1252 0 0 105248 63 0 0 25 0 5 0 732370139 2742583296 640966 33554432000 4194304 4417452 140734965918400 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=2678304 CPUtime=1052.92 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 602771 1252 0 0 105206 86 0 0 25 0 5 0 732370139 2742583296 640966 33554432000 4194304 4417452 140734965918400 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=2678304 CPUtime=1038.84 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 1168523 1252 0 0 103708 176 0 0 25 0 5 0 732370139 2742583296 640966 33554432000 4194304 4417452 140734965918400 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4207.2
Current children cumulated vsize (KiB) 2678304

[startup+1122.3 s]
/proc/loadavg: 8.07 8.08 8.02 9/422 9864
/proc/meminfo: memFree=16482840/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=2548132 CPUtime=4446.35 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 3092941 1252 0 0 444166 469 0 0 25 0 5 0 732369225 2609287168 608392 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 637033 608392 180 55 0 634919 0
[pid=9787/tid=9794] ppid=9785 vsize=2548132 CPUtime=1113.16 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 434881 1252 0 0 111242 74 0 0 25 0 5 0 732370139 2609287168 608392 33554432000 4194304 4417452 140734965918400 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=2548132 CPUtime=1113.12 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 425052 1252 0 0 111247 65 0 0 25 0 5 0 732370139 2609287168 608392 33554432000 4194304 4417452 140734965918400 18446744073709551615 4232598 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=2548132 CPUtime=1112.9 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 685791 1252 0 0 111188 102 0 0 25 0 5 0 732370139 2609287168 608392 33554432000 4194304 4417452 140734965918400 18446744073709551615 4265462 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=2548132 CPUtime=1098.02 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 1242438 1252 0 0 109615 187 0 0 25 0 5 0 732370139 2609287168 608392 33554432000 4194304 4417452 140734965918400 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4446.35
Current children cumulated vsize (KiB) 2548132

[startup+1182.3 s]
/proc/loadavg: 8.02 8.06 8.02 9/422 9865
/proc/meminfo: memFree=16842404/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=2995672 CPUtime=4685.54 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 3288349 1252 0 0 468056 498 0 0 25 0 5 0 732369225 3067568128 720216 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 748918 720216 180 55 0 746804 0
[pid=9787/tid=9794] ppid=9785 vsize=2995672 CPUtime=1173.16 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 483362 1252 0 0 117236 80 0 0 25 0 5 0 732370139 3067568128 720216 33554432000 4194304 4417452 140734965918400 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=2995672 CPUtime=1173.12 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 499039 1252 0 0 117237 75 0 0 25 0 5 0 732370139 3067568128 720216 33554432000 4194304 4417452 140734965918400 18446744073709551615 4320867 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=2995672 CPUtime=1172.9 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 685791 1252 0 0 117188 102 0 0 25 0 5 0 732370139 3067568128 720216 33554432000 4194304 4417452 140734965918400 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=2995672 CPUtime=1157.21 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 1315378 1252 0 0 115521 200 0 0 25 0 5 0 732370139 3067568128 720216 33554432000 4194304 4417452 140734965918400 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4685.54
Current children cumulated vsize (KiB) 2995672



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1211.12 s]
/proc/loadavg: 8.07 8.07 8.02 9/422 9866
/proc/meminfo: memFree=16268032/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=3283208 CPUtime=4800.4 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) S 9785 9787 9516 0 -1 4202496 3360233 1252 0 0 479528 512 0 0 25 0 5 0 732369225 3362004992 792100 33554432000 4194304 4417452 140734965918400 18446744073709551615 216000395237 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 820802 792100 180 55 0 818688 0
[pid=9787/tid=9794] ppid=9785 vsize=3283208 CPUtime=1201.99 cores=0,2,4,6
/proc/9787/task/9794/stat : 9794 (plingeling) R 9785 9787 9516 0 -1 4202560 485107 1252 0 0 120119 80 0 0 25 0 5 0 732370139 3362004992 792100 33554432000 4194304 4417452 140734965918400 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9787/tid=9795] ppid=9785 vsize=3283208 CPUtime=1201.95 cores=0,2,4,6
/proc/9787/task/9795/stat : 9795 (plingeling) R 9785 9787 9516 0 -1 4202560 499039 1252 0 0 120120 75 0 0 25 0 5 0 732370139 3362004992 792100 33554432000 4194304 4417452 140734965918400 18446744073709551615 4232695 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9796] ppid=9785 vsize=3283208 CPUtime=1201.72 cores=0,2,4,6
/proc/9787/task/9796/stat : 9796 (plingeling) R 9785 9787 9516 0 -1 4202560 701163 1252 0 0 120067 105 0 0 25 0 5 0 732370139 3362004992 792100 33554432000 4194304 4417452 140734965918400 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=3283208 CPUtime=1185.62 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4202560 1370145 1252 0 0 118351 211 0 0 25 0 5 0 732370139 3362004992 792100 33554432000 4194304 4417452 140734965918400 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.4
Current children cumulated vsize (KiB) 3283208

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1211.22 s]
/proc/loadavg: 8.07 8.07 8.02 9/422 9866
/proc/meminfo: memFree=16268032/32950940 swapFree=67111356/67111528
[pid=9787] ppid=9785 vsize=0 CPUtime=4800.54 cores=0,2,4,6
/proc/9787/stat : 9787 (plingeling) Z 9785 9787 9516 0 -1 4203548 3360233 1252 0 0 479533 521 0 0 18 0 2 0 732369225 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/9787/statm: 0 0 0 0 0 0 0
[pid=9787/tid=9797] ppid=9785 vsize=0 CPUtime=1185.7 cores=0,2,4,6
/proc/9787/task/9797/stat : 9797 (plingeling) R 9785 9787 9516 0 -1 4203588 1370145 1252 0 0 118351 219 0 0 25 0 2 0 732370139 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.54
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1211.28
CPU time (s): 4800.6
CPU user time (s): 4795.33
CPU system time (s): 5.2722
CPU usage (%): 396.326
Max. virtual memory (cumulated for all children) (KiB): 3283208

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.33
system time used= 5.2722
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3361485
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 145
involuntary context switches= 24398

runsolver used 4.68929 second user time and 11.8292 second system time

The end

Launcher Data 

Begin job on node117 at 2011-05-15 03:03:05
IDJOB=3371264
IDBENCH=82388
IDSOLVER=1848
FILE ID=node117/3371264-1305421379
RUNJOBID= node117-1305418966-9534
PBS_JOBID= 13324567
Free space on /tmp= 73248 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371264-1305421379/watcher-3371264-1305421379 -o /tmp/evaluation-result-3371264-1305421379/solver-3371264-1305421379 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371264-1305421379.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 48f03e5fbe31fc85b9a464480fc8aa5a
RANDOM SEED=628436876

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      20067980 kB
Buffers:        302228 kB
Cached:        3286712 kB
SwapCached:          0 kB
Active:       10609024 kB
Inactive:      1915484 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      20067980 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:          171512 kB
Writeback:           0 kB
AnonPages:     8935588 kB
Mapped:          32428 kB
Slab:           246108 kB
PageTables:      46468 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 101530092 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73232 MiB
End job on node117 at 2011-05-15 03:23:18