Trace number 3263266

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.19 1202.25

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_20_60_10-dir.shuffled-as.sat03-144.cnf
MD5SUMfab1e4926bfa9e7a1fae58c3b22b51e8
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark947.499
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses46074
Sum of the clauses size92708
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 246054
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 520

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3263266-1304099345/watcher-3263266-1304099345 -o /tmp/evaluation-result-3263266-1304099345/solver-3263266-1304099345 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3263266-1304099345.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.20 7.89 7.96 2/171 9149
/proc/meminfo: memFree=19120480/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=9332 CPUtime=0 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) R 9147 9149 8608 0 -1 4202496 426 1253 0 0 0 0 0 0 18 0 1 0 521534170 9555968 355 33554432000 4194304 4417332 140736419316032 18446744073709551615 4231504 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/9149/statm: 2333 355 146 55 0 219 0

[startup+0.15323 s]
/proc/loadavg: 7.20 7.89 7.96 2/171 9149
/proc/meminfo: memFree=19120480/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=57324 CPUtime=0.49 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 3814 1253 0 0 49 0 0 0 18 0 5 0 521534170 58699776 2116 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 14331 2116 177 55 0 12217 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 57324

[startup+0.253214 s]
/proc/loadavg: 7.20 7.89 7.96 2/171 9149
/proc/meminfo: memFree=19120480/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=59696 CPUtime=0.89 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 4657 1253 0 0 89 0 0 0 18 0 5 0 521534170 61128704 2713 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 14924 2713 181 55 0 12810 0
Current children cumulated CPU time (s) 0.89
Current children cumulated vsize (KiB) 59696

[startup+0.353196 s]
/proc/loadavg: 7.20 7.89 7.96 2/171 9149
/proc/meminfo: memFree=19120480/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=63024 CPUtime=1.28 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 5489 1253 0 0 128 0 0 0 18 0 5 0 521534170 64536576 3545 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 15756 3545 181 55 0 13642 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 63024

[startup+0.700138 s]
/proc/loadavg: 7.20 7.89 7.96 2/171 9149
/proc/meminfo: memFree=19120480/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=64912 CPUtime=2.41 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 6435 1253 0 0 234 7 0 0 18 0 5 0 521534170 66469888 4017 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 16228 4017 181 55 0 14114 0
Current children cumulated CPU time (s) 2.41
Current children cumulated vsize (KiB) 64912

[startup+1.50101 s]
/proc/loadavg: 7.20 7.89 7.96 10/184 9172
/proc/meminfo: memFree=19085540/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=74448 CPUtime=5.46 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 9944 1253 0 0 533 13 0 0 18 0 5 0 521534170 76234752 6401 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 18612 6401 181 55 0 16498 0
[pid=9149/tid=9165] ppid=9147 vsize=74448 CPUtime=1.21 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 797 1253 0 0 119 2 0 0 25 0 5 0 521534173 76234752 6401 33554432000 4194304 4417332 140736419316032 18446744073709551615 4258384 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=74448 CPUtime=1.45 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 1102 1253 0 0 145 0 0 0 25 0 5 0 521534173 76234752 6401 33554432000 4194304 4417332 140736419316032 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=74448 CPUtime=1.42 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 1462 1253 0 0 142 0 0 0 25 0 5 0 521534173 76234752 6401 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=74448 CPUtime=1.32 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 5116 1253 0 0 122 10 0 0 25 0 5 0 521534173 76234752 6401 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.46
Current children cumulated vsize (KiB) 74448

[startup+3.10073 s]
/proc/loadavg: 7.20 7.89 7.96 9/184 9172
/proc/meminfo: memFree=19061972/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=82052 CPUtime=11.86 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 17062 1253 0 0 1172 14 0 0 18 0 5 0 521534170 84021248 8302 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 20513 8302 181 55 0 18399 0
[pid=9149/tid=9165] ppid=9147 vsize=82052 CPUtime=2.81 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 1108 1253 0 0 279 2 0 0 25 0 5 0 521534173 84021248 8302 33554432000 4194304 4417332 140736419316032 18446744073709551615 4250017 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=82052 CPUtime=3.05 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 1102 1253 0 0 305 0 0 0 25 0 5 0 521534173 84021248 8302 33554432000 4194304 4417332 140736419316032 18446744073709551615 4258499 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=82052 CPUtime=3.02 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 2086 1253 0 0 302 0 0 0 25 0 5 0 521534173 84021248 8302 33554432000 4194304 4417332 140736419316032 18446744073709551615 4365977 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=82052 CPUtime=2.92 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 11299 1253 0 0 281 11 0 0 25 0 5 0 521534173 84021248 8302 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.86
Current children cumulated vsize (KiB) 82052

[startup+6.3012 s]
/proc/loadavg: 7.27 7.89 7.96 9/184 9172
/proc/meminfo: memFree=19027256/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=99900 CPUtime=24.61 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 27845 1253 0 0 2445 16 0 0 18 0 5 0 521534170 102297600 12764 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 24975 12764 181 55 0 22861 0
[pid=9149/tid=9165] ppid=9147 vsize=99900 CPUtime=5.98 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 1953 1253 0 0 596 2 0 0 25 0 5 0 521534173 102297600 12764 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=99900 CPUtime=6.23 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 2247 1253 0 0 623 0 0 0 25 0 5 0 521534173 102297600 12764 33554432000 4194304 4417332 140736419316032 18446744073709551615 4251100 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=99900 CPUtime=6.22 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 3854 1253 0 0 622 0 0 0 25 0 5 0 521534173 102297600 12764 33554432000 4194304 4417332 140736419316032 18446744073709551615 4336595 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=99900 CPUtime=6.13 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 18324 1253 0 0 600 13 0 0 25 0 5 0 521534173 102297600 12764 33554432000 4194304 4417332 140736419316032 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.61
Current children cumulated vsize (KiB) 99900

[startup+12.7011 s]
/proc/loadavg: 7.32 7.89 7.96 9/184 9173
/proc/meminfo: memFree=18940764/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=122240 CPUtime=50.14 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 56585 1253 0 0 4986 28 0 0 18 0 5 0 521534170 125173760 18349 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 30560 18349 181 55 0 28446 0
[pid=9149/tid=9165] ppid=9147 vsize=122240 CPUtime=12.34 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 5306 1253 0 0 1224 10 0 0 25 0 5 0 521534173 125173760 18349 33554432000 4194304 4417332 140736419316032 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=122240 CPUtime=12.58 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 6423 1253 0 0 1258 0 0 0 25 0 5 0 521534173 125173760 18349 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=122240 CPUtime=12.62 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 10569 1253 0 0 1261 1 0 0 25 0 5 0 521534173 125173760 18349 33554432000 4194304 4417332 140736419316032 18446744073709551615 4277764 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=122240 CPUtime=12.52 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 32820 1253 0 0 1237 15 0 0 25 0 5 0 521534173 125173760 18349 33554432000 4194304 4417332 140736419316032 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.14
Current children cumulated vsize (KiB) 122240

[startup+25.501 s]
/proc/loadavg: 7.47 7.90 7.96 9/184 9173
/proc/meminfo: memFree=18799912/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=181500 CPUtime=101.25 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 110180 1253 0 0 10088 37 0 0 18 0 5 0 521534170 185856000 33196 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 45375 33196 181 55 0 43261 0
[pid=9149/tid=9165] ppid=9147 vsize=181500 CPUtime=25.13 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 17810 1253 0 0 2501 12 0 0 25 0 5 0 521534173 185856000 33196 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364667 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=181500 CPUtime=25.31 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 18386 1253 0 0 2529 2 0 0 25 0 5 0 521534173 185856000 33196 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=181500 CPUtime=25.42 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 21417 1253 0 0 2539 3 0 0 25 0 5 0 521534173 185856000 33196 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=181500 CPUtime=25.32 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 51100 1253 0 0 2514 18 0 0 25 0 5 0 521534173 185856000 33196 33554432000 4194304 4417332 140736419316032 18446744073709551615 4365986 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.25
Current children cumulated vsize (KiB) 181500

[startup+51.1007 s]
/proc/loadavg: 7.65 7.91 7.96 9/184 9173
/proc/meminfo: memFree=18630516/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=245676 CPUtime=203.49 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 198485 1253 0 0 20298 51 0 0 18 0 5 0 521534170 251572224 49208 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 61419 49208 181 55 0 59305 0
[pid=9149/tid=9165] ppid=9147 vsize=245676 CPUtime=50.7 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 33110 1253 0 0 5056 14 0 0 25 0 5 0 521534173 251572224 49208 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=245676 CPUtime=50.78 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 49960 1253 0 0 5072 6 0 0 25 0 5 0 521534173 251572224 49208 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=245676 CPUtime=51.02 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 35672 1253 0 0 5096 6 0 0 25 0 5 0 521534173 251572224 49208 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=245676 CPUtime=50.92 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 78276 1253 0 0 5069 23 0 0 25 0 5 0 521534173 251572224 49208 33554432000 4194304 4417332 140736419316032 18446744073709551615 4250507 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.49
Current children cumulated vsize (KiB) 245676

[startup+102.301 s]
/proc/loadavg: 7.92 7.93 7.96 9/184 9175
/proc/meminfo: memFree=18434956/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=359032 CPUtime=407.99 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 347197 1253 0 0 40723 76 0 0 18 0 5 0 521534170 367648768 77547 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 89758 77547 181 55 0 87644 0
[pid=9149/tid=9165] ppid=9147 vsize=359032 CPUtime=101.88 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 73594 1253 0 0 10166 22 0 0 25 0 5 0 521534173 367648768 77547 33554432000 4194304 4417332 140736419316032 18446744073709551615 4309720 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=359032 CPUtime=101.71 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 90609 1253 0 0 10159 12 0 0 25 0 5 0 521534173 367648768 77547 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=359032 CPUtime=102.23 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 73575 1253 0 0 10210 13 0 0 25 0 5 0 521534173 367648768 77547 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364938 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=359032 CPUtime=102.13 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 107952 1253 0 0 10185 28 0 0 25 0 5 0 521534173 367648768 77547 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364818 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.99
Current children cumulated vsize (KiB) 359032

[startup+162.301 s]
/proc/loadavg: 8.03 7.96 7.97 9/184 9177
/proc/meminfo: memFree=18113540/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=529136 CPUtime=647.61 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 514953 1253 0 0 64658 103 0 0 18 0 5 0 521534170 541835264 120073 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 132284 120073 181 55 0 130170 0
[pid=9149/tid=9165] ppid=9147 vsize=529136 CPUtime=161.83 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 123965 1253 0 0 16153 30 0 0 25 0 5 0 521534173 541835264 120073 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=529136 CPUtime=161.38 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 142675 1253 0 0 16118 20 0 0 25 0 5 0 521534173 541835264 120073 33554432000 4194304 4417332 140736419316032 18446744073709551615 4309871 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=529136 CPUtime=162.23 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 100645 1253 0 0 16205 18 0 0 25 0 5 0 521534173 541835264 120073 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=529136 CPUtime=162.11 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 146201 1253 0 0 16178 33 0 0 25 0 5 0 521534173 541835264 120073 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 647.61
Current children cumulated vsize (KiB) 529136


################
# More data... #
################

[pid=9149/tid=9166] ppid=9147 vsize=976684 CPUtime=758.06 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 474080 1253 0 0 75741 65 0 0 25 0 5 0 521534173 1000124416 231960 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=976684 CPUtime=762.23 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 289574 1253 0 0 76176 47 0 0 25 0 5 0 521534173 1000124416 231960 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=976684 CPUtime=762.07 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 339257 1253 0 0 76148 59 0 0 25 0 5 0 521534173 1000124416 231960 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3043.85
Current children cumulated vsize (KiB) 976684

[startup+822.301 s]
/proc/loadavg: 8.22 8.11 8.02 10/184 9203
/proc/meminfo: memFree=16760528/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=1121124 CPUtime=3283.46 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 1530016 1253 0 0 328081 265 0 0 18 0 5 0 521534170 1148030976 268070 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 280281 268070 181 55 0 278167 0
[pid=9149/tid=9165] ppid=9147 vsize=1121124 CPUtime=821.37 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 344626 1253 0 0 82059 78 0 0 25 0 5 0 521534173 1148030976 268070 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=1121124 CPUtime=817.74 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 499575 1253 0 0 81703 71 0 0 25 0 5 0 521534173 1148030976 268070 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=1121124 CPUtime=822.23 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 320003 1253 0 0 82172 51 0 0 25 0 5 0 521534173 1148030976 268070 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=1121124 CPUtime=822.06 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 364345 1253 0 0 82143 63 0 0 25 0 5 0 521534173 1148030976 268070 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3283.46
Current children cumulated vsize (KiB) 1121124

[startup+882.307 s]
/proc/loadavg: 8.15 8.10 8.02 9/184 9205
/proc/meminfo: memFree=16501116/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=1190016 CPUtime=3523.1 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 1610271 1253 0 0 352033 277 0 0 18 0 5 0 521534170 1218576384 285293 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 297504 285293 181 55 0 295390 0
[pid=9149/tid=9165] ppid=9147 vsize=1190016 CPUtime=881.34 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 370927 1253 0 0 88051 83 0 0 25 0 5 0 521534173 1218576384 285293 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=1190016 CPUtime=877.41 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 499575 1253 0 0 87670 71 0 0 25 0 5 0 521534173 1218576384 285293 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=1190016 CPUtime=882.24 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 342400 1253 0 0 88170 54 0 0 25 0 5 0 521534173 1218576384 285293 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=1190016 CPUtime=882.06 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 395902 1253 0 0 88138 68 0 0 25 0 5 0 521534173 1218576384 285293 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3523.1
Current children cumulated vsize (KiB) 1190016

[startup+942.301 s]
/proc/loadavg: 8.18 8.11 8.02 9/184 9206
/proc/meminfo: memFree=16422736/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=1193536 CPUtime=3762.72 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 1708341 1253 0 0 375980 292 0 0 18 0 5 0 521534170 1222180864 286173 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 298384 286173 181 55 0 296270 0
[pid=9149/tid=9165] ppid=9147 vsize=1193536 CPUtime=941.31 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 370927 1253 0 0 94046 85 0 0 25 0 5 0 521534173 1222180864 286173 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=1193536 CPUtime=937.06 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 543252 1253 0 0 93630 76 0 0 25 0 5 0 521534173 1222180864 286173 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=1193536 CPUtime=942.23 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 378576 1253 0 0 94165 58 0 0 25 0 5 0 521534173 1222180864 286173 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=1193536 CPUtime=942.05 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 414119 1253 0 0 94134 71 0 0 25 0 5 0 521534173 1222180864 286173 33554432000 4194304 4417332 140736419316032 18446744073709551615 4236906 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3762.72
Current children cumulated vsize (KiB) 1193536

[startup+1002.3 s]
/proc/loadavg: 8.30 8.14 8.03 11/185 9211
/proc/meminfo: memFree=16254572/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=1230152 CPUtime=4002.26 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 1772827 1253 0 0 399925 301 0 0 18 0 5 0 521534170 1259675648 295327 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 307538 295327 181 55 0 305424 0
[pid=9149/tid=9165] ppid=9147 vsize=1230152 CPUtime=1001.18 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 398549 1253 0 0 100029 89 0 0 25 0 5 0 521534173 1259675648 295327 33554432000 4194304 4417332 140736419316032 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=1230152 CPUtime=996.74 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 563732 1253 0 0 99595 79 0 0 25 0 5 0 521534173 1259675648 295327 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=1230152 CPUtime=1002.23 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 378576 1253 0 0 100165 58 0 0 25 0 5 0 521534173 1259675648 295327 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=1230152 CPUtime=1002.04 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 430503 1253 0 0 100131 73 0 0 25 0 5 0 521534173 1259675648 295327 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4002.26
Current children cumulated vsize (KiB) 1230152

[startup+1062.3 s]
/proc/loadavg: 8.27 8.17 8.05 9/184 9213
/proc/meminfo: memFree=16563280/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=1154836 CPUtime=4241.37 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 1815621 1253 0 0 423815 322 0 0 18 0 5 0 521534170 1182552064 276498 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 288709 276498 181 55 0 286595 0
[pid=9149/tid=9165] ppid=9147 vsize=1154836 CPUtime=1060.74 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 399328 1253 0 0 105972 102 0 0 25 0 5 0 521534173 1182552064 276498 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=1154836 CPUtime=1056.41 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 581171 1253 0 0 105559 82 0 0 25 0 5 0 521534173 1182552064 276498 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=1154836 CPUtime=1062.13 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 386768 1253 0 0 106152 61 0 0 25 0 5 0 521534173 1182552064 276498 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=1154836 CPUtime=1062.04 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 446887 1253 0 0 106128 76 0 0 25 0 5 0 521534173 1182552064 276498 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4241.37
Current children cumulated vsize (KiB) 1154836

[startup+1122.3 s]
/proc/loadavg: 8.10 8.13 8.04 9/184 9214
/proc/meminfo: memFree=16676232/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=1025440 CPUtime=4481 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 1880617 1253 0 0 447767 333 0 0 18 0 5 0 521534170 1050050560 244149 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 256360 244149 181 55 0 254246 0
[pid=9149/tid=9165] ppid=9147 vsize=1025440 CPUtime=1120.72 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 432019 1253 0 0 111964 108 0 0 25 0 5 0 521534173 1050050560 244149 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=1025440 CPUtime=1116.07 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 581171 1253 0 0 111525 82 0 0 25 0 5 0 521534173 1050050560 244149 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=1025440 CPUtime=1122.12 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 403152 1253 0 0 112149 63 0 0 25 0 5 0 521534173 1050050560 244149 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364818 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=1025440 CPUtime=1122.03 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 462808 1253 0 0 112125 78 0 0 25 0 5 0 521534173 1050050560 244149 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4481
Current children cumulated vsize (KiB) 1025440

[startup+1182.3 s]
/proc/loadavg: 8.03 8.11 8.03 9/184 9216
/proc/meminfo: memFree=16569832/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=911352 CPUtime=4720.62 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 1939845 1253 0 0 471720 342 0 0 18 0 5 0 521534170 933224448 215627 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 227838 215627 181 55 0 225724 0
[pid=9149/tid=9165] ppid=9147 vsize=911352 CPUtime=1180.68 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 453621 1253 0 0 117955 113 0 0 25 0 5 0 521534173 933224448 215627 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=911352 CPUtime=1175.74 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 597001 1253 0 0 117490 84 0 0 25 0 5 0 521534173 933224448 215627 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=911352 CPUtime=1182.13 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 411344 1253 0 0 118149 64 0 0 25 0 5 0 521534173 933224448 215627 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=911352 CPUtime=1182.02 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 476412 1253 0 0 118122 80 0 0 25 0 5 0 521534173 933224448 215627 33554432000 4194304 4417332 140736419316032 18446744073709551615 4366006 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4720.62
Current children cumulated vsize (KiB) 911352



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.2 s]
/proc/loadavg: 8.02 8.10 8.03 5/178 9217
/proc/meminfo: memFree=18270044/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=895084 CPUtime=4800.11 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 1952162 1253 0 0 479667 344 0 0 18 0 5 0 521534170 916566016 211560 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 223771 211560 181 55 0 221657 0
[pid=9149/tid=9165] ppid=9147 vsize=895084 CPUtime=1200.57 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 455682 1253 0 0 119944 113 0 0 25 0 5 0 521534173 916566016 211560 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=895084 CPUtime=1195.53 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 597001 1253 0 0 119469 84 0 0 25 0 5 0 521534173 916566016 211560 33554432000 4194304 4417332 140736419316032 18446744073709551615 4307843 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=895084 CPUtime=1202.03 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 419536 1253 0 0 120138 65 0 0 25 0 5 0 521534173 916566016 211560 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=895084 CPUtime=1201.93 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 478476 1253 0 0 120112 81 0 0 25 0 5 0 521534173 916566016 211560 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.11
Current children cumulated vsize (KiB) 895084

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.2 s]
/proc/loadavg: 8.02 8.10 8.03 5/178 9217
/proc/meminfo: memFree=18270044/32951132 swapFree=67111400/67111528
[pid=9149] ppid=9147 vsize=895084 CPUtime=4800.11 cores=0,2,4,6
/proc/9149/stat : 9149 (plingeling) S 9147 9149 8608 0 -1 4202496 1952162 1253 0 0 479667 344 0 0 18 0 5 0 521534170 916566016 211560 33554432000 4194304 4417332 140736419316032 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/9149/statm: 223771 211560 181 55 0 221657 0
[pid=9149/tid=9165] ppid=9147 vsize=895084 CPUtime=1200.57 cores=0,2,4,6
/proc/9149/task/9165/stat : 9165 (plingeling) R 9147 9149 8608 0 -1 4202560 455682 1253 0 0 119944 113 0 0 25 0 5 0 521534173 916566016 211560 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9149/tid=9166] ppid=9147 vsize=895084 CPUtime=1195.53 cores=0,2,4,6
/proc/9149/task/9166/stat : 9166 (plingeling) R 9147 9149 8608 0 -1 4202560 597001 1253 0 0 119469 84 0 0 25 0 5 0 521534173 916566016 211560 33554432000 4194304 4417332 140736419316032 18446744073709551615 4307843 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9149/tid=9167] ppid=9147 vsize=895084 CPUtime=1202.03 cores=0,2,4,6
/proc/9149/task/9167/stat : 9167 (plingeling) R 9147 9149 8608 0 -1 4202560 419536 1253 0 0 120138 65 0 0 25 0 5 0 521534173 916566016 211560 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=9149/tid=9168] ppid=9147 vsize=895084 CPUtime=1201.93 cores=0,2,4,6
/proc/9149/task/9168/stat : 9168 (plingeling) R 9147 9149 8608 0 -1 4202560 478476 1253 0 0 120112 81 0 0 25 0 5 0 521534173 916566016 211560 33554432000 4194304 4417332 140736419316032 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.11
Current children cumulated vsize (KiB) 895084

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.25
CPU time (s): 4800.19
CPU user time (s): 4796.7
CPU system time (s): 3.48747
CPU usage (%): 399.267
Max. virtual memory (cumulated for all children) (KiB): 1262920

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.7
system time used= 3.48747
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1953415
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 152
involuntary context switches= 40065

runsolver used 1.86772 second user time and 4.69728 second system time

The end

Launcher Data 

Begin job on node129 at 2011-04-29 19:49:05
IDJOB=3263266
IDBENCH=83949
IDSOLVER=1605
FILE ID=node129/3263266-1304099345
RUNJOBID= node129-1304099345-9133
PBS_JOBID= 13170600
Free space on /tmp= 66368 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_20_60_10-dir.shuffled-as.sat03-144.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3263266-1304099345/watcher-3263266-1304099345 -o /tmp/evaluation-result-3263266-1304099345/solver-3263266-1304099345 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3263266-1304099345.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fab1e4926bfa9e7a1fae58c3b22b51e8
RANDOM SEED=193206818

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      19120760 kB
Buffers:       1254108 kB
Cached:       11849416 kB
SwapCached:        128 kB
Active:        2203996 kB
Inactive:     10964152 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      19120760 kB
SwapTotal:    67111528 kB
SwapFree:     67111400 kB
Dirty:            1292 kB
Writeback:           0 kB
AnonPages:       63756 kB
Mapped:          14788 kB
Slab:           598756 kB
PageTables:       4720 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   185768 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66368 MiB
End job on node129 at 2011-04-29 20:09:10