Trace number 3263632

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.31 1201.79

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_60_20_50_3-dir.shuffled-as.sat03-114.cnf
MD5SUM9ffa0325c9e00b41c025f41d20ec5a0c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4252.27
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses49070
Sum of the clauses size98700
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 249050
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 520

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3263632-1304101649/watcher-3263632-1304101649 -o /tmp/evaluation-result-3263632-1304101649/solver-3263632-1304101649 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3263632-1304101649.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.49 4.57 6.20 2/174 20642
/proc/meminfo: memFree=30343124/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=20140 CPUtime=0 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 535 0 0 0 0 0 0 0 21 0 1 0 521765268 20623360 450 33554432000 4194304 4623224 140737186538224 18446744073709551615 253640556299 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/20642/statm: 5035 464 297 105 0 539 0

[startup+0.082566 s]
/proc/loadavg: 3.49 4.57 6.20 2/174 20642
/proc/meminfo: memFree=30343124/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=254412 CPUtime=0.27 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 4215 0 0 0 27 0 0 0 23 0 4 0 521765268 260517888 2868 33554432000 4194304 4623224 140737186538224 18446744073709551615 4415014 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 63603 2868 346 105 0 59107 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 254412

[startup+0.10056 s]
/proc/loadavg: 3.49 4.57 6.20 2/174 20642
/proc/meminfo: memFree=30343124/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=254412 CPUtime=0.34 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 4407 0 0 0 34 0 0 0 23 0 4 0 521765268 260517888 2911 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510101 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 63603 2911 346 105 0 59107 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 254412

[startup+0.300484 s]
/proc/loadavg: 3.49 4.57 6.20 2/174 20642
/proc/meminfo: memFree=30343124/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=258284 CPUtime=1.14 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 7044 0 0 0 114 0 0 0 24 0 4 0 521765268 264482816 4908 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510189 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 64571 4908 344 105 0 60075 0
Current children cumulated CPU time (s) 1.14
Current children cumulated vsize (KiB) 258284

[startup+0.700412 s]
/proc/loadavg: 3.49 4.57 6.20 2/174 20642
/proc/meminfo: memFree=30343124/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=261908 CPUtime=2.74 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 10456 0 0 0 273 1 0 0 25 0 4 0 521765268 268193792 7419 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 65477 7419 345 105 0 60981 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 261908

[startup+1.50027 s]
/proc/loadavg: 3.49 4.57 6.20 9/184 20655
/proc/meminfo: memFree=30253284/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=268380 CPUtime=5.94 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 14923 0 0 0 592 2 0 0 25 0 4 0 521765268 274821120 10436 33554432000 4194304 4623224 140737186538224 18446744073709551615 4414972 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 67095 10436 357 105 0 62599 0
[pid=20642/tid=20644] ppid=20640 vsize=268380 CPUtime=1.47 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 2641 0 0 0 147 0 0 0 25 0 4 0 521765270 274821120 10436 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=268380 CPUtime=1.47 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 2246 0 0 0 147 0 0 0 25 0 4 0 521765270 274821120 10436 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=268380 CPUtime=1.47 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 1959 0 0 0 147 0 0 0 25 0 4 0 521765270 274821120 10436 33554432000 4194304 4623224 140737186538224 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 268380

[startup+3.10097 s]
/proc/loadavg: 3.49 4.57 6.20 9/184 20655
/proc/meminfo: memFree=30225632/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=277792 CPUtime=12.33 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 22270 0 0 0 1230 3 0 0 25 0 4 0 521765268 284459008 16901 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 69448 16901 455 105 0 64952 0
[pid=20642/tid=20644] ppid=20640 vsize=277792 CPUtime=3.07 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 5676 0 0 0 307 0 0 0 25 0 4 0 521765270 284459008 16901 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=277792 CPUtime=3.06 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 3583 0 0 0 306 0 0 0 25 0 4 0 521765270 284459008 16901 33554432000 4194304 4623224 140737186538224 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=277792 CPUtime=3.08 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 3801 0 0 0 307 1 0 0 25 0 4 0 521765270 284459008 16901 33554432000 4194304 4623224 140737186538224 18446744073709551615 4545403 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 277792

[startup+6.30039 s]
/proc/loadavg: 3.85 4.62 6.21 9/184 20655
/proc/meminfo: memFree=30184932/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=283876 CPUtime=25.12 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 31490 0 0 0 2507 5 0 0 25 0 4 0 521765268 290689024 21408 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 70969 21408 410 105 0 66473 0
[pid=20642/tid=20644] ppid=20640 vsize=283876 CPUtime=6.28 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 8524 0 0 0 627 1 0 0 25 0 4 0 521765270 290689024 21408 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=283876 CPUtime=6.25 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 5399 0 0 0 624 1 0 0 25 0 4 0 521765270 290689024 21408 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=283876 CPUtime=6.28 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 4862 0 0 0 627 1 0 0 25 0 4 0 521765270 290689024 21408 33554432000 4194304 4623224 140737186538224 18446744073709551615 4577493 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 283876

[startup+12.7002 s]
/proc/loadavg: 4.18 4.68 6.21 9/184 20655
/proc/meminfo: memFree=30127288/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=305652 CPUtime=50.68 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 46386 0 0 0 5060 8 0 0 25 0 4 0 521765268 312987648 30668 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510214 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 76413 30669 400 105 0 71917 0
[pid=20642/tid=20644] ppid=20640 vsize=305652 CPUtime=12.67 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 12830 0 0 0 1266 1 0 0 25 0 4 0 521765270 312987648 30669 33554432000 4194304 4623224 140737186538224 18446744073709551615 253640520389 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=305652 CPUtime=12.62 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 8290 0 0 0 1260 2 0 0 25 0 4 0 521765270 312987648 30669 33554432000 4194304 4623224 140737186538224 18446744073709551615 4366336 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=305652 CPUtime=12.68 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 6957 0 0 0 1266 2 0 0 25 0 4 0 521765270 312987648 30669 33554432000 4194304 4623224 140737186538224 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 305652

[startup+25.5009 s]
/proc/loadavg: 5.02 4.84 6.24 9/184 20656
/proc/meminfo: memFree=30041856/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=352084 CPUtime=101.82 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 75549 0 0 0 10168 14 0 0 25 0 4 0 521765268 360534016 47437 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 88021 47437 485 105 0 83525 0
[pid=20642/tid=20644] ppid=20640 vsize=352084 CPUtime=25.47 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 20851 0 0 0 2543 4 0 0 25 0 4 0 521765270 360534016 47437 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=352084 CPUtime=25.35 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 13491 0 0 0 2532 3 0 0 25 0 4 0 521765270 360534016 47438 33554432000 4194304 4623224 140737186538224 18446744073709551615 4317194 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=352084 CPUtime=25.48 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 14233 0 0 0 2545 3 0 0 25 0 4 0 521765270 360534016 47438 33554432000 4194304 4623224 140737186538224 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 352084

[startup+51.1002 s]
/proc/loadavg: 6.04 5.09 6.29 9/184 20656
/proc/meminfo: memFree=29926140/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=388788 CPUtime=204.09 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 209324 0 0 0 20375 34 0 0 25 0 4 0 521765268 398118912 67676 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510199 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 97197 67676 519 105 0 92701 0
[pid=20642/tid=20644] ppid=20640 vsize=388788 CPUtime=51.07 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 31124 0 0 0 5101 6 0 0 25 0 4 0 521765270 398118912 67676 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=388788 CPUtime=50.82 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 20489 0 0 0 5077 5 0 0 25 0 4 0 521765270 398118912 67676 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376865 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=388788 CPUtime=51.08 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 105640 0 0 0 5093 15 0 0 25 0 4 0 521765270 398118912 67676 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 204.09
Current children cumulated vsize (KiB) 388788

[startup+102.307 s]
/proc/loadavg: 7.23 5.57 6.39 9/184 20658
/proc/meminfo: memFree=29660648/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=729684 CPUtime=408.65 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 306133 0 0 0 40812 53 0 0 25 0 4 0 521765268 747196416 116597 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 182421 116597 972 105 0 177925 0
[pid=20642/tid=20644] ppid=20640 vsize=729684 CPUtime=102.27 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 46640 0 0 0 10218 9 0 0 25 0 4 0 521765270 747196416 116597 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=729684 CPUtime=101.77 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 29905 0 0 0 10168 9 0 0 25 0 4 0 521765270 747196416 116597 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=729684 CPUtime=102.29 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 114308 0 0 0 10212 17 0 0 25 0 4 0 521765270 747196416 116597 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.65
Current children cumulated vsize (KiB) 729684

[startup+162.301 s]
/proc/loadavg: 7.79 6.04 6.49 9/184 20659
/proc/meminfo: memFree=29335016/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=1018892 CPUtime=648.31 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 849088 0 0 0 64701 130 0 0 25 0 4 0 521765268 1043345408 185915 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 254723 185915 448 105 0 250227 0
[pid=20642/tid=20644] ppid=20640 vsize=1018892 CPUtime=162 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 55870 0 0 0 16187 13 0 0 25 0 4 0 521765270 1043345408 185915 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=1018892 CPUtime=161.72 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 33003 0 0 0 16161 11 0 0 25 0 4 0 521765270 1043345408 185915 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=1018892 CPUtime=162.27 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 500981 0 0 0 16156 71 0 0 25 0 4 0 521765270 1043345408 185915 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 648.31
Current children cumulated vsize (KiB) 1018892

[startup+222.301 s]
/proc/loadavg: 7.99 6.42 6.60 9/184 20661
/proc/meminfo: memFree=29046704/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=1327840 CPUtime=888 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 1213182 0 0 0 88618 182 0 0 25 0 4 0 521765268 1359708160 247444 33554432000 4194304 4623224 140737186538224 18446744073709551615 4414965 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 331960 247444 344 105 0 327464 0
[pid=20642/tid=20644] ppid=20640 vsize=1327840 CPUtime=221.69 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 80497 0 0 0 22149 20 0 0 25 0 4 0 521765270 1359708160 247444 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=1327840 CPUtime=221.71 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 45307 0 0 0 22158 13 0 0 25 0 4 0 521765270 1359708160 247444 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=1327840 CPUtime=222.27 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 693075 0 0 0 22131 96 0 0 25 0 4 0 521765270 1359708160 247444 33554432000 4194304 4623224 140737186538224 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 888
Current children cumulated vsize (KiB) 1327840

[startup+282.301 s]

################
# More data... #
################


[startup+702.3 s]
/proc/loadavg: 8.12 7.75 7.18 9/184 20674
/proc/meminfo: memFree=26489332/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=3884084 CPUtime=2805.5 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 5049094 0 0 0 279815 735 0 0 25 0 4 0 521765268 3977302016 803549 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 971021 803549 344 105 0 966525 0
[pid=20642/tid=20644] ppid=20640 vsize=3884084 CPUtime=699.26 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 170314 0 0 0 69878 48 0 0 25 0 4 0 521765270 3977302016 803549 33554432000 4194304 4623224 140737186538224 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=3884084 CPUtime=701.65 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 79236 0 0 0 70132 33 0 0 25 0 4 0 521765270 3977302016 803549 33554432000 4194304 4623224 140737186538224 18446744073709551615 4366336 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=3884084 CPUtime=702.27 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 3238526 0 0 0 69784 443 0 0 25 0 4 0 521765270 3977302016 803549 33554432000 4194304 4623224 140737186538224 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2805.5
Current children cumulated vsize (KiB) 3884084

[startup+762.306 s]
/proc/loadavg: 8.09 7.81 7.23 9/184 20675
/proc/meminfo: memFree=26353412/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=3953748 CPUtime=3045.21 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 5588800 0 0 0 303704 817 0 0 25 0 4 0 521765268 4048637952 834305 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 988437 834305 344 105 0 983941 0
[pid=20642/tid=20644] ppid=20640 vsize=3953748 CPUtime=758.95 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 170487 0 0 0 75847 48 0 0 25 0 4 0 521765270 4048637952 834305 33554432000 4194304 4623224 140737186538224 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=3953748 CPUtime=761.66 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 79707 0 0 0 76132 34 0 0 25 0 4 0 521765270 4048637952 834305 33554432000 4194304 4623224 140737186538224 18446744073709551615 253640508513 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=3953748 CPUtime=762.28 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 3728793 0 0 0 75712 516 0 0 25 0 4 0 521765270 4048637952 834305 33554432000 4194304 4623224 140737186538224 18446744073709551615 4545317 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3045.21
Current children cumulated vsize (KiB) 3953748

[startup+822.3 s]
/proc/loadavg: 8.03 7.84 7.28 9/184 20677
/proc/meminfo: memFree=26211664/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=4074516 CPUtime=3284.87 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 5876854 0 0 0 327624 863 0 0 25 0 4 0 521765268 4172304384 861110 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 1018629 861110 344 105 0 1014133 0
[pid=20642/tid=20644] ppid=20640 vsize=4074516 CPUtime=818.64 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 170752 0 0 0 81815 49 0 0 25 0 4 0 521765270 4172304384 861110 33554432000 4194304 4623224 140737186538224 18446744073709551615 4357984 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=4074516 CPUtime=821.63 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 83244 0 0 0 82124 39 0 0 25 0 4 0 521765270 4172304384 861110 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=4074516 CPUtime=822.27 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 3926119 0 0 0 81682 545 0 0 25 0 4 0 521765270 4172304384 861110 33554432000 4194304 4623224 140737186538224 18446744073709551615 4545527 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3284.87
Current children cumulated vsize (KiB) 4074516

[startup+882.3 s]
/proc/loadavg: 8.05 7.88 7.33 9/184 20679
/proc/meminfo: memFree=26067692/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=4124520 CPUtime=3524.56 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 6398634 0 0 0 351517 939 0 0 25 0 4 0 521765268 4223508480 893666 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 1031130 893666 347 105 0 1026634 0
[pid=20642/tid=20644] ppid=20640 vsize=4124520 CPUtime=878.32 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 171073 0 0 0 87783 49 0 0 25 0 4 0 521765270 4223508480 893666 33554432000 4194304 4623224 140737186538224 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=4124520 CPUtime=881.64 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 85048 0 0 0 88122 42 0 0 25 0 4 0 521765270 4223508480 893666 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376823 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=4124520 CPUtime=882.27 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 4415175 0 0 0 87613 614 0 0 25 0 4 0 521765270 4223508480 893666 33554432000 4194304 4623224 140737186538224 18446744073709551615 4545383 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3524.56
Current children cumulated vsize (KiB) 4124520

[startup+942.3 s]
/proc/loadavg: 8.05 7.92 7.37 9/184 20680
/proc/meminfo: memFree=25645956/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=5052480 CPUtime=3764.19 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 6926394 0 0 0 375410 1009 0 0 25 0 4 0 521765268 5173739520 994283 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 1263120 994283 344 105 0 1258624 0
[pid=20642/tid=20644] ppid=20640 vsize=5052480 CPUtime=938.04 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 171343 0 0 0 93755 49 0 0 25 0 4 0 521765270 5173739520 994283 33554432000 4194304 4623224 140737186538224 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=5052480 CPUtime=941.59 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 109659 0 0 0 94114 45 0 0 25 0 4 0 521765270 5173739520 994283 33554432000 4194304 4623224 140737186538224 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=5052480 CPUtime=942.24 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 4432920 0 0 0 93607 617 0 0 25 0 4 0 521765270 5173739520 994283 33554432000 4194304 4623224 140737186538224 18446744073709551615 4364926 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3764.19
Current children cumulated vsize (KiB) 5052480

[startup+1002.3 s]
/proc/loadavg: 8.02 7.93 7.41 9/184 20682
/proc/meminfo: memFree=25419016/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=5128928 CPUtime=4003.88 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 7389597 0 0 0 399311 1077 0 0 25 0 4 0 521765268 5252022272 1042432 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 1282232 1042432 346 105 0 1277736 0
[pid=20642/tid=20644] ppid=20640 vsize=5128928 CPUtime=997.72 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 172067 0 0 0 99723 49 0 0 25 0 4 0 521765270 5252022272 1042432 33554432000 4194304 4623224 140737186538224 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=5128928 CPUtime=1001.58 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 111632 0 0 0 100112 46 0 0 25 0 4 0 521765270 5252022272 1042434 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=5128928 CPUtime=1002.24 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 4849241 0 0 0 99547 677 0 0 25 0 4 0 521765270 5252022272 1042434 33554432000 4194304 4623224 140737186538224 18446744073709551615 4577678 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4003.88
Current children cumulated vsize (KiB) 5128928

[startup+1062.3 s]
/proc/loadavg: 8.04 7.95 7.45 9/184 20683
/proc/meminfo: memFree=25245152/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=5181440 CPUtime=4243.58 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 7922902 0 0 0 423205 1153 0 0 25 0 4 0 521765268 5305794560 1078570 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 1295360 1078570 344 105 0 1290864 0
[pid=20642/tid=20644] ppid=20640 vsize=5181440 CPUtime=1057.43 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 172512 0 0 0 105694 49 0 0 25 0 4 0 521765270 5305794560 1078570 33554432000 4194304 4623224 140737186538224 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=5181440 CPUtime=1061.58 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 112091 0 0 0 106112 46 0 0 25 0 4 0 521765270 5305794560 1078570 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=5181440 CPUtime=1062.24 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 5347369 0 0 0 105476 748 0 0 25 0 4 0 521765270 5305794560 1078570 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4243.58
Current children cumulated vsize (KiB) 5181440

[startup+1122.3 s]
/proc/loadavg: 8.04 7.97 7.48 9/184 20685
/proc/meminfo: memFree=25123612/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=5284420 CPUtime=4483.29 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 8403094 0 0 0 447103 1226 0 0 25 0 4 0 521765268 5411246080 1102334 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 1321105 1102335 349 105 0 1316609 0
[pid=20642/tid=20644] ppid=20640 vsize=5284420 CPUtime=1117.13 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 172760 0 0 0 111664 49 0 0 25 0 4 0 521765270 5411246080 1102335 33554432000 4194304 4623224 140737186538224 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=5284420 CPUtime=1121.58 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 113487 0 0 0 112110 48 0 0 25 0 4 0 521765270 5411246080 1102335 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=5284420 CPUtime=1122.24 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 5807529 0 0 0 111407 817 0 0 25 0 4 0 521765270 5411246080 1102335 33554432000 4194304 4623224 140737186538224 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4483.29
Current children cumulated vsize (KiB) 5284420

[startup+1182.3 s]
/proc/loadavg: 8.09 7.99 7.52 9/184 20687
/proc/meminfo: memFree=24980488/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=5486600 CPUtime=4722.99 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 8840857 0 0 0 471010 1289 0 0 25 0 4 0 521765268 5618278400 1132496 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 1371650 1132496 344 105 0 1367154 0
[pid=20642/tid=20644] ppid=20640 vsize=5486600 CPUtime=1176.84 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 172964 0 0 0 117634 50 0 0 25 0 4 0 521765270 5618278400 1132496 33554432000 4194304 4623224 140737186538224 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=5486600 CPUtime=1181.57 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 114534 0 0 0 118109 48 0 0 25 0 4 0 521765270 5618278400 1132496 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=5486600 CPUtime=1182.24 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 6186744 0 0 0 117354 870 0 0 25 0 4 0 521765270 5618278400 1132496 33554432000 4194304 4623224 140737186538224 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4722.99
Current children cumulated vsize (KiB) 5486600



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.6 s]
/proc/loadavg: 8.06 7.99 7.53 9/184 20687
/proc/meminfo: memFree=24961640/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=5489836 CPUtime=4800.11 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) R 20640 20642 19972 0 -1 4202496 9000974 0 0 0 478699 1312 0 0 25 0 4 0 521765268 5621592064 1135894 33554432000 4194304 4623224 140737186538224 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 1372459 1135894 344 105 0 1367963 0
[pid=20642/tid=20644] ppid=20640 vsize=5489836 CPUtime=1196.04 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4202560 172971 0 0 0 119554 50 0 0 25 0 4 0 521765270 5621592064 1135894 33554432000 4194304 4623224 140737186538224 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=20642/tid=20645] ppid=20640 vsize=5489836 CPUtime=1200.88 cores=0,2,4,6
/proc/20642/task/20645/stat : 20645 (SArTagnan) R 20640 20642 19972 0 -1 4202560 115269 0 0 0 120039 49 0 0 25 0 4 0 521765270 5621592064 1135894 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=20642/tid=20646] ppid=20640 vsize=5489836 CPUtime=1201.55 cores=0,2,4,6
/proc/20642/task/20646/stat : 20646 (SArTagnan) R 20640 20642 19972 0 -1 4202560 6345205 0 0 0 119262 893 0 0 25 0 4 0 521765270 5621592064 1135894 33554432000 4194304 4623224 140737186538224 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.11
Current children cumulated vsize (KiB) 5489836

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.71 s]
/proc/loadavg: 8.06 7.99 7.53 9/184 20687
/proc/meminfo: memFree=24961640/32951124 swapFree=67111364/67111528
[pid=20642] ppid=20640 vsize=0 CPUtime=4800.23 cores=0,2,4,6
/proc/20642/stat : 20642 (SArTagnan) Z 20640 20642 19972 0 -1 4203548 9000975 0 0 0 478701 1322 0 0 25 0 2 0 521765268 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/20642/statm: 0 0 0 0 0 0 0
[pid=20642/tid=20644] ppid=20640 vsize=0 CPUtime=1196.15 cores=0,2,4,6
/proc/20642/task/20644/stat : 20644 (SArTagnan) R 20640 20642 19972 0 -1 4203588 172971 0 0 0 119555 60 0 0 25 0 2 0 521765270 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.79
CPU time (s): 4800.31
CPU user time (s): 4787.01
CPU system time (s): 13.298
CPU usage (%): 399.431
Max. virtual memory (cumulated for all children) (KiB): 6413380

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4787.01
system time used= 13.298
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9000975
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3754
involuntary context switches= 19359

runsolver used 1.83872 second user time and 4.26035 second system time

The end

Launcher Data 

Begin job on node106 at 2011-04-29 20:27:29
IDJOB=3263632
IDBENCH=83988
IDSOLVER=1656
FILE ID=node106/3263632-1304101649
RUNJOBID= node106-1304101649-20628
PBS_JOBID= 13170612
Free space on /tmp= 72160 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_60_20_50_3-dir.shuffled-as.sat03-114.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3263632-1304101649/watcher-3263632-1304101649 -o /tmp/evaluation-result-3263632-1304101649/solver-3263632-1304101649 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3263632-1304101649.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9ffa0325c9e00b41c025f41d20ec5a0c
RANDOM SEED=635902566

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30343528 kB
Buffers:        254100 kB
Cached:        2075528 kB
SwapCached:         88 kB
Active:         790636 kB
Inactive:      1606352 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30343528 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:             844 kB
Writeback:           0 kB
AnonPages:       67188 kB
Mapped:          14484 kB
Slab:           146536 kB
PageTables:       4344 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   193596 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72156 MiB
End job on node106 at 2011-04-29 20:47:32