Trace number 3386106

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3881.97 1300.12

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2400c266431gyes6.cnf
MD5SUMe23fefb786281285c1d045e8bc698d74
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386106-1305578467/watcher-3386106-1305578467 -o /tmp/evaluation-result-3386106-1305578467/solver-3386106-1305578467 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386106-1305578467.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.92 9.10 9.15 6/462 17036
/proc/meminfo: memFree=13188552/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=25636 CPUtime=0.01 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 959 0 0 0 1 0 0 0 25 0 1 0 650262893 26251264 580 33554432000 4194304 4625164 140733863626960 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17036/statm: 6409 580 296 106 0 1912 0

[startup+0.109157 s]
/proc/loadavg: 8.92 9.10 9.15 6/462 17036
/proc/meminfo: memFree=13188552/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=137496 CPUtime=0.16 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 6255 0 0 0 16 0 0 0 25 0 4 0 650262893 140795904 4405 33554432000 4194304 4625164 140733863626960 18446744073709551615 255106811994 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/17036/statm: 34374 4405 333 106 0 29877 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 137496

[startup+0.200227 s]
/proc/loadavg: 8.92 9.10 9.15 6/462 17036
/proc/meminfo: memFree=13188552/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=203852 CPUtime=0.43 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 7093 0 0 0 43 0 0 0 25 0 4 0 650262893 208744448 5243 33554432000 4194304 4625164 140733863626960 18446744073709551615 255106465888 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17036/statm: 50963 5243 333 106 0 46466 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 203852

[startup+0.300209 s]
/proc/loadavg: 8.92 9.10 9.15 6/462 17036
/proc/meminfo: memFree=13188552/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=205120 CPUtime=0.73 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 7854 0 0 0 72 1 0 0 25 0 4 0 650262893 210042880 6004 33554432000 4194304 4625164 140733863626960 18446744073709551615 255106465888 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17036/statm: 51280 6005 333 106 0 46783 0
Current children cumulated CPU time (s) 0.73
Current children cumulated vsize (KiB) 205120

[startup+0.70014 s]
/proc/loadavg: 8.92 9.10 9.15 6/462 17036
/proc/meminfo: memFree=13188552/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=226316 CPUtime=1.91 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 16841 0 0 0 189 2 0 0 25 0 4 0 650262893 231747584 12920 33554432000 4194304 4625164 140733863626960 18446744073709551615 255106466261 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 56579 12920 333 106 0 52082 0
Current children cumulated CPU time (s) 1.91
Current children cumulated vsize (KiB) 226316

[startup+1.501 s]
/proc/loadavg: 8.92 9.10 9.15 10/466 17040
/proc/meminfo: memFree=13116852/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=297204 CPUtime=4.28 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 29540 0 0 0 424 4 0 0 25 0 4 0 650262893 304336896 19376 33554432000 4194304 4625164 140733863626960 18446744073709551615 4509371 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 74301 19376 346 106 0 69804 0
[pid=17036/tid=17038] ppid=17034 vsize=297204 CPUtime=1.31 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 2610 0 0 0 131 0 0 0 25 0 4 0 650262900 304336896 19376 33554432000 4194304 4625164 140733863626960 18446744073709551615 4288765 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=297204 CPUtime=1.09 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 3692 0 0 0 109 0 0 0 25 0 4 0 650262900 304336896 19376 33554432000 4194304 4625164 140733863626960 18446744073709551615 255106424987 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=297204 CPUtime=1.31 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 1750 0 0 0 131 0 0 0 19 0 4 0 650262900 304336896 19376 33554432000 4194304 4625164 140733863626960 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.28
Current children cumulated vsize (KiB) 297204

[startup+3.10072 s]
/proc/loadavg: 8.92 9.10 9.15 10/466 17040
/proc/meminfo: memFree=13106436/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=299176 CPUtime=9.07 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 31786 0 0 0 902 5 0 0 25 0 4 0 650262893 306356224 20804 33554432000 4194304 4625164 140733863626960 18446744073709551615 4512432 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 74794 20804 346 106 0 70297 0
[pid=17036/tid=17038] ppid=17034 vsize=299176 CPUtime=2.89 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 3435 0 0 0 289 0 0 0 25 0 4 0 650262900 306356224 20804 33554432000 4194304 4625164 140733863626960 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=299176 CPUtime=1.19 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 3744 0 0 0 119 0 0 0 21 0 4 0 650262900 306356224 20804 33554432000 4194304 4625164 140733863626960 18446744073709551615 4462375 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=299176 CPUtime=2.81 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 3109 0 0 0 281 0 0 0 22 0 4 0 650262900 306356224 20804 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 9.07
Current children cumulated vsize (KiB) 299176

[startup+6.30116 s]
/proc/loadavg: 8.92 9.10 9.15 10/466 17040
/proc/meminfo: memFree=13088648/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=300980 CPUtime=18.62 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 40302 0 0 0 1855 7 0 0 25 0 4 0 650262893 308203520 25360 33554432000 4194304 4625164 140733863626960 18446744073709551615 4511882 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 75245 25360 348 106 0 70748 0
[pid=17036/tid=17038] ppid=17034 vsize=300980 CPUtime=6.05 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 4967 0 0 0 604 1 0 0 25 0 4 0 650262900 308203520 25360 33554432000 4194304 4625164 140733863626960 18446744073709551615 4464677 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=300980 CPUtime=2.81 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 5806 0 0 0 280 1 0 0 25 0 4 0 650262900 308203520 25360 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=300980 CPUtime=4.4 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 7720 0 0 0 439 1 0 0 25 0 4 0 650262900 308203520 25360 33554432000 4194304 4625164 140733863626960 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 18.62
Current children cumulated vsize (KiB) 300980

[startup+12.701 s]
/proc/loadavg: 8.93 9.10 9.14 10/466 17040
/proc/meminfo: memFree=13056040/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=307224 CPUtime=37.71 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 64566 0 0 0 3758 13 0 0 25 0 4 0 650262893 314597376 32938 33554432000 4194304 4625164 140733863626960 18446744073709551615 4508979 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 76806 32938 346 106 0 72309 0
[pid=17036/tid=17038] ppid=17034 vsize=307224 CPUtime=10.1 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 7738 0 0 0 1008 2 0 0 25 0 4 0 650262900 314597376 32938 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=307224 CPUtime=5.82 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 7809 0 0 0 580 2 0 0 25 0 4 0 650262900 314597376 32938 33554432000 4194304 4625164 140733863626960 18446744073709551615 4339536 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=307224 CPUtime=10.01 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 25699 0 0 0 997 4 0 0 25 0 4 0 650262900 314597376 32938 33554432000 4194304 4625164 140733863626960 18446744073709551615 4334273 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37.71
Current children cumulated vsize (KiB) 307224

[startup+25.5008 s]
/proc/loadavg: 8.95 9.09 9.14 10/466 17041
/proc/meminfo: memFree=13000604/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=333928 CPUtime=75.9 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 93490 0 0 0 7572 18 0 0 25 0 4 0 650262893 341942272 47001 33554432000 4194304 4625164 140733863626960 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 83482 47001 390 106 0 78985 0
[pid=17036/tid=17038] ppid=17034 vsize=333928 CPUtime=18.95 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 11034 0 0 0 1893 2 0 0 25 0 4 0 650262900 341942272 47001 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=333928 CPUtime=13.94 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 12647 0 0 0 1390 4 0 0 25 0 4 0 650262900 341942272 47001 33554432000 4194304 4625164 140733863626960 18446744073709551615 4352318 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=333928 CPUtime=22.81 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 31726 0 0 0 2276 5 0 0 25 0 4 0 650262900 341942272 47001 33554432000 4194304 4625164 140733863626960 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 75.9
Current children cumulated vsize (KiB) 333928

[startup+51.1013 s]
/proc/loadavg: 9.10 9.12 9.15 10/466 17041
/proc/meminfo: memFree=12771676/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=549940 CPUtime=152.33 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 193480 0 0 0 15198 35 0 0 25 0 4 0 650262893 563138560 87373 33554432000 4194304 4625164 140733863626960 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 137485 87373 489 106 0 132988 0
[pid=17036/tid=17038] ppid=17034 vsize=549940 CPUtime=31.76 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 16975 0 0 0 3172 4 0 0 25 0 4 0 650262900 563138560 87373 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=549940 CPUtime=39.17 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 16959 0 0 0 3911 6 0 0 25 0 4 0 650262900 563138560 87373 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=549940 CPUtime=48.41 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 50053 0 0 0 4833 8 0 0 25 0 4 0 650262900 563138560 87373 33554432000 4194304 4625164 140733863626960 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 152.33
Current children cumulated vsize (KiB) 549940

[startup+102.301 s]
/proc/loadavg: 8.88 9.06 9.13 10/466 17074
/proc/meminfo: memFree=13803460/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=736588 CPUtime=305.19 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 440418 0 0 0 30447 72 0 0 25 0 4 0 650262893 754266112 129982 33554432000 4194304 4625164 140733863626960 18446744073709551615 4510163 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 184147 129982 691 106 0 179650 0
[pid=17036/tid=17038] ppid=17034 vsize=736588 CPUtime=64.1 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 24343 0 0 0 6405 5 0 0 25 0 4 0 650262900 754266112 129983 33554432000 4194304 4625164 140733863626960 18446744073709551615 4339581 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=736588 CPUtime=82.64 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 22666 0 0 0 8256 8 0 0 25 0 4 0 650262900 754266112 129983 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=736588 CPUtime=99.63 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 227210 0 0 0 9928 35 0 0 25 0 4 0 650262900 754266112 129983 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 305.19
Current children cumulated vsize (KiB) 736588

[startup+162.301 s]
/proc/loadavg: 9.19 9.11 9.14 10/466 17075
/proc/meminfo: memFree=13289020/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=943544 CPUtime=484.24 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 903886 0 0 0 48289 135 0 0 25 0 4 0 650262893 966189056 165251 33554432000 4194304 4625164 140733863626960 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/17036/statm: 235886 165251 361 106 0 231389 0
[pid=17036/tid=17038] ppid=17034 vsize=943544 CPUtime=120.29 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 35432 0 0 0 12022 7 0 0 25 0 4 0 650262900 966189056 165251 33554432000 4194304 4625164 140733863626960 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=943544 CPUtime=120.13 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 24126 0 0 0 12004 9 0 0 25 0 4 0 650262900 966189056 165251 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=943544 CPUtime=149.07 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 604081 0 0 0 14822 85 0 0 25 0 4 0 650262900 966189056 165251 33554432000 4194304 4625164 140733863626960 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 484.24
Current children cumulated vsize (KiB) 943544

[startup+222.317 s]
/proc/loadavg: 9.26 9.14 9.14 10/466 17077
/proc/meminfo: memFree=12884008/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=1086980 CPUtime=665.71 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 1213210 0 0 0 66386 185 0 0 25 0 4 0 650262893 1113067520 201097 33554432000 4194304 4625164 140733863626960 18446744073709551615 4393097 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/17036/statm: 271745 201097 418 106 0 267248 0
[pid=17036/tid=17038] ppid=17034 vsize=1086980 CPUtime=180.23 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 36619 0 0 0 18016 7 0 0 25 0 4 0 650262900 1113067520 201097 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=1086980 CPUtime=152.58 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 36464 0 0 0 15239 19 0 0 25 0 4 0 650262900 1113067520 201097 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=1086980 CPUtime=182.69 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 805666 0 0 0 18156 113 0 0 25 0 4 0 650262900 1113067520 201097 33554432000 4194304 4625164 140733863626960 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 665.71
Current children cumulated vsize (KiB) 1086980

[startup+282.301 s]

################
# More data... #
################

[pid=17036] ppid=17034 vsize=2155760 CPUtime=2277.17 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 3334882 0 0 0 227191 526 0 0 25 0 4 0 650262893 2207498240 427676 33554432000 4194304 4625164 140733863626960 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17036/statm: 538940 427676 389 106 0 534443 0
[pid=17036/tid=17038] ppid=17034 vsize=2155760 CPUtime=698.23 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 64959 0 0 0 69802 21 0 0 25 0 4 0 650262900 2207498240 427719 33554432000 4194304 4625164 140733863626960 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=2155760 CPUtime=453.32 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 73730 0 0 0 45280 52 0 0 25 0 4 0 650262900 2207498240 427719 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=2155760 CPUtime=499.2 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 2407469 0 0 0 49577 343 0 0 25 0 4 0 650262900 2207498240 427719 33554432000 4194304 4625164 140733863626960 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2277.17
Current children cumulated vsize (KiB) 2155760

[startup+822.301 s]
/proc/loadavg: 9.11 9.14 9.12 10/466 17093
/proc/meminfo: memFree=10702100/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=2280352 CPUtime=2456.2 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 3582952 0 0 0 245055 565 0 0 25 0 4 0 650262893 2335080448 447709 33554432000 4194304 4625164 140733863626960 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17036/statm: 570088 447709 389 106 0 565591 0
[pid=17036/tid=17038] ppid=17034 vsize=2280352 CPUtime=757.29 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 65217 0 0 0 75708 21 0 0 25 0 4 0 650262900 2335080448 447710 33554432000 4194304 4625164 140733863626960 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=2280352 CPUtime=483.32 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 73934 0 0 0 48280 52 0 0 25 0 4 0 650262900 2335080448 447710 33554432000 4194304 4625164 140733863626960 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=2280352 CPUtime=529.2 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 2614542 0 0 0 52544 376 0 0 25 0 4 0 650262900 2335080448 447710 33554432000 4194304 4625164 140733863626960 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2456.2
Current children cumulated vsize (KiB) 2280352

[startup+882.317 s]
/proc/loadavg: 9.11 9.13 9.11 10/466 17094
/proc/meminfo: memFree=10586268/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=2323688 CPUtime=2635.32 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 3798222 0 0 0 262933 599 0 0 25 0 4 0 650262893 2379456512 466696 33554432000 4194304 4625164 140733863626960 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/17036/statm: 580922 466696 389 106 0 576425 0
[pid=17036/tid=17038] ppid=17034 vsize=2323688 CPUtime=816.37 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 65720 0 0 0 81616 21 0 0 25 0 4 0 650262900 2379456512 466696 33554432000 4194304 4625164 140733863626960 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=2323688 CPUtime=513.42 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 76723 0 0 0 51288 54 0 0 25 0 4 0 650262900 2379456512 466696 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=2323688 CPUtime=559.11 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 2787478 0 0 0 55510 401 0 0 25 0 4 0 650262900 2379456512 466696 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2635.32
Current children cumulated vsize (KiB) 2323688

[startup+942.301 s]
/proc/loadavg: 9.19 9.14 9.11 10/466 17096
/proc/meminfo: memFree=10411540/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=2454872 CPUtime=2814.32 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 4047060 0 0 0 280791 641 0 0 25 0 4 0 650262893 2513788928 498486 33554432000 4194304 4625164 140733863626960 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 613718 498486 389 106 0 609221 0
[pid=17036/tid=17038] ppid=17034 vsize=2454872 CPUtime=875.9 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 83055 0 0 0 87567 23 0 0 25 0 4 0 650262900 2513788928 498486 33554432000 4194304 4625164 140733863626960 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=2454872 CPUtime=553.46 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 83419 0 0 0 55289 57 0 0 25 0 4 0 650262900 2513788928 498486 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=2454872 CPUtime=595.5 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 2971099 0 0 0 59120 430 0 0 25 0 4 0 650262900 2513788928 498486 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2814.32
Current children cumulated vsize (KiB) 2454872

[startup+1002.3 s]
/proc/loadavg: 9.07 9.11 9.10 10/466 17098
/proc/meminfo: memFree=10324604/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=2467940 CPUtime=2993.38 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 4209775 0 0 0 298672 666 0 0 25 0 4 0 650262893 2527170560 508991 33554432000 4194304 4625164 140733863626960 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 616985 508991 389 106 0 612488 0
[pid=17036/tid=17038] ppid=17034 vsize=2467940 CPUtime=935.9 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 83314 0 0 0 93567 23 0 0 25 0 4 0 650262900 2527170560 508991 33554432000 4194304 4625164 140733863626960 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=2467940 CPUtime=612.49 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 86847 0 0 0 61191 58 0 0 25 0 4 0 650262900 2527170560 508991 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=2467940 CPUtime=625.4 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 3116765 0 0 0 62090 450 0 0 25 0 4 0 650262900 2527170560 508991 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2993.38
Current children cumulated vsize (KiB) 2467940

[startup+1062.3 s]
/proc/loadavg: 9.15 9.12 9.10 10/466 17099
/proc/meminfo: memFree=10089368/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=2960156 CPUtime=3172.44 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 4703369 0 0 0 316511 733 0 0 25 0 4 0 650262893 3031199744 550274 33554432000 4194304 4625164 140733863626960 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 740039 550274 389 106 0 735542 0
[pid=17036/tid=17038] ppid=17034 vsize=2960156 CPUtime=995.91 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 83829 0 0 0 99567 24 0 0 25 0 4 0 650262900 3031199744 550274 33554432000 4194304 4625164 140733863626960 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=2960156 CPUtime=671.57 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 88873 0 0 0 67098 59 0 0 25 0 4 0 650262900 3031199744 550274 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=2960156 CPUtime=655.31 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 3311732 0 0 0 65051 480 0 0 25 0 4 0 650262900 3031199744 550274 33554432000 4194304 4625164 140733863626960 18446744073709551615 4547843 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3172.44
Current children cumulated vsize (KiB) 2960156

[startup+1122.3 s]
/proc/loadavg: 9.10 9.11 9.09 10/466 17101
/proc/meminfo: memFree=9976520/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=3033784 CPUtime=3351.5 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 4893207 0 0 0 334377 773 0 0 25 0 4 0 650262893 3106594816 568235 33554432000 4194304 4625164 140733863626960 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 758446 568235 389 106 0 753949 0
[pid=17036/tid=17038] ppid=17034 vsize=3033784 CPUtime=1055.91 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 84045 0 0 0 105567 24 0 0 25 0 4 0 650262900 3106594816 568235 33554432000 4194304 4625164 140733863626960 18446744073709551615 4330787 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=3033784 CPUtime=709.69 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 93904 0 0 0 70902 67 0 0 25 0 4 0 650262900 3106594816 568235 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=3033784 CPUtime=685.07 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 3479072 0 0 0 67999 508 0 0 25 0 4 0 650262900 3106594816 568235 33554432000 4194304 4625164 140733863626960 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3351.5
Current children cumulated vsize (KiB) 3033784

[startup+1182.3 s]
/proc/loadavg: 9.14 9.12 9.09 10/466 17102
/proc/meminfo: memFree=9866144/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=3040880 CPUtime=3530.56 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 5109567 0 0 0 352246 810 0 0 25 0 4 0 650262893 3113861120 585022 33554432000 4194304 4625164 140733863626960 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 760220 585022 389 106 0 755723 0
[pid=17036/tid=17038] ppid=17034 vsize=3040880 CPUtime=1115.11 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 84323 0 0 0 111487 24 0 0 25 0 4 0 650262900 3113861120 585022 33554432000 4194304 4625164 140733863626960 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=3040880 CPUtime=740.19 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 97512 0 0 0 73947 72 0 0 25 0 4 0 650262900 3113861120 585022 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=3040880 CPUtime=715.49 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 3680747 0 0 0 71010 539 0 0 25 0 4 0 650262900 3113861120 585022 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3530.56
Current children cumulated vsize (KiB) 3040880

[startup+1242.3 s]
/proc/loadavg: 9.20 9.14 9.10 10/466 17113
/proc/meminfo: memFree=9810492/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=3054332 CPUtime=3709.61 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 5301853 0 0 0 370124 837 0 0 25 0 4 0 650262893 3127635968 597156 33554432000 4194304 4625164 140733863626960 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 763583 597156 389 106 0 759086 0
[pid=17036/tid=17038] ppid=17034 vsize=3054332 CPUtime=1175.1 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 84478 0 0 0 117486 24 0 0 25 0 4 0 650262900 3127635968 597156 33554432000 4194304 4625164 140733863626960 18446744073709551615 4331211 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=3054332 CPUtime=769.68 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 97587 0 0 0 76896 72 0 0 25 0 4 0 650262900 3127635968 597156 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=3054332 CPUtime=745.06 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 3862565 0 0 0 73942 564 0 0 25 0 4 0 650262900 3127635968 597156 33554432000 4194304 4625164 140733863626960 18446744073709551615 4547307 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3709.61
Current children cumulated vsize (KiB) 3054332



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 9.21 9.16 9.10 6/461 17116
/proc/meminfo: memFree=12016596/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=3125128 CPUtime=3881.85 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 5483659 0 0 0 387319 866 0 0 25 0 4 0 650262893 3200131072 607879 33554432000 4194304 4625164 140733863626960 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 781282 607879 389 106 0 776785 0
[pid=17036/tid=17038] ppid=17034 vsize=3125128 CPUtime=1232.8 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 84778 0 0 0 123256 24 0 0 25 0 4 0 650262900 3200131072 607879 33554432000 4194304 4625164 140733863626960 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=3125128 CPUtime=798.07 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 99566 0 0 0 79734 73 0 0 25 0 4 0 650262900 3200131072 607879 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=3125128 CPUtime=773.48 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 4036196 0 0 0 76759 589 0 0 25 0 4 0 650262900 3200131072 607879 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3881.85
Current children cumulated vsize (KiB) 3125128

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 9.21 9.16 9.10 6/461 17116
/proc/meminfo: memFree=12016596/32951124 swapFree=67111348/67111528
[pid=17036] ppid=17034 vsize=3125128 CPUtime=3881.85 cores=0,2,4,6
/proc/17036/stat : 17036 (SArTagnan) R 17034 17036 16929 0 -1 4202496 5483659 0 0 0 387319 866 0 0 25 0 4 0 650262893 3200131072 607879 33554432000 4194304 4625164 140733863626960 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17036/statm: 781282 607879 389 106 0 776785 0
[pid=17036/tid=17038] ppid=17034 vsize=3125128 CPUtime=1232.8 cores=0,2,4,6
/proc/17036/task/17038/stat : 17038 (SArTagnan) R 17034 17036 16929 0 -1 4202560 84778 0 0 0 123256 24 0 0 25 0 4 0 650262900 3200131072 607879 33554432000 4194304 4625164 140733863626960 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=17036/tid=17039] ppid=17034 vsize=3125128 CPUtime=798.07 cores=0,2,4,6
/proc/17036/task/17039/stat : 17039 (SArTagnan) R 17034 17036 16929 0 -1 4202560 99566 0 0 0 79734 73 0 0 25 0 4 0 650262900 3200131072 607879 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=17036/tid=17040] ppid=17034 vsize=3125128 CPUtime=773.48 cores=0,2,4,6
/proc/17036/task/17040/stat : 17040 (SArTagnan) R 17034 17036 16929 0 -1 4202560 4036196 0 0 0 76759 589 0 0 25 0 4 0 650262900 3200131072 607879 33554432000 4194304 4625164 140733863626960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3881.85
Current children cumulated vsize (KiB) 3125128

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.12
CPU time (s): 3881.97
CPU user time (s): 3873.22
CPU system time (s): 8.75567
CPU usage (%): 298.587
Max. virtual memory (cumulated for all children) (KiB): 3928036

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3873.22
system time used= 8.75567
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5483660
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6934
involuntary context switches= 35707

runsolver used 5.65914 second user time and 14.1119 second system time

The end

Launcher Data 

Begin job on node144 at 2011-05-16 22:41:08
IDJOB=3386106
IDBENCH=71366
IDSOLVER=1871
FILE ID=node144/3386106-1305578467
RUNJOBID= node144-1305577260-16947
PBS_JOBID= 13350220
Free space on /tmp= 73260 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2400c266431gyes6.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386106-1305578467/watcher-3386106-1305578467 -o /tmp/evaluation-result-3386106-1305578467/solver-3386106-1305578467 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386106-1305578467.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e23fefb786281285c1d045e8bc698d74
RANDOM SEED=1295749902

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13188708 kB
Buffers:        330792 kB
Cached:        4109000 kB
SwapCached:          0 kB
Active:       16537860 kB
Inactive:      2848120 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13188708 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            3932 kB
Writeback:           0 kB
AnonPages:    14945456 kB
Mapped:          38396 kB
Slab:           246532 kB
PageTables:      63868 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 138167588 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73260 MiB
End job on node144 at 2011-05-16 23:02:50