Trace number 3386045

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3872.67 1300.08

General information on the benchmark

NameSAT02/handmade/simon/
satex-challenges/c6288.shuffled.cnf
MD5SUM75bd8319132b47c2d2e6f0889735a248
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.865867
Satisfiable
(Un)Satisfiability was proved
Number of variables5008
Number of clauses14813
Sum of the clauses size34485
Maximum clause length33
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 29982
Number of clauses of size 34829
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386045-1305583433/watcher-3386045-1305583433 -o /tmp/evaluation-result-3386045-1305583433/solver-3386045-1305583433 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386045-1305583433.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.13 10.02 8.11 7/486 19438
/proc/meminfo: memFree=5257708/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=52812 CPUtime=0.01 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1171 0 0 0 1 0 0 0 24 0 4 0 669942008 54079488 1108 33554432000 4194304 4625164 140733987309792 18446744073709551615 47285912274866 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/19438/statm: 13203 1108 304 106 0 8706 0
[pid=19438/tid=19439] ppid=19436 vsize=52812 CPUtime=0 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669942009 54079488 1108 33554432000 4194304 4625164 140733987309792 18446744073709551615 47285912274866 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=52812 CPUtime=0 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669942009 54079488 1108 33554432000 4194304 4625164 140733987309792 18446744073709551615 242970606577 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=52812 CPUtime=0 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 669942009 54079488 1108 33554432000 4194304 4625164 140733987309792 18446744073709551615 47285912274860 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.065905 s]
/proc/loadavg: 10.13 10.02 8.11 7/486 19438
/proc/meminfo: memFree=5257708/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=184752 CPUtime=0.16 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1712 0 0 0 16 0 0 0 25 0 4 0 669942008 189186048 1601 33554432000 4194304 4625164 140733987309792 18446744073709551615 242970593463 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 46188 1601 342 106 0 41691 0
[pid=19438/tid=19439] ppid=19436 vsize=184752 CPUtime=0.04 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 44 0 0 0 4 0 0 0 25 0 4 0 669942009 189186048 1601 33554432000 4194304 4625164 140733987309792 18446744073709551615 4465277 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=184752 CPUtime=0 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 74 0 0 0 0 0 0 0 25 0 4 0 669942009 189186048 1601 33554432000 4194304 4625164 140733987309792 18446744073709551615 4288541 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=184752 CPUtime=0.05 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) D 19436 19438 19292 0 -1 4202560 164 0 0 0 5 0 0 0 25 0 4 0 669942009 189186048 1601 33554432000 4194304 4625164 140733987309792 18446744073709551615 242970211361 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 184752

[startup+0.925235 s]
/proc/loadavg: 10.13 10.02 8.11 7/486 19438
/proc/meminfo: memFree=5257708/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=260772 CPUtime=2.73 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 12616 0 0 0 272 1 0 0 19 0 4 0 669942008 267030528 6055 33554432000 4194304 4625164 140733987309792 18446744073709551615 4519359 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 65193 6055 346 106 0 60696 0
[pid=19438/tid=19439] ppid=19436 vsize=260772 CPUtime=0.41 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1326 0 0 0 41 0 0 0 25 0 4 0 669942009 267030528 6055 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352208 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=260772 CPUtime=0.49 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1219 0 0 0 49 0 0 0 25 0 4 0 669942009 267030528 6055 33554432000 4194304 4625164 140733987309792 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=260772 CPUtime=0.9 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 5150 0 0 0 90 0 0 0 25 0 4 0 669942009 267030528 6055 33554432000 4194304 4625164 140733987309792 18446744073709551615 4353037 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.73
Current children cumulated vsize (KiB) 260772

[startup+1.00122 s]
/proc/loadavg: 10.13 10.02 8.11 7/486 19438
/proc/meminfo: memFree=5257708/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=260772 CPUtime=2.96 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 12902 0 0 0 295 1 0 0 19 0 4 0 669942008 267030528 6096 33554432000 4194304 4625164 140733987309792 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 65193 6096 346 106 0 60696 0
[pid=19438/tid=19439] ppid=19436 vsize=260772 CPUtime=0.47 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1327 0 0 0 47 0 0 0 25 0 4 0 669942009 267030528 6096 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=260772 CPUtime=0.5 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1219 0 0 0 50 0 0 0 25 0 4 0 669942009 267030528 6096 33554432000 4194304 4625164 140733987309792 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=260772 CPUtime=0.98 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 5433 0 0 0 98 0 0 0 25 0 4 0 669942009 267030528 6096 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 260772

[startup+1.10121 s]
/proc/loadavg: 10.13 10.02 8.11 7/486 19438
/proc/meminfo: memFree=5257708/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=260772 CPUtime=3.26 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 13191 0 0 0 325 1 0 0 19 0 4 0 669942008 267030528 6146 33554432000 4194304 4625164 140733987309792 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 65193 6146 346 106 0 60696 0
[pid=19438/tid=19439] ppid=19436 vsize=260772 CPUtime=0.51 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1333 0 0 0 51 0 0 0 25 0 4 0 669942009 267030528 6146 33554432000 4194304 4625164 140733987309792 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=260772 CPUtime=0.56 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1222 0 0 0 56 0 0 0 25 0 4 0 669942009 267030528 6146 33554432000 4194304 4625164 140733987309792 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=260772 CPUtime=1.08 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 5700 0 0 0 108 0 0 0 25 0 4 0 669942009 267030528 6146 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3.26
Current children cumulated vsize (KiB) 260772

[startup+1.50114 s]
/proc/loadavg: 10.13 10.02 8.11 7/486 19438
/proc/meminfo: memFree=5257708/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=262952 CPUtime=4.46 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 14885 0 0 0 445 1 0 0 20 0 4 0 669942008 269262848 6873 33554432000 4194304 4625164 140733987309792 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 65738 6873 346 106 0 61241 0
[pid=19438/tid=19439] ppid=19436 vsize=262952 CPUtime=0.71 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1714 0 0 0 71 0 0 0 25 0 4 0 669942009 269262848 6873 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=262952 CPUtime=0.76 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1228 0 0 0 76 0 0 0 25 0 4 0 669942009 269262848 6873 33554432000 4194304 4625164 140733987309792 18446744073709551615 4465531 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=262952 CPUtime=1.48 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 7006 0 0 0 148 0 0 0 25 0 4 0 669942009 269262848 6873 33554432000 4194304 4625164 140733987309792 18446744073709551615 4551230 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4.46
Current children cumulated vsize (KiB) 262952

[startup+3.10086 s]
/proc/loadavg: 10.20 10.03 8.13 11/490 19442
/proc/meminfo: memFree=5201064/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=263752 CPUtime=9.23 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 21738 0 0 0 921 2 0 0 25 0 4 0 669942008 270082048 7751 33554432000 4194304 4625164 140733987309792 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 65938 7751 346 106 0 61441 0
[pid=19438/tid=19439] ppid=19436 vsize=263752 CPUtime=1.51 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1751 0 0 0 151 0 0 0 25 0 4 0 669942009 270082048 7751 33554432000 4194304 4625164 140733987309792 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=263752 CPUtime=1.56 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1240 0 0 0 156 0 0 0 25 0 4 0 669942009 270082048 7751 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352812 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=263752 CPUtime=3.08 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 13383 0 0 0 307 1 0 0 25 0 4 0 669942009 270082048 7751 33554432000 4194304 4625164 140733987309792 18446744073709551615 4552402 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 9.23
Current children cumulated vsize (KiB) 263752

[startup+6.31831 s]
/proc/loadavg: 10.18 10.03 8.14 11/490 19442
/proc/meminfo: memFree=5173900/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=273008 CPUtime=18.8 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 28654 0 0 0 1877 3 0 0 25 0 4 0 669942008 279560192 10611 33554432000 4194304 4625164 140733987309792 18446744073709551615 4356964 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 68252 10611 346 106 0 63755 0
[pid=19438/tid=19439] ppid=19436 vsize=273008 CPUtime=3.19 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 2078 0 0 0 319 0 0 0 25 0 4 0 669942009 279560192 10611 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=273008 CPUtime=3.58 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1929 0 0 0 358 0 0 0 25 0 4 0 669942009 279560192 10611 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352691 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=273008 CPUtime=5.79 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 18462 0 0 0 578 1 0 0 25 0 4 0 669942009 279560192 10611 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 18.8
Current children cumulated vsize (KiB) 273008

[startup+12.7002 s]
/proc/loadavg: 10.17 10.03 8.15 11/490 19442
/proc/meminfo: memFree=5141164/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=282096 CPUtime=37.85 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 38088 0 0 0 3781 4 0 0 25 0 4 0 669942008 288866304 14381 33554432000 4194304 4625164 140733987309792 18446744073709551615 4356341 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 70524 14381 347 106 0 66027 0
[pid=19438/tid=19439] ppid=19436 vsize=282096 CPUtime=6.34 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 3308 0 0 0 634 0 0 0 25 0 4 0 669942009 288866304 14381 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=282096 CPUtime=9.6 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 3451 0 0 0 960 0 0 0 25 0 4 0 669942009 288866304 14381 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=282096 CPUtime=9.38 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 24059 0 0 0 936 2 0 0 25 0 4 0 669942009 288866304 14381 33554432000 4194304 4625164 140733987309792 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 37.85
Current children cumulated vsize (KiB) 282096

[startup+25.501 s]
/proc/loadavg: 10.30 10.06 8.18 11/490 19444
/proc/meminfo: memFree=5077692/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=295820 CPUtime=76.05 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 70978 0 0 0 7595 10 0 0 25 0 4 0 669942008 302919680 21856 33554432000 4194304 4625164 140733987309792 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 73955 21856 347 106 0 69458 0
[pid=19438/tid=19439] ppid=19436 vsize=295820 CPUtime=12.6 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 5443 0 0 0 1259 1 0 0 25 0 4 0 669942009 302919680 21856 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=295820 CPUtime=18.63 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 6237 0 0 0 1862 1 0 0 25 0 4 0 669942009 302919680 21856 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=295820 CPUtime=19.7 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 50391 0 0 0 1964 6 0 0 25 0 4 0 669942009 302919680 21856 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 76.05
Current children cumulated vsize (KiB) 295820

[startup+51.1006 s]
/proc/loadavg: 10.27 10.07 8.23 11/490 19444
/proc/meminfo: memFree=4991348/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=321276 CPUtime=152.45 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 125746 0 0 0 15223 22 0 0 25 0 4 0 669942008 328986624 33163 33554432000 4194304 4625164 140733987309792 18446744073709551615 4396722 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 80319 33163 347 106 0 75822 0
[pid=19438/tid=19439] ppid=19436 vsize=321276 CPUtime=27.8 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 11094 0 0 0 2778 2 0 0 25 0 4 0 669942009 328986624 33163 33554432000 4194304 4625164 140733987309792 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=321276 CPUtime=41.79 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 13555 0 0 0 4176 3 0 0 25 0 4 0 669942009 328986624 33163 33554432000 4194304 4625164 140733987309792 18446744073709551615 4288746 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=321276 CPUtime=32.52 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 89118 0 0 0 3239 13 0 0 25 0 4 0 669942009 328986624 33163 33554432000 4194304 4625164 140733987309792 18446744073709551615 4288789 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 152.45
Current children cumulated vsize (KiB) 321276

[startup+102.301 s]
/proc/loadavg: 10.16 10.07 8.33 11/490 19446
/proc/meminfo: memFree=4846988/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=337268 CPUtime=305.26 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 265614 0 0 0 30480 46 0 0 25 0 4 0 669942008 345362432 51496 33554432000 4194304 4625164 140733987309792 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 84317 51496 347 106 0 79820 0
[pid=19438/tid=19439] ppid=19436 vsize=337268 CPUtime=69.5 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 17758 0 0 0 6946 4 0 0 25 0 4 0 669942009 345362432 51496 33554432000 4194304 4625164 140733987309792 18446744073709551615 4339569 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=337268 CPUtime=76.62 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 21524 0 0 0 7657 5 0 0 25 0 4 0 669942009 345362432 51496 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=337268 CPUtime=58.38 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 206674 0 0 0 5807 31 0 0 25 0 4 0 669942009 345362432 51496 33554432000 4194304 4625164 140733987309792 18446744073709551615 4579358 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 305.26
Current children cumulated vsize (KiB) 337268

[startup+162.3 s]

################
# More data... #
################

[pid=19438] ppid=19436 vsize=1142384 CPUtime=2088.84 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1279300 0 0 0 208665 219 0 0 25 0 4 0 669942008 1169801216 221700 33554432000 4194304 4625164 140733987309792 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19438/statm: 285596 221700 410 106 0 281099 0
[pid=19438/tid=19439] ppid=19436 vsize=1142384 CPUtime=589.57 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 62973 0 0 0 58938 19 0 0 25 0 4 0 669942009 1169801216 221700 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1142384 CPUtime=494.62 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 75448 0 0 0 49445 17 0 0 25 0 4 0 669942009 1169801216 221700 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1142384 CPUtime=452.6 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1008186 0 0 0 45099 161 0 0 25 0 4 0 669942009 1169801216 221700 33554432000 4194304 4625164 140733987309792 18446744073709551615 4327712 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2088.84
Current children cumulated vsize (KiB) 1142384

[startup+762.3 s]
/proc/loadavg: 10.12 10.16 9.26 11/490 19465
/proc/meminfo: memFree=3633140/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=1178012 CPUtime=2267.89 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1292726 0 0 0 226567 222 0 0 25 0 4 0 669942008 1206284288 234352 33554432000 4194304 4625164 140733987309792 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19438/statm: 294503 234352 410 106 0 290006 0
[pid=19438/tid=19439] ppid=19436 vsize=1178012 CPUtime=648.62 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 64657 0 0 0 64842 20 0 0 25 0 4 0 669942009 1206284288 234352 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1178012 CPUtime=524.62 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 75950 0 0 0 52445 17 0 0 25 0 4 0 669942009 1206284288 234352 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1178012 CPUtime=512.6 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1017347 0 0 0 51097 163 0 0 25 0 4 0 669942009 1206284288 234352 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2267.89
Current children cumulated vsize (KiB) 1178012

[startup+822.301 s]
/proc/loadavg: 10.08 10.15 9.31 11/490 19467
/proc/meminfo: memFree=3556356/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=1215580 CPUtime=2446.96 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1306438 0 0 0 244469 227 0 0 25 0 4 0 669942008 1244753920 247437 33554432000 4194304 4625164 140733987309792 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19438/statm: 303895 247437 410 106 0 299398 0
[pid=19438/tid=19439] ppid=19436 vsize=1215580 CPUtime=707.69 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 67053 0 0 0 70747 22 0 0 25 0 4 0 669942009 1244753920 247437 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1215580 CPUtime=554.62 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 76139 0 0 0 55445 17 0 0 25 0 4 0 669942009 1244753920 247437 33554432000 4194304 4625164 140733987309792 18446744073709551615 4464310 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1215580 CPUtime=572.61 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1026910 0 0 0 57095 166 0 0 25 0 4 0 669942009 1244753920 247437 33554432000 4194304 4625164 140733987309792 18446744073709551615 4547221 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2446.96
Current children cumulated vsize (KiB) 1215580

[startup+882.301 s]
/proc/loadavg: 10.18 10.16 9.36 11/490 19469
/proc/meminfo: memFree=3479196/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=1253652 CPUtime=2626 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1320458 0 0 0 262370 230 0 0 25 0 4 0 669942008 1283739648 260166 33554432000 4194304 4625164 140733987309792 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19438/statm: 313413 260166 410 106 0 308916 0
[pid=19438/tid=19439] ppid=19436 vsize=1253652 CPUtime=766.73 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 68932 0 0 0 76650 23 0 0 25 0 4 0 669942009 1283739648 260166 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1253652 CPUtime=584.71 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 76290 0 0 0 58454 17 0 0 25 0 4 0 669942009 1283739648 260166 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1253652 CPUtime=632.6 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1036384 0 0 0 63093 167 0 0 25 0 4 0 669942009 1283739648 260166 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2626
Current children cumulated vsize (KiB) 1253652

[startup+942.3 s]
/proc/loadavg: 10.23 10.18 9.42 11/490 19471
/proc/meminfo: memFree=3383188/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=1332792 CPUtime=2805.09 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1356220 0 0 0 280273 236 0 0 25 0 4 0 669942008 1364779008 274076 33554432000 4194304 4625164 140733987309792 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/19438/statm: 333198 274076 410 106 0 328701 0
[pid=19438/tid=19439] ppid=19436 vsize=1332792 CPUtime=825.79 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 71529 0 0 0 82555 24 0 0 25 0 4 0 669942009 1364779008 274076 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1332792 CPUtime=614.71 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 76594 0 0 0 61453 18 0 0 25 0 4 0 669942009 1364779008 274076 33554432000 4194304 4625164 140733987309792 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1332792 CPUtime=692.62 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1045669 0 0 0 69093 169 0 0 25 0 4 0 669942009 1364779008 274076 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2805.09
Current children cumulated vsize (KiB) 1332792

[startup+1002.3 s]
/proc/loadavg: 10.21 10.17 9.46 11/490 19473
/proc/meminfo: memFree=3321656/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=1361104 CPUtime=2984.11 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1367865 0 0 0 298170 241 0 0 25 0 4 0 669942008 1393770496 284411 33554432000 4194304 4625164 140733987309792 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 340276 284411 397 106 0 335779 0
[pid=19438/tid=19439] ppid=19436 vsize=1361104 CPUtime=869.27 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 73124 0 0 0 86901 26 0 0 25 0 4 0 669942009 1393770496 284411 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1361104 CPUtime=660.73 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 76815 0 0 0 66055 18 0 0 25 0 4 0 669942009 1393770496 284411 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1361104 CPUtime=743.58 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1052947 0 0 0 74187 171 0 0 25 0 4 0 669942009 1393770496 284411 33554432000 4194304 4625164 140733987309792 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2984.11
Current children cumulated vsize (KiB) 1361104

[startup+1062.32 s]
/proc/loadavg: 10.13 10.16 9.50 11/490 19473
/proc/meminfo: memFree=3248216/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=1420840 CPUtime=3163.22 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1404513 0 0 0 316074 248 0 0 25 0 4 0 669942008 1454940160 298389 33554432000 4194304 4625164 140733987309792 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 355210 298389 347 106 0 350713 0
[pid=19438/tid=19439] ppid=19436 vsize=1420840 CPUtime=899.27 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 73825 0 0 0 89900 27 0 0 25 0 4 0 669942009 1454940160 298389 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1420840 CPUtime=720.75 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 77746 0 0 0 72056 19 0 0 25 0 4 0 669942009 1454940160 298389 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1420840 CPUtime=773.59 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1057052 0 0 0 77187 172 0 0 25 0 4 0 669942009 1454940160 298389 33554432000 4194304 4625164 140733987309792 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3163.22
Current children cumulated vsize (KiB) 1420840

[startup+1122.3 s]
/proc/loadavg: 10.15 10.15 9.54 11/490 19475
/proc/meminfo: memFree=3172056/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=1502608 CPUtime=3342.22 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1433250 0 0 0 333969 253 0 0 25 0 4 0 669942008 1538670592 312386 33554432000 4194304 4625164 140733987309792 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 375652 312386 381 106 0 371155 0
[pid=19438/tid=19439] ppid=19436 vsize=1502608 CPUtime=929.27 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 90030 0 0 0 92898 29 0 0 25 0 4 0 669942009 1538670592 312386 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1502608 CPUtime=780.73 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 79348 0 0 0 78053 20 0 0 25 0 4 0 669942009 1538670592 312386 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1502608 CPUtime=803.59 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1066996 0 0 0 80185 174 0 0 25 0 4 0 669942009 1538670592 312386 33554432000 4194304 4625164 140733987309792 18446744073709551615 4552402 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3342.22
Current children cumulated vsize (KiB) 1502608

[startup+1182.3 s]
/proc/loadavg: 10.21 10.17 9.58 11/490 19477
/proc/meminfo: memFree=3069356/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=1545152 CPUtime=3521.29 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1442020 0 0 0 351872 257 0 0 25 0 4 0 669942008 1582235648 321107 33554432000 4194304 4625164 140733987309792 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 386288 321107 381 106 0 381791 0
[pid=19438/tid=19439] ppid=19436 vsize=1545152 CPUtime=959.26 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 94955 0 0 0 95897 29 0 0 25 0 4 0 669942009 1582235648 321107 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1545152 CPUtime=840.73 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 80688 0 0 0 84050 23 0 0 25 0 4 0 669942009 1582235648 321107 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1545152 CPUtime=833.59 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1067953 0 0 0 83185 174 0 0 25 0 4 0 669942009 1582235648 321107 33554432000 4194304 4625164 140733987309792 18446744073709551615 242970247257 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3521.29
Current children cumulated vsize (KiB) 1545152

[startup+1242.3 s]
/proc/loadavg: 10.20 10.18 9.62 11/490 19479
/proc/meminfo: memFree=3016508/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=1557984 CPUtime=3700.36 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1448278 0 0 0 369777 259 0 0 25 0 4 0 669942008 1595375616 327332 33554432000 4194304 4625164 140733987309792 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 389496 327332 381 106 0 384999 0
[pid=19438/tid=19439] ppid=19436 vsize=1557984 CPUtime=989.26 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 95503 0 0 0 98897 29 0 0 25 0 4 0 669942009 1595375616 327332 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1557984 CPUtime=900.73 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 82362 0 0 0 90049 24 0 0 25 0 4 0 669942009 1595375616 327332 33554432000 4194304 4625164 140733987309792 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1557984 CPUtime=863.59 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1071133 0 0 0 86185 174 0 0 25 0 4 0 669942009 1595375616 327332 33554432000 4194304 4625164 140733987309792 18446744073709551615 4551652 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3700.36
Current children cumulated vsize (KiB) 1557984



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.22 10.19 9.65 7/486 19482
/proc/meminfo: memFree=3749720/32951132 swapFree=59792360/67111528
[pid=19438] ppid=19436 vsize=1574836 CPUtime=3872.59 cores=1,3,5,7
/proc/19438/stat : 19438 (SArTagnan) R 19436 19438 19292 0 -1 4202496 1454681 0 0 0 386996 263 0 0 25 0 4 0 669942008 1612632064 333693 33554432000 4194304 4625164 140733987309792 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/19438/statm: 393709 333693 381 106 0 389212 0
[pid=19438/tid=19439] ppid=19436 vsize=1574836 CPUtime=1037.35 cores=1,3,5,7
/proc/19438/task/19439/stat : 19439 (SArTagnan) R 19436 19438 19292 0 -1 4202560 95663 0 0 0 103705 30 0 0 25 0 4 0 669942009 1612632064 333693 33554432000 4194304 4625164 140733987309792 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=19438/tid=19440] ppid=19436 vsize=1574836 CPUtime=939.26 cores=1,3,5,7
/proc/19438/task/19440/stat : 19440 (SArTagnan) R 19436 19438 19292 0 -1 4202560 83089 0 0 0 93900 26 0 0 25 0 4 0 669942009 1612632064 333693 33554432000 4194304 4625164 140733987309792 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19438/tid=19441] ppid=19436 vsize=1574836 CPUtime=892.41 cores=1,3,5,7
/proc/19438/task/19441/stat : 19441 (SArTagnan) R 19436 19438 19292 0 -1 4202560 1075508 0 0 0 89066 175 0 0 25 0 4 0 669942009 1612632064 333693 33554432000 4194304 4625164 140733987309792 18446744073709551615 4548757 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3872.59
Current children cumulated vsize (KiB) 1574836

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.08
CPU time (s): 3872.67
CPU user time (s): 3869.99
CPU system time (s): 2.68359
CPU usage (%): 297.88
Max. virtual memory (cumulated for all children) (KiB): 1574836

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3869.99
system time used= 2.68359
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1454681
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1144
involuntary context switches= 31796

runsolver used 5.68513 second user time and 14.7638 second system time

The end

Launcher Data 

Begin job on node128 at 2011-05-17 00:03:54
IDJOB=3386045
IDBENCH=87734
IDSOLVER=1871
FILE ID=node128/3386045-1305583433
RUNJOBID= node128-1305582130-19311
PBS_JOBID= 13350295
Free space on /tmp= 73496 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT02/handmade/simon/satex-challenges/c6288.shuffled.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386045-1305583433/watcher-3386045-1305583433 -o /tmp/evaluation-result-3386045-1305583433/solver-3386045-1305583433 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386045-1305583433.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 75bd8319132b47c2d2e6f0889735a248
RANDOM SEED=412212672

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:       5257740 kB
Buffers:         71360 kB
Cached:         665132 kB
SwapCached:     122436 kB
Active:       12394140 kB
Inactive:     15028064 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:       5257740 kB
SwapTotal:    67111528 kB
SwapFree:     59792360 kB
Dirty:             780 kB
Writeback:          16 kB
AnonPages:    26571536 kB
Mapped:          19432 kB
Slab:            95868 kB
PageTables:     107004 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 153111828 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73496 MiB
End job on node128 at 2011-05-17 00:25:36