Trace number 3386229

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4612.61 1300.08

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_08_UNSAT.cnf
MD5SUM66aa2e18c32a02f55a810347a9702c7f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1067.51
Satisfiable
(Un)Satisfiability was proved
Number of variables1278
Number of clauses68055
Sum of the clauses size202155
Maximum clause length9
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22148
Number of clauses of size 365884
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386229-1305577881/watcher-3386229-1305577881 -o /tmp/evaluation-result-3386229-1305577881/solver-3386229-1305577881 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386229-1305577881.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.13 9.21 7.85 8/399 26165
/proc/meminfo: memFree=22519692/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=22820 CPUtime=0.01 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1834 0 0 0 1 0 0 0 25 0 1 0 669386241 23367680 1105 33554432000 4194304 4625164 140734010682128 18446744073709551615 232335553221 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26165/statm: 5705 1107 296 106 0 1208 0

[startup+0.0385709 s]
/proc/loadavg: 8.13 9.21 7.85 8/399 26165
/proc/meminfo: memFree=22519692/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=30052 CPUtime=0.03 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 4408 0 0 0 3 0 0 0 25 0 1 0 669386241 30773248 2637 33554432000 4194304 4625164 140734010682128 18446744073709551615 4298385 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26165/statm: 7513 2657 298 106 0 3016 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 30052

[startup+0.111036 s]
/proc/loadavg: 8.13 9.21 7.85 8/399 26165
/proc/meminfo: memFree=22519692/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=205964 CPUtime=0.23 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 7572 0 0 0 23 0 0 0 25 0 4 0 669386241 210907136 5595 33554432000 4194304 4625164 140734010682128 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 51491 5595 341 106 0 46994 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 205964

[startup+0.956374 s]
/proc/loadavg: 8.13 9.21 7.85 8/399 26165
/proc/meminfo: memFree=22519692/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=209404 CPUtime=2.76 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 21867 0 0 0 274 2 0 0 25 0 4 0 669386241 214429696 7209 33554432000 4194304 4625164 140734010682128 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 52351 7209 341 106 0 47854 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 209404

[startup+1.00037 s]
/proc/loadavg: 8.13 9.21 7.85 8/399 26165
/proc/meminfo: memFree=22519692/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=209404 CPUtime=2.89 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 22695 0 0 0 287 2 0 0 25 0 4 0 669386241 214429696 7304 33554432000 4194304 4625164 140734010682128 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 52351 7304 341 106 0 47854 0
Current children cumulated CPU time (s) 2.89
Current children cumulated vsize (KiB) 209404

[startup+1.50028 s]
/proc/loadavg: 8.13 9.21 7.85 8/399 26165
/proc/meminfo: memFree=22519692/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=209404 CPUtime=4.39 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 29800 0 0 0 436 3 0 0 25 0 4 0 669386241 214429696 7961 33554432000 4194304 4625164 140734010682128 18446744073709551615 4513822 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 52351 7961 341 106 0 47854 0
Current children cumulated CPU time (s) 4.39
Current children cumulated vsize (KiB) 209404

[startup+3.10099 s]
/proc/loadavg: 8.28 9.23 7.86 11/403 26169
/proc/meminfo: memFree=22437504/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=278416 CPUtime=9.16 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 47947 0 0 0 911 5 0 0 25 0 4 0 669386241 285097984 9598 33554432000 4194304 4625164 140734010682128 18446744073709551615 4392942 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 69604 9598 341 106 0 65107 0
[pid=26165/tid=26167] ppid=26163 vsize=278416 CPUtime=1.86 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 2325 0 0 0 186 0 0 0 25 0 4 0 669386245 285097984 9598 33554432000 4194304 4625164 140734010682128 18446744073709551615 4352098 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=278416 CPUtime=2.59 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 3387 0 0 0 258 1 0 0 25 0 4 0 669386245 285097984 9598 33554432000 4194304 4625164 140734010682128 18446744073709551615 4288765 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=278416 CPUtime=2.59 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 36145 0 0 0 256 3 0 0 22 0 4 0 669386245 285097984 9598 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 9.16
Current children cumulated vsize (KiB) 278416

[startup+6.30043 s]
/proc/loadavg: 8.28 9.23 7.86 12/403 26169
/proc/meminfo: memFree=22392948/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=282292 CPUtime=18.84 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 73554 0 0 0 1874 10 0 0 25 0 4 0 669386241 289067008 12630 33554432000 4194304 4625164 140734010682128 18446744073709551615 4396480 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 70573 12630 347 106 0 66076 0
[pid=26165/tid=26167] ppid=26163 vsize=282292 CPUtime=4.88 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 5099 0 0 0 488 0 0 0 25 0 4 0 669386245 289067008 12630 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351958 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=282292 CPUtime=4.51 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 5449 0 0 0 450 1 0 0 25 0 4 0 669386245 289067008 12630 33554432000 4194304 4625164 140734010682128 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=282292 CPUtime=4.13 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 55616 0 0 0 406 7 0 0 25 0 4 0 669386245 289067008 12630 33554432000 4194304 4625164 140734010682128 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 18.84
Current children cumulated vsize (KiB) 282292

[startup+12.7153 s]
/proc/loadavg: 8.62 9.27 7.88 11/403 26169
/proc/meminfo: memFree=22244772/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=291876 CPUtime=38.4 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 114447 0 0 0 3824 16 0 0 25 0 4 0 669386241 298881024 20163 33554432000 4194304 4625164 140734010682128 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 72969 20163 348 106 0 68472 0
[pid=26165/tid=26167] ppid=26163 vsize=291876 CPUtime=11.15 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 14476 0 0 0 1113 2 0 0 25 0 4 0 669386245 298881024 20163 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=291876 CPUtime=9.33 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 8861 0 0 0 932 1 0 0 25 0 4 0 669386245 298881024 20163 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=291876 CPUtime=7.19 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 82792 0 0 0 709 10 0 0 25 0 4 0 669386245 298881024 20163 33554432000 4194304 4625164 140734010682128 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38.4
Current children cumulated vsize (KiB) 291876

[startup+25.501 s]
/proc/loadavg: 8.83 9.29 7.91 11/403 26170
/proc/meminfo: memFree=22082316/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=311404 CPUtime=76.6 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 165378 0 0 0 7635 25 0 0 25 0 4 0 669386241 318877696 32851 33554432000 4194304 4625164 140734010682128 18446744073709551615 4338094 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 77851 32851 610 106 0 73354 0
[pid=26165/tid=26167] ppid=26163 vsize=311404 CPUtime=20.22 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 21924 0 0 0 2018 4 0 0 25 0 4 0 669386245 318877696 32852 33554432000 4194304 4625164 140734010682128 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=311404 CPUtime=19.93 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 14588 0 0 0 1990 3 0 0 25 0 4 0 669386245 318877696 32852 33554432000 4194304 4625164 140734010682128 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=311404 CPUtime=13.42 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 118394 0 0 0 1326 16 0 0 25 0 4 0 669386245 318877696 32852 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 76.6
Current children cumulated vsize (KiB) 311404

[startup+51.1005 s]
/proc/loadavg: 9.29 9.36 7.97 11/403 26171
/proc/meminfo: memFree=21937664/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=350392 CPUtime=153.09 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 222799 0 0 0 15272 37 0 0 25 0 4 0 669386241 358801408 45669 33554432000 4194304 4625164 140734010682128 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 87598 45669 663 106 0 83101 0
[pid=26165/tid=26167] ppid=26163 vsize=350392 CPUtime=33.12 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 24919 0 0 0 3307 5 0 0 25 0 4 0 669386245 358801408 45669 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=350392 CPUtime=40.04 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 23039 0 0 0 3998 6 0 0 25 0 4 0 669386245 358801408 45669 33554432000 4194304 4625164 140734010682128 18446744073709551615 4464700 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=350392 CPUtime=35.25 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 162558 0 0 0 3501 24 0 0 25 0 4 0 669386245 358801408 45669 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 153.09
Current children cumulated vsize (KiB) 350392

[startup+102.3 s]
/proc/loadavg: 9.85 9.51 8.10 11/403 26172
/proc/meminfo: memFree=21479248/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=407900 CPUtime=306.01 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 528543 0 0 0 30517 84 0 0 25 0 4 0 669386241 417689600 64532 33554432000 4194304 4625164 140734010682128 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 101975 64532 606 106 0 97478 0
[pid=26165/tid=26167] ppid=26163 vsize=407900 CPUtime=58.85 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 47018 0 0 0 5877 8 0 0 25 0 4 0 669386245 417689600 64532 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=407900 CPUtime=65.5 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 32170 0 0 0 6542 8 0 0 25 0 4 0 669386245 417689600 64532 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=407900 CPUtime=85.79 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 432821 0 0 0 8514 65 0 0 25 0 4 0 669386245 417689600 64532 33554432000 4194304 4625164 140734010682128 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 306.01
Current children cumulated vsize (KiB) 407900

[startup+162.315 s]
/proc/loadavg: 10.12 9.66 8.23 11/403 26173
/proc/meminfo: memFree=20917756/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=636836 CPUtime=485.29 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 806147 0 0 0 48403 126 0 0 25 0 4 0 669386241 652120064 105658 33554432000 4194304 4625164 140734010682128 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 159209 105658 1597 106 0 154712 0
[pid=26165/tid=26167] ppid=26163 vsize=636836 CPUtime=89.01 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 49136 0 0 0 8892 9 0 0 25 0 4 0 669386245 652120064 105658 33554432000 4194304 4625164 140734010682128 18446744073709551615 4339660 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=636836 CPUtime=95.35 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 44778 0 0 0 9526 9 0 0 25 0 4 0 669386245 652120064 105658 33554432000 4194304 4625164 140734010682128 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=636836 CPUtime=145.04 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 665760 0 0 0 14404 100 0 0 25 0 4 0 669386245 652120064 105658 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 485.29
Current children cumulated vsize (KiB) 636836

[startup+222.301 s]
/proc/loadavg: 10.14 9.75 8.35 11/403 26175
/proc/meminfo: memFree=20359376/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=630468 CPUtime=664.49 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1064276 0 0 0 66287 162 0 0 25 0 4 0 669386241 645599232 119376 33554432000 4194304 4625164 140734010682128 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 157617 119376 1562 106 0 153120 0
[pid=26165/tid=26167] ppid=26163 vsize=630468 CPUtime=119 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 53374 0 0 0 11890 10 0 0 25 0 4 0 669386245 645599232 119376 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=630468 CPUtime=125.35 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 45728 0 0 0 12525 10 0 0 25 0 4 0 669386245 645599232 119376 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=630468 CPUtime=204.27 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 902592 0 0 0 20295 132 0 0 25 0 4 0 669386245 645599232 119376 33554432000 4194304 4625164 140734010682128 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 664.49
Current children cumulated vsize (KiB) 630468

[startup+282.3 s]
/proc/loadavg: 10.21 9.85 8.47 11/403 26177
/proc/meminfo: memFree=19796140/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=860964 CPUtime=843.72 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1118094 0 0 0 84198 174 0 0 25 0 4 0 669386241 881627136 142597 33554432000 4194304 4625164 140734010682128 18446744073709551615 4512326 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26165/statm: 215241 142597 1404 106 0 210744 0
[pid=26165/tid=26167] ppid=26163 vsize=860964 CPUtime=149 cores=0,2,4,6

################
# More data... #
################

[pid=26165] ppid=26163 vsize=1216024 CPUtime=2229.44 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1349922 0 0 0 222713 231 0 0 25 0 4 0 669386241 1245208576 237279 33554432000 4194304 4625164 140734010682128 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 304006 237279 347 106 0 299509 0
[pid=26165/tid=26167] ppid=26163 vsize=1216024 CPUtime=424.71 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 117923 0 0 0 42435 36 0 0 25 0 4 0 669386245 1245208576 237279 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1216024 CPUtime=462.87 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 79492 0 0 0 46265 22 0 0 25 0 4 0 669386245 1245208576 237279 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1216024 CPUtime=678.18 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 925633 0 0 0 67680 138 0 0 25 0 4 0 669386245 1245208576 237279 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2229.44
Current children cumulated vsize (KiB) 1216024

[startup+762.301 s]
/proc/loadavg: 9.26 9.66 8.98 10/402 26189
/proc/meminfo: memFree=14973420/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=1333192 CPUtime=2468.63 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1407094 0 0 0 246619 244 0 0 25 0 4 0 669386241 1365188608 254956 33554432000 4194304 4625164 140734010682128 18446744073709551615 4393077 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 333298 254956 347 106 0 328801 0
[pid=26165/tid=26167] ppid=26163 vsize=1333192 CPUtime=484.69 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 124668 0 0 0 48431 38 0 0 25 0 4 0 669386245 1365188608 254956 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1333192 CPUtime=522.85 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 107560 0 0 0 52257 28 0 0 25 0 4 0 669386245 1365188608 254956 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1333192 CPUtime=737.41 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 942784 0 0 0 73600 141 0 0 25 0 4 0 669386245 1365188608 254956 33554432000 4194304 4625164 140734010682128 18446744073709551615 4579584 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2468.63
Current children cumulated vsize (KiB) 1333192

[startup+822.315 s]
/proc/loadavg: 9.28 9.59 9.00 10/402 26191
/proc/meminfo: memFree=15987980/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=1484056 CPUtime=2707.9 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1498964 0 0 0 270531 259 0 0 25 0 4 0 669386241 1519673344 271834 33554432000 4194304 4625164 140734010682128 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 371014 271834 347 106 0 366517 0
[pid=26165/tid=26167] ppid=26163 vsize=1484056 CPUtime=544.71 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 125664 0 0 0 54433 38 0 0 25 0 4 0 669386245 1519673344 271834 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1484056 CPUtime=582.85 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 110938 0 0 0 58254 31 0 0 25 0 4 0 669386245 1519673344 271834 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1484056 CPUtime=796.66 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 944853 0 0 0 79524 142 0 0 25 0 4 0 669386245 1519673344 271834 33554432000 4194304 4625164 140734010682128 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2707.9
Current children cumulated vsize (KiB) 1484056

[startup+882.301 s]
/proc/loadavg: 9.25 9.52 9.01 10/402 26193
/proc/meminfo: memFree=15756452/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=1490072 CPUtime=2947.07 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1506434 0 0 0 294445 262 0 0 25 0 4 0 669386241 1525833728 278575 33554432000 4194304 4625164 140734010682128 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 372518 278575 347 106 0 368021 0
[pid=26165/tid=26167] ppid=26163 vsize=1490072 CPUtime=604.7 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 127270 0 0 0 60431 39 0 0 25 0 4 0 669386245 1525833728 278575 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1490072 CPUtime=642.83 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 112835 0 0 0 64250 33 0 0 25 0 4 0 669386245 1525833728 278575 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1490072 CPUtime=855.88 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 946747 0 0 0 85446 142 0 0 25 0 4 0 669386245 1525833728 278575 33554432000 4194304 4625164 140734010682128 18446744073709551615 4547221 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2947.07
Current children cumulated vsize (KiB) 1490072

[startup+942.301 s]
/proc/loadavg: 9.19 9.46 9.01 10/402 26194
/proc/meminfo: memFree=15433904/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=1495104 CPUtime=3186.3 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1525577 0 0 0 318358 272 0 0 25 0 4 0 669386241 1530986496 290770 33554432000 4194304 4625164 140734010682128 18446744073709551615 4512312 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 373776 290770 347 106 0 369279 0
[pid=26165/tid=26167] ppid=26163 vsize=1495104 CPUtime=664.7 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 130805 0 0 0 66426 44 0 0 25 0 4 0 669386245 1530986496 290770 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1495104 CPUtime=702.82 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 115676 0 0 0 70247 35 0 0 25 0 4 0 669386245 1530986496 290770 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1495104 CPUtime=915.12 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 948789 0 0 0 91369 143 0 0 25 0 4 0 669386245 1530986496 290770 33554432000 4194304 4625164 140734010682128 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3186.3
Current children cumulated vsize (KiB) 1495104

[startup+1002.3 s]
/proc/loadavg: 9.25 9.43 9.03 10/402 26196
/proc/meminfo: memFree=15211288/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=1565376 CPUtime=3425.52 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1547419 0 0 0 342272 280 0 0 25 0 4 0 669386241 1602945024 302403 33554432000 4194304 4625164 140734010682128 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 391344 302403 347 106 0 386847 0
[pid=26165/tid=26167] ppid=26163 vsize=1565376 CPUtime=724.7 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 133681 0 0 0 72423 47 0 0 25 0 4 0 669386245 1602945024 302403 33554432000 4194304 4625164 140734010682128 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1565376 CPUtime=762.81 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 118093 0 0 0 76244 37 0 0 25 0 4 0 669386245 1602945024 302403 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1565376 CPUtime=974.37 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 950320 0 0 0 97293 144 0 0 25 0 4 0 669386245 1602945024 302403 33554432000 4194304 4625164 140734010682128 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3425.52
Current children cumulated vsize (KiB) 1565376

[startup+1062.3 s]
/proc/loadavg: 9.18 9.38 9.03 10/402 26197
/proc/meminfo: memFree=14880172/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=1604640 CPUtime=3664.76 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1562855 0 0 0 366187 289 0 0 25 0 4 0 669386241 1643151360 315725 33554432000 4194304 4625164 140734010682128 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 401160 315725 347 106 0 396663 0
[pid=26165/tid=26167] ppid=26163 vsize=1604640 CPUtime=784.7 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 135686 0 0 0 78421 49 0 0 25 0 4 0 669386245 1643151360 315725 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1604640 CPUtime=822.8 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 123911 0 0 0 82240 40 0 0 25 0 4 0 669386245 1643151360 315725 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1604640 CPUtime=1033.6 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 952726 0 0 0 103215 145 0 0 25 0 4 0 669386245 1643151360 315725 33554432000 4194304 4625164 140734010682128 18446744073709551615 4547830 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3664.76
Current children cumulated vsize (KiB) 1604640

[startup+1122.3 s]
/proc/loadavg: 9.24 9.38 9.05 10/402 26199
/proc/meminfo: memFree=14689800/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=1679284 CPUtime=3904 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1608801 0 0 0 390101 299 0 0 25 0 4 0 669386241 1719586816 327051 33554432000 4194304 4625164 140734010682128 18446744073709551615 4511933 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 419821 327051 347 106 0 415324 0
[pid=26165/tid=26167] ppid=26163 vsize=1679284 CPUtime=844.7 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 176365 0 0 0 84414 56 0 0 25 0 4 0 669386245 1719586816 327051 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1679284 CPUtime=882.79 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 125427 0 0 0 88237 42 0 0 25 0 4 0 669386245 1719586816 327051 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1679284 CPUtime=1092.84 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 954557 0 0 0 109139 145 0 0 25 0 4 0 669386245 1719586816 327051 33554432000 4194304 4625164 140734010682128 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3904
Current children cumulated vsize (KiB) 1679284

[startup+1182.3 s]
/proc/loadavg: 9.24 9.35 9.06 11/402 26201
/proc/meminfo: memFree=14356100/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=1748624 CPUtime=4143.21 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1616771 0 0 0 414017 304 0 0 25 0 4 0 669386241 1790590976 334773 33554432000 4194304 4625164 140734010682128 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 437156 334773 347 106 0 432659 0
[pid=26165/tid=26167] ppid=26163 vsize=1748624 CPUtime=904.7 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 177991 0 0 0 90411 59 0 0 25 0 4 0 669386245 1790590976 334773 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1748624 CPUtime=942.77 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 127392 0 0 0 94233 44 0 0 25 0 4 0 669386245 1790590976 334773 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1748624 CPUtime=1152.07 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 956386 0 0 0 115061 146 0 0 25 0 4 0 669386245 1790590976 334773 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4143.21
Current children cumulated vsize (KiB) 1748624

[startup+1242.3 s]
/proc/loadavg: 9.19 9.33 9.07 10/402 26202
/proc/meminfo: memFree=14162892/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=1827336 CPUtime=4382.45 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1662236 0 0 0 437931 314 0 0 25 0 4 0 669386241 1871192064 345216 33554432000 4194304 4625164 140734010682128 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 456834 345216 347 106 0 452337 0
[pid=26165/tid=26167] ppid=26163 vsize=1827336 CPUtime=964.71 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 180945 0 0 0 96409 62 0 0 25 0 4 0 669386245 1871192064 345216 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1827336 CPUtime=1002.77 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 166796 0 0 0 100226 51 0 0 25 0 4 0 669386245 1871192064 345216 33554432000 4194304 4625164 140734010682128 18446744073709551615 4352007 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1827336 CPUtime=1211.31 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 958395 0 0 0 120985 146 0 0 25 0 4 0 669386245 1871192064 345216 33554432000 4194304 4625164 140734010682128 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4382.45
Current children cumulated vsize (KiB) 1827336



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 8.65 9.17 9.04 11/402 26235
/proc/meminfo: memFree=20162248/32951124 swapFree=65173164/67111528
[pid=26165] ppid=26163 vsize=1832264 CPUtime=4612.52 cores=0,2,4,6
/proc/26165/stat : 26165 (SArTagnan) R 26163 26165 25968 0 -1 4202496 1671750 0 0 0 460928 324 0 0 25 0 4 0 669386241 1876238336 354346 33554432000 4194304 4625164 140734010682128 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26165/statm: 458066 354346 347 106 0 453569 0
[pid=26165/tid=26167] ppid=26163 vsize=1832264 CPUtime=1022.42 cores=0,2,4,6
/proc/26165/task/26167/stat : 26167 (SArTagnan) R 26163 26165 25968 0 -1 4202560 183953 0 0 0 102178 64 0 0 25 0 4 0 669386245 1876238336 354346 33554432000 4194304 4625164 140734010682128 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26165/tid=26168] ppid=26163 vsize=1832264 CPUtime=1060.47 cores=0,2,4,6
/proc/26165/task/26168/stat : 26168 (SArTagnan) R 26163 26165 25968 0 -1 4202560 169573 0 0 0 105990 57 0 0 25 0 4 0 669386245 1876238336 354346 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26165/tid=26169] ppid=26163 vsize=1832264 CPUtime=1268.25 cores=0,2,4,6
/proc/26165/task/26169/stat : 26169 (SArTagnan) R 26163 26165 25968 0 -1 4202560 960405 0 0 0 126679 146 0 0 25 0 4 0 669386245 1876238336 354346 33554432000 4194304 4625164 140734010682128 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4612.52
Current children cumulated vsize (KiB) 1832264

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.08
CPU time (s): 4612.61
CPU user time (s): 4609.31
CPU system time (s): 3.3035
CPU usage (%): 354.794
Max. virtual memory (cumulated for all children) (KiB): 1966904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4609.31
system time used= 3.3035
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1671751
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 662
involuntary context switches= 56906

runsolver used 4.68329 second user time and 11.8832 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-16 22:31:21
IDJOB=3386229
IDBENCH=71078
IDSOLVER=1871
FILE ID=node132/3386229-1305577881
RUNJOBID= node132-1305576571-25986
PBS_JOBID= 13350206
Free space on /tmp= 73264 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_08_UNSAT.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386229-1305577881/watcher-3386229-1305577881 -o /tmp/evaluation-result-3386229-1305577881/solver-3386229-1305577881 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386229-1305577881.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 66aa2e18c32a02f55a810347a9702c7f
RANDOM SEED=255266195

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22519848 kB
Buffers:        315636 kB
Cached:        3552664 kB
SwapCached:       9908 kB
Active:        3981148 kB
Inactive:      6119336 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22519848 kB
SwapTotal:    67111528 kB
SwapFree:     65173164 kB
Dirty:           28736 kB
Writeback:           0 kB
AnonPages:     6228780 kB
Mapped:          25148 kB
Slab:           222332 kB
PageTables:      41116 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 78802872 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73128 MiB
End job on node132 at 2011-05-16 22:53:03