Trace number 3386054

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.49 1205.17

General information on the benchmark

NameSAT05/crafted/sorge05/QG7a/
gensys-icl005.shuffled-as.sat05-3826.cnf
MD5SUM5d8489e52ec1ef9c7431a7fd60f9ff86
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark455.087
Satisfiable
(Un)Satisfiability was proved
Number of variables2703
Number of clauses18312
Sum of the clauses size128119
Maximum clause length13
Minimum clause length1
Number of clauses of size 156
Number of clauses of size 2533
Number of clauses of size 32417
Number of clauses of size 4522
Number of clauses of size 5685
Number of clauses of size over 514099

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386054-1305583338/watcher-3386054-1305583338 -o /tmp/evaluation-result-3386054-1305583338/solver-3386054-1305583338 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386054-1305583338.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.16 8.03 6.41 6/493 31702
/proc/meminfo: memFree=14310864/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=20808 CPUtime=0.01 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 1301 0 0 0 1 0 0 0 25 0 1 0 650750090 21307392 882 33554432000 4194304 4625164 140733194534960 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/31702/statm: 5202 883 299 106 0 705 0

[startup+0.0202001 s]
/proc/loadavg: 8.16 8.03 6.41 6/493 31702
/proc/meminfo: memFree=14310864/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=21264 CPUtime=0.01 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 1509 0 0 0 1 0 0 0 25 0 1 0 650750090 21774336 928 33554432000 4194304 4625164 140733194534960 18446744073709551615 212039316165 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/31702/statm: 5316 928 299 106 0 819 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 21264

[startup+0.127787 s]
/proc/loadavg: 8.16 8.03 6.41 6/493 31702
/proc/meminfo: memFree=14310864/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=255276 CPUtime=0.42 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 4787 0 0 0 42 0 0 0 25 0 4 0 650750090 261402624 3282 33554432000 4194304 4625164 140733194534960 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 63819 3282 340 106 0 59322 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 255276

[startup+0.300094 s]
/proc/loadavg: 8.16 8.03 6.41 6/493 31702
/proc/meminfo: memFree=14310864/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=257628 CPUtime=1.11 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 7631 0 0 0 111 0 0 0 25 0 4 0 650750090 263811072 4081 33554432000 4194304 4625164 140733194534960 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 64407 4083 340 106 0 59910 0
Current children cumulated CPU time (s) 1.11
Current children cumulated vsize (KiB) 257628

[startup+0.701023 s]
/proc/loadavg: 8.16 8.03 6.41 6/493 31702
/proc/meminfo: memFree=14310864/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=262152 CPUtime=2.71 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 11991 0 0 0 270 1 0 0 25 0 4 0 650750090 268443648 5814 33554432000 4194304 4625164 140733194534960 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 65538 5814 346 106 0 61041 0
Current children cumulated CPU time (s) 2.71
Current children cumulated vsize (KiB) 262152

[startup+1.50088 s]
/proc/loadavg: 8.15 8.03 6.42 9/497 31706
/proc/meminfo: memFree=14281948/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=266600 CPUtime=5.89 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 17362 0 0 0 587 2 0 0 25 0 4 0 650750090 272998400 7540 33554432000 4194304 4625164 140733194534960 18446744073709551615 4512736 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 66650 7540 346 106 0 62153 0
[pid=31702/tid=31704] ppid=31700 vsize=266600 CPUtime=1.46 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 2884 0 0 0 146 0 0 0 18 0 4 0 650750093 272998400 7540 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=266600 CPUtime=1.45 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 2751 0 0 0 145 0 0 0 18 0 4 0 650750093 272998400 7540 33554432000 4194304 4625164 140733194534960 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=266600 CPUtime=1.46 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 5900 0 0 0 146 0 0 0 25 0 4 0 650750093 272998400 7540 33554432000 4194304 4625164 140733194534960 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.89
Current children cumulated vsize (KiB) 266600

[startup+3.1006 s]
/proc/loadavg: 8.15 8.03 6.42 9/497 31706
/proc/meminfo: memFree=14241272/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=274464 CPUtime=12.28 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 30064 0 0 0 1223 5 0 0 25 0 4 0 650750090 281051136 9754 33554432000 4194304 4625164 140733194534960 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 68616 9754 347 106 0 64119 0
[pid=31702/tid=31704] ppid=31700 vsize=274464 CPUtime=3.06 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 4225 0 0 0 306 0 0 0 21 0 4 0 650750093 281051136 9754 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=274464 CPUtime=3.02 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 3944 0 0 0 302 0 0 0 21 0 4 0 650750093 281051136 9754 33554432000 4194304 4625164 140733194534960 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=274464 CPUtime=3.07 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 15324 0 0 0 305 2 0 0 25 0 4 0 650750093 281051136 9754 33554432000 4194304 4625164 140733194534960 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.28
Current children cumulated vsize (KiB) 274464

[startup+6.30102 s]
/proc/loadavg: 8.14 8.03 6.43 9/497 31707
/proc/meminfo: memFree=14231572/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=272600 CPUtime=25.02 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 47876 0 0 0 2496 6 0 0 25 0 4 0 650750090 279142400 11370 33554432000 4194304 4625164 140733194534960 18446744073709551615 4512312 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 68150 11370 347 106 0 63653 0
[pid=31702/tid=31704] ppid=31700 vsize=272600 CPUtime=6.26 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 6240 0 0 0 626 0 0 0 25 0 4 0 650750093 279142400 11370 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=272600 CPUtime=6.17 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 4132 0 0 0 617 0 0 0 25 0 4 0 650750093 279142400 11370 33554432000 4194304 4625164 140733194534960 18446744073709551615 4352731 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=272600 CPUtime=6.26 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 30800 0 0 0 623 3 0 0 25 0 4 0 650750093 279142400 11370 33554432000 4194304 4625164 140733194534960 18446744073709551615 4554634 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.02
Current children cumulated vsize (KiB) 272600

[startup+12.7009 s]
/proc/loadavg: 8.12 8.03 6.44 9/497 31707
/proc/meminfo: memFree=14116048/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=280532 CPUtime=50.51 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 87600 0 0 0 5038 13 0 0 25 0 4 0 650750090 287264768 16051 33554432000 4194304 4625164 140733194534960 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 70133 16051 353 106 0 65636 0
[pid=31702/tid=31704] ppid=31700 vsize=280532 CPUtime=12.66 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 9362 0 0 0 1265 1 0 0 25 0 4 0 650750093 287264768 16051 33554432000 4194304 4625164 140733194534960 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=280532 CPUtime=12.47 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 5731 0 0 0 1246 1 0 0 25 0 4 0 650750093 287264768 16051 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=280532 CPUtime=12.66 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 65690 0 0 0 1258 8 0 0 25 0 4 0 650750093 287264768 16051 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.51
Current children cumulated vsize (KiB) 280532

[startup+25.5006 s]
/proc/loadavg: 8.10 8.03 6.45 9/497 31707
/proc/meminfo: memFree=13812232/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=278140 CPUtime=101.5 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 185204 0 0 0 10122 28 0 0 25 0 4 0 650750090 284815360 22378 33554432000 4194304 4625164 140733194534960 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 69535 22378 353 106 0 65038 0
[pid=31702/tid=31704] ppid=31700 vsize=278140 CPUtime=25.47 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 14544 0 0 0 2544 3 0 0 25 0 4 0 650750093 284815360 22378 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=278140 CPUtime=25.05 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 8500 0 0 0 2503 2 0 0 25 0 4 0 650750093 284815360 22378 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=278140 CPUtime=25.47 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 153194 0 0 0 2526 21 0 0 25 0 4 0 650750093 284815360 22378 33554432000 4194304 4625164 140733194534960 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.5
Current children cumulated vsize (KiB) 278140

[startup+51.101 s]
/proc/loadavg: 8.19 8.05 6.51 9/497 31708
/proc/meminfo: memFree=13527612/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=307456 CPUtime=203.48 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 366234 0 0 0 20291 57 0 0 25 0 4 0 650750090 314834944 34645 33554432000 4194304 4625164 140733194534960 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 76864 34645 408 106 0 72367 0
[pid=31702/tid=31704] ppid=31700 vsize=307456 CPUtime=51.07 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 20776 0 0 0 5103 4 0 0 25 0 4 0 650750093 314834944 34645 33554432000 4194304 4625164 140733194534960 18446744073709551615 4352636 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=307456 CPUtime=50.24 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 9172 0 0 0 5022 2 0 0 25 0 4 0 650750093 314834944 34645 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=307456 CPUtime=51.07 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 323810 0 0 0 5059 48 0 0 25 0 4 0 650750093 314834944 34645 33554432000 4194304 4625164 140733194534960 18446744073709551615 212039698791 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 203.48
Current children cumulated vsize (KiB) 307456

[startup+102.319 s]
/proc/loadavg: 8.15 8.06 6.59 9/497 31709
/proc/meminfo: memFree=13336624/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=413332 CPUtime=407.49 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 486796 0 0 0 40673 76 0 0 25 0 4 0 650750090 423251968 63426 33554432000 4194304 4625164 140733194534960 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 103333 63426 1284 106 0 98836 0
[pid=31702/tid=31704] ppid=31700 vsize=413332 CPUtime=102.28 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 29749 0 0 0 10223 5 0 0 25 0 4 0 650750093 423251968 63426 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=413332 CPUtime=100.6 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 13251 0 0 0 10058 2 0 0 25 0 4 0 650750093 423251968 63426 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=413332 CPUtime=102.29 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 410704 0 0 0 10166 63 0 0 25 0 4 0 650750093 423251968 63426 33554432000 4194304 4625164 140733194534960 18446744073709551615 4552336 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 407.49
Current children cumulated vsize (KiB) 413332

[startup+162.301 s]
/proc/loadavg: 7.94 8.00 6.66 9/497 31742
/proc/meminfo: memFree=18843904/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=451696 CPUtime=646.44 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 540031 0 0 0 64556 88 0 0 25 0 4 0 650750090 462536704 80286 33554432000 4194304 4625164 140733194534960 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 112924 80286 1123 106 0 108427 0
[pid=31702/tid=31704] ppid=31700 vsize=451696 CPUtime=162.27 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 30912 0 0 0 16221 6 0 0 25 0 4 0 650750093 462536704 80286 33554432000 4194304 4625164 140733194534960 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=451696 CPUtime=159.62 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 18766 0 0 0 15959 3 0 0 25 0 4 0 650750093 462536704 80286 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=451696 CPUtime=162.26 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 441401 0 0 0 16157 69 0 0 25 0 4 0 650750093 462536704 80286 33554432000 4194304 4625164 140733194534960 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 646.44
Current children cumulated vsize (KiB) 451696

[startup+222.3 s]
/proc/loadavg: 8.01 8.01 6.75 9/497 31743
/proc/meminfo: memFree=18739084/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=475416 CPUtime=885.43 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 896363 0 0 0 88400 143 0 0 25 0 4 0 650750090 486825984 87291 33554432000 4194304 4625164 140733194534960 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 118854 87291 662 106 0 114357 0
[pid=31702/tid=31704] ppid=31700 vsize=475416 CPUtime=222.26 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 43679 0 0 0 22219 7 0 0 25 0 4 0 650750093 486825984 87291 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=475416 CPUtime=218.63 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 19272 0 0 0 21860 3 0 0 25 0 4 0 650750093 486825984 87291 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=475416 CPUtime=222.27 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 760993 0 0 0 22107 120 0 0 25 0 4 0 650750093 486825984 87291 33554432000 4194304 4625164 140733194534960 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 885.43
Current children cumulated vsize (KiB) 475416

[startup+282.301 s]

################
# More data... #
################

[pid=31702] ppid=31700 vsize=883760 CPUtime=2797.49 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 3806274 0 0 0 279175 574 0 0 25 0 4 0 650750090 904970240 183264 33554432000 4194304 4625164 140733194534960 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 220940 183264 351 106 0 216443 0
[pid=31702/tid=31704] ppid=31700 vsize=883760 CPUtime=702.28 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 75296 0 0 0 70214 14 0 0 25 0 4 0 650750093 904970240 183264 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=883760 CPUtime=690.79 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 31285 0 0 0 69073 6 0 0 25 0 4 0 650750093 904970240 183264 33554432000 4194304 4625164 140733194534960 18446744073709551615 4339581 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=883760 CPUtime=702.28 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 3523794 0 0 0 69702 526 0 0 25 0 4 0 650750093 904970240 183264 33554432000 4194304 4625164 140733194534960 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2797.49
Current children cumulated vsize (KiB) 883760

[startup+762.319 s]
/proc/loadavg: 8.20 8.14 7.36 9/497 31788
/proc/meminfo: memFree=17281656/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=1122744 CPUtime=3036.54 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 4192490 0 0 0 303026 628 0 0 25 0 4 0 650750090 1149689856 200793 33554432000 4194304 4625164 140733194534960 18446744073709551615 4511997 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 280686 200793 351 106 0 276189 0
[pid=31702/tid=31704] ppid=31700 vsize=1122744 CPUtime=762.3 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 76825 0 0 0 76215 15 0 0 25 0 4 0 650750093 1149689856 200793 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=1122744 CPUtime=749.82 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 31932 0 0 0 74975 7 0 0 25 0 4 0 650750093 1149689856 200793 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=1122744 CPUtime=762.29 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 3838003 0 0 0 75659 570 0 0 25 0 4 0 650750093 1149689856 200793 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3036.54
Current children cumulated vsize (KiB) 1122744

[startup+822.3 s]
/proc/loadavg: 8.19 8.14 7.41 9/497 31789
/proc/meminfo: memFree=17149556/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=1241504 CPUtime=3275.5 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 4430475 0 0 0 326886 664 0 0 25 0 4 0 650750090 1271300096 221016 33554432000 4194304 4625164 140733194534960 18446744073709551615 4510225 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 310376 221016 408 106 0 305879 0
[pid=31702/tid=31704] ppid=31700 vsize=1241504 CPUtime=822.28 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 102341 0 0 0 82210 18 0 0 25 0 4 0 650750093 1271300096 221016 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=1241504 CPUtime=808.83 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 32406 0 0 0 80876 7 0 0 25 0 4 0 650750093 1271300096 221016 33554432000 4194304 4625164 140733194534960 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=1241504 CPUtime=822.27 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 4039951 0 0 0 81627 600 0 0 25 0 4 0 650750093 1271300096 221016 33554432000 4194304 4625164 140733194534960 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3275.5
Current children cumulated vsize (KiB) 1241504

[startup+882.301 s]
/proc/loadavg: 8.17 8.14 7.45 9/497 31791
/proc/meminfo: memFree=17088368/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=1241504 CPUtime=3514.5 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 4791197 0 0 0 350733 717 0 0 25 0 4 0 650750090 1271300096 229703 33554432000 4194304 4625164 140733194534960 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 310376 229703 408 106 0 305879 0
[pid=31702/tid=31704] ppid=31700 vsize=1241504 CPUtime=882.28 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 103761 0 0 0 88208 20 0 0 25 0 4 0 650750093 1271300096 229703 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=1241504 CPUtime=867.84 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 32561 0 0 0 86777 7 0 0 25 0 4 0 650750093 1271300096 229703 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=1241504 CPUtime=882.28 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 4387563 0 0 0 87578 650 0 0 25 0 4 0 650750093 1271300096 229703 33554432000 4194304 4625164 140733194534960 18446744073709551615 4579358 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3514.5
Current children cumulated vsize (KiB) 1241504

[startup+942.301 s]
/proc/loadavg: 8.16 8.14 7.49 9/497 31792
/proc/meminfo: memFree=17000152/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=1241504 CPUtime=3753.51 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 5190518 0 0 0 374573 778 0 0 25 0 4 0 650750090 1271300096 242673 33554432000 4194304 4625164 140733194534960 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 310376 242673 404 106 0 305879 0
[pid=31702/tid=31704] ppid=31700 vsize=1241504 CPUtime=942.28 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 106006 0 0 0 94207 21 0 0 25 0 4 0 650750093 1271300096 242673 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=1241504 CPUtime=926.88 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 32785 0 0 0 92680 8 0 0 25 0 4 0 650750093 1271300096 242673 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=1241504 CPUtime=942.27 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 4773855 0 0 0 93520 707 0 0 25 0 4 0 650750093 1271300096 242673 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3753.51
Current children cumulated vsize (KiB) 1241504

[startup+1002.3 s]
/proc/loadavg: 8.20 8.16 7.54 9/497 31794
/proc/meminfo: memFree=16911812/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=1241504 CPUtime=3992.52 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 5556921 0 0 0 398420 832 0 0 25 0 4 0 650750090 1271300096 253714 33554432000 4194304 4625164 140733194534960 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 310376 253714 406 106 0 305879 0
[pid=31702/tid=31704] ppid=31700 vsize=1241504 CPUtime=1002.28 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 107067 0 0 0 100207 21 0 0 25 0 4 0 650750093 1271300096 253714 33554432000 4194304 4625164 140733194534960 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=1241504 CPUtime=985.88 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 33266 0 0 0 98580 8 0 0 25 0 4 0 650750093 1271300096 253714 33554432000 4194304 4625164 140733194534960 18446744073709551615 4467580 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=1241504 CPUtime=1002.27 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 5129513 0 0 0 99469 758 0 0 25 0 4 0 650750093 1271300096 253714 33554432000 4194304 4625164 140733194534960 18446744073709551615 4335567 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3992.52
Current children cumulated vsize (KiB) 1241504

[startup+1062.3 s]
/proc/loadavg: 8.20 8.17 7.58 9/497 31796
/proc/meminfo: memFree=16827824/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=1372412 CPUtime=4231.53 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 5968113 0 0 0 422262 891 0 0 25 0 4 0 650750090 1405349888 267698 33554432000 4194304 4625164 140733194534960 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 343103 267698 404 106 0 338606 0
[pid=31702/tid=31704] ppid=31700 vsize=1372412 CPUtime=1062.29 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 108319 0 0 0 106207 22 0 0 25 0 4 0 650750093 1405349888 267698 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=1372412 CPUtime=1044.92 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 33791 0 0 0 104483 9 0 0 25 0 4 0 650750093 1405349888 267698 33554432000 4194304 4625164 140733194534960 18446744073709551615 4339680 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=1372412 CPUtime=1062.28 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 5491167 0 0 0 105418 810 0 0 25 0 4 0 650750093 1405349888 267698 33554432000 4194304 4625164 140733194534960 18446744073709551615 4352017 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4231.53
Current children cumulated vsize (KiB) 1372412

[startup+1122.3 s]
/proc/loadavg: 8.16 8.17 7.61 9/497 31797
/proc/meminfo: memFree=16746188/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=1468564 CPUtime=4470.52 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 6256703 0 0 0 446121 931 0 0 25 0 4 0 650750090 1503809536 280993 33554432000 4194304 4625164 140733194534960 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 367141 280993 404 106 0 362644 0
[pid=31702/tid=31704] ppid=31700 vsize=1468564 CPUtime=1122.29 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 109464 0 0 0 112207 22 0 0 25 0 4 0 650750093 1503809536 280993 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=1468564 CPUtime=1103.93 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 34236 0 0 0 110384 9 0 0 25 0 4 0 650750093 1503809536 280993 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=1468564 CPUtime=1122.27 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 5716532 0 0 0 111386 841 0 0 25 0 4 0 650750093 1503809536 280993 33554432000 4194304 4625164 140733194534960 18446744073709551615 4547578 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4470.52
Current children cumulated vsize (KiB) 1468564

[startup+1182.3 s]
/proc/loadavg: 8.10 8.15 7.64 9/497 31799
/proc/meminfo: memFree=16691956/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=1468564 CPUtime=4709.54 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 6642833 0 0 0 469969 985 0 0 25 0 4 0 650750090 1503809536 289494 33554432000 4194304 4625164 140733194534960 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 367141 289494 407 106 0 362644 0
[pid=31702/tid=31704] ppid=31700 vsize=1468564 CPUtime=1182.29 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 110303 0 0 0 118207 22 0 0 25 0 4 0 650750093 1503809536 289494 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=1468564 CPUtime=1162.95 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 34726 0 0 0 116286 9 0 0 25 0 4 0 650750093 1503809536 289494 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=1468564 CPUtime=1182.27 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 6097052 0 0 0 117333 894 0 0 25 0 4 0 650750093 1503809536 289494 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4709.54
Current children cumulated vsize (KiB) 1468564



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205.1 s]
/proc/loadavg: 8.14 8.15 7.65 9/497 31800
/proc/meminfo: memFree=16669256/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=1534100 CPUtime=4800.41 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 6788655 0 0 0 479030 1011 0 0 25 0 4 0 650750090 1570918400 292306 33554432000 4194304 4625164 140733194534960 18446744073709551615 4360194 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 383525 292306 404 106 0 379028 0
[pid=31702/tid=31704] ppid=31700 vsize=1534100 CPUtime=1205.1 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 110909 0 0 0 120488 22 0 0 25 0 4 0 650750093 1570918400 292306 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=1534100 CPUtime=1185.38 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 35191 0 0 0 118528 10 0 0 25 0 4 0 650750093 1570918400 292306 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=1534100 CPUtime=1205.1 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 6240815 0 0 0 119591 919 0 0 25 0 4 0 650750093 1570918400 292306 33554432000 4194304 4625164 140733194534960 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 1534100

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205.1 s]
/proc/loadavg: 8.14 8.15 7.65 9/497 31800
/proc/meminfo: memFree=16669256/32951124 swapFree=51873468/67111528
[pid=31702] ppid=31700 vsize=1534100 CPUtime=4800.41 cores=0,2,4,6
/proc/31702/stat : 31702 (SArTagnan) R 31700 31702 31559 0 -1 4202496 6788655 0 0 0 479030 1011 0 0 25 0 4 0 650750090 1570918400 292306 33554432000 4194304 4625164 140733194534960 18446744073709551615 4360194 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31702/statm: 383525 292306 404 106 0 379028 0
[pid=31702/tid=31704] ppid=31700 vsize=1534100 CPUtime=1205.1 cores=0,2,4,6
/proc/31702/task/31704/stat : 31704 (SArTagnan) R 31700 31702 31559 0 -1 4202560 110909 0 0 0 120488 22 0 0 25 0 4 0 650750093 1570918400 292306 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=31702/tid=31705] ppid=31700 vsize=1534100 CPUtime=1185.38 cores=0,2,4,6
/proc/31702/task/31705/stat : 31705 (SArTagnan) R 31700 31702 31559 0 -1 4202560 35191 0 0 0 118528 10 0 0 25 0 4 0 650750093 1570918400 292306 33554432000 4194304 4625164 140733194534960 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=31702/tid=31706] ppid=31700 vsize=1534100 CPUtime=1205.1 cores=0,2,4,6
/proc/31702/task/31706/stat : 31706 (SArTagnan) R 31700 31702 31559 0 -1 4202560 6240815 0 0 0 119591 919 0 0 25 0 4 0 650750093 1570918400 292306 33554432000 4194304 4625164 140733194534960 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 1534100

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.17
CPU time (s): 4800.49
CPU user time (s): 4790.33
CPU system time (s): 10.1575
CPU usage (%): 398.324
Max. virtual memory (cumulated for all children) (KiB): 1660748

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4790.33
system time used= 10.1575
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6788655
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 866
involuntary context switches= 24518

runsolver used 5.53616 second user time and 14.2068 second system time

The end

Launcher Data 

Begin job on node146 at 2011-05-17 00:02:18
IDJOB=3386054
IDBENCH=85799
IDSOLVER=1871
FILE ID=node146/3386054-1305583338
RUNJOBID= node146-1305582130-31577
PBS_JOBID= 13350290
Free space on /tmp= 73204 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT05/crafted/sorge05/QG7a/gensys-icl005.shuffled-as.sat05-3826.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386054-1305583338/watcher-3386054-1305583338 -o /tmp/evaluation-result-3386054-1305583338/solver-3386054-1305583338 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386054-1305583338.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5d8489e52ec1ef9c7431a7fd60f9ff86
RANDOM SEED=1666624095

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      14311152 kB
Buffers:        222016 kB
Cached:        1420824 kB
SwapCached:      56140 kB
Active:       15511316 kB
Inactive:      2841968 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      14311152 kB
SwapTotal:    67111528 kB
SwapFree:     51873468 kB
Dirty:            1192 kB
Writeback:           0 kB
AnonPages:    16661412 kB
Mapped:          26512 kB
Slab:           115016 kB
PageTables:     102004 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 146475556 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73200 MiB
End job on node146 at 2011-05-17 00:22:25