Trace number 3251178

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.35 1201.79

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m37-q505.75-n35-p15-s48276711.cnf
MD5SUM1bac7b96ea6eb843b1de7405a721cd87
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.861868
Satisfiable
(Un)Satisfiability was proved
Number of variables1244
Number of clauses150604
Sum of the clauses size302382
Maximum clause length37
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2150569
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 535

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3251178-1304121914/watcher-3251178-1304121914 -o /tmp/evaluation-result-3251178-1304121914/solver-3251178-1304121914 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3251178-1304121914.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.89 8.09 7.87 2/174 22516
/proc/meminfo: memFree=30596740/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=22352 CPUtime=0 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 560 0 0 0 0 0 0 0 25 0 1 0 523793793 22888448 464 33554432000 4194304 4623224 140733795907600 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/22516/statm: 5588 464 297 105 0 1092 0

[startup+0.0414801 s]
/proc/loadavg: 7.89 8.09 7.87 2/174 22516
/proc/meminfo: memFree=30596740/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=63404 CPUtime=0.03 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 3610 0 0 0 3 0 0 0 25 0 4 0 523793793 64925696 2325 33554432000 4194304 4623224 140733795907600 18446744073709551615 46998519924652 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 15851 2325 302 105 0 11355 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 63404

[startup+0.100435 s]
/proc/loadavg: 7.89 8.09 7.87 2/174 22516
/proc/meminfo: memFree=30596740/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=261360 CPUtime=0.26 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 5031 0 0 0 26 0 0 0 25 0 4 0 523793793 267632640 3616 33554432000 4194304 4623224 140733795907600 18446744073709551615 4278472 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 65340 3616 340 105 0 60844 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 261360

[startup+0.300399 s]
/proc/loadavg: 7.89 8.09 7.87 2/174 22516
/proc/meminfo: memFree=30596740/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=265584 CPUtime=1.07 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 7821 0 0 0 106 1 0 0 25 0 4 0 523793793 271958016 6158 33554432000 4194304 4623224 140733795907600 18446744073709551615 4509982 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 66396 6158 343 105 0 61900 0
Current children cumulated CPU time (s) 1.07
Current children cumulated vsize (KiB) 265584

[startup+0.700323 s]
/proc/loadavg: 7.89 8.09 7.87 2/174 22516
/proc/meminfo: memFree=30596740/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=267368 CPUtime=2.67 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 10791 0 0 0 265 2 0 0 25 0 4 0 523793793 273784832 8556 33554432000 4194304 4623224 140733795907600 18446744073709551615 4519742 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 66842 8556 343 105 0 62346 0
Current children cumulated CPU time (s) 2.67
Current children cumulated vsize (KiB) 267368

[startup+1.50117 s]
/proc/loadavg: 7.89 8.09 7.87 9/184 22529
/proc/meminfo: memFree=30530824/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=278856 CPUtime=5.86 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 15653 0 0 0 584 2 0 0 25 0 4 0 523793793 285548544 12557 33554432000 4194304 4623224 140733795907600 18446744073709551615 4510045 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 69714 12557 349 105 0 65218 0
[pid=22516/tid=22527] ppid=22514 vsize=278856 CPUtime=1.45 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 2630 0 0 0 145 0 0 0 25 0 4 0 523793797 285548544 12557 33554432000 4194304 4623224 140733795907600 18446744073709551615 4377387 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=278856 CPUtime=1.44 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 4239 0 0 0 144 0 0 0 25 0 4 0 523793797 285548544 12557 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376853 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=278856 CPUtime=1.46 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 2029 0 0 0 146 0 0 0 25 0 4 0 523793797 285548544 12557 33554432000 4194304 4623224 140733795907600 18446744073709551615 4363987 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.86
Current children cumulated vsize (KiB) 278856

[startup+3.10086 s]
/proc/loadavg: 7.89 8.09 7.87 9/184 22529
/proc/meminfo: memFree=30500816/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=290428 CPUtime=12.26 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 29882 0 0 0 1220 6 0 0 25 0 4 0 523793793 297398272 17831 33554432000 4194304 4623224 140733795907600 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 72607 17831 349 105 0 68111 0
[pid=22516/tid=22527] ppid=22514 vsize=290428 CPUtime=3.05 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 5986 0 0 0 304 1 0 0 25 0 4 0 523793797 297398272 17831 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=290428 CPUtime=3.04 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 6512 0 0 0 303 1 0 0 25 0 4 0 523793797 297398272 17831 33554432000 4194304 4623224 140733795907600 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=290428 CPUtime=3.06 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 9232 0 0 0 304 2 0 0 25 0 4 0 523793797 297398272 17831 33554432000 4194304 4623224 140733795907600 18446744073709551615 212452000795 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.26
Current children cumulated vsize (KiB) 290428

[startup+6.30026 s]
/proc/loadavg: 7.90 8.09 7.87 9/184 22529
/proc/meminfo: memFree=30437836/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=313592 CPUtime=25.04 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 54091 0 0 0 2494 10 0 0 25 0 4 0 523793793 321118208 26100 33554432000 4194304 4623224 140733795907600 18446744073709551615 4415008 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 78398 26100 345 105 0 73902 0
[pid=22516/tid=22527] ppid=22514 vsize=313592 CPUtime=6.25 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 9916 0 0 0 623 2 0 0 25 0 4 0 523793797 321118208 26100 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=313592 CPUtime=6.22 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 11392 0 0 0 620 2 0 0 25 0 4 0 523793797 321118208 26100 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=313592 CPUtime=6.25 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 22559 0 0 0 622 3 0 0 25 0 4 0 523793797 321118208 26100 33554432000 4194304 4623224 140733795907600 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.04
Current children cumulated vsize (KiB) 313592

[startup+12.701 s]
/proc/loadavg: 7.90 8.09 7.87 9/184 22529
/proc/meminfo: memFree=30354296/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=340460 CPUtime=50.6 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 113728 0 0 0 5041 19 0 0 25 0 4 0 523793793 348631040 38783 33554432000 4194304 4623224 140733795907600 18446744073709551615 4415014 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 85115 38783 355 105 0 80619 0
[pid=22516/tid=22527] ppid=22514 vsize=340460 CPUtime=12.65 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 16181 0 0 0 1261 4 0 0 25 0 4 0 523793797 348631040 38783 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376917 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=340460 CPUtime=12.58 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 17737 0 0 0 1255 3 0 0 25 0 4 0 523793797 348631040 38783 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376844 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=340460 CPUtime=12.66 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 68784 0 0 0 1256 10 0 0 25 0 4 0 523793797 348631040 38783 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.6
Current children cumulated vsize (KiB) 340460

[startup+25.5006 s]
/proc/loadavg: 7.93 8.08 7.87 9/184 22530
/proc/meminfo: memFree=30218748/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=370160 CPUtime=101.73 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 250362 0 0 0 10129 44 0 0 25 0 4 0 523793793 379043840 57109 33554432000 4194304 4623224 140733795907600 18446744073709551615 4415005 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 92540 57109 366 105 0 88044 0
[pid=22516/tid=22527] ppid=22514 vsize=370160 CPUtime=25.45 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 23228 0 0 0 2539 6 0 0 25 0 4 0 523793797 379043840 57109 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=370160 CPUtime=25.31 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 27671 0 0 0 2524 7 0 0 25 0 4 0 523793797 379043840 57109 33554432000 4194304 4623224 140733795907600 18446744073709551615 4366381 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=370160 CPUtime=25.45 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 181205 0 0 0 2518 27 0 0 25 0 4 0 523793797 379043840 57109 33554432000 4194304 4623224 140733795907600 18446744073709551615 4363742 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.73
Current children cumulated vsize (KiB) 370160

[startup+51.1007 s]
/proc/loadavg: 7.95 8.07 7.87 9/184 22531
/proc/meminfo: memFree=29970796/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=543464 CPUtime=204 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 462865 0 0 0 20321 79 0 0 25 0 4 0 523793793 556507136 93933 33554432000 4194304 4623224 140733795907600 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 135866 93933 380 105 0 131370 0
[pid=22516/tid=22527] ppid=22514 vsize=543464 CPUtime=51.05 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 41427 0 0 0 5095 10 0 0 25 0 4 0 523793797 556507136 93933 33554432000 4194304 4623224 140733795907600 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=543464 CPUtime=50.77 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 41899 0 0 0 5065 12 0 0 25 0 4 0 523793797 556507136 93933 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=543464 CPUtime=51.05 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 327327 0 0 0 5058 47 0 0 25 0 4 0 523793797 556507136 93933 33554432000 4194304 4623224 140733795907600 18446744073709551615 4558129 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 204
Current children cumulated vsize (KiB) 543464

[startup+102.307 s]
/proc/loadavg: 7.98 8.06 7.88 9/184 22562
/proc/meminfo: memFree=29783300/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=888152 CPUtime=408.54 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 987510 0 0 0 40694 160 0 0 25 0 4 0 523793793 909467648 155824 33554432000 4194304 4623224 140733795907600 18446744073709551615 4415031 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 222038 155824 462 105 0 217542 0
[pid=22516/tid=22527] ppid=22514 vsize=888152 CPUtime=102.25 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 61286 0 0 0 10209 16 0 0 25 0 4 0 523793797 909467648 155824 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=888152 CPUtime=101.69 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 61374 0 0 0 10151 18 0 0 25 0 4 0 523793797 909467648 155824 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=888152 CPUtime=102.25 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 711522 0 0 0 10121 104 0 0 25 0 4 0 523793797 909467648 155824 33554432000 4194304 4623224 140733795907600 18446744073709551615 4552704 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.54
Current children cumulated vsize (KiB) 888152

[startup+162.301 s]
/proc/loadavg: 7.99 8.05 7.89 10/184 22563
/proc/meminfo: memFree=29342520/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=1213280 CPUtime=648.19 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 1631874 0 0 0 64557 262 0 0 25 0 4 0 523793793 1242398720 217261 33554432000 4194304 4623224 140733795907600 18446744073709551615 4414984 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 303320 217261 794 105 0 298824 0
[pid=22516/tid=22527] ppid=22514 vsize=1213280 CPUtime=162.25 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 72762 0 0 0 16203 22 0 0 25 0 4 0 523793797 1242398720 217261 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=1213280 CPUtime=161.36 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 86462 0 0 0 16108 28 0 0 25 0 4 0 523793797 1242398720 217261 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=1213280 CPUtime=162.25 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 1244880 0 0 0 16045 180 0 0 25 0 4 0 523793797 1242398720 217261 33554432000 4194304 4623224 140733795907600 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 648.19
Current children cumulated vsize (KiB) 1213280

[startup+222.301 s]
/proc/loadavg: 8.06 8.05 7.90 10/184 22565
/proc/meminfo: memFree=29104408/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=1275532 CPUtime=887.86 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 2249697 0 0 0 88429 357 0 0 25 0 4 0 523793793 1306144768 243794 33554432000 4194304 4623224 140733795907600 18446744073709551615 4355953 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 318883 243794 370 105 0 314387 0
[pid=22516/tid=22527] ppid=22514 vsize=1275532 CPUtime=222.26 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 97798 0 0 0 22198 28 0 0 25 0 4 0 523793797 1306144768 243794 33554432000 4194304 4623224 140733795907600 18446744073709551615 4291568 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=1275532 CPUtime=221.21 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 114602 0 0 0 22086 35 0 0 25 0 4 0 523793797 1306144768 243794 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376832 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=1275532 CPUtime=222.07 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 1791985 0 0 0 21948 259 0 0 25 0 4 0 523793797 1306144768 243794 33554432000 4194304 4623224 140733795907600 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 887.86
Current children cumulated vsize (KiB) 1275532

[startup+282.301 s]

################
# More data... #
################

[pid=22516] ppid=22514 vsize=2120048 CPUtime=2805.27 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 6879847 0 0 0 279394 1133 0 0 25 0 4 0 523793793 2170929152 413867 33554432000 4194304 4623224 140733795907600 18446744073709551615 4508304 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 530012 413867 344 105 0 525516 0
[pid=22516/tid=22527] ppid=22514 vsize=2120048 CPUtime=702.27 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110001 0 0 0 70195 32 0 0 25 0 4 0 523793797 2170929152 413867 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2120048 CPUtime=701.2 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 188276 0 0 0 70037 83 0 0 25 0 4 0 523793797 2170929152 413867 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2120048 CPUtime=699.47 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 5903211 0 0 0 69030 917 0 0 25 0 4 0 523793797 2170929152 413867 33554432000 4194304 4623224 140733795907600 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2805.27
Current children cumulated vsize (KiB) 2120048

[startup+762.306 s]
/proc/loadavg: 8.05 8.07 7.96 9/184 22609
/proc/meminfo: memFree=28156416/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=2186828 CPUtime=3044.98 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 7350693 0 0 0 303283 1215 0 0 25 0 4 0 523793793 2239311872 421685 33554432000 4194304 4623224 140733795907600 18446744073709551615 4415016 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 546707 421685 345 105 0 542211 0
[pid=22516/tid=22527] ppid=22514 vsize=2186828 CPUtime=762.28 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110082 0 0 0 76196 32 0 0 25 0 4 0 523793797 2239311872 421685 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2186828 CPUtime=761.2 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 188518 0 0 0 76037 83 0 0 25 0 4 0 523793797 2239311872 421685 33554432000 4194304 4623224 140733795907600 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2186828 CPUtime=759.15 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 6337416 0 0 0 74926 989 0 0 25 0 4 0 523793797 2239311872 421685 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376754 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3044.98
Current children cumulated vsize (KiB) 2186828

[startup+822.301 s]
/proc/loadavg: 8.02 8.06 7.96 9/184 22611
/proc/meminfo: memFree=27960580/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=2190780 CPUtime=3284.65 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 7888538 0 0 0 327150 1315 0 0 25 0 4 0 523793793 2243358720 431486 33554432000 4194304 4623224 140733795907600 18446744073709551615 4415016 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 547695 431486 344 105 0 543199 0
[pid=22516/tid=22527] ppid=22514 vsize=2190780 CPUtime=822.27 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110153 0 0 0 82195 32 0 0 25 0 4 0 523793797 2243358720 431486 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2190780 CPUtime=821.2 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 191596 0 0 0 82036 84 0 0 25 0 4 0 523793797 2243358720 431486 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2190780 CPUtime=818.82 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 6791866 0 0 0 80809 1073 0 0 25 0 4 0 523793797 2243358720 431486 33554432000 4194304 4623224 140733795907600 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3284.65
Current children cumulated vsize (KiB) 2190780

[startup+882.301 s]
/proc/loadavg: 8.00 8.04 7.96 9/184 22613
/proc/meminfo: memFree=27837276/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=2190780 CPUtime=3524.32 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 8460752 0 0 0 351022 1410 0 0 25 0 4 0 523793793 2243358720 435664 33554432000 4194304 4623224 140733795907600 18446744073709551615 4510142 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 547695 435664 344 105 0 543199 0
[pid=22516/tid=22527] ppid=22514 vsize=2190780 CPUtime=882.27 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110220 0 0 0 88195 32 0 0 25 0 4 0 523793797 2243358720 435664 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2190780 CPUtime=881.2 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 191633 0 0 0 88036 84 0 0 25 0 4 0 523793797 2243358720 435664 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2190780 CPUtime=878.49 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 7284771 0 0 0 86696 1153 0 0 25 0 4 0 523793797 2243358720 435664 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3524.32
Current children cumulated vsize (KiB) 2190780

[startup+942.3 s]
/proc/loadavg: 8.03 8.05 7.97 9/184 22614
/proc/meminfo: memFree=27725156/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=2190780 CPUtime=3764 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 9054746 0 0 0 374886 1514 0 0 25 0 4 0 523793793 2243358720 442186 33554432000 4194304 4623224 140733795907600 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 547695 442186 344 105 0 543199 0
[pid=22516/tid=22527] ppid=22514 vsize=2190780 CPUtime=942.28 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110290 0 0 0 94196 32 0 0 25 0 4 0 523793797 2243358720 442186 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2190780 CPUtime=941.2 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 192110 0 0 0 94036 84 0 0 25 0 4 0 523793797 2243358720 442186 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2190780 CPUtime=938.17 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 7799700 0 0 0 92577 1240 0 0 25 0 4 0 523793797 2243358720 442186 33554432000 4194304 4623224 140733795907600 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3764
Current children cumulated vsize (KiB) 2190780

[startup+1002.3 s]
/proc/loadavg: 8.12 8.07 7.98 9/184 22616
/proc/meminfo: memFree=27600108/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=2190780 CPUtime=4003.69 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 9605210 0 0 0 398762 1607 0 0 25 0 4 0 523793793 2243358720 447380 33554432000 4194304 4623224 140733795907600 18446744073709551615 4510978 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 547695 447380 344 105 0 543199 0
[pid=22516/tid=22527] ppid=22514 vsize=2190780 CPUtime=1002.28 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110354 0 0 0 100196 32 0 0 25 0 4 0 523793797 2243358720 447380 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2190780 CPUtime=1001.2 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 192137 0 0 0 100036 84 0 0 25 0 4 0 523793797 2243358720 447380 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2190780 CPUtime=997.84 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 8261137 0 0 0 98467 1317 0 0 25 0 4 0 523793797 2243358720 447380 33554432000 4194304 4623224 140733795907600 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4003.69
Current children cumulated vsize (KiB) 2190780

[startup+1062.3 s]
/proc/loadavg: 8.12 8.07 7.98 9/184 22617
/proc/meminfo: memFree=27527784/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=2190780 CPUtime=4243.36 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 9765812 0 0 0 422701 1635 0 0 25 0 4 0 523793793 2243358720 448324 33554432000 4194304 4623224 140733795907600 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 547695 448324 344 105 0 543199 0
[pid=22516/tid=22527] ppid=22514 vsize=2190780 CPUtime=1062.28 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110439 0 0 0 106196 32 0 0 25 0 4 0 523793797 2243358720 448324 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2190780 CPUtime=1061.21 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 192162 0 0 0 106037 84 0 0 25 0 4 0 523793797 2243358720 448324 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2190780 CPUtime=1057.52 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 8412310 0 0 0 104409 1343 0 0 25 0 4 0 523793797 2243358720 448324 33554432000 4194304 4623224 140733795907600 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4243.36
Current children cumulated vsize (KiB) 2190780

[startup+1122.3 s]
/proc/loadavg: 8.04 8.05 7.98 9/184 22619
/proc/meminfo: memFree=27401380/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=2190780 CPUtime=4483.05 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 10217134 0 0 0 446595 1710 0 0 25 0 4 0 523793793 2243358720 451798 33554432000 4194304 4623224 140733795907600 18446744073709551615 4414978 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 547695 451798 344 105 0 543199 0
[pid=22516/tid=22527] ppid=22514 vsize=2190780 CPUtime=1122.28 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110500 0 0 0 112196 32 0 0 25 0 4 0 523793797 2243358720 451798 33554432000 4194304 4623224 140733795907600 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2190780 CPUtime=1121.21 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 192186 0 0 0 112037 84 0 0 25 0 4 0 523793797 2243358720 451798 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2190780 CPUtime=1117.19 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 8853328 0 0 0 110303 1416 0 0 25 0 4 0 523793797 2243358720 451798 33554432000 4194304 4623224 140733795907600 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4483.05
Current children cumulated vsize (KiB) 2190780

[startup+1182.3 s]
/proc/loadavg: 8.14 8.07 7.99 9/184 22621
/proc/meminfo: memFree=27307356/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=2190780 CPUtime=4722.73 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 10670085 0 0 0 470487 1786 0 0 25 0 4 0 523793793 2243358720 458605 33554432000 4194304 4623224 140733795907600 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 547695 458605 345 105 0 543199 0
[pid=22516/tid=22527] ppid=22514 vsize=2190780 CPUtime=1182.29 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110563 0 0 0 118197 32 0 0 25 0 4 0 523793797 2243358720 458605 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2190780 CPUtime=1181.21 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 192211 0 0 0 118037 84 0 0 25 0 4 0 523793797 2243358720 458605 33554432000 4194304 4623224 140733795907600 18446744073709551615 4357679 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2190780 CPUtime=1176.87 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 9296582 0 0 0 116197 1490 0 0 25 0 4 0 523793797 2243358720 458605 33554432000 4194304 4623224 140733795907600 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4722.73
Current children cumulated vsize (KiB) 2190780



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.10 8.07 7.99 9/184 22621
/proc/meminfo: memFree=27282416/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=2190780 CPUtime=4800.24 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 10811991 0 0 0 478214 1810 0 0 25 0 4 0 523793793 2243358720 458096 33554432000 4194304 4623224 140733795907600 18446744073709551615 4415008 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 547695 458096 344 105 0 543199 0
[pid=22516/tid=22527] ppid=22514 vsize=2190780 CPUtime=1201.69 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110604 0 0 0 120137 32 0 0 25 0 4 0 523793797 2243358720 458096 33554432000 4194304 4623224 140733795907600 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2190780 CPUtime=1200.62 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 192219 0 0 0 119978 84 0 0 25 0 4 0 523793797 2243358720 458096 33554432000 4194304 4623224 140733795907600 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2190780 CPUtime=1196.16 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 9434863 0 0 0 118103 1513 0 0 25 0 4 0 523793797 2243358720 458096 33554432000 4194304 4623224 140733795907600 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 2190780

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.10 8.07 7.99 9/184 22621
/proc/meminfo: memFree=27282416/32951124 swapFree=67111416/67111528
[pid=22516] ppid=22514 vsize=2190780 CPUtime=4800.24 cores=1,3,5,7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22284 0 -1 4202496 10811991 0 0 0 478214 1810 0 0 25 0 4 0 523793793 2243358720 458096 33554432000 4194304 4623224 140733795907600 18446744073709551615 4415008 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22516/statm: 547695 458096 344 105 0 543199 0
[pid=22516/tid=22527] ppid=22514 vsize=2190780 CPUtime=1201.69 cores=1,3,5,7
/proc/22516/task/22527/stat : 22527 (SArTagnan) R 22514 22516 22284 0 -1 4202560 110604 0 0 0 120137 32 0 0 25 0 4 0 523793797 2243358720 458096 33554432000 4194304 4623224 140733795907600 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22528] ppid=22514 vsize=2190780 CPUtime=1200.62 cores=1,3,5,7
/proc/22516/task/22528/stat : 22528 (SArTagnan) R 22514 22516 22284 0 -1 4202560 192219 0 0 0 119978 84 0 0 25 0 4 0 523793797 2243358720 458096 33554432000 4194304 4623224 140733795907600 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22529] ppid=22514 vsize=2190780 CPUtime=1196.16 cores=1,3,5,7
/proc/22516/task/22529/stat : 22529 (SArTagnan) R 22514 22516 22284 0 -1 4202560 9434863 0 0 0 118103 1513 0 0 25 0 4 0 523793797 2243358720 458096 33554432000 4194304 4623224 140733795907600 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 2190780

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.79
CPU time (s): 4800.35
CPU user time (s): 4782.17
CPU system time (s): 18.1792
CPU usage (%): 399.434
Max. virtual memory (cumulated for all children) (KiB): 2440972

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4782.17
system time used= 18.1792
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10811991
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2287
involuntary context switches= 17983

runsolver used 1.85872 second user time and 4.70428 second system time

The end

Launcher Data 

Begin job on node102 at 2011-04-30 02:05:14
IDJOB=3251178
IDBENCH=88212
IDSOLVER=1656
FILE ID=node102/3251178-1304121914
RUNJOBID= node102-1304119506-22303
PBS_JOBID= 13170726
Free space on /tmp= 71560 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m37-q505.75-n35-p15-s48276711.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3251178-1304121914/watcher-3251178-1304121914 -o /tmp/evaluation-result-3251178-1304121914/solver-3251178-1304121914 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3251178-1304121914.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1bac7b96ea6eb843b1de7405a721cd87
RANDOM SEED=1970195234

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30597144 kB
Buffers:        605376 kB
Cached:        1267956 kB
SwapCached:          0 kB
Active:         143336 kB
Inactive:      1795900 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30597144 kB
SwapTotal:    67111528 kB
SwapFree:     67111416 kB
Dirty:            2352 kB
Writeback:           0 kB
AnonPages:       65968 kB
Mapped:          14708 kB
Slab:           351672 kB
PageTables:       4672 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   192728 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71556 MiB
End job on node102 at 2011-04-30 02:25:18