Trace number 3251266

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.22 1202.23

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m62-q1327.5-n60-p15-s1351253.cnf
MD5SUMb23c52475e3d098cb9d5a92c025d6982
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark7.18991
Satisfiable
(Un)Satisfiability was proved
Number of variables3420
Number of clauses1120760
Sum of the clauses size2244820
Maximum clause length62
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21120700
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 560

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3251266-1304122969/watcher-3251266-1304122969 -o /tmp/evaluation-result-3251266-1304122969/solver-3251266-1304122969 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3251266-1304122969.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.43 5.44 6.86 6/180 26759
/proc/meminfo: memFree=30994936/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=45328 CPUtime=0 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 606 0 0 0 0 0 0 0 21 0 1 0 504713222 46415872 510 33554432000 4194304 4623224 140733360838064 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/26759/statm: 11332 510 297 105 0 6836 0

[startup+0.027442 s]
/proc/loadavg: 3.43 5.44 6.86 6/180 26759
/proc/meminfo: memFree=30994936/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=46636 CPUtime=0.02 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 1511 0 0 0 2 0 0 0 21 0 1 0 504713222 47755264 759 33554432000 4194304 4623224 140733360838064 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/26759/statm: 11659 760 297 105 0 7163 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 46636

[startup+0.100431 s]
/proc/loadavg: 3.43 5.44 6.86 6/180 26759
/proc/meminfo: memFree=30994936/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=52760 CPUtime=0.09 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 5571 0 0 0 8 1 0 0 21 0 1 0 504713222 54026240 1757 33554432000 4194304 4623224 140733360838064 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/26759/statm: 13190 1758 297 105 0 8694 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 52760

[startup+0.300359 s]
/proc/loadavg: 3.43 5.44 6.86 6/180 26759
/proc/meminfo: memFree=30994936/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=145124 CPUtime=0.29 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 23485 0 0 0 26 3 0 0 22 0 4 0 504713222 148606976 14900 33554432000 4194304 4623224 140733360838064 18446744073709551615 47614210275250 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 36281 14900 302 105 0 31785 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 145124

[startup+0.70029 s]
/proc/loadavg: 3.43 5.44 6.86 6/180 26759
/proc/meminfo: memFree=30994936/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=403724 CPUtime=1.89 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 56709 0 0 0 181 8 0 0 25 0 4 0 504713222 413413376 33630 33554432000 4194304 4623224 140733360838064 18446744073709551615 4497639 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 100931 33630 342 105 0 96435 0
Current children cumulated CPU time (s) 1.89
Current children cumulated vsize (KiB) 403724

[startup+1.50115 s]
/proc/loadavg: 3.63 5.44 6.86 9/184 26763
/proc/meminfo: memFree=30831604/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=403724 CPUtime=5.09 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 60520 0 0 0 500 9 0 0 25 0 4 0 504713222 413413376 37114 33554432000 4194304 4623224 140733360838064 18446744073709551615 4510635 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 100931 37114 347 105 0 96435 0
[pid=26759/tid=26761] ppid=26757 vsize=403724 CPUtime=1.19 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 3697 0 0 0 119 0 0 0 25 0 4 0 504713252 413413376 37114 33554432000 4194304 4623224 140733360838064 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=403724 CPUtime=1.19 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 3645 0 0 0 119 0 0 0 25 0 4 0 504713252 413413376 37114 33554432000 4194304 4623224 140733360838064 18446744073709551615 4462966 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=403724 CPUtime=1.19 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 1201 0 0 0 119 0 0 0 25 0 4 0 504713252 413413376 37114 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.09
Current children cumulated vsize (KiB) 403724

[startup+3.10086 s]
/proc/loadavg: 3.63 5.44 6.86 9/184 26763
/proc/meminfo: memFree=30801600/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=408484 CPUtime=11.48 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 68122 0 0 0 1138 10 0 0 25 0 4 0 504713222 418287616 43216 33554432000 4194304 4623224 140733360838064 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 102121 43216 366 105 0 97625 0
[pid=26759/tid=26761] ppid=26757 vsize=408484 CPUtime=2.79 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 5056 0 0 0 279 0 0 0 25 0 4 0 504713252 418287616 43216 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=408484 CPUtime=2.79 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 8719 0 0 0 278 1 0 0 25 0 4 0 504713252 418287616 43216 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=408484 CPUtime=2.79 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 2341 0 0 0 279 0 0 0 25 0 4 0 504713252 418287616 43216 33554432000 4194304 4623224 140733360838064 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.48
Current children cumulated vsize (KiB) 408484

[startup+6.30029 s]
/proc/loadavg: 3.98 5.49 6.86 9/184 26763
/proc/meminfo: memFree=30709964/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=426188 CPUtime=24.25 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 82120 0 0 0 2413 12 0 0 25 0 4 0 504713222 436416512 57145 33554432000 4194304 4623224 140733360838064 18446744073709551615 4510604 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 106547 57166 401 105 0 102051 0
[pid=26759/tid=26761] ppid=26757 vsize=426188 CPUtime=5.99 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 10390 0 0 0 598 1 0 0 25 0 4 0 504713252 436416512 57176 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=426188 CPUtime=5.98 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 14462 0 0 0 596 2 0 0 25 0 4 0 504713252 436416512 57188 33554432000 4194304 4623224 140733360838064 18446744073709551615 212039352789 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=426188 CPUtime=5.99 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 3411 0 0 0 599 0 0 0 25 0 4 0 504713252 436416512 57201 33554432000 4194304 4623224 140733360838064 18446744073709551615 4366271 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.25
Current children cumulated vsize (KiB) 426188

[startup+12.7011 s]
/proc/loadavg: 4.38 5.54 6.87 9/184 26764
/proc/meminfo: memFree=30515844/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=508136 CPUtime=49.83 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 118376 0 0 0 4964 19 0 0 25 0 4 0 504713222 520331264 81073 33554432000 4194304 4623224 140733360838064 18446744073709551615 4519725 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 127034 81073 547 105 0 122538 0
[pid=26759/tid=26761] ppid=26757 vsize=508136 CPUtime=12.39 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 16508 0 0 0 1236 3 0 0 25 0 4 0 504713252 520331264 81073 33554432000 4194304 4623224 140733360838064 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=508136 CPUtime=12.39 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 26170 0 0 0 1235 4 0 0 25 0 4 0 504713252 520331264 81073 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=508136 CPUtime=12.39 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 18656 0 0 0 1237 2 0 0 25 0 4 0 504713252 520331264 81073 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 49.83
Current children cumulated vsize (KiB) 508136

[startup+25.5009 s]
/proc/loadavg: 5.26 5.68 6.90 9/184 26764
/proc/meminfo: memFree=30274188/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=746868 CPUtime=100.96 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 161785 0 0 0 10067 29 0 0 25 0 4 0 504713222 764792832 112685 33554432000 4194304 4623224 140733360838064 18446744073709551615 4507318 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 186717 112685 807 105 0 182221 0
[pid=26759/tid=26761] ppid=26757 vsize=746868 CPUtime=25.19 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 23307 0 0 0 2515 4 0 0 25 0 4 0 504713252 764792832 112685 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376865 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=746868 CPUtime=25.19 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 42975 0 0 0 2508 11 0 0 25 0 4 0 504713252 764792832 112685 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376850 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=746868 CPUtime=25.19 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 23603 0 0 0 2516 3 0 0 25 0 4 0 504713252 764792832 112685 33554432000 4194304 4623224 140733360838064 18446744073709551615 4377419 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 100.96
Current children cumulated vsize (KiB) 746868

[startup+51.1003 s]
/proc/loadavg: 6.25 5.88 6.93 9/184 26765
/proc/meminfo: memFree=29635972/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=871156 CPUtime=203.22 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 340961 0 0 0 20262 60 0 0 25 0 4 0 504713222 892063744 162651 33554432000 4194304 4623224 140733360838064 18446744073709551615 4415014 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 217789 162651 731 105 0 213293 0
[pid=26759/tid=26761] ppid=26757 vsize=871156 CPUtime=50.79 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 34964 0 0 0 5072 7 0 0 25 0 4 0 504713252 892063744 162651 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=871156 CPUtime=50.79 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 65689 0 0 0 5059 20 0 0 25 0 4 0 504713252 892063744 162651 33554432000 4194304 4623224 140733360838064 18446744073709551615 4377463 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=871156 CPUtime=50.79 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 111817 0 0 0 5064 15 0 0 25 0 4 0 504713252 892063744 162651 33554432000 4194304 4623224 140733360838064 18446744073709551615 4551411 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.22
Current children cumulated vsize (KiB) 871156

[startup+102.307 s]
/proc/loadavg: 7.29 6.22 6.99 9/184 26766
/proc/meminfo: memFree=28829072/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=1436748 CPUtime=407.72 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 914682 0 0 0 40625 147 0 0 25 0 4 0 504713222 1471229952 267218 33554432000 4194304 4623224 140733360838064 18446744073709551615 4415005 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 359187 267218 557 105 0 354691 0
[pid=26759/tid=26761] ppid=26757 vsize=1436748 CPUtime=101.99 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 60465 0 0 0 10186 13 0 0 25 0 4 0 504713252 1471229952 267218 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=1436748 CPUtime=101.99 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 99259 0 0 0 10166 33 0 0 25 0 4 0 504713252 1471229952 267218 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=1436748 CPUtime=101.98 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 407827 0 0 0 10142 56 0 0 25 0 4 0 504713252 1471229952 267218 33554432000 4194304 4623224 140733360838064 18446744073709551615 4545317 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 407.72
Current children cumulated vsize (KiB) 1436748

[startup+162.3 s]
/proc/loadavg: 8.08 6.64 7.08 9/184 26771
/proc/meminfo: memFree=28367080/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=1522848 CPUtime=646.54 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 1379008 0 0 0 64433 221 0 0 25 0 4 0 504713222 1559396352 310623 33554432000 4194304 4623224 140733360838064 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 380712 310623 444 105 0 376216 0
[pid=26759/tid=26761] ppid=26757 vsize=1522848 CPUtime=161.14 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 60958 0 0 0 16101 13 0 0 25 0 4 0 504713252 1559396352 310623 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=1522848 CPUtime=161.98 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 107947 0 0 0 16160 38 0 0 25 0 4 0 504713252 1559396352 310623 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=1522848 CPUtime=161.98 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 829468 0 0 0 16079 119 0 0 25 0 4 0 504713252 1559396352 310623 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 646.54
Current children cumulated vsize (KiB) 1522848

[startup+222.301 s]
/proc/loadavg: 8.14 6.91 7.15 9/184 26772
/proc/meminfo: memFree=27956932/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=1807184 CPUtime=886.22 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 1904777 0 0 0 88312 310 0 0 25 0 4 0 504713222 1850556416 339622 33554432000 4194304 4623224 140733360838064 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 451796 339622 444 105 0 447300 0
[pid=26759/tid=26761] ppid=26757 vsize=1807184 CPUtime=221.14 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 61192 0 0 0 22101 13 0 0 25 0 4 0 504713252 1850556416 339622 33554432000 4194304 4623224 140733360838064 18446744073709551615 4358011 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=1807184 CPUtime=221.98 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 108337 0 0 0 22160 38 0 0 25 0 4 0 504713252 1850556416 339622 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=1807184 CPUtime=221.98 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 1224900 0 0 0 22009 189 0 0 25 0 4 0 504713252 1850556416 339622 33554432000 4194304 4623224 140733360838064 18446744073709551615 4559248 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 886.22
Current children cumulated vsize (KiB) 1807184

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2563.98
Current children cumulated vsize (KiB) 2342784

[startup+702.301 s]
/proc/loadavg: 8.02 7.86 7.52 9/184 26785
/proc/meminfo: memFree=27092028/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=2379056 CPUtime=2803.64 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 5339138 0 0 0 279452 912 0 0 25 0 4 0 504713222 2436153344 463352 33554432000 4194304 4623224 140733360838064 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 594764 463352 342 105 0 590268 0
[pid=26759/tid=26761] ppid=26757 vsize=2379056 CPUtime=701.16 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 80142 0 0 0 70099 17 0 0 25 0 4 0 504713252 2436153344 463352 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=2379056 CPUtime=701.99 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 130054 0 0 0 70158 41 0 0 25 0 4 0 504713252 2436153344 463352 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=2379056 CPUtime=701.98 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 4211401 0 0 0 69489 709 0 0 25 0 4 0 504713252 2436153344 463352 33554432000 4194304 4623224 140733360838064 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2803.64
Current children cumulated vsize (KiB) 2379056

[startup+762.307 s]
/proc/loadavg: 8.01 7.88 7.55 9/184 26787
/proc/meminfo: memFree=26985704/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=2444592 CPUtime=3043.34 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 5843755 0 0 0 303331 1003 0 0 25 0 4 0 504713222 2503262208 476462 33554432000 4194304 4623224 140733360838064 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 611148 476462 342 105 0 606652 0
[pid=26759/tid=26761] ppid=26757 vsize=2444592 CPUtime=761.16 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 80382 0 0 0 76099 17 0 0 25 0 4 0 504713252 2503262208 476462 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=2444592 CPUtime=762 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 130521 0 0 0 76158 42 0 0 25 0 4 0 504713252 2503262208 476462 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=2444592 CPUtime=761.99 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 4680216 0 0 0 75409 790 0 0 25 0 4 0 504713252 2503262208 476462 33554432000 4194304 4623224 140733360838064 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3043.34
Current children cumulated vsize (KiB) 2444592

[startup+822.301 s]
/proc/loadavg: 8.00 7.90 7.58 9/184 26788
/proc/meminfo: memFree=26886832/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=2510128 CPUtime=3283 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 6231933 0 0 0 327232 1068 0 0 25 0 4 0 504713222 2570371072 489710 33554432000 4194304 4623224 140733360838064 18446744073709551615 4415014 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 627532 489710 342 105 0 623036 0
[pid=26759/tid=26761] ppid=26757 vsize=2510128 CPUtime=821.16 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 80557 0 0 0 82099 17 0 0 25 0 4 0 504713252 2570371072 489710 33554432000 4194304 4623224 140733360838064 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=2510128 CPUtime=822 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 131555 0 0 0 82157 43 0 0 25 0 4 0 504713252 2570371072 489710 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=2510128 CPUtime=821.98 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 5028068 0 0 0 81351 847 0 0 25 0 4 0 504713252 2570371072 489710 33554432000 4194304 4623224 140733360838064 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3283
Current children cumulated vsize (KiB) 2510128

[startup+882.301 s]
/proc/loadavg: 8.00 7.91 7.60 9/184 26790
/proc/meminfo: memFree=26678960/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=2575664 CPUtime=3522.66 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 6933215 0 0 0 351080 1186 0 0 25 0 4 0 504713222 2637479936 531785 33554432000 4194304 4623224 140733360838064 18446744073709551615 4510108 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 643916 531785 342 105 0 639420 0
[pid=26759/tid=26761] ppid=26757 vsize=2575664 CPUtime=881.16 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 81805 0 0 0 88098 18 0 0 25 0 4 0 504713252 2637479936 531785 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=2575664 CPUtime=881.99 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 145263 0 0 0 88144 55 0 0 25 0 4 0 504713252 2637479936 531785 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=2575664 CPUtime=881.98 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 5682094 0 0 0 87250 948 0 0 25 0 4 0 504713252 2637479936 531785 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3522.66
Current children cumulated vsize (KiB) 2575664

[startup+942.301 s]
/proc/loadavg: 8.05 7.94 7.63 9/184 26791
/proc/meminfo: memFree=26346220/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=3172580 CPUtime=3762.33 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 7775751 0 0 0 374912 1321 0 0 25 0 4 0 504713222 3248721920 605604 33554432000 4194304 4623224 140733360838064 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 793145 605604 342 105 0 788649 0
[pid=26759/tid=26761] ppid=26757 vsize=3172580 CPUtime=941.16 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 82944 0 0 0 94098 18 0 0 25 0 4 0 504713252 3248721920 605604 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=3172580 CPUtime=941.99 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 160368 0 0 0 94133 66 0 0 25 0 4 0 504713252 3248721920 605604 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=3172580 CPUtime=941.98 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 6185493 0 0 0 93169 1029 0 0 25 0 4 0 504713252 3248721920 605605 33554432000 4194304 4623224 140733360838064 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3762.33
Current children cumulated vsize (KiB) 3172580

[startup+1002.3 s]
/proc/loadavg: 8.06 7.96 7.65 9/184 26793
/proc/meminfo: memFree=26130908/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=3272576 CPUtime=4002.01 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 8273095 0 0 0 398783 1418 0 0 25 0 4 0 504713222 3351117824 651058 33554432000 4194304 4623224 140733360838064 18446744073709551615 4511040 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 818144 651058 342 105 0 813648 0
[pid=26759/tid=26761] ppid=26757 vsize=3272576 CPUtime=1001.17 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 83950 0 0 0 100098 19 0 0 25 0 4 0 504713252 3351117824 651058 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=3272576 CPUtime=1001.98 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 176214 0 0 0 100119 79 0 0 25 0 4 0 504713252 3351117824 651058 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=3272576 CPUtime=1001.97 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 6631364 0 0 0 99093 1104 0 0 25 0 4 0 504713252 3351117824 651058 33554432000 4194304 4623224 140733360838064 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4002.01
Current children cumulated vsize (KiB) 3272576

[startup+1062.3 s]
/proc/loadavg: 8.06 7.98 7.68 9/184 26795
/proc/meminfo: memFree=25908288/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=3372164 CPUtime=4241.68 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 8790468 0 0 0 422660 1508 0 0 25 0 4 0 504713222 3453095936 699227 33554432000 4194304 4623224 140733360838064 18446744073709551615 4414965 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 843041 699227 342 105 0 838545 0
[pid=26759/tid=26761] ppid=26757 vsize=3372164 CPUtime=1061.16 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 84817 0 0 0 106097 19 0 0 25 0 4 0 504713252 3453095936 699227 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357614 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=3372164 CPUtime=1061.99 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 197008 0 0 0 106105 94 0 0 25 0 4 0 504713252 3453095936 699227 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=3372164 CPUtime=1061.97 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 7101686 0 0 0 105023 1174 0 0 25 0 4 0 504713252 3453095936 699227 33554432000 4194304 4623224 140733360838064 18446744073709551615 4544933 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4241.68
Current children cumulated vsize (KiB) 3372164

[startup+1122.3 s]
/proc/loadavg: 8.12 8.01 7.70 9/184 26796
/proc/meminfo: memFree=25713056/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=3479828 CPUtime=4481.37 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 9345732 0 0 0 446534 1603 0 0 25 0 4 0 504713222 3563343872 738482 33554432000 4194304 4623224 140733360838064 18446744073709551615 4414965 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 869957 738482 342 105 0 865461 0
[pid=26759/tid=26761] ppid=26757 vsize=3479828 CPUtime=1121.16 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 109101 0 0 0 112094 22 0 0 25 0 4 0 504713252 3563343872 738482 33554432000 4194304 4623224 140733360838064 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=3479828 CPUtime=1121.99 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 206784 0 0 0 112096 103 0 0 25 0 4 0 504713252 3563343872 738482 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=3479828 CPUtime=1121.97 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 7593928 0 0 0 110946 1251 0 0 25 0 4 0 504713252 3563343872 738482 33554432000 4194304 4623224 140733360838064 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4481.37
Current children cumulated vsize (KiB) 3479828

[startup+1182.3 s]
/proc/loadavg: 8.13 8.04 7.73 9/184 26798
/proc/meminfo: memFree=25209952/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=4322872 CPUtime=4720.96 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 10282449 0 0 0 470344 1752 0 0 25 0 4 0 504713222 4426620928 826563 33554432000 4194304 4623224 140733360838064 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 1080718 826563 342 105 0 1076222 0
[pid=26759/tid=26761] ppid=26757 vsize=4322872 CPUtime=1181.17 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 116003 0 0 0 118093 24 0 0 25 0 4 0 504713252 4426620928 826563 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=4322872 CPUtime=1181.94 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 224010 0 0 0 118076 118 0 0 25 0 4 0 504713252 4426620928 826563 33554432000 4194304 4623224 140733360838064 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=4322872 CPUtime=1181.95 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 8082526 0 0 0 116865 1330 0 0 25 0 4 0 504713252 4426620928 826563 33554432000 4194304 4623224 140733360838064 18446744073709551615 4365088 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4720.96
Current children cumulated vsize (KiB) 4322872



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.1 s]
/proc/loadavg: 8.09 8.03 7.73 5/179 26799
/proc/meminfo: memFree=27716136/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=4377208 CPUtime=4800.07 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4202496 10515063 0 0 0 478215 1792 0 0 25 0 4 0 504713222 4482260992 837229 33554432000 4194304 4623224 140733360838064 18446744073709551615 4415028 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26759/statm: 1094302 837229 342 105 0 1089806 0
[pid=26759/tid=26761] ppid=26757 vsize=4377208 CPUtime=1200.98 cores=1,3,5,7
/proc/26759/task/26761/stat : 26761 (SArTagnan) R 26757 26759 26718 0 -1 4202560 116224 0 0 0 120074 24 0 0 25 0 4 0 504713252 4482260992 837230 33554432000 4194304 4623224 140733360838064 18446744073709551615 4357610 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26759/tid=26762] ppid=26757 vsize=4377208 CPUtime=1201.75 cores=1,3,5,7
/proc/26759/task/26762/stat : 26762 (SArTagnan) R 26757 26759 26718 0 -1 4202560 257956 0 0 0 120048 127 0 0 25 0 4 0 504713252 4482260992 837231 33554432000 4194304 4623224 140733360838064 18446744073709551615 4373096 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26759/tid=26763] ppid=26757 vsize=4377208 CPUtime=1201.76 cores=1,3,5,7
/proc/26759/task/26763/stat : 26763 (SArTagnan) R 26757 26759 26718 0 -1 4202560 8277907 0 0 0 118815 1361 0 0 25 0 4 0 504713252 4482260992 837231 33554432000 4194304 4623224 140733360838064 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.07
Current children cumulated vsize (KiB) 4377208

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.21 s]
/proc/loadavg: 8.09 8.03 7.73 2/177 26800
/proc/meminfo: memFree=30467836/32951124 swapFree=67106388/67111528
[pid=26759] ppid=26757 vsize=0 CPUtime=4800.2 cores=1,3,5,7
/proc/26759/stat : 26759 (SArTagnan) R 26757 26759 26718 0 -1 4203524 10515132 0 0 0 478217 1803 0 0 25 0 1 0 504713222 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/26759/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.23
CPU time (s): 4800.22
CPU user time (s): 4782.18
CPU system time (s): 18.0453
CPU usage (%): 399.276
Max. virtual memory (cumulated for all children) (KiB): 5666688

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4782.18
system time used= 18.0453
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10515132
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4141
involuntary context switches= 28725

runsolver used 1.62575 second user time and 4.94325 second system time

The end

Launcher Data 

Begin job on node146 at 2011-04-30 02:22:50
IDJOB=3251266
IDBENCH=88217
IDSOLVER=1656
FILE ID=node146/3251266-1304122969
RUNJOBID= node146-1304122969-26737
PBS_JOBID= 13170750
Free space on /tmp= 72976 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m62-q1327.5-n60-p15-s1351253.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3251266-1304122969/watcher-3251266-1304122969 -o /tmp/evaluation-result-3251266-1304122969/solver-3251266-1304122969 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3251266-1304122969.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b23c52475e3d098cb9d5a92c025d6982
RANDOM SEED=2042686803

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30995216 kB
Buffers:        389212 kB
Cached:        1056796 kB
SwapCached:        540 kB
Active:         180724 kB
Inactive:      1400488 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30995216 kB
SwapTotal:    67111528 kB
SwapFree:     67106388 kB
Dirty:           20252 kB
Writeback:           0 kB
AnonPages:      134044 kB
Mapped:          15288 kB
Slab:           310548 kB
PageTables:       4924 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   327200 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72972 MiB
End job on node146 at 2011-04-30 02:42:54