Trace number 3291337

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.23 1201.82

General information on the benchmark

NameSAT03/industrial/goldberg/hard_eq_check/
c6288mul.miter.shuffled-as.sat03-346.cnf
MD5SUM9799c8db3562549113e4a12f98721530
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark42.8615
Satisfiable
(Un)Satisfiability was proved
Number of variables9540
Number of clauses61421
Sum of the clauses size207840
Maximum clause length64
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 214116
Number of clauses of size 328488
Number of clauses of size 40
Number of clauses of size 518816
Number of clauses of size over 51

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3291337-1304102253/watcher-3291337-1304102253 -o /tmp/evaluation-result-3291337-1304102253/solver-3291337-1304102253 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3291337-1304102253.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.74 7.97 7.99 6/180 25895
/proc/meminfo: memFree=29418600/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=21368 CPUtime=0 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 836 0 0 0 0 0 0 0 25 0 1 0 600456015 21880832 726 33554432000 4194304 4623224 140735384051264 18446744073709551615 256415391488 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/25895/statm: 5342 726 297 105 0 846 0

[startup+0.150786 s]
/proc/loadavg: 7.74 7.97 7.99 6/180 25895
/proc/meminfo: memFree=29418600/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=268548 CPUtime=0.44 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 8661 0 0 0 43 1 0 0 25 0 4 0 600456015 274993152 5835 33554432000 4194304 4623224 140735384051264 18446744073709551615 4516371 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 67137 5835 340 105 0 62641 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 268548

[startup+0.200777 s]
/proc/loadavg: 7.74 7.97 7.99 6/180 25895
/proc/meminfo: memFree=29418600/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=268548 CPUtime=0.64 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 8705 0 0 0 63 1 0 0 25 0 4 0 600456015 274993152 5879 33554432000 4194304 4623224 140735384051264 18446744073709551615 4507318 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 67137 5879 341 105 0 62641 0
Current children cumulated CPU time (s) 0.64
Current children cumulated vsize (KiB) 268548

[startup+0.300758 s]
/proc/loadavg: 7.74 7.97 7.99 6/180 25895
/proc/meminfo: memFree=29418600/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=268548 CPUtime=1.04 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 8900 0 0 0 103 1 0 0 25 0 4 0 600456015 274993152 6074 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 67137 6074 341 105 0 62641 0
Current children cumulated CPU time (s) 1.04
Current children cumulated vsize (KiB) 268548

[startup+0.700684 s]
/proc/loadavg: 7.74 7.97 7.99 6/180 25895
/proc/meminfo: memFree=29418600/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=283736 CPUtime=2.64 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 18860 0 0 0 261 3 0 0 25 0 4 0 600456015 290545664 11960 33554432000 4194304 4623224 140735384051264 18446744073709551615 4368435 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 70934 11960 344 105 0 66438 0
Current children cumulated CPU time (s) 2.64
Current children cumulated vsize (KiB) 283736

[startup+1.50053 s]
/proc/loadavg: 7.84 7.98 7.99 10/184 25899
/proc/meminfo: memFree=29366620/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=287164 CPUtime=5.84 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 27004 0 0 0 580 4 0 0 25 0 4 0 600456015 294055936 13291 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 71791 13291 345 105 0 67295 0
[pid=25895/tid=25897] ppid=25893 vsize=287164 CPUtime=1.44 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 3303 0 0 0 144 0 0 0 25 0 4 0 600456020 294055936 13291 33554432000 4194304 4623224 140735384051264 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=287164 CPUtime=1.43 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 3464 0 0 0 143 0 0 0 25 0 4 0 600456020 294055936 13291 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=287164 CPUtime=1.45 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 6729 0 0 0 144 1 0 0 20 0 4 0 600456020 294055936 13291 33554432000 4194304 4623224 140735384051264 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.84
Current children cumulated vsize (KiB) 287164

[startup+3.10023 s]
/proc/loadavg: 7.84 7.98 7.99 10/184 25899
/proc/meminfo: memFree=29361536/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=293184 CPUtime=12.24 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 35968 0 0 0 1217 7 0 0 25 0 4 0 600456015 300220416 14629 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510353 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 73296 14629 345 105 0 68800 0
[pid=25895/tid=25897] ppid=25893 vsize=293184 CPUtime=3.04 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 3400 0 0 0 304 0 0 0 25 0 4 0 600456020 300220416 14629 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=293184 CPUtime=3.03 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 3552 0 0 0 302 1 0 0 25 0 4 0 600456020 300220416 14629 33554432000 4194304 4623224 140735384051264 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=293184 CPUtime=3.04 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 13035 0 0 0 302 2 0 0 25 0 4 0 600456020 300220416 14629 33554432000 4194304 4623224 140735384051264 18446744073709551615 4550495 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.24
Current children cumulated vsize (KiB) 293184

[startup+6.30063 s]
/proc/loadavg: 7.86 7.98 7.99 10/184 25899
/proc/meminfo: memFree=29348104/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=293184 CPUtime=25.02 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 56538 0 0 0 2491 11 0 0 25 0 4 0 600456015 300220416 15975 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 73296 15975 345 105 0 68800 0
[pid=25895/tid=25897] ppid=25893 vsize=293184 CPUtime=6.25 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 3892 0 0 0 624 1 0 0 25 0 4 0 600456020 300220416 15975 33554432000 4194304 4623224 140735384051264 18446744073709551615 4289772 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=293184 CPUtime=6.21 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 3706 0 0 0 620 1 0 0 25 0 4 0 600456020 300220416 15975 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=293184 CPUtime=6.25 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 32873 0 0 0 619 6 0 0 25 0 4 0 600456020 300220416 15975 33554432000 4194304 4623224 140735384051264 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.02
Current children cumulated vsize (KiB) 293184

[startup+12.7004 s]
/proc/loadavg: 7.87 7.98 7.99 10/184 25899
/proc/meminfo: memFree=29316000/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=298104 CPUtime=50.57 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 91968 0 0 0 5041 16 0 0 25 0 4 0 600456015 305258496 17504 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 74526 17504 345 105 0 70030 0
[pid=25895/tid=25897] ppid=25893 vsize=298104 CPUtime=12.64 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 5536 0 0 0 1263 1 0 0 25 0 4 0 600456020 305258496 17504 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=298104 CPUtime=12.58 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 5641 0 0 0 1257 1 0 0 25 0 4 0 600456020 305258496 17504 33554432000 4194304 4623224 140735384051264 18446744073709551615 4461319 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=298104 CPUtime=12.64 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 64650 0 0 0 1254 10 0 0 25 0 4 0 600456020 305258496 17504 33554432000 4194304 4623224 140735384051264 18446744073709551615 4290002 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.57
Current children cumulated vsize (KiB) 298104

[startup+25.501 s]
/proc/loadavg: 7.90 7.98 7.99 10/184 25899
/proc/meminfo: memFree=29222624/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=309852 CPUtime=101.71 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 167068 0 0 0 10142 29 0 0 25 0 4 0 600456015 317288448 27244 33554432000 4194304 4623224 140735384051264 18446744073709551615 4507318 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 77463 27244 345 105 0 72967 0
[pid=25895/tid=25897] ppid=25893 vsize=309852 CPUtime=25.44 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 9646 0 0 0 2542 2 0 0 25 0 4 0 600456020 317288448 27244 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=309852 CPUtime=25.3 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 9266 0 0 0 2529 1 0 0 25 0 4 0 600456020 317288448 27244 33554432000 4194304 4623224 140735384051264 18446744073709551615 256415046664 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=309852 CPUtime=25.45 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 129963 0 0 0 2524 21 0 0 25 0 4 0 600456020 317288448 27244 33554432000 4194304 4623224 140735384051264 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.71
Current children cumulated vsize (KiB) 309852

[startup+51.1012 s]
/proc/loadavg: 7.93 7.98 7.99 10/184 25900
/proc/meminfo: memFree=29023312/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=341460 CPUtime=203.98 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 266734 0 0 0 20351 47 0 0 25 0 4 0 600456015 349655040 43585 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 85365 43585 345 105 0 80869 0
[pid=25895/tid=25897] ppid=25893 vsize=341460 CPUtime=51.05 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 16294 0 0 0 5100 5 0 0 25 0 4 0 600456020 349655040 43585 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=341460 CPUtime=50.77 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 15917 0 0 0 5074 3 0 0 25 0 4 0 600456020 349655040 43585 33554432000 4194304 4623224 140735384051264 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=341460 CPUtime=51.04 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 212496 0 0 0 5070 34 0 0 25 0 4 0 600456020 349655040 43585 33554432000 4194304 4623224 140735384051264 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.98
Current children cumulated vsize (KiB) 341460

[startup+102.301 s]
/proc/loadavg: 8.25 8.05 8.01 11/185 25904
/proc/meminfo: memFree=28689204/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=436312 CPUtime=408.5 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 416936 0 0 0 40771 79 0 0 25 0 4 0 600456015 446783488 82208 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 109078 82208 345 105 0 104582 0
[pid=25895/tid=25897] ppid=25893 vsize=436312 CPUtime=102.25 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 29077 0 0 0 10212 13 0 0 25 0 4 0 600456020 446783488 82208 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=436312 CPUtime=101.69 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 25577 0 0 0 10163 6 0 0 25 0 4 0 600456020 446783488 82208 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=436312 CPUtime=102.25 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 314054 0 0 0 10175 50 0 0 25 0 4 0 600456020 446783488 82208 33554432000 4194304 4623224 140735384051264 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 408.5
Current children cumulated vsize (KiB) 436312

[startup+162.3 s]
/proc/loadavg: 8.15 8.05 8.01 10/184 25906
/proc/meminfo: memFree=28445948/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=623996 CPUtime=648.15 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 800269 0 0 0 64661 154 0 0 25 0 4 0 600456015 638971904 110270 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 155999 110270 345 105 0 151503 0
[pid=25895/tid=25897] ppid=25893 vsize=623996 CPUtime=162.25 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 34556 0 0 0 16206 19 0 0 25 0 4 0 600456020 638971904 110270 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=623996 CPUtime=161.36 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 38384 0 0 0 16126 10 0 0 25 0 4 0 600456020 638971904 110270 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=623996 CPUtime=162.23 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 660767 0 0 0 16112 111 0 0 25 0 4 0 600456020 638971904 110270 33554432000 4194304 4623224 140735384051264 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 648.15
Current children cumulated vsize (KiB) 623996

[startup+222.307 s]
/proc/loadavg: 8.17 8.07 8.02 10/184 25907
/proc/meminfo: memFree=28175340/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=792544 CPUtime=887.85 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 1171402 0 0 0 88567 218 0 0 25 0 4 0 600456015 811565056 140660 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 198136 140660 345 105 0 193640 0
[pid=25895/tid=25897] ppid=25893 vsize=792544 CPUtime=222.26 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 47946 0 0 0 22200 26 0 0 25 0 4 0 600456020 811565056 140660 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=792544 CPUtime=221.05 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 42294 0 0 0 22093 12 0 0 25 0 4 0 600456020 811565056 140660 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=792544 CPUtime=222.23 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 997397 0 0 0 22059 164 0 0 25 0 4 0 600456020 811565056 140660 33554432000 4194304 4623224 140735384051264 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 887.85
Current children cumulated vsize (KiB) 792544

[startup+282.301 s]

################
# More data... #
################


[startup+702.3 s]
/proc/loadavg: 8.05 8.08 8.03 10/184 25920
/proc/meminfo: memFree=26715748/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=1743036 CPUtime=2805.19 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 3952751 0 0 0 279782 737 0 0 25 0 4 0 600456015 1784868864 358819 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 435759 358819 435 105 0 431263 0
[pid=25895/tid=25897] ppid=25893 vsize=1743036 CPUtime=701.34 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 97804 0 0 0 70064 70 0 0 25 0 4 0 600456020 1784868864 358819 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=1743036 CPUtime=699.36 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 98770 0 0 0 69891 45 0 0 25 0 4 0 600456020 1784868864 358819 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=1743036 CPUtime=702.17 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 3484585 0 0 0 69642 575 0 0 25 0 4 0 600456020 1784868864 358819 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376697 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2805.19
Current children cumulated vsize (KiB) 1743036

[startup+762.301 s]
/proc/loadavg: 8.21 8.11 8.04 10/184 25922
/proc/meminfo: memFree=26563420/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=1945860 CPUtime=3044.88 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 4310430 0 0 0 303687 801 0 0 25 0 4 0 600456015 1992560640 377817 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510113 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 486465 377818 435 105 0 481969 0
[pid=25895/tid=25897] ppid=25893 vsize=1945860 CPUtime=761.02 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 101512 0 0 0 76028 74 0 0 25 0 4 0 600456020 1992560640 377819 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=1945860 CPUtime=759.36 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 102004 0 0 0 75888 48 0 0 25 0 4 0 600456020 1992560640 377819 33554432000 4194304 4623224 140735384051264 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=1945860 CPUtime=762.18 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 3799397 0 0 0 75591 627 0 0 25 0 4 0 600456020 1992560640 377820 33554432000 4194304 4623224 140735384051264 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3044.88
Current children cumulated vsize (KiB) 1945860

[startup+822.301 s]
/proc/loadavg: 8.22 8.12 8.04 10/184 25923
/proc/meminfo: memFree=26422644/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=1974376 CPUtime=3284.53 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 4643993 0 0 0 327590 863 0 0 25 0 4 0 600456015 2021761024 400406 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510475 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 493594 400406 436 105 0 489098 0
[pid=25895/tid=25897] ppid=25893 vsize=1974376 CPUtime=820.7 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 122163 0 0 0 81989 81 0 0 25 0 4 0 600456020 2021761024 400406 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=1974376 CPUtime=819.35 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 105338 0 0 0 81885 50 0 0 25 0 4 0 600456020 2021761024 400406 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=1974376 CPUtime=822.16 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 4105231 0 0 0 81537 679 0 0 25 0 4 0 600456020 2021761024 400406 33554432000 4194304 4623224 140735384051264 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3284.53
Current children cumulated vsize (KiB) 1974376

[startup+882.306 s]
/proc/loadavg: 8.22 8.13 8.05 10/184 25925
/proc/meminfo: memFree=26276136/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=2042676 CPUtime=3524.23 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 4963645 0 0 0 351500 923 0 0 25 0 4 0 600456015 2091700224 421199 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 510669 421199 436 105 0 506173 0
[pid=25895/tid=25897] ppid=25893 vsize=2042676 CPUtime=880.37 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 127739 0 0 0 87951 86 0 0 25 0 4 0 600456020 2091700224 421199 33554432000 4194304 4623224 140735384051264 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=2042676 CPUtime=879.36 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 109052 0 0 0 87882 54 0 0 25 0 4 0 600456020 2091700224 421199 33554432000 4194304 4623224 140735384051264 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=2042676 CPUtime=882.16 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 4411818 0 0 0 87487 729 0 0 25 0 4 0 600456020 2091700224 421199 33554432000 4194304 4623224 140735384051264 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3524.23
Current children cumulated vsize (KiB) 2042676

[startup+942.301 s]
/proc/loadavg: 8.20 8.13 8.05 10/184 25927
/proc/meminfo: memFree=26143432/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=2045892 CPUtime=3763.88 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 5294585 0 0 0 375402 986 0 0 25 0 4 0 600456015 2094993408 443405 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 511473 443405 435 105 0 506977 0
[pid=25895/tid=25897] ppid=25893 vsize=2045892 CPUtime=940.04 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 134026 0 0 0 93913 91 0 0 25 0 4 0 600456020 2094993408 443405 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=2045892 CPUtime=939.36 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 113180 0 0 0 93878 58 0 0 25 0 4 0 600456020 2094993408 443405 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=2045892 CPUtime=942.15 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 4727809 0 0 0 93434 781 0 0 25 0 4 0 600456020 2094993408 443405 33554432000 4194304 4623224 140735384051264 18446744073709551615 4552512 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3763.88
Current children cumulated vsize (KiB) 2045892

[startup+1002.3 s]
/proc/loadavg: 8.13 8.12 8.05 10/184 25928
/proc/meminfo: memFree=26005372/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=2127880 CPUtime=4003.56 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 5619126 0 0 0 399312 1044 0 0 25 0 4 0 600456015 2178949120 468178 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 531970 468178 435 105 0 527474 0
[pid=25895/tid=25897] ppid=25893 vsize=2127880 CPUtime=999.72 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 140339 0 0 0 99879 93 0 0 25 0 4 0 600456020 2178949120 468178 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=2127880 CPUtime=999.37 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 116141 0 0 0 99875 62 0 0 25 0 4 0 600456020 2178949120 468178 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=2127880 CPUtime=1002.14 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 5034404 0 0 0 99382 832 0 0 25 0 4 0 600456020 2178949120 468178 33554432000 4194304 4623224 140735384051264 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4003.56
Current children cumulated vsize (KiB) 2127880

[startup+1062.3 s]
/proc/loadavg: 8.05 8.10 8.05 10/184 25930
/proc/meminfo: memFree=25876876/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=2357432 CPUtime=4243.24 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 5983214 0 0 0 423217 1107 0 0 25 0 4 0 600456015 2414010368 490537 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510285 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 589358 490537 436 105 0 584862 0
[pid=25895/tid=25897] ppid=25893 vsize=2357432 CPUtime=1059.4 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 143070 0 0 0 105844 96 0 0 25 0 4 0 600456020 2414010368 490537 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=2357432 CPUtime=1059.36 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 118748 0 0 0 105871 65 0 0 25 0 4 0 600456020 2414010368 490537 33554432000 4194304 4623224 140735384051264 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=2357432 CPUtime=1062.15 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 5336482 0 0 0 105333 882 0 0 25 0 4 0 600456020 2414010368 490537 33554432000 4194304 4623224 140735384051264 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4243.24
Current children cumulated vsize (KiB) 2357432

[startup+1122.3 s]
/proc/loadavg: 8.07 8.09 8.05 10/184 25931
/proc/meminfo: memFree=25753696/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=2404272 CPUtime=4482.9 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 6313367 0 0 0 447126 1164 0 0 25 0 4 0 600456015 2461974528 510408 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 601068 510408 437 105 0 596572 0
[pid=25895/tid=25897] ppid=25893 vsize=2404272 CPUtime=1119.07 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 170479 0 0 0 111803 104 0 0 25 0 4 0 600456020 2461974528 510408 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=2404272 CPUtime=1119.36 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 121398 0 0 0 111869 67 0 0 25 0 4 0 600456020 2461974528 510408 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=2404272 CPUtime=1122.14 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 5633683 0 0 0 111285 929 0 0 25 0 4 0 600456020 2461974528 510408 33554432000 4194304 4623224 140735384051264 18446744073709551615 4364687 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4482.9
Current children cumulated vsize (KiB) 2404272

[startup+1182.3 s]
/proc/loadavg: 6.45 7.69 7.91 5/175 25951
/proc/meminfo: memFree=27629260/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=2580860 CPUtime=4722.58 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 6647003 0 0 0 471018 1240 0 0 25 0 4 0 600456015 2642800640 530194 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 645215 530194 435 105 0 640719 0
[pid=25895/tid=25897] ppid=25893 vsize=2580860 CPUtime=1178.76 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 173474 0 0 0 117760 116 0 0 25 0 4 0 600456020 2642800640 530194 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=2580860 CPUtime=1179.36 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 148191 0 0 0 117855 81 0 0 25 0 4 0 600456020 2642800640 530194 33554432000 4194304 4623224 140735384051264 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=2580860 CPUtime=1182.11 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 5933493 0 0 0 117235 976 0 0 25 0 4 0 600456020 2642800640 530194 33554432000 4194304 4623224 140735384051264 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4722.58
Current children cumulated vsize (KiB) 2580860



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 5.75 7.45 7.83 5/175 25952
/proc/meminfo: memFree=27595632/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=2583192 CPUtime=4800.08 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) R 25893 25895 25177 0 -1 4202496 6751302 0 0 0 478735 1273 0 0 25 0 4 0 600456015 2645188608 538121 33554432000 4194304 4623224 140735384051264 18446744073709551615 4510285 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 645798 538121 435 105 0 641302 0
[pid=25895/tid=25897] ppid=25893 vsize=2583192 CPUtime=1198.07 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4202560 174491 0 0 0 119683 124 0 0 25 0 4 0 600456020 2645188608 538121 33554432000 4194304 4623224 140735384051264 18446744073709551615 4366369 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25895/tid=25898] ppid=25893 vsize=2583192 CPUtime=1198.76 cores=0,2,4,6
/proc/25895/task/25898/stat : 25898 (SArTagnan) R 25893 25895 25177 0 -1 4202560 150607 0 0 0 119787 89 0 0 25 0 4 0 600456020 2645188608 538121 33554432000 4194304 4623224 140735384051264 18446744073709551615 4289954 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25895/tid=25899] ppid=25893 vsize=2583192 CPUtime=1201.51 cores=0,2,4,6
/proc/25895/task/25899/stat : 25899 (SArTagnan) R 25893 25895 25177 0 -1 4202560 6032264 0 0 0 119157 994 0 0 25 0 4 0 600456020 2645188608 538121 33554432000 4194304 4623224 140735384051264 18446744073709551615 4545569 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.08
Current children cumulated vsize (KiB) 2583192

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.81 s]
/proc/loadavg: 5.75 7.45 7.83 5/175 25952
/proc/meminfo: memFree=27595632/32950928 swapFree=67111364/67111528
[pid=25895] ppid=25893 vsize=0 CPUtime=4800.21 cores=0,2,4,6
/proc/25895/stat : 25895 (SArTagnan) Z 25893 25895 25177 0 -1 4203548 6751370 0 0 0 478738 1283 0 0 25 0 2 0 600456015 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/25895/statm: 0 0 0 0 0 0 0
[pid=25895/tid=25897] ppid=25893 vsize=0 CPUtime=1198.17 cores=0,2,4,6
/proc/25895/task/25897/stat : 25897 (SArTagnan) R 25893 25895 25177 0 -1 4203588 174491 0 0 0 119683 134 0 0 25 0 2 0 600456020 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.82
CPU time (s): 4800.23
CPU user time (s): 4787.38
CPU system time (s): 12.848
CPU usage (%): 399.412
Max. virtual memory (cumulated for all children) (KiB): 2583192

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4787.38
system time used= 12.848
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6751370
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6693
involuntary context switches= 27690

runsolver used 1.82572 second user time and 4.69229 second system time

The end

Launcher Data 

Begin job on node115 at 2011-04-29 20:37:33
IDJOB=3291337
IDBENCH=84205
IDSOLVER=1656
FILE ID=node115/3291337-1304102253
RUNJOBID= node115-1304102204-25780
PBS_JOBID= 13170604
Free space on /tmp= 72732 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT03/industrial/goldberg/hard_eq_check/c6288mul.miter.shuffled-as.sat03-346.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3291337-1304102253/watcher-3291337-1304102253 -o /tmp/evaluation-result-3291337-1304102253/solver-3291337-1304102253 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3291337-1304102253.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9799c8db3562549113e4a12f98721530
RANDOM SEED=11768669

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29418756 kB
Buffers:        799148 kB
Cached:        1910708 kB
SwapCached:          0 kB
Active:         487184 kB
Inactive:      2619728 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29418756 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            1560 kB
Writeback:           0 kB
AnonPages:      396812 kB
Mapped:          15516 kB
Slab:           362324 kB
PageTables:       5440 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   617472 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72732 MiB
End job on node115 at 2011-04-29 20:57:37