Trace number 3293131

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.34 1201.78

General information on the benchmark

NameSAT02/industrial/dellacherie/
comb/comb1.shuffled.cnf
MD5SUM0e9d17eb95ee436fc1015c5591cfb63f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark21.2328
Satisfiable
(Un)Satisfiability was proved
Number of variables5910
Number of clauses16804
Sum of the clauses size38654
Maximum clause length28
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 213041
Number of clauses of size 32838
Number of clauses of size 4787
Number of clauses of size 5103
Number of clauses of size over 534

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3293131-1304114963/watcher-3293131-1304114963 -o /tmp/evaluation-result-3293131-1304114963/solver-3293131-1304114963 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3293131-1304114963.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.79 7.97 7.99 7/180 19992
/proc/meminfo: memFree=20773892/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=19908 CPUtime=0 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 655 0 0 0 0 0 0 0 25 0 1 0 503911959 20385792 592 33554432000 4194304 4623224 140735677253280 18446744073709551615 264726101771 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/19992/statm: 4977 603 297 105 0 481 0

[startup+0.0168261 s]
/proc/loadavg: 7.79 7.97 7.99 7/180 19992
/proc/meminfo: memFree=20773892/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=53196 CPUtime=0.02 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 1291 0 0 0 2 0 0 0 25 0 4 0 503911959 54472704 1163 33554432000 4194304 4623224 140735677253280 18446744073709551615 47570307860392 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 13299 1163 306 105 0 8803 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 53196

[startup+0.165768 s]
/proc/loadavg: 7.79 7.97 7.99 7/180 19992
/proc/meminfo: memFree=20773892/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=262016 CPUtime=0.61 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 8577 0 0 0 61 0 0 0 18 0 4 0 503911959 268304384 5081 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 65504 5081 344 105 0 61008 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 262016

[startup+0.300745 s]
/proc/loadavg: 7.79 7.97 7.99 7/180 19992
/proc/meminfo: memFree=20773892/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=263456 CPUtime=1.15 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 9499 0 0 0 114 1 0 0 18 0 4 0 503911959 269778944 5209 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 65864 5209 344 105 0 61368 0
Current children cumulated CPU time (s) 1.15
Current children cumulated vsize (KiB) 263456

[startup+0.700669 s]
/proc/loadavg: 7.79 7.97 7.99 7/180 19992
/proc/meminfo: memFree=20773892/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=263912 CPUtime=2.75 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 9861 0 0 0 274 1 0 0 18 0 4 0 503911959 270245888 5571 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510896 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 65978 5571 344 105 0 61482 0
Current children cumulated CPU time (s) 2.75
Current children cumulated vsize (KiB) 263912

[startup+1.50052 s]
/proc/loadavg: 7.79 7.97 7.99 9/184 19996
/proc/meminfo: memFree=20748572/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=268764 CPUtime=5.94 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 12286 0 0 0 593 1 0 0 20 0 4 0 503911959 275214336 6696 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 67191 6696 344 105 0 62695 0
[pid=19992/tid=19994] ppid=19990 vsize=268764 CPUtime=1.47 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 2551 0 0 0 147 0 0 0 25 0 4 0 503911960 275214336 6696 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=268764 CPUtime=1.48 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 1899 0 0 0 148 0 0 0 20 0 4 0 503911960 275214336 6696 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=268764 CPUtime=1.48 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 2462 0 0 0 148 0 0 0 25 0 4 0 503911960 275214336 6696 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 268764

[startup+3.10021 s]
/proc/loadavg: 7.79 7.97 7.99 9/184 19996
/proc/meminfo: memFree=20743240/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=272076 CPUtime=12.34 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 18717 0 0 0 1232 2 0 0 25 0 4 0 503911959 278605824 8070 33554432000 4194304 4623224 140735677253280 18446744073709551615 4507144 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 68019 8070 344 105 0 63523 0
[pid=19992/tid=19994] ppid=19990 vsize=272076 CPUtime=3.06 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 2774 0 0 0 306 0 0 0 25 0 4 0 503911960 278605824 8070 33554432000 4194304 4623224 140735677253280 18446744073709551615 4461088 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=272076 CPUtime=3.08 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 2084 0 0 0 308 0 0 0 25 0 4 0 503911960 278605824 8070 33554432000 4194304 4623224 140735677253280 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=272076 CPUtime=3.07 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 7837 0 0 0 307 0 0 0 25 0 4 0 503911960 278605824 8070 33554432000 4194304 4623224 140735677253280 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 272076

[startup+6.30061 s]
/proc/loadavg: 7.97 8.01 8.00 9/184 19997
/proc/meminfo: memFree=20727988/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=278036 CPUtime=25.12 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 34806 0 0 0 2507 5 0 0 25 0 4 0 503911959 284708864 10942 33554432000 4194304 4623224 140735677253280 18446744073709551615 4507508 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 69509 10942 344 105 0 65013 0
[pid=19992/tid=19994] ppid=19990 vsize=278036 CPUtime=6.24 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 4185 0 0 0 624 0 0 0 25 0 4 0 503911960 284708864 10942 33554432000 4194304 4623224 140735677253280 18446744073709551615 4460982 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=278036 CPUtime=6.28 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3129 0 0 0 628 0 0 0 25 0 4 0 503911960 284708864 10942 33554432000 4194304 4623224 140735677253280 18446744073709551615 4377034 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=278036 CPUtime=6.28 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 21437 0 0 0 625 3 0 0 25 0 4 0 503911960 284708864 10942 33554432000 4194304 4623224 140735677253280 18446744073709551615 4468031 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 278036

[startup+12.7004 s]
/proc/loadavg: 7.97 8.01 8.00 9/184 19997
/proc/meminfo: memFree=20682448/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=286124 CPUtime=50.69 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 72291 0 0 0 5057 12 0 0 25 0 4 0 503911959 292990976 16069 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 71531 16069 352 105 0 67035 0
[pid=19992/tid=19994] ppid=19990 vsize=286124 CPUtime=12.61 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 6665 0 0 0 1260 1 0 0 25 0 4 0 503911960 292990976 16069 33554432000 4194304 4623224 140735677253280 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=286124 CPUtime=12.67 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 4869 0 0 0 1267 0 0 0 25 0 4 0 503911960 292990976 16069 33554432000 4194304 4623224 140735677253280 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=286124 CPUtime=12.68 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 54511 0 0 0 1260 8 0 0 25 0 4 0 503911960 292990976 16069 33554432000 4194304 4623224 140735677253280 18446744073709551615 264742388763 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 286124

[startup+25.501 s]
/proc/loadavg: 7.98 8.01 8.00 9/184 19997
/proc/meminfo: memFree=20625416/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=293696 CPUtime=101.81 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 151903 0 0 0 10155 26 0 0 25 0 4 0 503911959 300744704 23313 33554432000 4194304 4623224 140735677253280 18446744073709551615 4366446 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 73424 23313 349 105 0 68928 0
[pid=19992/tid=19994] ppid=19990 vsize=293696 CPUtime=25.34 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 10563 0 0 0 2532 2 0 0 25 0 4 0 503911960 300744704 23313 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=293696 CPUtime=25.48 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 7221 0 0 0 2546 2 0 0 25 0 4 0 503911960 300744704 23313 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=293696 CPUtime=25.48 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 126123 0 0 0 2529 19 0 0 25 0 4 0 503911960 300744704 23313 33554432000 4194304 4623224 140735677253280 18446744073709551615 4550519 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 293696

[startup+51.1012 s]
/proc/loadavg: 7.98 8.00 8.00 9/184 19998
/proc/meminfo: memFree=20522972/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=310856 CPUtime=204.08 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 221766 0 0 0 20370 38 0 0 25 0 4 0 503911959 318316544 36673 33554432000 4194304 4623224 140735677253280 18446744073709551615 4507318 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 77714 36673 344 105 0 73218 0
[pid=19992/tid=19994] ppid=19990 vsize=310856 CPUtime=50.8 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 17095 0 0 0 5076 4 0 0 25 0 4 0 503911960 318316544 36673 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=310856 CPUtime=51.08 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 11383 0 0 0 5105 3 0 0 25 0 4 0 503911960 318316544 36673 33554432000 4194304 4623224 140735677253280 18446744073709551615 4377220 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=310856 CPUtime=51.08 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 182428 0 0 0 5080 28 0 0 25 0 4 0 503911960 318316544 36673 33554432000 4194304 4623224 140735677253280 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 204.08
Current children cumulated vsize (KiB) 310856

[startup+102.306 s]
/proc/loadavg: 8.07 8.03 8.00 9/184 19999
/proc/meminfo: memFree=20323048/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=351244 CPUtime=408.61 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 422232 0 0 0 40789 72 0 0 25 0 4 0 503911959 359673856 60017 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 87811 60017 454 105 0 83315 0
[pid=19992/tid=19994] ppid=19990 vsize=351244 CPUtime=101.72 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 25148 0 0 0 10166 6 0 0 25 0 4 0 503911960 359673856 60018 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=351244 CPUtime=102.28 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 16165 0 0 0 10223 5 0 0 25 0 4 0 503911960 359673856 60018 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=351244 CPUtime=102.28 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 361256 0 0 0 10172 56 0 0 25 0 4 0 503911960 359673856 60018 33554432000 4194304 4623224 140735677253280 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.61
Current children cumulated vsize (KiB) 351244

[startup+162.301 s]
/proc/loadavg: 8.10 8.05 8.01 9/184 20001
/proc/meminfo: memFree=20102060/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=503612 CPUtime=648.27 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 522723 0 0 0 64738 89 0 0 25 0 4 0 503911959 515698688 85186 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 125903 85186 741 105 0 121407 0
[pid=19992/tid=19994] ppid=19990 vsize=503612 CPUtime=161.4 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 36680 0 0 0 16131 9 0 0 25 0 4 0 503911960 515698688 85186 33554432000 4194304 4623224 140735677253280 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=503612 CPUtime=162.28 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 16948 0 0 0 16222 6 0 0 25 0 4 0 503911960 515698688 85186 33554432000 4194304 4623224 140735677253280 18446744073709551615 4377451 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=503612 CPUtime=162.28 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 433170 0 0 0 16160 68 0 0 25 0 4 0 503911960 515698688 85186 33554432000 4194304 4623224 140735677253280 18446744073709551615 4546792 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 648.27
Current children cumulated vsize (KiB) 503612

[startup+222.301 s]
/proc/loadavg: 8.10 8.07 8.01 9/184 20002
/proc/meminfo: memFree=19741308/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=738740 CPUtime=887.93 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 797312 0 0 0 88656 137 0 0 25 0 4 0 503911959 756469760 139986 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 184685 139986 1140 105 0 180189 0
[pid=19992/tid=19994] ppid=19990 vsize=738740 CPUtime=221.06 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 52446 0 0 0 22092 14 0 0 25 0 4 0 503911960 756469760 139986 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=738740 CPUtime=222.28 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 17458 0 0 0 22222 6 0 0 25 0 4 0 503911960 756469760 139986 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=738740 CPUtime=222.28 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 611951 0 0 0 22130 98 0 0 25 0 4 0 503911960 756469760 139986 33554432000 4194304 4623224 140735677253280 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 887.93
Current children cumulated vsize (KiB) 738740

[startup+282.301 s]

################
# More data... #
################

[pid=19992] ppid=19990 vsize=1378640 CPUtime=2805.33 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 3088135 0 0 0 279994 539 0 0 25 0 4 0 503911959 1411727360 269840 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510327 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 344660 269840 1127 105 0 340164 0
[pid=19992/tid=19994] ppid=19990 vsize=1378640 CPUtime=698.46 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 99252 0 0 0 69804 42 0 0 25 0 4 0 503911960 1411727360 269840 33554432000 4194304 4623224 140735677253280 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1378640 CPUtime=702.3 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26170 0 0 0 70220 10 0 0 25 0 4 0 503911960 1411727360 269840 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376634 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1378640 CPUtime=702.29 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 2747019 0 0 0 69776 453 0 0 25 0 4 0 503911960 1411727360 269840 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2805.33
Current children cumulated vsize (KiB) 1378640

[startup+762.307 s]
/proc/loadavg: 8.09 8.09 8.02 9/184 20017
/proc/meminfo: memFree=18013204/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=1378640 CPUtime=3045.02 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 3374271 0 0 0 303912 590 0 0 25 0 4 0 503911959 1411727360 281537 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 344660 281537 1127 105 0 340164 0
[pid=19992/tid=19994] ppid=19990 vsize=1378640 CPUtime=758.14 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 101959 0 0 0 75769 45 0 0 25 0 4 0 503911960 1411727360 281537 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376749 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1378640 CPUtime=762.31 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26254 0 0 0 76221 10 0 0 25 0 4 0 503911960 1411727360 281537 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1378640 CPUtime=762.31 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3027072 0 0 0 75730 501 0 0 25 0 4 0 503911960 1411727360 281537 33554432000 4194304 4623224 140735677253280 18446744073709551615 4363928 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3045.02
Current children cumulated vsize (KiB) 1378640

[startup+822.301 s]
/proc/loadavg: 8.08 8.09 8.02 9/184 20018
/proc/meminfo: memFree=17844288/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=1545948 CPUtime=3284.68 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 3691867 0 0 0 327826 642 0 0 25 0 4 0 503911959 1583050752 304273 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 386487 304274 1194 105 0 381991 0
[pid=19992/tid=19994] ppid=19990 vsize=1545948 CPUtime=817.82 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 104616 0 0 0 81734 48 0 0 25 0 4 0 503911960 1583050752 304274 33554432000 4194304 4623224 140735677253280 18446744073709551615 4278645 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1545948 CPUtime=822.3 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26373 0 0 0 82220 10 0 0 25 0 4 0 503911960 1583050752 304274 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1545948 CPUtime=822.3 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3302079 0 0 0 81685 545 0 0 25 0 4 0 503911960 1583050752 304274 33554432000 4194304 4623224 140735677253280 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3284.68
Current children cumulated vsize (KiB) 1545948

[startup+882.301 s]
/proc/loadavg: 8.02 8.07 8.02 9/184 20020
/proc/meminfo: memFree=17717396/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=1545948 CPUtime=3524.35 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 3973872 0 0 0 351744 691 0 0 25 0 4 0 503911959 1583050752 314972 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 386487 314982 1195 105 0 381991 0
[pid=19992/tid=19994] ppid=19990 vsize=1545948 CPUtime=877.5 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 106706 0 0 0 87699 51 0 0 25 0 4 0 503911960 1583050752 314992 33554432000 4194304 4623224 140735677253280 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1545948 CPUtime=882.3 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26417 0 0 0 88220 10 0 0 25 0 4 0 503911960 1583050752 315008 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1545948 CPUtime=882.3 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3578987 0 0 0 87639 591 0 0 25 0 4 0 503911960 1583050752 315022 33554432000 4194304 4623224 140735677253280 18446744073709551615 264726102135 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3524.35
Current children cumulated vsize (KiB) 1545948

[startup+942.301 s]
/proc/loadavg: 8.05 8.07 8.02 9/184 20023
/proc/meminfo: memFree=17496524/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=1687532 CPUtime=3764.02 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 4084098 0 0 0 375692 710 0 0 25 0 4 0 503911959 1728032768 332025 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 421883 332025 586 105 0 417387 0
[pid=19992/tid=19994] ppid=19990 vsize=1687532 CPUtime=937.17 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 133245 0 0 0 93660 57 0 0 25 0 4 0 503911960 1728032768 332025 33554432000 4194304 4623224 140735677253280 18446744073709551615 4378104 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1687532 CPUtime=942.3 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26450 0 0 0 94220 10 0 0 25 0 4 0 503911960 1728032768 332025 33554432000 4194304 4623224 140735677253280 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1687532 CPUtime=942.3 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3619260 0 0 0 93632 598 0 0 25 0 4 0 503911960 1728032768 332025 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3764.02
Current children cumulated vsize (KiB) 1687532

[startup+1002.3 s]
/proc/loadavg: 8.19 8.12 8.04 9/184 20026
/proc/meminfo: memFree=17380712/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=1717628 CPUtime=4003.7 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 4097582 0 0 0 399655 715 0 0 25 0 4 0 503911959 1758851072 337735 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 429407 337735 477 105 0 424911 0
[pid=19992/tid=19994] ppid=19990 vsize=1717628 CPUtime=996.84 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 143644 0 0 0 99623 61 0 0 25 0 4 0 503911960 1758851072 337735 33554432000 4194304 4623224 140735677253280 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1717628 CPUtime=1002.31 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26628 0 0 0 100221 10 0 0 25 0 4 0 503911960 1758851072 337735 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1717628 CPUtime=1002.3 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3619711 0 0 0 99632 598 0 0 25 0 4 0 503911960 1758851072 337735 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4003.7
Current children cumulated vsize (KiB) 1717628

[startup+1062.3 s]
/proc/loadavg: 8.11 8.11 8.04 9/184 20058
/proc/meminfo: memFree=19612772/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=1728164 CPUtime=4243.38 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 4104950 0 0 0 423618 720 0 0 25 0 4 0 503911959 1769639936 344772 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 432041 344772 439 105 0 427545 0
[pid=19992/tid=19994] ppid=19990 vsize=1728164 CPUtime=1056.52 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 145794 0 0 0 105588 64 0 0 25 0 4 0 503911960 1769639936 344772 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1728164 CPUtime=1062.3 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26728 0 0 0 106220 10 0 0 25 0 4 0 503911960 1769639936 344772 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1728164 CPUtime=1062.3 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3622361 0 0 0 105631 599 0 0 25 0 4 0 503911960 1769639936 344772 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4243.38
Current children cumulated vsize (KiB) 1728164

[startup+1122.3 s]
/proc/loadavg: 8.10 8.12 8.04 9/184 20059
/proc/meminfo: memFree=19409456/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=1815404 CPUtime=4483.05 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 4116305 0 0 0 447580 725 0 0 25 0 4 0 503911959 1858973696 355367 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 453851 355367 416 105 0 449355 0
[pid=19992/tid=19994] ppid=19990 vsize=1815404 CPUtime=1116.2 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 147760 0 0 0 111553 67 0 0 25 0 4 0 503911960 1858973696 355367 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1815404 CPUtime=1122.31 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26733 0 0 0 112221 10 0 0 25 0 4 0 503911960 1858973696 355367 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376643 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1815404 CPUtime=1122.31 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3628105 0 0 0 111630 601 0 0 25 0 4 0 503911960 1858973696 355367 33554432000 4194304 4623224 140735677253280 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4483.05
Current children cumulated vsize (KiB) 1815404

[startup+1182.3 s]
/proc/loadavg: 8.15 8.12 8.05 9/184 20061
/proc/meminfo: memFree=19273892/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=1835936 CPUtime=4722.73 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 4126416 0 0 0 471543 730 0 0 25 0 4 0 503911959 1879998464 364624 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 458984 364624 414 105 0 454488 0
[pid=19992/tid=19994] ppid=19990 vsize=1835936 CPUtime=1175.87 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 149703 0 0 0 117517 70 0 0 25 0 4 0 503911960 1879998464 364624 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1835936 CPUtime=1182.31 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26764 0 0 0 118221 10 0 0 25 0 4 0 503911960 1879998464 364624 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1835936 CPUtime=1182.3 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3633396 0 0 0 117629 601 0 0 25 0 4 0 503911960 1879998464 364624 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4722.73
Current children cumulated vsize (KiB) 1835936



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.11 8.11 8.05 9/184 20061
/proc/meminfo: memFree=19199736/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=1843628 CPUtime=4800.24 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 4129649 0 0 0 479293 731 0 0 25 0 4 0 503911959 1887875072 367771 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 460907 367771 414 105 0 456411 0
[pid=19992/tid=19994] ppid=19990 vsize=1843628 CPUtime=1195.17 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 150273 0 0 0 119446 71 0 0 25 0 4 0 503911960 1887875072 367771 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1843628 CPUtime=1201.72 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26764 0 0 0 120162 10 0 0 25 0 4 0 503911960 1887875072 367771 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1843628 CPUtime=1201.72 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3635379 0 0 0 119570 602 0 0 25 0 4 0 503911960 1887875072 367771 33554432000 4194304 4623224 140735677253280 18446744073709551615 4550467 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 1843628

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.11 8.11 8.05 9/184 20061
/proc/meminfo: memFree=19199736/32951124 swapFree=67111524/67111528
[pid=19992] ppid=19990 vsize=1843628 CPUtime=4800.24 cores=0,2,4,6
/proc/19992/stat : 19992 (SArTagnan) R 19990 19992 19501 0 -1 4202496 4129649 0 0 0 479293 731 0 0 25 0 4 0 503911959 1887875072 367771 33554432000 4194304 4623224 140735677253280 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/19992/statm: 460907 367771 414 105 0 456411 0
[pid=19992/tid=19994] ppid=19990 vsize=1843628 CPUtime=1195.17 cores=0,2,4,6
/proc/19992/task/19994/stat : 19994 (SArTagnan) R 19990 19992 19501 0 -1 4202560 150273 0 0 0 119446 71 0 0 25 0 4 0 503911960 1887875072 367771 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19992/tid=19995] ppid=19990 vsize=1843628 CPUtime=1201.72 cores=0,2,4,6
/proc/19992/task/19995/stat : 19995 (SArTagnan) R 19990 19992 19501 0 -1 4202560 26764 0 0 0 120162 10 0 0 25 0 4 0 503911960 1887875072 367771 33554432000 4194304 4623224 140735677253280 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19992/tid=19996] ppid=19990 vsize=1843628 CPUtime=1201.72 cores=0,2,4,6
/proc/19992/task/19996/stat : 19996 (SArTagnan) R 19990 19992 19501 0 -1 4202560 3635379 0 0 0 119570 602 0 0 25 0 4 0 503911960 1887875072 367771 33554432000 4194304 4623224 140735677253280 18446744073709551615 4550467 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 1843628

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.78
CPU time (s): 4800.34
CPU user time (s): 4792.95
CPU system time (s): 7.38488
CPU usage (%): 399.436
Max. virtual memory (cumulated for all children) (KiB): 1843628

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4792.95
system time used= 7.38488
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4129649
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2268
involuntary context switches= 22431

runsolver used 1.9797 second user time and 4.5733 second system time

The end

Launcher Data

Begin job on node141 at 2011-04-30 00:09:23
IDJOB=3293131
IDBENCH=88045
IDSOLVER=1656
FILE ID=node141/3293131-1304114963
RUNJOBID= node141-1304114804-19845
PBS_JOBID= 13170684
Free space on /tmp= 71424 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT02/industrial/dellacherie/comb/comb1.shuffled.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3293131-1304114963/watcher-3293131-1304114963 -o /tmp/evaluation-result-3293131-1304114963/solver-3293131-1304114963 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3293131-1304114963.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0e9d17eb95ee436fc1015c5591cfb63f
RANDOM SEED=363319224

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20774164 kB
Buffers:       1398836 kB
Cached:        9751288 kB
SwapCached:          4 kB
Active:        3387184 kB
Inactive:      8214372 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20774164 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             780 kB
Writeback:           0 kB
AnonPages:      451224 kB
Mapped:          15336 kB
Slab:           512140 kB
PageTables:       5356 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   666936 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71420 MiB
End job on node141 at 2011-04-30 00:29:27