Trace number 3261344

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.38 1201.75

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-7-12-unsat.cnf
MD5SUM72a4d94c7603cb921acb8c9bb848aa10
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark11.2073
Satisfiable
(Un)Satisfiability was proved
Number of variables84
Number of clauses301
Sum of the clauses size1092
Maximum clause length12
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2252
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 549

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3261344-1304090462/watcher-3261344-1304090462 -o /tmp/evaluation-result-3261344-1304090462/solver-3261344-1304090462 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3261344-1304090462.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.83 8.05 7.99 5/180 19103
/proc/meminfo: memFree=28476848/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=180432 CPUtime=0 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 547 0 0 0 0 0 0 0 25 0 4 0 520646624 184762368 483 33554432000 4194304 4623224 140734323808176 18446744073709551615 253640556752 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 45108 483 340 105 0 40612 0
[pid=19103/tid=19104] ppid=19101 vsize=180432 CPUtime=0 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 25 0 0 0 0 0 0 0 25 0 4 0 520646624 184762368 489 33554432000 4194304 4623224 140734323808176 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=180432 CPUtime=0 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 4 0 520646624 184762368 489 33554432000 4194304 4623224 140734323808176 18446744073709551615 253640964590 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=180432 CPUtime=0 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 28 0 0 0 0 0 0 0 25 0 4 0 520646624 184762368 490 33554432000 4194304 4623224 140734323808176 18446744073709551615 253656843291 0 0 4096 2 0 0 0 -1 0 0 0 0

[startup+0.046653 s]
/proc/loadavg: 7.83 8.05 7.99 5/180 19103
/proc/meminfo: memFree=28476848/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=247140 CPUtime=0.16 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) D 19101 19103 18837 0 -1 4202496 1225 0 0 0 16 0 0 0 25 0 4 0 520646624 253071360 1021 33554432000 4194304 4623224 140734323808176 18446744073709551615 253640556752 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 61785 1021 343 105 0 57289 0
[pid=19103/tid=19104] ppid=19101 vsize=247140 CPUtime=0.04 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 206 0 0 0 4 0 0 0 25 0 4 0 520646624 253071360 1021 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376829 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=247140 CPUtime=0.03 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 270 0 0 0 3 0 0 0 25 0 4 0 520646624 253071360 1021 33554432000 4194304 4623224 140734323808176 18446744073709551615 253640902839 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=247140 CPUtime=0.04 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 143 0 0 0 4 0 0 0 25 0 4 0 520646624 253071360 1021 33554432000 4194304 4623224 140734323808176 18446744073709551615 4550481 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 247140

[startup+0.106418 s]
/proc/loadavg: 7.83 8.05 7.99 5/180 19103
/proc/meminfo: memFree=28476848/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=247768 CPUtime=0.4 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 2021 0 0 0 40 0 0 0 25 0 4 0 520646624 253714432 1453 33554432000 4194304 4623224 140734323808176 18446744073709551615 4424576 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 61942 1453 343 105 0 57446 0
[pid=19103/tid=19104] ppid=19101 vsize=247768 CPUtime=0.1 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 442 0 0 0 10 0 0 0 25 0 4 0 520646624 253714432 1453 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376993 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=247768 CPUtime=0.09 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 616 0 0 0 9 0 0 0 25 0 4 0 520646624 253714432 1453 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376749 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=247768 CPUtime=0.1 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 286 0 0 0 10 0 0 0 25 0 4 0 520646624 253714432 1453 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376853 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 247768

[startup+0.300385 s]
/proc/loadavg: 7.83 8.05 7.99 5/180 19103
/proc/meminfo: memFree=28476848/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=249952 CPUtime=1.18 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 3789 0 0 0 118 0 0 0 25 0 4 0 520646624 255950848 2691 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510066 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 62488 2691 343 105 0 57992 0
[pid=19103/tid=19104] ppid=19101 vsize=249952 CPUtime=0.29 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 1116 0 0 0 29 0 0 0 25 0 4 0 520646624 255950848 2691 33554432000 4194304 4623224 140734323808176 18446744073709551615 4377608 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=249952 CPUtime=0.29 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 1143 0 0 0 29 0 0 0 25 0 4 0 520646624 255950848 2691 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=249952 CPUtime=0.29 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 574 0 0 0 29 0 0 0 25 0 4 0 520646624 255950848 2691 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.18
Current children cumulated vsize (KiB) 249952

[startup+0.700313 s]
/proc/loadavg: 7.83 8.05 7.99 5/180 19103
/proc/meminfo: memFree=28476848/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=253232 CPUtime=2.77 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 6886 0 0 0 277 0 0 0 25 0 4 0 520646624 259309568 4301 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510127 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 63308 4301 344 105 0 58812 0
[pid=19103/tid=19104] ppid=19101 vsize=253232 CPUtime=0.69 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 2315 0 0 0 69 0 0 0 25 0 4 0 520646624 259309568 4301 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376895 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=253232 CPUtime=0.69 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 2320 0 0 0 69 0 0 0 25 0 4 0 520646624 259309568 4301 33554432000 4194304 4623224 140734323808176 18446744073709551615 4377613 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=253232 CPUtime=0.69 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 1086 0 0 0 69 0 0 0 25 0 4 0 520646624 259309568 4301 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376850 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 253232

[startup+1.50116 s]
/proc/loadavg: 7.83 8.05 7.99 9/184 19107
/proc/meminfo: memFree=28454892/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=259640 CPUtime=5.97 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 13675 0 0 0 596 1 0 0 25 0 4 0 520646624 265871360 6868 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510939 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 64910 6868 345 105 0 60414 0
[pid=19103/tid=19104] ppid=19101 vsize=259640 CPUtime=1.49 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 3703 0 0 0 149 0 0 0 25 0 4 0 520646624 265871360 6868 33554432000 4194304 4623224 140734323808176 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=259640 CPUtime=1.48 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 4882 0 0 0 148 0 0 0 25 0 4 0 520646624 265871360 6881 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376846 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=259640 CPUtime=1.49 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 3379 0 0 0 149 0 0 0 25 0 4 0 520646624 265871360 6892 33554432000 4194304 4623224 140734323808176 18446744073709551615 4577678 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 259640

[startup+3.10087 s]
/proc/loadavg: 7.83 8.05 7.99 9/184 19107
/proc/meminfo: memFree=28440996/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=267120 CPUtime=12.37 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 19471 0 0 0 1234 3 0 0 25 0 4 0 520646624 273530880 10228 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510302 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 66780 10228 353 105 0 62284 0
[pid=19103/tid=19104] ppid=19101 vsize=267120 CPUtime=3.09 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 5976 0 0 0 308 1 0 0 25 0 4 0 520646624 273530880 10228 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=267120 CPUtime=3.07 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 5336 0 0 0 307 0 0 0 25 0 4 0 520646624 273530880 10228 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=267120 CPUtime=3.08 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 5733 0 0 0 308 0 0 0 25 0 4 0 520646624 273530880 10228 33554432000 4194304 4623224 140734323808176 18446744073709551615 4550432 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.37
Current children cumulated vsize (KiB) 267120

[startup+6.30029 s]
/proc/loadavg: 7.84 8.05 7.99 9/184 19107
/proc/meminfo: memFree=28430688/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=285656 CPUtime=25.15 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 37375 0 0 0 2510 5 0 0 25 0 4 0 520646624 292511744 17085 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510302 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 71414 17085 361 105 0 66918 0
[pid=19103/tid=19104] ppid=19101 vsize=285656 CPUtime=6.29 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 11983 0 0 0 627 2 0 0 25 0 4 0 520646624 292511744 17085 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376844 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=285656 CPUtime=6.26 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 11114 0 0 0 625 1 0 0 25 0 4 0 520646624 292511744 17085 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=285656 CPUtime=6.29 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 10754 0 0 0 628 1 0 0 25 0 4 0 520646624 292511744 17085 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.15
Current children cumulated vsize (KiB) 285656

[startup+12.7011 s]
/proc/loadavg: 7.53 7.98 7.97 9/184 19138
/proc/meminfo: memFree=30228680/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=301528 CPUtime=50.72 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 53266 0 0 0 5059 13 0 0 25 0 4 0 520646624 308764672 24502 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 75382 24502 347 105 0 70886 0
[pid=19103/tid=19104] ppid=19101 vsize=301528 CPUtime=12.69 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 18236 0 0 0 1262 7 0 0 25 0 4 0 520646624 308764672 24502 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=301528 CPUtime=12.63 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 17971 0 0 0 1259 4 0 0 25 0 4 0 520646624 308764672 24502 33554432000 4194304 4623224 140734323808176 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=301528 CPUtime=12.69 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 12680 0 0 0 1268 1 0 0 25 0 4 0 520646624 308764672 24502 33554432000 4194304 4623224 140734323808176 18446744073709551615 4550432 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.72
Current children cumulated vsize (KiB) 301528

[startup+25.5008 s]
/proc/loadavg: 7.64 7.98 7.97 9/184 19138
/proc/meminfo: memFree=30051096/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=318596 CPUtime=101.86 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 124334 0 0 0 10161 25 0 0 25 0 4 0 520646624 326242304 35479 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 79649 35479 439 105 0 75153 0
[pid=19103/tid=19104] ppid=19101 vsize=318596 CPUtime=25.49 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 21868 0 0 0 2541 8 0 0 25 0 4 0 520646624 326242304 35479 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=318596 CPUtime=25.36 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 26154 0 0 0 2531 5 0 0 25 0 4 0 520646624 326242304 35479 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=318596 CPUtime=25.48 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 70854 0 0 0 2539 9 0 0 25 0 4 0 520646624 326242304 35479 33554432000 4194304 4623224 140734323808176 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.86
Current children cumulated vsize (KiB) 318596

[startup+51.1011 s]
/proc/loadavg: 7.83 8.00 7.98 9/184 19139
/proc/meminfo: memFree=29870044/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=356584 CPUtime=204.14 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 239645 0 0 0 20370 44 0 0 25 0 4 0 520646624 365142016 52071 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 89146 52071 514 105 0 84650 0
[pid=19103/tid=19104] ppid=19101 vsize=356584 CPUtime=51.09 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 30723 0 0 0 5099 10 0 0 25 0 4 0 520646624 365142016 52071 33554432000 4194304 4623224 140734323808176 18446744073709551615 4366336 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=356584 CPUtime=50.84 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 39747 0 0 0 5076 8 0 0 25 0 4 0 520646624 365142016 52071 33554432000 4194304 4623224 140734323808176 18446744073709551615 4292404 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=356584 CPUtime=51.09 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 160970 0 0 0 5086 23 0 0 25 0 4 0 520646624 365142016 52071 33554432000 4194304 4623224 140734323808176 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 204.14
Current children cumulated vsize (KiB) 356584

[startup+102.307 s]
/proc/loadavg: 8.00 8.01 7.98 9/184 19140
/proc/meminfo: memFree=29544896/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=439204 CPUtime=408.68 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 360402 0 0 0 40803 65 0 0 25 0 4 0 520646624 449744896 77485 33554432000 4194304 4623224 140734323808176 18446744073709551615 4517563 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 109801 77485 663 105 0 105305 0
[pid=19103/tid=19104] ppid=19101 vsize=439204 CPUtime=102.3 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 47297 0 0 0 10215 15 0 0 25 0 4 0 520646624 449744896 77485 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=439204 CPUtime=101.78 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 58282 0 0 0 10166 12 0 0 25 0 4 0 520646624 449744896 77485 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=439204 CPUtime=102.29 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 236245 0 0 0 10195 34 0 0 25 0 4 0 520646624 449744896 77485 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.68
Current children cumulated vsize (KiB) 439204

[startup+162.301 s]

################
# More data... #
################

[pid=19103] ppid=19101 vsize=1085960 CPUtime=2805.42 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 2392004 0 0 0 280168 374 0 0 25 0 4 0 520646624 1112023040 206912 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 271490 206912 435 105 0 266994 0
[pid=19103/tid=19104] ppid=19101 vsize=1085960 CPUtime=702.31 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 148252 0 0 0 70188 43 0 0 25 0 4 0 520646624 1112023040 206912 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1085960 CPUtime=698.55 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 140972 0 0 0 69823 32 0 0 25 0 4 0 520646624 1112023040 206912 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1085960 CPUtime=702.3 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 2009335 0 0 0 69946 284 0 0 25 0 4 0 520646624 1112023040 206912 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2805.42
Current children cumulated vsize (KiB) 1085960

[startup+762.306 s]
/proc/loadavg: 8.03 8.05 8.00 9/184 19158
/proc/meminfo: memFree=27658464/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=1130612 CPUtime=3045.1 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 2700645 0 0 0 304092 418 0 0 25 0 4 0 520646624 1157746688 217263 33554432000 4194304 4623224 140734323808176 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 282653 217263 456 105 0 278157 0
[pid=19103/tid=19104] ppid=19101 vsize=1130612 CPUtime=762.32 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 150828 0 0 0 76187 45 0 0 25 0 4 0 520646624 1157746688 217263 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1130612 CPUtime=758.22 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 143092 0 0 0 75789 33 0 0 25 0 4 0 520646624 1157746688 217263 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1130612 CPUtime=762.31 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 2291049 0 0 0 75908 323 0 0 25 0 4 0 520646624 1157746688 217263 33554432000 4194304 4623224 140734323808176 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3045.1
Current children cumulated vsize (KiB) 1130612

[startup+822.301 s]
/proc/loadavg: 8.01 8.04 8.00 9/184 19160
/proc/meminfo: memFree=27555412/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=1136156 CPUtime=3284.76 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 2999114 0 0 0 328012 464 0 0 25 0 4 0 520646624 1163423744 227987 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 284039 227987 459 105 0 279543 0
[pid=19103/tid=19104] ppid=19101 vsize=1136156 CPUtime=822.32 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 154283 0 0 0 82185 47 0 0 25 0 4 0 520646624 1163423744 227987 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1136156 CPUtime=817.9 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 148112 0 0 0 81755 35 0 0 25 0 4 0 520646624 1163423744 227987 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1136156 CPUtime=822.3 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 2580315 0 0 0 81865 365 0 0 25 0 4 0 520646624 1163423744 227987 33554432000 4194304 4623224 140734323808176 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3284.76
Current children cumulated vsize (KiB) 1136156

[startup+882.3 s]
/proc/loadavg: 8.15 8.07 8.01 9/184 19161
/proc/meminfo: memFree=27509632/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=1187040 CPUtime=3524.42 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 3280404 0 0 0 351938 504 0 0 25 0 4 0 520646624 1215528960 235625 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 296760 235625 442 105 0 292264 0
[pid=19103/tid=19104] ppid=19101 vsize=1187040 CPUtime=882.32 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 161739 0 0 0 88184 48 0 0 25 0 4 0 520646624 1215528960 235625 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1187040 CPUtime=877.57 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 152949 0 0 0 87720 37 0 0 25 0 4 0 520646624 1215528960 235625 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1187040 CPUtime=882.3 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 2848991 0 0 0 87828 402 0 0 25 0 4 0 520646624 1215528960 235625 33554432000 4194304 4623224 140734323808176 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3524.42
Current children cumulated vsize (KiB) 1187040

[startup+942.3 s]
/proc/loadavg: 8.24 8.10 8.02 9/184 19163
/proc/meminfo: memFree=27472172/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=1194168 CPUtime=3764.11 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 3577870 0 0 0 375864 547 0 0 25 0 4 0 520646624 1222828032 239728 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 298542 239728 416 105 0 294046 0
[pid=19103/tid=19104] ppid=19101 vsize=1194168 CPUtime=942.32 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 164760 0 0 0 94183 49 0 0 25 0 4 0 520646624 1222828032 239728 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1194168 CPUtime=937.25 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 153052 0 0 0 93688 37 0 0 25 0 4 0 520646624 1222828032 239728 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1194168 CPUtime=942.3 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 3143333 0 0 0 93787 443 0 0 25 0 4 0 520646624 1222828032 239728 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3764.11
Current children cumulated vsize (KiB) 1194168

[startup+1002.3 s]
/proc/loadavg: 8.23 8.11 8.03 9/184 19164
/proc/meminfo: memFree=27444868/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=1202088 CPUtime=4003.77 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 3850666 0 0 0 399791 586 0 0 25 0 4 0 520646624 1230938112 244045 33554432000 4194304 4623224 140734323808176 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 300522 244045 383 105 0 296026 0
[pid=19103/tid=19104] ppid=19101 vsize=1202088 CPUtime=1002.31 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 167426 0 0 0 100181 50 0 0 25 0 4 0 520646624 1230938112 244045 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1202088 CPUtime=996.93 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 154076 0 0 0 99655 38 0 0 25 0 4 0 520646624 1230938112 244045 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1202088 CPUtime=1002.31 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 3412439 0 0 0 99750 481 0 0 25 0 4 0 520646624 1230938112 244045 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4003.77
Current children cumulated vsize (KiB) 1202088

[startup+1062.3 s]
/proc/loadavg: 8.15 8.11 8.03 9/184 19166
/proc/meminfo: memFree=27411616/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=1213904 CPUtime=4243.45 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 4116230 0 0 0 423725 620 0 0 25 0 4 0 520646624 1243037696 249005 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 303476 249005 363 105 0 298980 0
[pid=19103/tid=19104] ppid=19101 vsize=1213904 CPUtime=1062.31 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 169629 0 0 0 106180 51 0 0 25 0 4 0 520646624 1243037696 249005 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1213904 CPUtime=1056.6 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 155207 0 0 0 105622 38 0 0 25 0 4 0 520646624 1243037696 249005 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1213904 CPUtime=1062.32 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 3674669 0 0 0 105718 514 0 0 25 0 4 0 520646624 1243037696 249005 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4243.45
Current children cumulated vsize (KiB) 1213904

[startup+1122.3 s]
/proc/loadavg: 8.18 8.12 8.03 9/184 19168
/proc/meminfo: memFree=27354180/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=1382136 CPUtime=4483.11 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 4473750 0 0 0 447640 671 0 0 25 0 4 0 520646624 1415307264 261152 33554432000 4194304 4623224 140734323808176 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 345534 261152 407 105 0 341038 0
[pid=19103/tid=19104] ppid=19101 vsize=1382136 CPUtime=1122.31 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 170544 0 0 0 112179 52 0 0 25 0 4 0 520646624 1415307264 261152 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1382136 CPUtime=1116.28 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 208782 0 0 0 111583 45 0 0 25 0 4 0 520646624 1415307264 261152 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1382136 CPUtime=1122.32 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 3977699 0 0 0 111674 558 0 0 25 0 4 0 520646624 1415307264 261152 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4483.11
Current children cumulated vsize (KiB) 1382136

[startup+1182.3 s]
/proc/loadavg: 8.18 8.12 8.04 9/184 19169
/proc/meminfo: memFree=27322156/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=1398208 CPUtime=4722.8 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 4668260 0 0 0 471577 703 0 0 25 0 4 0 520646624 1431764992 265927 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 349552 265927 360 105 0 345056 0
[pid=19103/tid=19104] ppid=19101 vsize=1398208 CPUtime=1182.31 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 171252 0 0 0 118179 52 0 0 25 0 4 0 520646624 1431764992 265927 33554432000 4194304 4623224 140734323808176 18446744073709551615 4292200 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1398208 CPUtime=1175.95 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 209952 0 0 0 117550 45 0 0 25 0 4 0 520646624 1431764992 265927 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1398208 CPUtime=1182.32 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 4033245 0 0 0 117667 565 0 0 25 0 4 0 520646624 1431764992 265927 33554432000 4194304 4623224 140734323808176 18446744073709551615 4366341 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4722.8
Current children cumulated vsize (KiB) 1398208



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.13 8.12 8.03 10/184 19170
/proc/meminfo: memFree=27305160/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=1398208 CPUtime=4800.3 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 4733501 0 0 0 479316 714 0 0 25 0 4 0 520646624 1431764992 267972 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 349552 267972 360 105 0 345056 0
[pid=19103/tid=19104] ppid=19101 vsize=1398208 CPUtime=1201.73 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 172432 0 0 0 120120 53 0 0 25 0 4 0 520646624 1431764992 267972 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1398208 CPUtime=1195.25 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 210243 0 0 0 119479 46 0 0 25 0 4 0 520646624 1431764992 267972 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1398208 CPUtime=1201.72 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 4033610 0 0 0 119607 565 0 0 25 0 4 0 520646624 1431764992 267972 33554432000 4194304 4623224 140734323808176 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 1398208

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.13 8.12 8.03 10/184 19170
/proc/meminfo: memFree=27305160/32951124 swapFree=67111364/67111528
[pid=19103] ppid=19101 vsize=1398208 CPUtime=4800.3 cores=0,2,4,6
/proc/19103/stat : 19103 (SArTagnan) R 19101 19103 18837 0 -1 4202496 4733501 0 0 0 479316 714 0 0 25 0 4 0 520646624 1431764992 267972 33554432000 4194304 4623224 140734323808176 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/19103/statm: 349552 267972 360 105 0 345056 0
[pid=19103/tid=19104] ppid=19101 vsize=1398208 CPUtime=1201.73 cores=0,2,4,6
/proc/19103/task/19104/stat : 19104 (SArTagnan) R 19101 19103 18837 0 -1 4202560 172432 0 0 0 120120 53 0 0 25 0 4 0 520646624 1431764992 267972 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19103/tid=19105] ppid=19101 vsize=1398208 CPUtime=1195.25 cores=0,2,4,6
/proc/19103/task/19105/stat : 19105 (SArTagnan) R 19101 19103 18837 0 -1 4202560 210243 0 0 0 119479 46 0 0 25 0 4 0 520646624 1431764992 267972 33554432000 4194304 4623224 140734323808176 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=19103/tid=19106] ppid=19101 vsize=1398208 CPUtime=1201.72 cores=0,2,4,6
/proc/19103/task/19106/stat : 19106 (SArTagnan) R 19101 19103 18837 0 -1 4202560 4033610 0 0 0 119607 565 0 0 25 0 4 0 520646624 1431764992 267972 33554432000 4194304 4623224 140734323808176 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 1398208

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.75
CPU time (s): 4800.38
CPU user time (s): 4793.19
CPU system time (s): 7.18491
CPU usage (%): 399.447
Max. virtual memory (cumulated for all children) (KiB): 1567356

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4793.19
system time used= 7.18491
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4733501
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 386
involuntary context switches= 20840

runsolver used 1.9947 second user time and 4.49032 second system time

The end

Launcher Data 

Begin job on node106 at 2011-04-29 17:21:02
IDJOB=3261344
IDBENCH=83222
IDSOLVER=1656
FILE ID=node106/3261344-1304090462
RUNJOBID= node106-1304089256-18855
PBS_JOBID= 13170570
Free space on /tmp= 72156 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-7-12-unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3261344-1304090462/watcher-3261344-1304090462 -o /tmp/evaluation-result-3261344-1304090462/solver-3261344-1304090462 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3261344-1304090462.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 72a4d94c7603cb921acb8c9bb848aa10
RANDOM SEED=1057091402

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28477128 kB
Buffers:        248892 kB
Cached:        2068484 kB
SwapCached:         88 kB
Active:        2660340 kB
Inactive:      1599852 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28477128 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:             432 kB
Writeback:           0 kB
AnonPages:     1942372 kB
Mapped:          15460 kB
Slab:           146212 kB
PageTables:       8564 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  2408192 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72160 MiB
End job on node106 at 2011-04-29 17:41:06