Trace number 3439266

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.5 5004.01

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_15_90_1-log.shuffled-as.sat03-137.cnf
MD5SUM808fa775df860c59a1178e77fc60f410
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3885.47
Satisfiable
(Un)Satisfiability was proved
Number of variables75
Number of clauses25452
Sum of the clauses size254370
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530
Number of clauses of size over 525422

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439266-1307666407/watcher-3439266-1307666407 -o /tmp/evaluation-result-3439266-1307666407/solver-3439266-1307666407 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439266-1307666407.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 1/170 14189
/proc/meminfo: memFree=32610312/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=6356 CPUtime=0 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) S 14187 14189 14159 0 -1 4194304 93 0 0 0 0 0 0 0 25 0 1 0 878237750 6508544 47 33554432000 4194304 4625164 140737359589280 18446744073709551615 239471771271 0 2147483391 4096 0 18446744071699207358 0 0 17 6 0 0 0
/proc/14189/statm: 1589 47 37 106 0 44 0

[startup+0.0895139 s]
/proc/loadavg: 2.00 2.00 2.00 1/170 14189
/proc/meminfo: memFree=32610312/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=311660 CPUtime=0.26 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 7240 0 1 0 26 0 0 0 17 0 8 0 878237750 319139840 6087 33554432000 4194304 4625164 140737359589280 18446744073709551615 4513489 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 77915 6087 388 106 0 73418 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 311660

[startup+0.123882 s]
/proc/loadavg: 2.00 2.00 2.00 1/170 14189
/proc/meminfo: memFree=32610312/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=313696 CPUtime=0.51 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 9059 0 1 0 50 1 0 0 18 0 8 0 878237750 321224704 6428 33554432000 4194304 4625164 140737359589280 18446744073709551615 4393068 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 78096 6429 364 106 0 73599 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 313696

[startup+0.300908 s]
/proc/loadavg: 2.00 2.00 2.00 1/170 14189
/proc/meminfo: memFree=32610312/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=318584 CPUtime=1.91 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 14384 0 1 0 189 2 0 0 18 0 8 0 878237750 326230016 8636 33554432000 4194304 4625164 140737359589280 18446744073709551615 4512857 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 79646 8636 352 106 0 75149 0
Current children cumulated CPU time (s) 1.91
Current children cumulated vsize (KiB) 318584

[startup+0.700832 s]
/proc/loadavg: 2.00 2.00 2.00 1/170 14189
/proc/meminfo: memFree=32610312/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=325624 CPUtime=5.11 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 22729 0 1 0 508 3 0 0 18 0 8 0 878237750 333438976 12010 33554432000 4194304 4625164 140737359589280 18446744073709551615 4512857 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 81406 12010 346 106 0 76909 0
Current children cumulated CPU time (s) 5.11
Current children cumulated vsize (KiB) 325624

[startup+1.50068 s]
/proc/loadavg: 2.00 2.00 2.00 9/178 14197
/proc/meminfo: memFree=32556512/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=339320 CPUtime=11.49 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 37644 0 1 0 1145 4 0 0 20 0 8 0 878237750 347463680 16813 33554432000 4194304 4625164 140737359589280 18446744073709551615 4512326 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 84830 16813 346 106 0 80333 0
[pid=14189/tid=14191] ppid=14187 vsize=339320 CPUtime=1.44 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 2901 0 0 0 144 0 0 0 20 0 8 0 878237754 347463680 16813 33554432000 4194304 4625164 140737359589280 18446744073709551615 4288628 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=339320 CPUtime=1.36 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 2660 0 0 0 136 0 0 0 25 0 8 0 878237754 347463680 16813 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=339320 CPUtime=1.41 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 13592 0 0 0 140 1 0 0 25 0 8 0 878237754 347463680 16813 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=339320 CPUtime=1.42 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 2906 0 0 0 142 0 0 0 20 0 8 0 878237754 347463680 16813 33554432000 4194304 4625164 140737359589280 18446744073709551615 4353820 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=339320 CPUtime=1.44 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 2246 0 0 0 144 0 0 0 25 0 8 0 878237754 347463680 16813 33554432000 4194304 4625164 140737359589280 18446744073709551615 4349173 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=339320 CPUtime=1.44 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 2921 0 0 0 144 0 0 0 25 0 8 0 878237754 347463680 16813 33554432000 4194304 4625164 140737359589280 18446744073709551615 4340144 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=339320 CPUtime=1.44 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 2960 0 0 0 144 0 0 0 20 0 8 0 878237755 347463680 16813 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351989 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.49
Current children cumulated vsize (KiB) 339320

[startup+3.10037 s]
/proc/loadavg: 2.48 2.10 2.03 9/178 14197
/proc/meminfo: memFree=32532456/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=348012 CPUtime=24.29 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 64180 0 1 0 2420 9 0 0 24 0 8 0 878237750 356364288 23002 33554432000 4194304 4625164 140737359589280 18446744073709551615 4329208 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 87003 23013 345 106 0 82506 0
[pid=14189/tid=14191] ppid=14187 vsize=348012 CPUtime=3.04 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 4659 0 0 0 304 0 0 0 25 0 8 0 878237754 356364288 23019 33554432000 4194304 4625164 140737359589280 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=348012 CPUtime=2.96 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 4173 0 0 0 296 0 0 0 25 0 8 0 878237754 356364288 23026 33554432000 4194304 4625164 140737359589280 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=348012 CPUtime=3 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 29190 0 0 0 297 3 0 0 25 0 8 0 878237754 356364288 23033 33554432000 4194304 4625164 140737359589280 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=348012 CPUtime=3.01 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 4547 0 0 0 301 0 0 0 25 0 8 0 878237754 356364288 23039 33554432000 4194304 4625164 140737359589280 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=348012 CPUtime=3.04 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 3811 0 0 0 304 0 0 0 25 0 8 0 878237754 356364288 23046 33554432000 4194304 4625164 140737359589280 18446744073709551615 4349210 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=348012 CPUtime=3.04 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 4700 0 0 0 304 0 0 0 25 0 8 0 878237754 356364288 23053 33554432000 4194304 4625164 140737359589280 18446744073709551615 4352859 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=348012 CPUtime=3.04 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 4562 0 0 0 304 0 0 0 25 0 8 0 878237755 356364288 23057 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.29
Current children cumulated vsize (KiB) 348012

[startup+6.30076 s]
/proc/loadavg: 2.48 2.10 2.03 9/178 14197
/proc/meminfo: memFree=32484164/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=374412 CPUtime=49.87 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 100753 0 1 0 4973 14 0 0 25 0 8 0 878237750 383397888 35193 33554432000 4194304 4625164 140737359589280 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 93603 35193 389 106 0 89106 0
[pid=14189/tid=14191] ppid=14187 vsize=374412 CPUtime=6.24 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 7499 0 0 0 624 0 0 0 25 0 8 0 878237754 383397888 35193 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=374412 CPUtime=6.16 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 4983 0 0 0 615 1 0 0 25 0 8 0 878237754 383397888 35193 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=374412 CPUtime=6.19 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 50034 0 0 0 612 7 0 0 25 0 8 0 878237754 383397888 35193 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=374412 CPUtime=6.22 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 7406 0 0 0 621 1 0 0 25 0 8 0 878237754 383397888 35193 33554432000 4194304 4625164 140737359589280 18446744073709551615 4288653 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=374412 CPUtime=6.24 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 6900 0 0 0 624 0 0 0 25 0 8 0 878237754 383397888 35193 33554432000 4194304 4625164 140737359589280 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=374412 CPUtime=6.24 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 7930 0 0 0 623 1 0 0 25 0 8 0 878237754 383397888 35193 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=374412 CPUtime=6.24 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 7075 0 0 0 624 0 0 0 25 0 8 0 878237755 383397888 35193 33554432000 4194304 4625164 140737359589280 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.87
Current children cumulated vsize (KiB) 374412

[startup+12.7005 s]
/proc/loadavg: 3.33 2.29 2.10 9/178 14197
/proc/meminfo: memFree=32420636/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=413236 CPUtime=101.03 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 157916 0 1 0 10079 24 0 0 25 0 8 0 878237750 423153664 49628 33554432000 4194304 4625164 140737359589280 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 103309 49628 347 106 0 98812 0
[pid=14189/tid=14191] ppid=14187 vsize=413236 CPUtime=12.64 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 11495 0 0 0 1263 1 0 0 25 0 8 0 878237754 423153664 49628 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351786 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=413236 CPUtime=12.56 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 7545 0 0 0 1255 1 0 0 25 0 8 0 878237754 423153664 49628 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=413236 CPUtime=12.55 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 84012 0 0 0 1243 12 0 0 25 0 8 0 878237754 423153664 49628 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=413236 CPUtime=12.61 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 11516 0 0 0 1260 1 0 0 25 0 8 0 878237754 423153664 49628 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=413236 CPUtime=12.64 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 11380 0 0 0 1263 1 0 0 25 0 8 0 878237754 423153664 49628 33554432000 4194304 4625164 140737359589280 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=413236 CPUtime=12.64 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 11788 0 0 0 1263 1 0 0 25 0 8 0 878237754 423153664 49628 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=413236 CPUtime=12.64 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 11045 0 0 0 1263 1 0 0 25 0 8 0 878237755 423153664 49628 33554432000 4194304 4625164 140737359589280 18446744073709551615 4352027 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.03
Current children cumulated vsize (KiB) 413236

[startup+25.5011 s]
/proc/loadavg: 4.12 2.50 2.16 9/178 14198
/proc/meminfo: memFree=32305440/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=518568 CPUtime=203.36 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 281604 0 1 0 20293 43 0 0 25 0 8 0 878237750 531013632 77847 33554432000 4194304 4625164 140737359589280 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 129642 77847 378 106 0 125145 0
[pid=14189/tid=14191] ppid=14187 vsize=518568 CPUtime=25.44 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 19177 0 0 0 2542 2 0 0 25 0 8 0 878237754 531013632 77847 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=518568 CPUtime=25.36 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 11376 0 0 0 2534 2 0 0 25 0 8 0 878237754 531013632 77847 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=518568 CPUtime=25.28 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 147200 0 0 0 2506 22 0 0 25 0 8 0 878237754 531013632 77847 33554432000 4194304 4625164 140737359589280 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=518568 CPUtime=25.42 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 26163 0 0 0 2538 4 0 0 25 0 8 0 878237754 531013632 77847 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=518568 CPUtime=25.44 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 17403 0 0 0 2541 3 0 0 25 0 8 0 878237754 531013632 77847 33554432000 4194304 4625164 140737359589280 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=518568 CPUtime=25.44 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 25376 0 0 0 2541 3 0 0 25 0 8 0 878237754 531013632 77847 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=518568 CPUtime=25.44 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 25406 0 0 0 2541 3 0 0 25 0 8 0 878237755 531013632 77847 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.36
Current children cumulated vsize (KiB) 518568

[startup+51.1012 s]
/proc/loadavg: 5.44 2.94 2.32 9/178 14198
/proc/meminfo: memFree=32166208/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=651224 CPUtime=408.02 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 444088 0 1 0 40732 70 0 0 25 0 8 0 878237750 666853376 112259 33554432000 4194304 4625164 140737359589280 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 162806 112259 455 106 0 158309 0
[pid=14189/tid=14191] ppid=14187 vsize=651224 CPUtime=51.04 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 29139 0 0 0 5100 4 0 0 25 0 8 0 878237754 666853376 112259 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=651224 CPUtime=50.96 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 11982 0 0 0 5094 2 0 0 25 0 8 0 878237754 666853376 112259 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=651224 CPUtime=50.74 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 279562 0 0 0 5033 41 0 0 25 0 8 0 878237754 666853376 112259 33554432000 4194304 4625164 140737359589280 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=651224 CPUtime=51.02 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 29605 0 0 0 5097 5 0 0 25 0 8 0 878237754 666853376 112259 33554432000 4194304 4625164 140737359589280 18446744073709551615 4462650 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=651224 CPUtime=51.05 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 27076 0 0 0 5100 5 0 0 25 0 8 0 878237754 666853376 112259 33554432000 4194304 4625164 140737359589280 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=651224 CPUtime=51.04 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 28097 0 0 0 5100 4 0 0 25 0 8 0 878237754 666853376 112259 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=651224 CPUtime=51.04 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 28201 0 0 0 5100 4 0 0 25 0 8 0 878237755 666853376 112259 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.02

################
# More data... #
################

Current children cumulated vsize (KiB) 5353268

[startup+4722.31 s]
/proc/loadavg: 8.06 8.06 7.99 9/178 14335
/proc/meminfo: memFree=28356920/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=5355676 CPUtime=37751.6 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 21292362 0 1 0 3771767 3396 0 0 25 0 8 0 878237750 5484212224 1061058 33554432000 4194304 4625164 140737359589280 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 1338919 1061058 347 106 0 1334422 0
[pid=14189/tid=14191] ppid=14187 vsize=5355676 CPUtime=4722.3 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 344243 0 0 0 472164 66 0 0 25 0 8 0 878237754 5484212224 1061058 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=5355676 CPUtime=4721.95 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 104417 0 0 0 472173 22 0 0 25 0 8 0 878237754 5484212224 1061058 33554432000 4194304 4625164 140737359589280 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=5355676 CPUtime=4715.02 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 16301137 0 0 0 468965 2537 0 0 25 0 8 0 878237754 5484212224 1061058 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=5355676 CPUtime=4721.78 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 347363 0 0 0 472119 59 0 0 25 0 8 0 878237754 5484212224 1061058 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=5355676 CPUtime=4722.42 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 338534 0 0 0 472178 64 0 0 25 0 8 0 878237754 5484212224 1061058 33554432000 4194304 4625164 140737359589280 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=5355676 CPUtime=4711.9 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 67781 0 0 0 471147 43 0 0 25 0 8 0 878237754 5484212224 1061058 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=5355676 CPUtime=4714.23 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 344041 0 0 0 471358 65 0 0 25 0 8 0 878237755 5484212224 1061058 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37751.6
Current children cumulated vsize (KiB) 5355676

[startup+4782.3 s]
/proc/loadavg: 8.02 8.05 7.99 9/178 14337
/proc/meminfo: memFree=28289180/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=5359424 CPUtime=38231.3 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 21592652 0 1 0 3819686 3440 0 0 25 0 8 0 878237750 5488050176 1077808 33554432000 4194304 4625164 140737359589280 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 1339856 1077808 347 106 0 1335359 0
[pid=14189/tid=14191] ppid=14187 vsize=5359424 CPUtime=4782.29 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 344385 0 0 0 478163 66 0 0 25 0 8 0 878237754 5488050176 1077808 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=5359424 CPUtime=4781.95 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 104459 0 0 0 478173 22 0 0 25 0 8 0 878237754 5488050176 1077808 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=5359424 CPUtime=4775.02 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 16548224 0 0 0 474929 2573 0 0 25 0 8 0 878237754 5488050176 1077808 33554432000 4194304 4625164 140737359589280 18446744073709551615 239476353453 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=5359424 CPUtime=4781.77 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 360609 0 0 0 478116 61 0 0 25 0 8 0 878237754 5488050176 1077808 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=5359424 CPUtime=4782.41 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 338677 0 0 0 478177 64 0 0 25 0 8 0 878237754 5488050176 1077808 33554432000 4194304 4625164 140737359589280 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=5359424 CPUtime=4771.9 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 67846 0 0 0 477146 44 0 0 25 0 8 0 878237754 5488050176 1077808 33554432000 4194304 4625164 140737359589280 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=5359424 CPUtime=4773.9 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 344719 0 0 0 477325 65 0 0 25 0 8 0 878237755 5488050176 1077808 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351820 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38231.3
Current children cumulated vsize (KiB) 5359424

[startup+4842.3 s]
/proc/loadavg: 8.00 8.04 7.99 9/178 14338
/proc/meminfo: memFree=28275652/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=5360036 CPUtime=38710.9 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 21843404 0 1 0 3867616 3479 0 0 25 0 8 0 878237750 5488676864 1081149 33554432000 4194304 4625164 140737359589280 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 1340009 1081149 348 106 0 1335512 0
[pid=14189/tid=14191] ppid=14187 vsize=5360036 CPUtime=4842.29 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 344524 0 0 0 484163 66 0 0 25 0 8 0 878237754 5488676864 1081149 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=5360036 CPUtime=4841.95 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 104612 0 0 0 484173 22 0 0 25 0 8 0 878237754 5488676864 1081149 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=5360036 CPUtime=4835.01 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 16753226 0 0 0 480897 2604 0 0 25 0 8 0 878237754 5488676864 1081149 33554432000 4194304 4625164 140737359589280 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=5360036 CPUtime=4841.77 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 361096 0 0 0 484116 61 0 0 25 0 8 0 878237754 5488676864 1081149 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=5360036 CPUtime=4842.42 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 338803 0 0 0 484177 65 0 0 25 0 8 0 878237754 5488676864 1081149 33554432000 4194304 4625164 140737359589280 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=5360036 CPUtime=4831.9 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 67859 0 0 0 483146 44 0 0 25 0 8 0 878237754 5488676864 1081149 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=5360036 CPUtime=4833.57 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 344867 0 0 0 483292 65 0 0 25 0 8 0 878237755 5488676864 1081149 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38710.9
Current children cumulated vsize (KiB) 5360036

[startup+4902.3 s]
/proc/loadavg: 8.00 8.03 7.99 9/178 14349
/proc/meminfo: memFree=28237800/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=5361012 CPUtime=39190.6 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 22173563 0 1 0 3915529 3531 0 0 25 0 8 0 878237750 5489676288 1089636 33554432000 4194304 4625164 140737359589280 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 1340253 1089636 394 106 0 1335756 0
[pid=14189/tid=14191] ppid=14187 vsize=5361012 CPUtime=4902.28 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 344633 0 0 0 490162 66 0 0 25 0 8 0 878237754 5489676288 1089636 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=5361012 CPUtime=4901.95 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 104864 0 0 0 490173 22 0 0 25 0 8 0 878237754 5489676288 1089636 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=5361012 CPUtime=4895.01 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 17020409 0 0 0 486856 2645 0 0 25 0 8 0 878237754 5489676288 1089636 33554432000 4194304 4625164 140737359589280 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=5361012 CPUtime=4901.75 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 361274 0 0 0 490114 61 0 0 25 0 8 0 878237754 5489676288 1089636 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=5361012 CPUtime=4902.42 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 338940 0 0 0 490177 65 0 0 25 0 8 0 878237754 5489676288 1089636 33554432000 4194304 4625164 140737359589280 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=5361012 CPUtime=4891.9 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 67866 0 0 0 489146 44 0 0 25 0 8 0 878237754 5489676288 1089636 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=5361012 CPUtime=4893.25 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 348785 0 0 0 489258 67 0 0 25 0 8 0 878237755 5489676288 1089636 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351996 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39190.6
Current children cumulated vsize (KiB) 5361012

[startup+4962.3 s]
/proc/loadavg: 8.28 8.11 8.02 9/178 14842
/proc/meminfo: memFree=28158168/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=5369640 CPUtime=39668.4 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 22487074 0 1 0 3963260 3581 0 0 25 0 8 0 878237750 5498511360 1107492 33554432000 4194304 4625164 140737359589280 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 1342410 1107492 371 106 0 1337913 0
[pid=14189/tid=14191] ppid=14187 vsize=5369640 CPUtime=4962.09 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 344805 0 0 0 496143 66 0 0 25 0 8 0 878237754 5498511360 1107492 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=5369640 CPUtime=4961.93 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 107864 0 0 0 496170 23 0 0 25 0 8 0 878237754 5498511360 1107492 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=5369640 CPUtime=4955.01 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 17274393 0 0 0 492819 2682 0 0 25 0 8 0 878237754 5498511360 1107492 33554432000 4194304 4625164 140737359589280 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=5369640 CPUtime=4961.74 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 361548 0 0 0 496112 62 0 0 25 0 8 0 878237754 5498511360 1107492 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=5369640 CPUtime=4961.27 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 339174 0 0 0 496062 65 0 0 25 0 8 0 878237754 5498511360 1107492 33554432000 4194304 4625164 140737359589280 18446744073709551615 4349779 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=5369640 CPUtime=4951.76 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 67897 0 0 0 495131 45 0 0 25 0 8 0 878237754 5498511360 1107492 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=5369640 CPUtime=4952.9 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 359152 0 0 0 495221 69 0 0 25 0 8 0 878237755 5498511360 1107492 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39668.4
Current children cumulated vsize (KiB) 5369640



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.8 s]
/proc/loadavg: 8.14 8.09 8.01 9/178 14844
/proc/meminfo: memFree=28148076/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=5369640 CPUtime=40000.2 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) R 14187 14189 14159 0 -1 4202496 22681017 0 1 0 3996414 3609 0 0 25 0 8 0 878237750 5498511360 1110639 33554432000 4194304 4625164 140737359589280 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 1342410 1110639 347 106 0 1337913 0
[pid=14189/tid=14191] ppid=14187 vsize=5369640 CPUtime=5003.59 cores=0-7
/proc/14189/task/14191/stat : 14191 (SArTagnan) R 14187 14189 14159 0 -1 4202560 344933 0 0 0 500293 66 0 0 25 0 8 0 878237754 5498511360 1110639 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14189/tid=14192] ppid=14187 vsize=5369640 CPUtime=5003.44 cores=0-7
/proc/14189/task/14192/stat : 14192 (SArTagnan) R 14187 14189 14159 0 -1 4202560 108258 0 0 0 500321 23 0 0 25 0 8 0 878237754 5498511360 1110639 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=14189/tid=14193] ppid=14187 vsize=5369640 CPUtime=4996.52 cores=0-7
/proc/14189/task/14193/stat : 14193 (SArTagnan) R 14187 14189 14159 0 -1 4202560 17427909 0 0 0 496948 2704 0 0 25 0 8 0 878237754 5498511360 1110639 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14189/tid=14194] ppid=14187 vsize=5369640 CPUtime=5003.24 cores=0-7
/proc/14189/task/14194/stat : 14194 (SArTagnan) R 14187 14189 14159 0 -1 4202560 361635 0 0 0 500262 62 0 0 25 0 8 0 878237754 5498511360 1110639 33554432000 4194304 4625164 140737359589280 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=14189/tid=14195] ppid=14187 vsize=5369640 CPUtime=5002.77 cores=0-7
/proc/14189/task/14195/stat : 14195 (SArTagnan) R 14187 14189 14159 0 -1 4202560 339739 0 0 0 500212 65 0 0 25 0 8 0 878237754 5498511360 1110639 33554432000 4194304 4625164 140737359589280 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=14189/tid=14196] ppid=14187 vsize=5369640 CPUtime=4993.26 cores=0-7
/proc/14189/task/14196/stat : 14196 (SArTagnan) R 14187 14189 14159 0 -1 4202560 67933 0 0 0 499281 45 0 0 25 0 8 0 878237754 5498511360 1110639 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=5369640 CPUtime=4994.17 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4202560 359275 0 0 0 499348 69 0 0 25 0 8 0 878237755 5498511360 1110639 33554432000 4194304 4625164 140737359589280 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 5369640

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.91 s]
/proc/loadavg: 8.14 8.09 8.01 2/173 14845
/proc/meminfo: memFree=30455260/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=0 CPUtime=40000.4 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) Z 14187 14189 14159 0 -1 4203548 22681017 0 1 0 3996418 3620 0 0 25 0 2 0 878237750 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 0 0 0 0 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=0 CPUtime=4994.28 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4203588 359275 0 0 0 499349 79 0 0 25 0 2 0 878237755 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

[startup+5004.01 s]
/proc/loadavg: 8.14 8.09 8.01 2/173 14845
/proc/meminfo: memFree=30455260/32950928 swapFree=67055428/67111528
[pid=14189] ppid=14187 vsize=0 CPUtime=40000.5 cores=0-7
/proc/14189/stat : 14189 (SArTagnan) Z 14187 14189 14159 0 -1 4203548 22681017 0 1 0 3996418 3628 0 0 25 0 2 0 878237750 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/14189/statm: 0 0 0 0 0 0 0
[pid=14189/tid=14197] ppid=14187 vsize=0 CPUtime=4994.37 cores=0-7
/proc/14189/task/14197/stat : 14197 (SArTagnan) R 14187 14189 14159 0 -1 4203588 359275 0 0 0 499349 88 0 0 25 0 2 0 878237755 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5004.01
CPU time (s): 40000.5
CPU user time (s): 39964.2
CPU system time (s): 36.2895
CPU usage (%): 799.369
Max. virtual memory (cumulated for all children) (KiB): 5369640

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39964.2
system time used= 36.2895
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22681017
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8150
involuntary context switches= 166646

runsolver used 7.83381 second user time and 19.485 second system time

The end

Launcher Data

Begin job on node148 at 2011-06-10 02:40:07
IDJOB=3439266
IDBENCH=83921
IDSOLVER=1936
FILE ID=node148/3439266-1307666407
RUNJOBID= node148-1307666407-14173
PBS_JOBID= 13549475
Free space on /tmp= 74164 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_15_90_1-log.shuffled-as.sat03-137.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439266-1307666407/watcher-3439266-1307666407 -o /tmp/evaluation-result-3439266-1307666407/solver-3439266-1307666407 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439266-1307666407.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 808fa775df860c59a1178e77fc60f410
RANDOM SEED=1592199036

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      32610600 kB
Buffers:         54380 kB
Cached:         130088 kB
SwapCached:       8788 kB
Active:         103564 kB
Inactive:        98296 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      32610600 kB
SwapTotal:    67111528 kB
SwapFree:     67055428 kB
Dirty:            1384 kB
Writeback:           0 kB
AnonPages:       15740 kB
Mapped:          12016 kB
Slab:            73044 kB
PageTables:       4280 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   188236 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74172 MiB
End job on node148 at 2011-06-10 04:03:33