Trace number 3386413

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3832.87 1300.07

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
MD5SUMa0ec1baa890da62d0c6df7f1e62c6af3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3057.55
Satisfiable
(Un)Satisfiability was proved
Number of variables163622
Number of clauses488120
Sum of the clauses size1138944
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2325412
Number of clauses of size 3162706
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386413-1305579841/watcher-3386413-1305579841 -o /tmp/evaluation-result-3386413-1305579841/solver-3386413-1305579841 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386413-1305579841.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.74 10.34 10.18 7/373 28266
/proc/meminfo: memFree=13965892/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=44004 CPUtime=0 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 3469 0 0 0 0 0 0 0 21 0 1 0 669583808 45060096 3407 33554432000 4194304 4625164 140735603472160 18446744073709551615 274664505455 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/28266/statm: 11001 3408 296 106 0 6504 0

[startup+0.038894 s]
/proc/loadavg: 10.74 10.34 10.18 7/373 28266
/proc/meminfo: memFree=13965892/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=46740 CPUtime=0.03 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 5099 0 0 0 3 0 0 0 21 0 1 0 669583808 47861760 4111 33554432000 4194304 4625164 140735603472160 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/28266/statm: 11685 4112 296 106 0 7188 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 46740

[startup+0.100881 s]
/proc/loadavg: 10.74 10.34 10.18 7/373 28266
/proc/meminfo: memFree=13965892/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=53832 CPUtime=0.09 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 9234 0 0 0 8 1 0 0 21 0 1 0 669583808 55123968 5922 33554432000 4194304 4625164 140735603472160 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/28266/statm: 13458 5922 296 106 0 8961 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 53832

[startup+0.300819 s]
/proc/loadavg: 10.74 10.34 10.18 7/373 28266
/proc/meminfo: memFree=13965892/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=173784 CPUtime=0.35 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 33304 0 0 0 31 4 0 0 22 0 4 0 669583808 177954816 25659 33554432000 4194304 4625164 140735603472160 18446744073709551615 4503743 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28266/statm: 43446 25659 323 106 0 38949 0
Current children cumulated CPU time (s) 0.35
Current children cumulated vsize (KiB) 173784

[startup+0.700748 s]
/proc/loadavg: 10.74 10.34 10.18 7/373 28266
/proc/meminfo: memFree=13965892/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=315288 CPUtime=1.14 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 36544 0 0 0 110 4 0 0 24 0 4 0 669583808 322854912 28899 33554432000 4194304 4625164 140735603472160 18446744073709551615 4390623 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 78822 28899 336 106 0 74325 0
Current children cumulated CPU time (s) 1.14
Current children cumulated vsize (KiB) 315288

[startup+1.50061 s]
/proc/loadavg: 10.44 10.29 10.16 11/377 28270
/proc/meminfo: memFree=13849804/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=315288 CPUtime=2.72 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 37023 0 0 0 268 4 0 0 25 0 4 0 669583808 322854912 29345 33554432000 4194304 4625164 140735603472160 18446744073709551615 4509196 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 78822 29345 342 106 0 74325 0
[pid=28266/tid=28268] ppid=28264 vsize=315288 CPUtime=0.52 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 1311 0 0 0 52 0 0 0 25 0 4 0 669583833 322854912 29345 33554432000 4194304 4625164 140735603472160 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=315288 CPUtime=0.61 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 1361 0 0 0 61 0 0 0 25 0 4 0 669583833 322854912 29345 33554432000 4194304 4625164 140735603472160 18446744073709551615 4352812 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=315288 CPUtime=0.67 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 2072 0 0 0 67 0 0 0 25 0 4 0 669583833 322854912 29345 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.72
Current children cumulated vsize (KiB) 315288

[startup+3.10033 s]
/proc/loadavg: 10.44 10.29 10.16 11/377 28270
/proc/meminfo: memFree=13843972/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=321304 CPUtime=5.91 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 41333 0 0 0 586 5 0 0 25 0 4 0 669583808 329015296 30942 33554432000 4194304 4625164 140735603472160 18446744073709551615 4512265 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 80326 30942 342 106 0 75829 0
[pid=28266/tid=28268] ppid=28264 vsize=321304 CPUtime=1.32 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 2980 0 0 0 132 0 0 0 25 0 4 0 669583833 329015296 30942 33554432000 4194304 4625164 140735603472160 18446744073709551615 4288693 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=321304 CPUtime=1.41 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 1643 0 0 0 141 0 0 0 25 0 4 0 669583833 329015296 30942 33554432000 4194304 4625164 140735603472160 18446744073709551615 4465337 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=321304 CPUtime=1.47 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 2477 0 0 0 147 0 0 0 25 0 4 0 669583833 329015296 30942 33554432000 4194304 4625164 140735603472160 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.91
Current children cumulated vsize (KiB) 321304

[startup+6.30078 s]
/proc/loadavg: 10.72 10.35 10.18 13/377 28270
/proc/meminfo: memFree=13830972/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=324224 CPUtime=12.27 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 46726 0 0 0 1221 6 0 0 25 0 4 0 669583808 332005376 32738 33554432000 4194304 4625164 140735603472160 18446744073709551615 4390706 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 81056 32738 342 106 0 76559 0
[pid=28266/tid=28268] ppid=28264 vsize=324224 CPUtime=2.92 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 3308 0 0 0 292 0 0 0 25 0 4 0 669583833 332005376 32738 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=324224 CPUtime=3 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 3322 0 0 0 300 0 0 0 25 0 4 0 669583833 332005376 32738 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=324224 CPUtime=3.07 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 4374 0 0 0 307 0 0 0 25 0 4 0 669583833 332005376 32738 33554432000 4194304 4625164 140735603472160 18446744073709551615 4552296 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.27
Current children cumulated vsize (KiB) 324224

[startup+12.7007 s]
/proc/loadavg: 10.66 10.34 10.18 11/377 28270
/proc/meminfo: memFree=13812428/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=340720 CPUtime=24.98 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 59392 0 0 0 2490 8 0 0 25 0 4 0 669583808 348897280 36837 33554432000 4194304 4625164 140735603472160 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 85180 36837 342 106 0 80683 0
[pid=28266/tid=28268] ppid=28264 vsize=340720 CPUtime=6.12 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 6091 0 0 0 611 1 0 0 25 0 4 0 669583833 348897280 36837 33554432000 4194304 4625164 140735603472160 18446744073709551615 4352186 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=340720 CPUtime=6.13 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 6052 0 0 0 613 0 0 0 25 0 4 0 669583833 348897280 36837 33554432000 4194304 4625164 140735603472160 18446744073709551615 4288793 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=340720 CPUtime=6.27 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 8695 0 0 0 626 1 0 0 25 0 4 0 669583833 348897280 36837 33554432000 4194304 4625164 140735603472160 18446744073709551615 4352256 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.98
Current children cumulated vsize (KiB) 340720

[startup+25.5005 s]
/proc/loadavg: 10.52 10.32 10.18 11/377 28270
/proc/meminfo: memFree=13502380/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=648756 CPUtime=50.42 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 198352 0 0 0 5015 27 0 0 25 0 4 0 669583808 664326144 112226 33554432000 4194304 4625164 140735603472160 18446744073709551615 4278423 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 162189 112226 349 106 0 157692 0
[pid=28266/tid=28268] ppid=28264 vsize=648756 CPUtime=12.59 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 10140 0 0 0 1257 2 0 0 25 0 4 0 669583833 664326144 112226 33554432000 4194304 4625164 140735603472160 18446744073709551615 4477934 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=648756 CPUtime=12.46 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 10177 0 0 0 1246 0 0 0 25 0 4 0 669583833 664326144 112226 33554432000 4194304 4625164 140735603472160 18446744073709551615 4278640 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=648756 CPUtime=12.59 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 26203 0 0 0 1256 3 0 0 25 0 4 0 669583833 664326144 112226 33554432000 4194304 4625164 140735603472160 18446744073709551615 4477922 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.42
Current children cumulated vsize (KiB) 648756

[startup+51.101 s]
/proc/loadavg: 10.48 10.33 10.18 11/377 28271
/proc/meminfo: memFree=13273624/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=935812 CPUtime=101.32 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 405562 0 0 0 10079 53 0 0 25 0 4 0 669583808 958271488 167604 33554432000 4194304 4625164 140735603472160 18446744073709551615 4509011 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 233953 167605 347 106 0 229456 0
[pid=28266/tid=28268] ppid=28264 vsize=935812 CPUtime=25.41 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 50824 0 0 0 2534 7 0 0 25 0 4 0 669583833 958271488 167605 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=935812 CPUtime=24.9 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 47052 0 0 0 2485 5 0 0 25 0 4 0 669583833 958271488 167605 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=935812 CPUtime=25.37 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 139259 0 0 0 2520 17 0 0 25 0 4 0 669583833 958271488 167605 33554432000 4194304 4625164 140735603472160 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.32
Current children cumulated vsize (KiB) 935812

[startup+102.314 s]
/proc/loadavg: 10.33 10.31 10.18 11/377 28272
/proc/meminfo: memFree=13206660/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=956004 CPUtime=233.61 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 649987 0 0 0 23269 92 0 0 25 0 4 0 669583808 978948096 169946 33554432000 4194304 4625164 140735603472160 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 239001 169946 347 106 0 234504 0
[pid=28266/tid=28268] ppid=28264 vsize=956004 CPUtime=51.11 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 50835 0 0 0 5104 7 0 0 25 0 4 0 669583833 978948096 169946 33554432000 4194304 4625164 140735603472160 18446744073709551615 4334733 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=956004 CPUtime=63.76 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 47494 0 0 0 6371 5 0 0 25 0 4 0 669583833 978948096 169946 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=956004 CPUtime=50.89 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 372468 0 0 0 5036 53 0 0 25 0 4 0 669583833 978948096 169946 33554432000 4194304 4625164 140735603472160 18446744073709551615 4334197 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 233.61
Current children cumulated vsize (KiB) 956004

[startup+162.301 s]
/proc/loadavg: 10.53 10.37 10.21 11/377 28277
/proc/meminfo: memFree=13160172/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=956004 CPUtime=412.85 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 874068 0 0 0 41162 123 0 0 25 0 4 0 669583808 978948096 175265 33554432000 4194304 4625164 140735603472160 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 239001 175265 347 106 0 234504 0
[pid=28266/tid=28268] ppid=28264 vsize=956004 CPUtime=81.1 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 51324 0 0 0 8103 7 0 0 25 0 4 0 669583833 978948096 175265 33554432000 4194304 4625164 140735603472160 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=956004 CPUtime=123.74 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 48289 0 0 0 12368 6 0 0 25 0 4 0 669583833 978948096 175265 33554432000 4194304 4625164 140735603472160 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=956004 CPUtime=80.88 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 594483 0 0 0 8005 83 0 0 25 0 4 0 669583833 978948096 175265 33554432000 4194304 4625164 140735603472160 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 412.85
Current children cumulated vsize (KiB) 956004

[startup+222.3 s]
/proc/loadavg: 10.35 10.35 10.21 11/377 28278
/proc/meminfo: memFree=13102260/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=956004 CPUtime=592.12 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 994541 0 0 0 59072 140 0 0 25 0 4 0 669583808 978948096 177447 33554432000 4194304 4625164 140735603472160 18446744073709551615 4511936 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 239001 177447 347 106 0 234504 0
[pid=28266/tid=28268] ppid=28264 vsize=956004 CPUtime=111.1 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 51834 0 0 0 11103 7 0 0 25 0 4 0 669583833 978948096 177447 33554432000 4194304 4625164 140735603472160 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=956004 CPUtime=183.73 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 49823 0 0 0 18367 6 0 0 25 0 4 0 669583833 978948096 177447 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=956004 CPUtime=110.89 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 712010 0 0 0 10989 100 0 0 25 0 4 0 669583833 978948096 177447 33554432000 4194304 4625164 140735603472160 18446744073709551615 4352085 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 592.12
Current children cumulated vsize (KiB) 956004

[startup+282.301 s]

################
# More data... #
################

[pid=28266] ppid=28264 vsize=1309184 CPUtime=2046.77 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 3016741 0 0 0 204223 454 0 0 25 0 4 0 669583808 1340604416 233825 33554432000 4194304 4625164 140735603472160 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 327296 233825 347 106 0 322799 0
[pid=28266/tid=28268] ppid=28264 vsize=1309184 CPUtime=561.33 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 98085 0 0 0 56114 19 0 0 25 0 4 0 669583833 1340604416 233825 33554432000 4194304 4625164 140735603472160 18446744073709551615 4278657 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1309184 CPUtime=502.35 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 68153 0 0 0 50225 10 0 0 25 0 4 0 669583833 1340604416 233825 33554432000 4194304 4625164 140735603472160 18446744073709551615 4352609 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1309184 CPUtime=434.85 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 2630039 0 0 0 43094 391 0 0 25 0 4 0 669583833 1340604416 233825 33554432000 4194304 4625164 140735603472160 18446744073709551615 4334466 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2046.77
Current children cumulated vsize (KiB) 1309184

[startup+762.315 s]
/proc/loadavg: 10.15 10.19 10.18 11/377 28324
/proc/meminfo: memFree=13147752/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=1309184 CPUtime=2226.1 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 3232868 0 0 0 222123 487 0 0 25 0 4 0 669583808 1340604416 236063 33554432000 4194304 4625164 140735603472160 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 327296 236063 347 106 0 322799 0
[pid=28266/tid=28268] ppid=28264 vsize=1309184 CPUtime=591.33 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 99882 0 0 0 59112 21 0 0 25 0 4 0 669583833 1340604416 236063 33554432000 4194304 4625164 140735603472160 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1309184 CPUtime=562.37 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 68369 0 0 0 56227 10 0 0 25 0 4 0 669583833 1340604416 236063 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1309184 CPUtime=464.87 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 2843503 0 0 0 46064 423 0 0 25 0 4 0 669583833 1340604416 236063 33554432000 4194304 4625164 140735603472160 18446744073709551615 4339086 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2226.1
Current children cumulated vsize (KiB) 1309184

[startup+822.3 s]
/proc/loadavg: 10.05 10.16 10.16 12/377 28325
/proc/meminfo: memFree=13039244/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=1374720 CPUtime=2405.36 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 3446033 0 0 0 240016 520 0 0 25 0 4 0 669583808 1407713280 242017 33554432000 4194304 4625164 140735603472160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 343680 242017 347 106 0 339183 0
[pid=28266/tid=28268] ppid=28264 vsize=1374720 CPUtime=621.32 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 101809 0 0 0 62110 22 0 0 25 0 4 0 669583833 1407713280 242017 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1374720 CPUtime=622.35 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 68681 0 0 0 62225 10 0 0 25 0 4 0 669583833 1407713280 242017 33554432000 4194304 4625164 140735603472160 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1374720 CPUtime=494.86 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 3053569 0 0 0 49033 453 0 0 25 0 4 0 669583833 1407713280 242017 33554432000 4194304 4625164 140735603472160 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2405.36
Current children cumulated vsize (KiB) 1374720

[startup+882.301 s]
/proc/loadavg: 10.17 10.17 10.17 12/377 28327
/proc/meminfo: memFree=12936560/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=1319200 CPUtime=2584.65 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 3577025 0 0 0 257922 543 0 0 25 0 4 0 669583808 1350860800 247008 33554432000 4194304 4625164 140735603472160 18446744073709551615 4512747 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 329800 247008 347 106 0 325303 0
[pid=28266/tid=28268] ppid=28264 vsize=1319200 CPUtime=651.32 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 103485 0 0 0 65108 24 0 0 25 0 4 0 669583833 1350860800 247008 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1319200 CPUtime=682.35 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 69448 0 0 0 68225 10 0 0 25 0 4 0 669583833 1350860800 247008 33554432000 4194304 4625164 140735603472160 18446744073709551615 4463742 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1319200 CPUtime=524.86 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 3181001 0 0 0 52013 473 0 0 25 0 4 0 669583833 1350860800 247008 33554432000 4194304 4625164 140735603472160 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2584.65
Current children cumulated vsize (KiB) 1319200

[startup+942.301 s]
/proc/loadavg: 10.20 10.17 10.17 11/377 28329
/proc/meminfo: memFree=12819728/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=1384736 CPUtime=2763.92 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 3782716 0 0 0 275821 571 0 0 25 0 4 0 669583808 1417969664 254437 33554432000 4194304 4625164 140735603472160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 346184 254437 347 106 0 341687 0
[pid=28266/tid=28268] ppid=28264 vsize=1384736 CPUtime=702.9 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 104083 0 0 0 70266 24 0 0 25 0 4 0 669583833 1417969664 254437 33554432000 4194304 4625164 140735603472160 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1384736 CPUtime=720.73 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 70473 0 0 0 72062 11 0 0 25 0 4 0 669583833 1417969664 254437 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1384736 CPUtime=554.91 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 3384061 0 0 0 54991 500 0 0 25 0 4 0 669583833 1417969664 254437 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2763.92
Current children cumulated vsize (KiB) 1384736

[startup+1002.3 s]
/proc/loadavg: 10.07 10.14 10.16 11/377 28330
/proc/meminfo: memFree=12744688/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=1384736 CPUtime=2943.2 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 4005831 0 0 0 293718 602 0 0 25 0 4 0 669583808 1417969664 256568 33554432000 4194304 4625164 140735603472160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 346184 256568 347 106 0 341687 0
[pid=28266/tid=28268] ppid=28264 vsize=1384736 CPUtime=762.9 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 104675 0 0 0 76266 24 0 0 25 0 4 0 669583833 1417969664 256568 33554432000 4194304 4625164 140735603472160 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1384736 CPUtime=750.73 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 70627 0 0 0 75062 11 0 0 25 0 4 0 669583833 1417969664 256568 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1384736 CPUtime=584.9 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 3605627 0 0 0 57960 530 0 0 25 0 4 0 669583833 1417969664 256568 33554432000 4194304 4625164 140735603472160 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2943.2
Current children cumulated vsize (KiB) 1384736

[startup+1062.3 s]
/proc/loadavg: 10.14 10.14 10.16 11/377 28332
/proc/meminfo: memFree=12686396/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=1384736 CPUtime=3122.49 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 4231891 0 0 0 311613 636 0 0 25 0 4 0 669583808 1417969664 261639 33554432000 4194304 4625164 140735603472160 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 346184 261639 347 106 0 341687 0
[pid=28266/tid=28268] ppid=28264 vsize=1384736 CPUtime=822.91 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 105378 0 0 0 82266 25 0 0 25 0 4 0 669583833 1417969664 261639 33554432000 4194304 4625164 140735603472160 18446744073709551615 4462457 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1384736 CPUtime=780.74 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 71699 0 0 0 78062 12 0 0 25 0 4 0 669583833 1417969664 261639 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1384736 CPUtime=614.9 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 3828725 0 0 0 60928 562 0 0 25 0 4 0 669583833 1417969664 261639 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3122.49
Current children cumulated vsize (KiB) 1384736

[startup+1122.3 s]
/proc/loadavg: 10.16 10.14 10.15 12/377 28333
/proc/meminfo: memFree=12586308/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=1389356 CPUtime=3301.76 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 4424400 0 0 0 329510 666 0 0 25 0 4 0 669583808 1422700544 267716 33554432000 4194304 4625164 140735603472160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 347339 267716 347 106 0 342842 0
[pid=28266/tid=28268] ppid=28264 vsize=1389356 CPUtime=882.91 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 107426 0 0 0 88265 26 0 0 25 0 4 0 669583833 1422700544 267716 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1389356 CPUtime=810.78 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 71783 0 0 0 81066 12 0 0 25 0 4 0 669583833 1422700544 267716 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1389356 CPUtime=644.86 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 4018483 0 0 0 63894 592 0 0 25 0 4 0 669583833 1422700544 267716 33554432000 4194304 4625164 140735603472160 18446744073709551615 4334466 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3301.76
Current children cumulated vsize (KiB) 1389356

[startup+1182.3 s]
/proc/loadavg: 10.15 10.14 10.15 11/377 28335
/proc/meminfo: memFree=12494168/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=1397804 CPUtime=3481.07 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 4646363 0 0 0 347405 702 0 0 25 0 4 0 669583808 1431351296 271272 33554432000 4194304 4625164 140735603472160 18446744073709551615 4512869 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 349451 271272 347 106 0 344954 0
[pid=28266/tid=28268] ppid=28264 vsize=1397804 CPUtime=942.91 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 110245 0 0 0 94263 28 0 0 25 0 4 0 669583833 1431351296 271272 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1397804 CPUtime=840.78 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 72087 0 0 0 84065 13 0 0 25 0 4 0 669583833 1431351296 271272 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351786 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1397804 CPUtime=674.87 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 4236661 0 0 0 66862 625 0 0 25 0 4 0 669583833 1431351296 271272 33554432000 4194304 4625164 140735603472160 18446744073709551615 4547411 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3481.07
Current children cumulated vsize (KiB) 1397804

[startup+1242.3 s]
/proc/loadavg: 10.14 10.14 10.15 11/377 28337
/proc/meminfo: memFree=12411828/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=1407440 CPUtime=3660.35 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 4889875 0 0 0 365298 737 0 0 25 0 4 0 669583808 1441218560 276290 33554432000 4194304 4625164 140735603472160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 351860 276290 347 106 0 347363 0
[pid=28266/tid=28268] ppid=28264 vsize=1407440 CPUtime=1002.91 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 113696 0 0 0 100262 29 0 0 25 0 4 0 669583833 1441218560 276290 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1407440 CPUtime=870.86 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 72453 0 0 0 87073 13 0 0 25 0 4 0 669583833 1441218560 276290 33554432000 4194304 4625164 140735603472160 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1407440 CPUtime=704.79 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 4475727 0 0 0 69821 658 0 0 25 0 4 0 669583833 1441218560 276290 33554432000 4194304 4625164 140735603472160 18446744073709551615 4555099 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3660.35
Current children cumulated vsize (KiB) 1407440



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.18 10.16 10.16 12/377 28338
/proc/meminfo: memFree=12343496/32951132 swapFree=67093824/67111528
[pid=28266] ppid=28264 vsize=1417604 CPUtime=3832.79 cores=1,3,5,7
/proc/28266/stat : 28266 (SArTagnan) R 28264 28266 27834 0 -1 4202496 5130287 0 0 0 382505 774 0 0 25 0 4 0 669583808 1451626496 285956 33554432000 4194304 4625164 140735603472160 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28266/statm: 354401 285956 347 106 0 349904 0
[pid=28266/tid=28268] ppid=28264 vsize=1417604 CPUtime=1060.6 cores=1,3,5,7
/proc/28266/task/28268/stat : 28268 (SArTagnan) R 28264 28266 27834 0 -1 4202560 117127 0 0 0 106029 31 0 0 25 0 4 0 669583833 1451626496 285956 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351786 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28266/tid=28269] ppid=28264 vsize=1417604 CPUtime=899.77 cores=1,3,5,7
/proc/28266/task/28269/stat : 28269 (SArTagnan) R 28264 28266 27834 0 -1 4202560 73772 0 0 0 89962 15 0 0 25 0 4 0 669583833 1451626496 285956 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28266/tid=28270] ppid=28264 vsize=1417604 CPUtime=733.61 cores=1,3,5,7
/proc/28266/task/28270/stat : 28270 (SArTagnan) R 28264 28266 27834 0 -1 4202560 4710883 0 0 0 72670 691 0 0 25 0 4 0 669583833 1451626496 285956 33554432000 4194304 4625164 140735603472160 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3832.79
Current children cumulated vsize (KiB) 1417604

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.07
CPU time (s): 3832.87
CPU user time (s): 3825.08
CPU system time (s): 7.79581
CPU usage (%): 294.82
Max. virtual memory (cumulated for all children) (KiB): 1417604

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3825.08
system time used= 7.79581
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5130287
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 515
involuntary context switches= 47210

runsolver used 4.18836 second user time and 11.2283 second system time

The end

Launcher Data 

Begin job on node131 at 2011-05-16 23:04:02
IDJOB=3386413
IDBENCH=82468
IDSOLVER=1871
FILE ID=node131/3386413-1305579841
RUNJOBID= node131-1305576906-27853
PBS_JOBID= 13350211
Free space on /tmp= 73564 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386413-1305579841/watcher-3386413-1305579841 -o /tmp/evaluation-result-3386413-1305579841/solver-3386413-1305579841 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386413-1305579841.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a0ec1baa890da62d0c6df7f1e62c6af3
RANDOM SEED=96699321

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      13966172 kB
Buffers:        309560 kB
Cached:        4751772 kB
SwapCached:       1504 kB
Active:       15023108 kB
Inactive:      3678624 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      13966172 kB
SwapTotal:    67111528 kB
SwapFree:     67093824 kB
Dirty:            9280 kB
Writeback:           0 kB
AnonPages:    13638956 kB
Mapped:          33112 kB
Slab:           171924 kB
PageTables:      47812 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 66721864 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73564 MiB
End job on node131 at 2011-05-16 23:25:44