Trace number 3274111

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.33 1201.77

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n260-s62321009-sat.cnf
MD5SUMf2b430bdd9bc1c472e9e437567706bb7
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark3.48747
Satisfiable
(Un)Satisfiability was proved
Number of variables260
Number of clauses624
Sum of the clauses size1560
Maximum clause length5
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2520
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 5104
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3274111-1304086700/watcher-3274111-1304086700 -o /tmp/evaluation-result-3274111-1304086700/solver-3274111-1304086700 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3274111-1304086700.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.34 7.99 8.06 5/184 5852
/proc/meminfo: memFree=29686792/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=49340 CPUtime=0 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 459 0 0 0 0 0 0 0 25 0 4 0 520267872 50524160 396 33554432000 4194304 4623224 140734513570384 18446744073709551615 46981714917298 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 12335 396 301 105 0 7839 0
[pid=5852/tid=5853] ppid=5850 vsize=49340 CPUtime=0 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 520267873 50524160 396 33554432000 4194304 4623224 140734513570384 18446744073709551615 255377357809 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=49340 CPUtime=0 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 520267873 50524160 396 33554432000 4194304 4623224 140734513570384 18446744073709551615 46981714917298 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=49340 CPUtime=0 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 520267873 50524160 396 33554432000 4194304 4623224 140734513570384 18446744073709551615 46981714917298 0 0 4096 2 0 0 0 -1 0 0 0 0

[startup+0.148555 s]
/proc/loadavg: 7.34 7.99 8.06 5/184 5852
/proc/meminfo: memFree=29686792/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=248528 CPUtime=0.57 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 2267 0 0 0 57 0 0 0 25 0 4 0 520267872 254492672 1613 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 62132 1613 344 105 0 57636 0
[pid=5852/tid=5853] ppid=5850 vsize=248528 CPUtime=0.14 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 503 0 0 0 14 0 0 0 25 0 4 0 520267873 254492672 1613 33554432000 4194304 4623224 140734513570384 18446744073709551615 255377344695 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=248528 CPUtime=0.14 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) D 5850 5852 4914 0 -1 4202560 470 0 0 0 14 0 0 0 25 0 4 0 520267873 254492672 1613 33554432000 4194304 4623224 140734513570384 18446744073709551615 4366665 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=248528 CPUtime=0.14 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 477 0 0 0 14 0 0 0 25 0 4 0 520267873 254492672 1613 33554432000 4194304 4623224 140734513570384 18446744073709551615 255393285147 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 248528

[startup+0.200493 s]
/proc/loadavg: 7.34 7.99 8.06 5/184 5852
/proc/meminfo: memFree=29686792/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=248724 CPUtime=0.78 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 2789 0 0 0 78 0 0 0 25 0 4 0 520267872 254693376 1941 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510123 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 62181 1941 344 105 0 57685 0
[pid=5852/tid=5853] ppid=5850 vsize=248724 CPUtime=0.19 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 593 0 0 0 19 0 0 0 25 0 4 0 520267873 254693376 1941 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=248724 CPUtime=0.19 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 690 0 0 0 19 0 0 0 25 0 4 0 520267873 254693376 1941 33554432000 4194304 4623224 140734513570384 18446744073709551615 4461113 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=248724 CPUtime=0.19 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 559 0 0 0 19 0 0 0 25 0 4 0 520267873 254693376 1941 33554432000 4194304 4623224 140734513570384 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.78
Current children cumulated vsize (KiB) 248724

[startup+0.300477 s]
/proc/loadavg: 7.34 7.99 8.06 5/184 5852
/proc/meminfo: memFree=29686792/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=250228 CPUtime=1.17 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 3947 0 0 0 117 0 0 0 25 0 4 0 520267872 256233472 2495 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 62557 2495 344 105 0 58061 0
[pid=5852/tid=5853] ppid=5850 vsize=250228 CPUtime=0.29 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 934 0 0 0 29 0 0 0 25 0 4 0 520267873 256233472 2495 33554432000 4194304 4623224 140734513570384 18446744073709551615 4462937 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=250228 CPUtime=0.29 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1059 0 0 0 29 0 0 0 18 0 4 0 520267873 256233472 2495 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=250228 CPUtime=0.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 977 0 0 0 29 0 0 0 25 0 4 0 520267873 256233472 2495 33554432000 4194304 4623224 140734513570384 18446744073709551615 4559108 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 250228

[startup+0.700403 s]
/proc/loadavg: 7.34 7.99 8.06 5/184 5852
/proc/meminfo: memFree=29686792/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=253824 CPUtime=2.77 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 7071 0 0 0 277 0 0 0 25 0 4 0 520267872 259915776 4329 33554432000 4194304 4623224 140734513570384 18446744073709551615 4517551 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 63456 4330 344 105 0 58960 0
[pid=5852/tid=5853] ppid=5850 vsize=253824 CPUtime=0.69 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1865 0 0 0 69 0 0 0 25 0 4 0 520267873 259915776 4330 33554432000 4194304 4623224 140734513570384 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=253824 CPUtime=0.69 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1847 0 0 0 69 0 0 0 18 0 4 0 520267873 259915776 4330 33554432000 4194304 4623224 140734513570384 18446744073709551615 4464117 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=253824 CPUtime=0.69 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 2033 0 0 0 69 0 0 0 25 0 4 0 520267873 259915776 4330 33554432000 4194304 4623224 140734513570384 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 253824

[startup+1.50025 s]
/proc/loadavg: 7.34 7.99 8.06 9/188 5856
/proc/meminfo: memFree=29660128/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=258940 CPUtime=5.97 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 11619 0 0 0 596 1 0 0 25 0 4 0 520267872 265154560 6819 33554432000 4194304 4623224 140734513570384 18446744073709551615 4414480 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 64735 6819 344 105 0 60239 0
[pid=5852/tid=5853] ppid=5850 vsize=258940 CPUtime=1.48 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 3177 0 0 0 148 0 0 0 25 0 4 0 520267873 265154560 6819 33554432000 4194304 4623224 140734513570384 18446744073709551615 4378339 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=258940 CPUtime=1.49 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 3464 0 0 0 149 0 0 0 19 0 4 0 520267873 265154560 6819 33554432000 4194304 4623224 140734513570384 18446744073709551615 4366389 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=258940 CPUtime=1.49 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 3089 0 0 0 149 0 0 0 25 0 4 0 520267873 265154560 6819 33554432000 4194304 4623224 140734513570384 18446744073709551615 4366428 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 258940

[startup+3.10096 s]
/proc/loadavg: 7.34 7.99 8.06 9/188 5856
/proc/meminfo: memFree=29638428/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=263616 CPUtime=12.37 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 18170 0 0 0 1235 2 0 0 25 0 4 0 520267872 269942784 10269 33554432000 4194304 4623224 140734513570384 18446744073709551615 4280224 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 65904 10269 344 105 0 61408 0
[pid=5852/tid=5853] ppid=5850 vsize=263616 CPUtime=3.07 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 5864 0 0 0 307 0 0 0 25 0 4 0 520267873 269942784 10269 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=263616 CPUtime=3.08 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 5505 0 0 0 308 0 0 0 23 0 4 0 520267873 269942784 10269 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=263616 CPUtime=3.09 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 4296 0 0 0 309 0 0 0 25 0 4 0 520267873 269942784 10269 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376883 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.37
Current children cumulated vsize (KiB) 263616

[startup+6.30037 s]
/proc/loadavg: 7.47 8.01 8.07 9/188 5856
/proc/meminfo: memFree=29584304/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=276952 CPUtime=25.15 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 30798 0 0 0 2510 5 0 0 25 0 4 0 520267872 283598848 16897 33554432000 4194304 4623224 140734513570384 18446744073709551615 4517488 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 69238 16897 376 105 0 64742 0
[pid=5852/tid=5853] ppid=5850 vsize=276952 CPUtime=6.26 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 9360 0 0 0 625 1 0 0 25 0 4 0 520267873 283598848 16897 33554432000 4194304 4623224 140734513570384 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=276952 CPUtime=6.29 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 8634 0 0 0 628 1 0 0 25 0 4 0 520267873 283598848 16897 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=276952 CPUtime=6.28 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 8811 0 0 0 627 1 0 0 25 0 4 0 520267873 283598848 16897 33554432000 4194304 4623224 140734513570384 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.15
Current children cumulated vsize (KiB) 276952

[startup+12.7012 s]
/proc/loadavg: 7.51 8.01 8.07 9/188 5856
/proc/meminfo: memFree=29512312/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=291024 CPUtime=50.71 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 47913 0 0 0 5063 8 0 0 25 0 4 0 520267872 298008576 24909 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510978 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 72756 24909 410 105 0 68260 0
[pid=5852/tid=5853] ppid=5850 vsize=291024 CPUtime=12.62 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 13128 0 0 0 1260 2 0 0 25 0 4 0 520267873 298008576 24909 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=291024 CPUtime=12.69 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 13155 0 0 0 1267 2 0 0 25 0 4 0 520267873 298008576 24909 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=291024 CPUtime=12.68 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 15701 0 0 0 1266 2 0 0 25 0 4 0 520267873 298008576 24909 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 291024

[startup+25.5008 s]
/proc/loadavg: 7.62 8.01 8.07 9/188 5857
/proc/meminfo: memFree=29418184/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=314724 CPUtime=101.84 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 66734 0 0 0 10171 13 0 0 25 0 4 0 520267872 322277376 37130 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 78681 37130 503 105 0 74185 0
[pid=5852/tid=5853] ppid=5850 vsize=314724 CPUtime=25.35 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 20199 0 0 0 2531 4 0 0 25 0 4 0 520267873 322277376 37130 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=314724 CPUtime=25.48 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 19393 0 0 0 2545 3 0 0 25 0 4 0 520267873 322277376 37130 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=314724 CPUtime=25.49 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 18427 0 0 0 2546 3 0 0 25 0 4 0 520267873 322277376 37130 33554432000 4194304 4623224 140734513570384 18446744073709551615 255376998555 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.84
Current children cumulated vsize (KiB) 314724

[startup+51.1011 s]
/proc/loadavg: 7.81 8.02 8.07 9/188 5857
/proc/meminfo: memFree=29284008/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=346204 CPUtime=204.11 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 95239 0 0 0 20388 23 0 0 25 0 4 0 520267872 354512896 55736 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 86551 55736 753 105 0 82055 0
[pid=5852/tid=5853] ppid=5850 vsize=346204 CPUtime=50.81 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 30709 0 0 0 5072 9 0 0 25 0 4 0 520267873 354512896 55736 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376646 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=346204 CPUtime=51.09 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 29007 0 0 0 5103 6 0 0 25 0 4 0 520267873 354512896 55736 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=346204 CPUtime=51.09 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 22308 0 0 0 5105 4 0 0 25 0 4 0 520267873 354512896 55736 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 204.11
Current children cumulated vsize (KiB) 346204

[startup+102.301 s]
/proc/loadavg: 8.11 8.07 8.09 9/188 5859
/proc/meminfo: memFree=29103208/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=467196 CPUtime=408.64 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 240543 0 0 0 40819 45 0 0 25 0 4 0 520267872 478408704 69517 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 116799 69517 344 105 0 112303 0
[pid=5852/tid=5853] ppid=5850 vsize=467196 CPUtime=101.73 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 41647 0 0 0 10161 12 0 0 25 0 4 0 520267873 478408704 69517 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=467196 CPUtime=102.28 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 44246 0 0 0 10220 8 0 0 25 0 4 0 520267873 478408704 69517 33554432000 4194304 4623224 140734513570384 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=467196 CPUtime=102.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 133532 0 0 0 10210 19 0 0 25 0 4 0 520267873 478408704 69517 33554432000 4194304 4623224 140734513570384 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.64
Current children cumulated vsize (KiB) 467196

[startup+162.3 s]

################
# More data... #
################

[pid=5852] ppid=5850 vsize=1076704 CPUtime=2565.67 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1616160 0 0 0 256273 294 0 0 25 0 4 0 520267872 1102544896 188509 33554432000 4194304 4623224 140734513570384 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 269176 188509 1107 105 0 264680 0
[pid=5852/tid=5853] ppid=5850 vsize=1076704 CPUtime=638.8 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 97411 0 0 0 63844 36 0 0 25 0 4 0 520267873 1102544896 188509 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1076704 CPUtime=642.24 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 100374 0 0 0 64199 25 0 0 25 0 4 0 520267873 1102544896 188509 33554432000 4194304 4623224 140734513570384 18446744073709551615 4377583 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1076704 CPUtime=642.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1348427 0 0 0 64008 221 0 0 25 0 4 0 520267873 1102544896 188509 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2565.67
Current children cumulated vsize (KiB) 1076704

[startup+702.3 s]
/proc/loadavg: 8.17 8.20 8.14 9/188 5875
/proc/meminfo: memFree=28022560/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=1079820 CPUtime=2805.34 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1624341 0 0 0 280234 300 0 0 25 0 4 0 520267872 1105735680 196642 33554432000 4194304 4623224 140734513570384 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 269955 196642 1107 105 0 265459 0
[pid=5852/tid=5853] ppid=5850 vsize=1079820 CPUtime=698.47 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 100866 0 0 0 69808 39 0 0 25 0 4 0 520267873 1105735680 196642 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1079820 CPUtime=702.24 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 103184 0 0 0 70196 28 0 0 25 0 4 0 520267873 1105735680 196642 33554432000 4194304 4623224 140734513570384 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1079820 CPUtime=702.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1349510 0 0 0 70008 221 0 0 25 0 4 0 520267873 1105735680 196642 33554432000 4194304 4623224 140734513570384 18446744073709551615 4550432 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2805.34
Current children cumulated vsize (KiB) 1079820

[startup+762.3 s]
/proc/loadavg: 8.21 8.21 8.15 9/188 5876
/proc/meminfo: memFree=27934496/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=1080128 CPUtime=3045.04 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1631328 0 0 0 304197 307 0 0 25 0 4 0 520267872 1106051072 203559 33554432000 4194304 4623224 140734513570384 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 270032 203559 1107 105 0 265536 0
[pid=5852/tid=5853] ppid=5850 vsize=1080128 CPUtime=758.15 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 103910 0 0 0 75772 43 0 0 25 0 4 0 520267873 1106051072 203559 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1080128 CPUtime=762.25 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 105434 0 0 0 76195 30 0 0 25 0 4 0 520267873 1106051072 203559 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1080128 CPUtime=762.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1350078 0 0 0 76008 221 0 0 25 0 4 0 520267873 1106051072 203559 33554432000 4194304 4623224 140734513570384 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3045.04
Current children cumulated vsize (KiB) 1080128

[startup+822.301 s]
/proc/loadavg: 8.07 8.17 8.13 9/188 5878
/proc/meminfo: memFree=27821888/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=1183056 CPUtime=3284.7 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1674221 0 0 0 328153 317 0 0 25 0 4 0 520267872 1211449344 220869 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510142 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 295764 220869 1107 105 0 291268 0
[pid=5852/tid=5853] ppid=5850 vsize=1183056 CPUtime=817.82 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 136726 0 0 0 81733 49 0 0 25 0 4 0 520267873 1211449344 220869 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376946 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1183056 CPUtime=822.24 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 113754 0 0 0 82190 34 0 0 25 0 4 0 520267873 1211449344 220869 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376659 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1183056 CPUtime=822.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1350905 0 0 0 82008 221 0 0 25 0 4 0 520267873 1211449344 220869 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3284.7
Current children cumulated vsize (KiB) 1183056

[startup+882.307 s]
/proc/loadavg: 8.03 8.13 8.12 9/188 5879
/proc/meminfo: memFree=27737672/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=1238540 CPUtime=3524.39 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1723937 0 0 0 352111 328 0 0 25 0 4 0 520267872 1268264960 229605 33554432000 4194304 4623224 140734513570384 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 309635 229605 1107 105 0 305139 0
[pid=5852/tid=5853] ppid=5850 vsize=1238540 CPUtime=877.5 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 144363 0 0 0 87700 50 0 0 25 0 4 0 520267873 1268264960 229605 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1238540 CPUtime=882.23 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 143146 0 0 0 88183 40 0 0 25 0 4 0 520267873 1268264960 229605 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1238540 CPUtime=882.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1352014 0 0 0 88007 222 0 0 25 0 4 0 520267873 1268264960 229605 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3524.39
Current children cumulated vsize (KiB) 1238540

[startup+942.301 s]
/proc/loadavg: 8.01 8.11 8.11 9/188 5881
/proc/meminfo: memFree=27683964/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=1252480 CPUtime=3764.04 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1730039 0 0 0 376072 332 0 0 25 0 4 0 520267872 1282539520 235531 33554432000 4194304 4623224 140734513570384 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 313120 235531 1107 105 0 308624 0
[pid=5852/tid=5853] ppid=5850 vsize=1252480 CPUtime=937.18 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 144636 0 0 0 93667 51 0 0 25 0 4 0 520267873 1282539520 235531 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1252480 CPUtime=942.23 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 144832 0 0 0 94180 43 0 0 25 0 4 0 520267873 1282539520 235531 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1252480 CPUtime=942.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1355676 0 0 0 94006 223 0 0 25 0 4 0 520267873 1282539520 235531 33554432000 4194304 4623224 140734513570384 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3764.04
Current children cumulated vsize (KiB) 1252480

[startup+1002.3 s]
/proc/loadavg: 8.08 8.11 8.11 9/188 5883
/proc/meminfo: memFree=27622688/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=1255396 CPUtime=4003.71 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1733606 0 0 0 400037 334 0 0 25 0 4 0 520267872 1285525504 238999 33554432000 4194304 4623224 140734513570384 18446744073709551615 4511029 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 313849 238999 1107 105 0 309353 0
[pid=5852/tid=5853] ppid=5850 vsize=1255396 CPUtime=996.85 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 145170 0 0 0 99634 51 0 0 25 0 4 0 520267873 1285525504 238999 33554432000 4194304 4623224 140734513570384 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1255396 CPUtime=1002.23 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 146231 0 0 0 100178 45 0 0 25 0 4 0 520267873 1285525504 238999 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1255396 CPUtime=1002.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1356698 0 0 0 100006 223 0 0 25 0 4 0 520267873 1285525504 238999 33554432000 4194304 4623224 140734513570384 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4003.71
Current children cumulated vsize (KiB) 1255396

[startup+1062.3 s]
/proc/loadavg: 8.07 8.11 8.10 9/188 5884
/proc/meminfo: memFree=27569596/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=1258640 CPUtime=4243.39 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1740221 0 0 0 423999 340 0 0 25 0 4 0 520267872 1288847360 245514 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 314660 245514 1107 105 0 310164 0
[pid=5852/tid=5853] ppid=5850 vsize=1258640 CPUtime=1056.53 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 147250 0 0 0 105599 54 0 0 25 0 4 0 520267873 1288847360 245514 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1258640 CPUtime=1062.22 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 148439 0 0 0 106175 47 0 0 25 0 4 0 520267873 1288847360 245514 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1258640 CPUtime=1062.28 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1357984 0 0 0 106005 223 0 0 25 0 4 0 520267873 1288847360 245514 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4243.39
Current children cumulated vsize (KiB) 1258640

[startup+1122.3 s]
/proc/loadavg: 8.06 8.10 8.10 9/188 5886
/proc/meminfo: memFree=27503108/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=1291584 CPUtime=4483.05 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1765919 0 0 0 447957 348 0 0 25 0 4 0 520267872 1322582016 256081 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 322896 256081 1107 105 0 318400 0
[pid=5852/tid=5853] ppid=5850 vsize=1291584 CPUtime=1116.2 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 149801 0 0 0 111563 57 0 0 25 0 4 0 520267873 1322582016 256081 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1291584 CPUtime=1122.21 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 153209 0 0 0 112172 49 0 0 25 0 4 0 520267873 1322582016 256081 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1291584 CPUtime=1122.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1358710 0 0 0 112005 224 0 0 25 0 4 0 520267873 1322582016 256081 33554432000 4194304 4623224 140734513570384 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4483.05
Current children cumulated vsize (KiB) 1291584

[startup+1182.3 s]
/proc/loadavg: 8.18 8.12 8.10 9/188 5887
/proc/meminfo: memFree=27453244/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=1294132 CPUtime=4722.73 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1772373 0 0 0 471919 354 0 0 25 0 4 0 520267872 1325191168 262523 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 323533 262523 1107 105 0 319037 0
[pid=5852/tid=5853] ppid=5850 vsize=1294132 CPUtime=1175.88 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 152416 0 0 0 117528 60 0 0 25 0 4 0 520267873 1325191168 262523 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1294132 CPUtime=1182.21 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 155054 0 0 0 118170 51 0 0 25 0 4 0 520267873 1325191168 262523 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1294132 CPUtime=1182.29 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1359839 0 0 0 118005 224 0 0 25 0 4 0 520267873 1325191168 262523 33554432000 4194304 4623224 140734513570384 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4722.73
Current children cumulated vsize (KiB) 1294132



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.13 8.11 8.10 5/180 5906
/proc/meminfo: memFree=28681236/32951124 swapFree=67111352/67111528
[pid=5852] ppid=5850 vsize=1294132 CPUtime=4800.24 cores=0,2,4,6
/proc/5852/stat : 5852 (SArTagnan) R 5850 5852 4914 0 -1 4202496 1773895 0 0 0 479668 356 0 0 25 0 4 0 520267872 1325191168 264040 33554432000 4194304 4623224 140734513570384 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5852/statm: 323533 264040 1107 105 0 319037 0
[pid=5852/tid=5853] ppid=5850 vsize=1294132 CPUtime=1195.17 cores=0,2,4,6
/proc/5852/task/5853/stat : 5853 (SArTagnan) R 5850 5852 4914 0 -1 4202560 153015 0 0 0 119456 61 0 0 25 0 4 0 520267873 1325191168 264040 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5852/tid=5854] ppid=5850 vsize=1294132 CPUtime=1201.62 cores=0,2,4,6
/proc/5852/task/5854/stat : 5854 (SArTagnan) R 5850 5852 4914 0 -1 4202560 155759 0 0 0 120109 53 0 0 25 0 4 0 520267873 1325191168 264040 33554432000 4194304 4623224 140734513570384 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5852/tid=5855] ppid=5850 vsize=1294132 CPUtime=1201.69 cores=0,2,4,6
/proc/5852/task/5855/stat : 5855 (SArTagnan) R 5850 5852 4914 0 -1 4202560 1359897 0 0 0 119945 224 0 0 25 0 4 0 520267873 1325191168 264040 33554432000 4194304 4623224 140734513570384 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 1294132

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.77
CPU time (s): 4800.33
CPU user time (s): 4796.71
CPU system time (s): 3.61845
CPU usage (%): 399.439
Max. virtual memory (cumulated for all children) (KiB): 1314144

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.71
system time used= 3.61845
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1773895
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 211
involuntary context switches= 71308

runsolver used 1.81572 second user time and 4.74728 second system time

The end

Launcher Data 

Begin job on node135 at 2011-04-29 16:18:20
IDJOB=3274111
IDBENCH=83153
IDSOLVER=1656
FILE ID=node135/3274111-1304086700
RUNJOBID= node135-1304086697-5799
PBS_JOBID= 13170518
Free space on /tmp= 71120 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n260-s62321009-sat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3274111-1304086700/watcher-3274111-1304086700 -o /tmp/evaluation-result-3274111-1304086700/solver-3274111-1304086700 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3274111-1304086700.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f2b430bdd9bc1c472e9e437567706bb7
RANDOM SEED=1537553463

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29687180 kB
Buffers:        906656 kB
Cached:        1725572 kB
SwapCached:        172 kB
Active:         160432 kB
Inactive:      2585696 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29687180 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:            1120 kB
Writeback:           0 kB
AnonPages:      114096 kB
Mapped:          15392 kB
Slab:           453616 kB
PageTables:       4860 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   296860 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71120 MiB
End job on node135 at 2011-04-29 16:38:24