Trace number 3386078

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3894.13 1300.05

General information on the benchmark

NameSAT03/handmade/stanion/hwb/
hwb-n30-02-S77299857.shuffled-as.sat03-1633.cnf
MD5SUMbdf2c49c74bfdbd3bd4663dca402d24f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables194
Number of clauses954
Sum of the clauses size3252
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 210
Number of clauses of size 3544
Number of clauses of size 4400
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386078-1305582458/watcher-3386078-1305582458 -o /tmp/evaluation-result-3386078-1305582458/solver-3386078-1305582458 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386078-1305582458.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.75 6.19 7.55 5/365 28513
/proc/meminfo: memFree=14853424/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=49356 CPUtime=0.01 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 488 0 0 0 1 0 0 0 20 0 4 0 669845424 50540544 425 33554432000 4194304 4625164 140734941490512 18446744073709551615 47766700894134 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/28513/statm: 12339 425 300 106 0 7842 0
[pid=28513/tid=28516] ppid=28511 vsize=49356 CPUtime=0 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 4 0 669845424 50540544 425 33554432000 4194304 4625164 140734941490512 18446744073709551615 47766700894130 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=49356 CPUtime=0 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 0 0 0 0 0 0 0 0 21 0 4 0 669845424 50540544 425 33554432000 4194304 4625164 140734941490512 18446744073709551615 47766700894128 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=49356 CPUtime=0 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 0 0 0 0 0 0 0 0 22 0 4 0 669845425 50540544 425 33554432000 4194304 4625164 140734941490512 18446744073709551615 274664864753 0 0 4096 2 0 0 0 -1 4 0 0 0

[startup+0.100443 s]
/proc/loadavg: 5.75 6.19 7.55 5/365 28513
/proc/meminfo: memFree=14853424/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=181308 CPUtime=0.27 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 1001 0 0 0 27 0 0 0 22 0 4 0 669845424 185659392 846 33554432000 4194304 4625164 140734941490512 18446744073709551615 4512007 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/28513/statm: 45327 846 342 106 0 40830 0
[pid=28513/tid=28516] ppid=28511 vsize=181308 CPUtime=0.08 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 143 0 0 0 8 0 0 0 22 0 4 0 669845424 185659392 846 33554432000 4194304 4625164 140734941490512 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=181308 CPUtime=0.09 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 161 0 0 0 9 0 0 0 22 0 4 0 669845424 185659392 846 33554432000 4194304 4625164 140734941490512 18446744073709551615 4462583 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=181308 CPUtime=0 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 14 0 0 0 0 0 0 0 23 0 4 0 669845425 185659392 846 33554432000 4194304 4625164 140734941490512 18446744073709551615 4328582 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 181308

[startup+0.202436 s]
/proc/loadavg: 5.75 6.19 7.55 5/365 28513
/proc/meminfo: memFree=14853424/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=248144 CPUtime=0.58 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 1713 0 0 0 55 3 0 0 22 0 4 0 669845424 254099456 1316 33554432000 4194304 4625164 140734941490512 18446744073709551615 4512758 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 62036 1416 345 106 0 57539 0
[pid=28513/tid=28516] ppid=28511 vsize=248924 CPUtime=0.19 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 255 0 0 0 18 1 0 0 22 0 4 0 669845424 254898176 1709 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=248924 CPUtime=0.3 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 536 0 0 0 23 7 0 0 17 0 4 0 669845424 254898176 1709 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=248924 CPUtime=0.26 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 463 0 0 0 26 0 0 0 18 0 4 0 669845425 254898176 1709 33554432000 4194304 4625164 140734941490512 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 248144

[startup+0.564364 s]
/proc/loadavg: 5.75 6.19 7.55 5/365 28513
/proc/meminfo: memFree=14853424/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=249816 CPUtime=1.34 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 2943 0 0 0 125 9 0 0 22 0 4 0 669845424 255811584 2073 33554432000 4194304 4625164 140734941490512 18446744073709551615 274664505099 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 62454 2073 345 106 0 57957 0
[pid=28513/tid=28516] ppid=28511 vsize=249816 CPUtime=0.29 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 611 0 0 0 28 1 0 0 23 0 4 0 669845424 255811584 2073 33554432000 4194304 4625164 140734941490512 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=249816 CPUtime=0.4 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 783 0 0 0 33 7 0 0 17 0 4 0 669845424 255811584 2073 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=249816 CPUtime=0.36 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 693 0 0 0 36 0 0 0 18 0 4 0 669845425 255811584 2073 33554432000 4194304 4625164 140734941490512 18446744073709551615 4327632 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1.34
Current children cumulated vsize (KiB) 249816

[startup+0.700341 s]
/proc/loadavg: 5.75 6.19 7.55 5/365 28513
/proc/meminfo: memFree=14853424/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=250568 CPUtime=1.76 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 4012 0 0 0 166 10 0 0 22 0 4 0 669845424 256581632 2601 33554432000 4194304 4625164 140734941490512 18446744073709551615 274664505099 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 62642 2601 345 106 0 58145 0
[pid=28513/tid=28516] ppid=28511 vsize=250568 CPUtime=0.43 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1006 0 0 0 42 1 0 0 24 0 4 0 669845424 256581632 2601 33554432000 4194304 4625164 140734941490512 18446744073709551615 4462538 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=250568 CPUtime=0.53 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1127 0 0 0 46 7 0 0 17 0 4 0 669845424 256581632 2601 33554432000 4194304 4625164 140734941490512 18446744073709551615 274664469189 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=250568 CPUtime=0.49 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1023 0 0 0 49 0 0 0 18 0 4 0 669845425 256581632 2601 33554432000 4194304 4625164 140734941490512 18446744073709551615 4552336 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1.76
Current children cumulated vsize (KiB) 250568

[startup+1.5012 s]
/proc/loadavg: 5.75 6.19 7.55 11/377 28528
/proc/meminfo: memFree=14820312/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=252752 CPUtime=4.15 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 11580 0 0 0 404 11 0 0 22 0 4 0 669845424 258818048 4659 33554432000 4194304 4625164 140734941490512 18446744073709551615 274664505544 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 63188 4659 346 106 0 58691 0
[pid=28513/tid=28516] ppid=28511 vsize=252752 CPUtime=1.22 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 2485 0 0 0 121 1 0 0 25 0 4 0 669845424 258818048 4659 33554432000 4194304 4625164 140734941490512 18446744073709551615 4353637 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=252752 CPUtime=1.33 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 2536 0 0 0 126 7 0 0 18 0 4 0 669845424 258818048 4659 33554432000 4194304 4625164 140734941490512 18446744073709551615 4352056 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=252752 CPUtime=1.28 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 5699 0 0 0 128 0 0 0 19 0 4 0 669845425 258818048 4659 33554432000 4194304 4625164 140734941490512 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4.15
Current children cumulated vsize (KiB) 252752

[startup+3.10092 s]
/proc/loadavg: 5.75 6.19 7.55 11/377 28528
/proc/meminfo: memFree=14803324/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=258048 CPUtime=8.91 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 20664 0 0 0 878 13 0 0 24 0 4 0 669845424 264241152 7774 33554432000 4194304 4625164 140734941490512 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 64512 7774 349 106 0 60015 0
[pid=28513/tid=28516] ppid=28511 vsize=258048 CPUtime=2.79 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 4244 0 0 0 277 2 0 0 25 0 4 0 669845424 264241152 7774 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=258048 CPUtime=2.39 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 3698 0 0 0 231 8 0 0 19 0 4 0 669845424 264241152 7774 33554432000 4194304 4625164 140734941490512 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=258048 CPUtime=2.89 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 11322 0 0 0 288 1 0 0 23 0 4 0 669845425 264241152 7774 33554432000 4194304 4625164 140734941490512 18446744073709551615 4551080 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 8.91
Current children cumulated vsize (KiB) 258048

[startup+6.30037 s]
/proc/loadavg: 6.17 6.27 7.57 11/377 28528
/proc/meminfo: memFree=14772068/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=269568 CPUtime=18.47 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 27618 0 0 0 1833 14 0 0 25 0 4 0 669845424 276037632 11333 33554432000 4194304 4625164 140734941490512 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 67392 11333 352 106 0 62895 0
[pid=28513/tid=28516] ppid=28511 vsize=269568 CPUtime=5.94 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 6237 0 0 0 592 2 0 0 25 0 4 0 669845424 276037632 11333 33554432000 4194304 4625164 140734941490512 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=269568 CPUtime=3.99 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 4985 0 0 0 391 8 0 0 25 0 4 0 669845424 276037632 11333 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=269568 CPUtime=6.09 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 14299 0 0 0 608 1 0 0 25 0 4 0 669845425 276037632 11333 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 18.47
Current children cumulated vsize (KiB) 269568

[startup+12.7003 s]
/proc/loadavg: 6.48 6.33 7.58 11/377 28529
/proc/meminfo: memFree=14727028/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=280544 CPUtime=37.56 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 36048 0 0 0 3740 16 0 0 25 0 4 0 669845424 287277056 16786 33554432000 4194304 4625164 140734941490512 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 70136 16786 398 106 0 65639 0
[pid=28513/tid=28516] ppid=28511 vsize=280544 CPUtime=12.24 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 9896 0 0 0 1220 4 0 0 25 0 4 0 669845424 287277056 16786 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=280544 CPUtime=7.19 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 7236 0 0 0 710 9 0 0 25 0 4 0 669845424 287277056 16786 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=280544 CPUtime=12.49 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 15492 0 0 0 1248 1 0 0 25 0 4 0 669845425 287277056 16786 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37.56
Current children cumulated vsize (KiB) 280544

[startup+25.501 s]
/proc/loadavg: 7.26 6.51 7.62 11/377 28529
/proc/meminfo: memFree=14665408/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=296412 CPUtime=75.83 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 46579 0 0 0 7565 18 0 0 25 0 4 0 669845424 303525888 24958 33554432000 4194304 4625164 140734941490512 18446744073709551615 4356337 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 74103 24958 419 106 0 69606 0
[pid=28513/tid=28516] ppid=28511 vsize=296412 CPUtime=23.82 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 14651 0 0 0 2378 4 0 0 25 0 4 0 669845424 303525888 24958 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=296412 CPUtime=13.59 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 9015 0 0 0 1349 10 0 0 25 0 4 0 669845424 303525888 24958 33554432000 4194304 4625164 140734941490512 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=296412 CPUtime=25.29 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 18009 0 0 0 2528 1 0 0 25 0 4 0 669845425 303525888 24958 33554432000 4194304 4625164 140734941490512 18446744073709551615 4552423 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 75.83
Current children cumulated vsize (KiB) 296412

[startup+51.1006 s]
/proc/loadavg: 8.26 6.81 7.69 11/377 28530
/proc/meminfo: memFree=14562232/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=327888 CPUtime=159.53 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 69346 0 0 0 15923 30 0 0 25 0 4 0 669845424 335757312 38506 33554432000 4194304 4625164 140734941490512 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 81972 38506 534 106 0 77475 0
[pid=28513/tid=28516] ppid=28511 vsize=327888 CPUtime=43.68 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 21977 0 0 0 4355 13 0 0 25 0 4 0 669845424 335757312 38506 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=327888 CPUtime=26.29 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 17864 0 0 0 2616 13 0 0 25 0 4 0 669845424 335757312 38506 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=327888 CPUtime=50.86 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 20931 0 0 0 5085 1 0 0 25 0 4 0 669845425 335757312 38506 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 159.53
Current children cumulated vsize (KiB) 327888

[startup+102.301 s]
/proc/loadavg: 9.28 7.31 7.81 11/377 28531
/proc/meminfo: memFree=14424464/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=350504 CPUtime=314.99 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 155580 0 0 0 31453 46 0 0 25 0 4 0 669845424 358916096 52373 33554432000 4194304 4625164 140734941490512 18446744073709551615 4393263 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 87626 52373 482 106 0 83129 0
[pid=28513/tid=28516] ppid=28511 vsize=350504 CPUtime=71.68 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 32575 0 0 0 7151 17 0 0 25 0 4 0 669845424 358916096 52373 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=350504 CPUtime=69.23 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 28051 0 0 0 6907 16 0 0 25 0 4 0 669845424 358916096 52373 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=350504 CPUtime=88.05 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 81498 0 0 0 8796 9 0 0 25 0 4 0 669845425 358916096 52373 33554432000 4194304 4625164 140734941490512 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 314.99
Current children cumulated vsize (KiB) 350504

[startup+162.3 s]

################
# More data... #
################

[pid=28513] ppid=28511 vsize=842716 CPUtime=2107.43 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 943824 0 0 0 210555 188 0 0 25 0 4 0 669845424 862941184 152146 33554432000 4194304 4625164 140734941490512 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 210679 152146 983 106 0 206182 0
[pid=28513/tid=28516] ppid=28511 vsize=842716 CPUtime=624.16 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 92292 0 0 0 62375 41 0 0 25 0 4 0 669845424 862941184 152146 33554432000 4194304 4625164 140734941490512 18446744073709551615 4462650 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=842716 CPUtime=379.43 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 94239 0 0 0 37908 35 0 0 25 0 4 0 669845424 862941184 152146 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=842716 CPUtime=417.99 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 721925 0 0 0 41695 104 0 0 25 0 4 0 669845425 862941184 152146 33554432000 4194304 4625164 140734941490512 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2107.43
Current children cumulated vsize (KiB) 842716

[startup+762.3 s]
/proc/loadavg: 10.04 9.78 8.96 11/377 28549
/proc/meminfo: memFree=13569376/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=931032 CPUtime=2286.68 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 1038520 0 0 0 228466 202 0 0 25 0 4 0 669845424 953376768 158782 33554432000 4194304 4625164 140734941490512 18446744073709551615 4512066 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 232758 158782 983 106 0 228261 0
[pid=28513/tid=28516] ppid=28511 vsize=931032 CPUtime=683.43 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 116673 0 0 0 68298 45 0 0 25 0 4 0 669845424 953376768 158782 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=931032 CPUtime=409.43 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 94390 0 0 0 40908 35 0 0 25 0 4 0 669845424 953376768 158782 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=931032 CPUtime=448 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 791592 0 0 0 44686 114 0 0 25 0 4 0 669845425 953376768 158782 33554432000 4194304 4625164 140734941490512 18446744073709551615 4552388 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2286.68
Current children cumulated vsize (KiB) 931032

[startup+822.301 s]
/proc/loadavg: 10.31 9.90 9.05 11/377 28559
/proc/meminfo: memFree=13536040/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=913520 CPUtime=2465.85 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 1141653 0 0 0 246363 222 0 0 25 0 4 0 669845424 935444480 161747 33554432000 4194304 4625164 140734941490512 18446744073709551615 4511933 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 228380 161747 993 106 0 223883 0
[pid=28513/tid=28516] ppid=28511 vsize=913520 CPUtime=742.61 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 118241 0 0 0 74212 49 0 0 25 0 4 0 669845424 935444480 161747 33554432000 4194304 4625164 140734941490512 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=913520 CPUtime=439.43 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 94815 0 0 0 43907 36 0 0 25 0 4 0 669845424 935444480 161747 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351769 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=913520 CPUtime=478 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 885093 0 0 0 47672 128 0 0 25 0 4 0 669845425 935444480 161747 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2465.85
Current children cumulated vsize (KiB) 913520

[startup+882.301 s]
/proc/loadavg: 10.23 9.95 9.11 11/377 28561
/proc/meminfo: memFree=13475280/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=961412 CPUtime=2645.09 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 1274361 0 0 0 264268 241 0 0 25 0 4 0 669845424 984485888 173957 33554432000 4194304 4625164 140734941490512 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 240353 173957 1827 106 0 235856 0
[pid=28513/tid=28516] ppid=28511 vsize=961412 CPUtime=801.87 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 119899 0 0 0 80137 50 0 0 25 0 4 0 669845424 984485888 173957 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351769 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=961412 CPUtime=469.42 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 96613 0 0 0 46905 37 0 0 25 0 4 0 669845424 984485888 173957 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=961412 CPUtime=508 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1005781 0 0 0 50656 144 0 0 25 0 4 0 669845425 984485888 173957 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2645.09
Current children cumulated vsize (KiB) 961412

[startup+942.3 s]
/proc/loadavg: 10.13 9.97 9.17 11/377 28562
/proc/meminfo: memFree=13437572/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=1032228 CPUtime=2824.32 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 1397716 0 0 0 282170 262 0 0 25 0 4 0 669845424 1057001472 177803 33554432000 4194304 4625164 140734941490512 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 258057 177803 1846 106 0 253560 0
[pid=28513/tid=28516] ppid=28511 vsize=1032228 CPUtime=861.12 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 121430 0 0 0 86059 53 0 0 25 0 4 0 669845424 1057001472 177803 33554432000 4194304 4625164 140734941490512 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=1032228 CPUtime=499.42 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 97591 0 0 0 49903 39 0 0 25 0 4 0 669845424 1057001472 177803 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=1032228 CPUtime=538.01 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1125765 0 0 0 53640 161 0 0 25 0 4 0 669845425 1057001472 177803 33554432000 4194304 4625164 140734941490512 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2824.32
Current children cumulated vsize (KiB) 1032228

[startup+1002.3 s]
/proc/loadavg: 10.15 10.00 9.23 11/377 28564
/proc/meminfo: memFree=13414500/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=1037772 CPUtime=3003.6 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 1539131 0 0 0 300074 286 0 0 25 0 4 0 669845424 1062678528 181389 33554432000 4194304 4625164 140734941490512 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 259443 181389 1853 106 0 254946 0
[pid=28513/tid=28516] ppid=28511 vsize=1037772 CPUtime=920.38 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 123029 0 0 0 91984 54 0 0 25 0 4 0 669845424 1062678528 181389 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=1037772 CPUtime=529.41 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 98612 0 0 0 52902 39 0 0 25 0 4 0 669845424 1062678528 181389 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=1037772 CPUtime=568.03 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1264310 0 0 0 56620 183 0 0 25 0 4 0 669845425 1062678528 181389 33554432000 4194304 4625164 140734941490512 18446744073709551615 4548757 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3003.6
Current children cumulated vsize (KiB) 1037772

[startup+1062.3 s]
/proc/loadavg: 10.17 10.03 9.29 11/377 28566
/proc/meminfo: memFree=13383492/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=1043052 CPUtime=3182.82 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 1693181 0 0 0 317970 312 0 0 25 0 4 0 669845424 1068085248 186474 33554432000 4194304 4625164 140734941490512 18446744073709551615 4512789 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28513/statm: 260763 186474 1820 106 0 256266 0
[pid=28513/tid=28516] ppid=28511 vsize=1043052 CPUtime=979.6 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 126193 0 0 0 97905 55 0 0 25 0 4 0 669845424 1068085248 186474 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=1043052 CPUtime=559.5 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 99620 0 0 0 55909 41 0 0 25 0 4 0 669845424 1068085248 186474 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351989 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=1043052 CPUtime=597.95 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1413149 0 0 0 59590 205 0 0 25 0 4 0 669845425 1068085248 186474 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3182.82
Current children cumulated vsize (KiB) 1043052

[startup+1122.3 s]
/proc/loadavg: 10.48 10.12 9.36 12/378 28570
/proc/meminfo: memFree=13280264/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=1093960 CPUtime=3361.46 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 1861493 0 0 0 335806 340 0 0 25 0 4 0 669845424 1120215040 198103 33554432000 4194304 4625164 140734941490512 18446744073709551615 4512193 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/28513/statm: 273490 198103 1859 106 0 268993 0
[pid=28513/tid=28516] ppid=28511 vsize=1093960 CPUtime=1038.3 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 133282 0 0 0 103771 59 0 0 25 0 4 0 669845424 1120215040 198103 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=1093960 CPUtime=589.5 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 102326 0 0 0 58907 43 0 0 25 0 4 0 669845424 1120215040 198103 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=1093960 CPUtime=627.96 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1571308 0 0 0 62569 227 0 0 25 0 4 0 669845425 1120215040 198103 33554432000 4194304 4625164 140734941490512 18446744073709551615 4339600 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3361.46
Current children cumulated vsize (KiB) 1093960

[startup+1182.3 s]
/proc/loadavg: 10.32 10.14 9.41 11/377 28572
/proc/meminfo: memFree=13285268/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=1093960 CPUtime=3540.97 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 2019302 0 0 0 353730 367 0 0 25 0 4 0 669845424 1120215040 199681 33554432000 4194304 4625164 140734941490512 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28513/statm: 273490 199681 1815 106 0 268993 0
[pid=28513/tid=28516] ppid=28511 vsize=1093960 CPUtime=1098.28 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 134009 0 0 0 109768 60 0 0 25 0 4 0 669845424 1120215040 199681 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=1093960 CPUtime=619.5 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 103211 0 0 0 61905 45 0 0 25 0 4 0 669845424 1120215040 199681 33554432000 4194304 4625164 140734941490512 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=1093960 CPUtime=657.96 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1727010 0 0 0 65545 251 0 0 25 0 4 0 669845425 1120215040 199681 33554432000 4194304 4625164 140734941490512 18446744073709551615 4552438 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3540.97
Current children cumulated vsize (KiB) 1093960

[startup+1242.3 s]
/proc/loadavg: 10.27 10.16 9.46 11/377 28573
/proc/meminfo: memFree=13260084/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=1093960 CPUtime=3720.95 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 2143306 0 0 0 371708 387 0 0 25 0 4 0 669845424 1120215040 202512 33554432000 4194304 4625164 140734941490512 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28513/statm: 273490 202512 1808 106 0 268993 0
[pid=28513/tid=28516] ppid=28511 vsize=1093960 CPUtime=1158.27 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 134213 0 0 0 115767 60 0 0 25 0 4 0 669845424 1120215040 202512 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351798 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=1093960 CPUtime=649.49 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 104216 0 0 0 64903 46 0 0 25 0 4 0 669845424 1120215040 202512 33554432000 4194304 4625164 140734941490512 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=1093960 CPUtime=687.95 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1848835 0 0 0 68526 269 0 0 25 0 4 0 669845425 1120215040 202512 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3720.95
Current children cumulated vsize (KiB) 1093960



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.10 10.13 9.49 11/377 28575
/proc/meminfo: memFree=13211468/32951132 swapFree=67093824/67111528
[pid=28513] ppid=28511 vsize=1093960 CPUtime=3894.08 cores=0,2,4,6
/proc/28513/stat : 28513 (SArTagnan) R 28511 28513 27834 0 -1 4202496 2295388 0 0 0 388998 410 0 0 25 0 4 0 669845424 1120215040 206321 33554432000 4194304 4625164 140734941490512 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28513/statm: 273490 206321 1847 106 0 268993 0
[pid=28513/tid=28516] ppid=28511 vsize=1093960 CPUtime=1215.97 cores=0,2,4,6
/proc/28513/task/28516/stat : 28516 (SArTagnan) R 28511 28513 27834 0 -1 4202560 134395 0 0 0 121537 60 0 0 25 0 4 0 669845424 1120215040 206321 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=28513/tid=28517] ppid=28511 vsize=1093960 CPUtime=678.33 cores=0,2,4,6
/proc/28513/task/28517/stat : 28517 (SArTagnan) R 28511 28513 27834 0 -1 4202560 106691 0 0 0 67785 48 0 0 25 0 4 0 669845424 1120215040 206321 33554432000 4194304 4625164 140734941490512 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28513/tid=28518] ppid=28511 vsize=1093960 CPUtime=716.83 cores=0,2,4,6
/proc/28513/task/28518/stat : 28518 (SArTagnan) R 28511 28513 27834 0 -1 4202560 1997984 0 0 0 71393 290 0 0 25 0 4 0 669845425 1120215040 206321 33554432000 4194304 4625164 140734941490512 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3894.08
Current children cumulated vsize (KiB) 1093960

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.05
CPU time (s): 3894.13
CPU user time (s): 3890
CPU system time (s): 4.13737
CPU usage (%): 299.537
Max. virtual memory (cumulated for all children) (KiB): 1093960

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3890
system time used= 4.13737
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2295388
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 402
involuntary context switches= 32698

runsolver used 4.30934 second user time and 11.2423 second system time

The end

Launcher Data

Begin job on node131 at 2011-05-16 23:47:38
IDJOB=3386078
IDBENCH=84028
IDSOLVER=1871
FILE ID=node131/3386078-1305582458
RUNJOBID= node131-1305582458-28501
PBS_JOBID= 13350211
Free space on /tmp= 73576 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/stanion/hwb/hwb-n30-02-S77299857.shuffled-as.sat03-1633.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386078-1305582458/watcher-3386078-1305582458 -o /tmp/evaluation-result-3386078-1305582458/solver-3386078-1305582458 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386078-1305582458.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bdf2c49c74bfdbd3bd4663dca402d24f
RANDOM SEED=1487079694

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      14853828 kB
Buffers:        309896 kB
Cached:        4743668 kB
SwapCached:       1504 kB
Active:       14135216 kB
Inactive:      3680076 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      14853828 kB
SwapTotal:    67111528 kB
SwapFree:     67093824 kB
Dirty:             404 kB
Writeback:           0 kB
AnonPages:    12759948 kB
Mapped:          32152 kB
Slab:           170648 kB
PageTables:      45856 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 65673844 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73576 MiB
End job on node131 at 2011-05-17 00:09:20