Trace number 3438776

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.4 5008.08

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-7x39.cnf
MD5SUMf717554c4e7f802b3078c48464dbcd9d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1092
Number of clauses64155
Sum of the clauses size253344
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21638
Number of clauses of size 30
Number of clauses of size 462517
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438776-1306923159/watcher-3438776-1306923159 -o /tmp/evaluation-result-3438776-1306923159/solver-3438776-1306923159 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438776-1306923159.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.46 7.95 7.96 2/366 28485
/proc/meminfo: memFree=23034576/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=21472 CPUtime=0.01 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 1116 0 0 0 1 0 0 0 25 0 1 0 803916318 21987328 783 33554432000 4194304 4625164 140735124918176 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/28485/statm: 5368 784 296 106 0 871 0

[startup+0.050642 s]
/proc/loadavg: 7.46 7.95 7.96 2/366 28485
/proc/meminfo: memFree=23034576/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=114760 CPUtime=0.06 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 7626 0 0 0 6 0 0 0 18 0 8 0 803916318 117514240 6257 33554432000 4194304 4625164 140735124918176 18446744073709551615 47372475504566 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 28690 6257 301 106 0 24193 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 114760

[startup+0.100633 s]
/proc/loadavg: 7.46 7.95 7.96 2/366 28485
/proc/meminfo: memFree=23034576/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=261228 CPUtime=0.37 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 10127 0 0 0 36 1 0 0 20 0 8 0 803916318 267497472 8246 33554432000 4194304 4625164 140735124918176 18446744073709551615 4329142 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 65307 7875 344 106 0 60810 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 261228

[startup+0.863024 s]
/proc/loadavg: 7.46 7.95 7.96 2/366 28485
/proc/meminfo: memFree=23034576/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=407160 CPUtime=6.65 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 30127 0 0 0 660 5 0 0 18 0 8 0 803916318 416931840 19539 33554432000 4194304 4625164 140735124918176 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 101790 19539 348 106 0 97293 0
Current children cumulated CPU time (s) 6.65
Current children cumulated vsize (KiB) 407160

[startup+0.942234 s]
/proc/loadavg: 7.46 7.95 7.96 2/366 28485
/proc/meminfo: memFree=23034576/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=411796 CPUtime=7.45 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 33820 0 0 0 739 6 0 0 19 0 8 0 803916318 421679104 21108 33554432000 4194304 4625164 140735124918176 18446744073709551615 4513472 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 102949 21108 348 106 0 98452 0
Current children cumulated CPU time (s) 7.45
Current children cumulated vsize (KiB) 411796

[startup+1.50034 s]
/proc/loadavg: 7.46 7.95 7.96 9/374 28493
/proc/meminfo: memFree=22922344/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=420796 CPUtime=11.56 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 47100 0 0 0 1147 9 0 0 19 0 8 0 803916318 430895104 28172 33554432000 4194304 4625164 140735124918176 18446744073709551615 4512078 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 105199 28172 348 106 0 100702 0
[pid=28485/tid=28487] ppid=28483 vsize=420796 CPUtime=1.45 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 3257 0 0 0 145 0 0 0 20 0 8 0 803916322 430895104 28189 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=420796 CPUtime=1.33 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 3190 0 0 0 133 0 0 0 25 0 8 0 803916322 430895104 28189 33554432000 4194304 4625164 140735124918176 18446744073709551615 4462317 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=420796 CPUtime=1.4 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 16708 0 0 0 137 3 0 0 20 0 8 0 803916322 430895104 28189 33554432000 4194304 4625164 140735124918176 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=420796 CPUtime=1.45 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 3263 0 0 0 145 0 0 0 20 0 8 0 803916322 430895104 28189 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=420796 CPUtime=1.45 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 3359 0 0 0 145 0 0 0 18 0 8 0 803916322 430895104 28189 33554432000 4194304 4625164 140735124918176 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=420796 CPUtime=1.45 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 3423 0 0 0 145 0 0 0 19 0 8 0 803916322 430895104 28189 33554432000 4194304 4625164 140735124918176 18446744073709551615 4352170 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=420796 CPUtime=1.46 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 3199 0 0 0 145 1 0 0 19 0 8 0 803916322 430895104 28189 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.56
Current children cumulated vsize (KiB) 420796

[startup+3.10105 s]
/proc/loadavg: 7.46 7.95 7.96 9/374 28493
/proc/meminfo: memFree=22872372/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=443476 CPUtime=24.26 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 84384 0 0 0 2411 15 0 0 19 0 8 0 803916318 454119424 46297 33554432000 4194304 4625164 140735124918176 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 110869 46297 348 106 0 106372 0
[pid=28485/tid=28487] ppid=28483 vsize=443476 CPUtime=3.05 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 5825 0 0 0 304 1 0 0 25 0 8 0 803916322 454119424 46297 33554432000 4194304 4625164 140735124918176 18446744073709551615 4278245 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=443476 CPUtime=2.91 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 6045 0 0 0 291 0 0 0 25 0 8 0 803916322 454119424 46297 33554432000 4194304 4625164 140735124918176 18446744073709551615 230808826565 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=443476 CPUtime=2.98 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 36395 0 0 0 292 6 0 0 25 0 8 0 803916322 454119424 46297 33554432000 4194304 4625164 140735124918176 18446744073709551615 4555506 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=443476 CPUtime=3.04 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 5930 0 0 0 303 1 0 0 25 0 8 0 803916322 454119424 46297 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=443476 CPUtime=3.04 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 6162 0 0 0 304 0 0 0 19 0 8 0 803916322 454119424 46297 33554432000 4194304 4625164 140735124918176 18446744073709551615 4437076 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=443476 CPUtime=3.04 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 6166 0 0 0 303 1 0 0 25 0 8 0 803916322 454119424 46297 33554432000 4194304 4625164 140735124918176 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=443476 CPUtime=3.04 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 5683 0 0 0 303 1 0 0 25 0 8 0 803916322 454119424 46297 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.26
Current children cumulated vsize (KiB) 443476

[startup+6.30047 s]
/proc/loadavg: 7.50 7.95 7.96 9/374 28493
/proc/meminfo: memFree=22747008/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=486840 CPUtime=49.81 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 143279 0 0 0 4956 25 0 0 25 0 8 0 803916318 498524160 76147 33554432000 4194304 4625164 140735124918176 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 121710 76147 351 106 0 117213 0
[pid=28485/tid=28487] ppid=28483 vsize=486840 CPUtime=6.24 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 9084 0 0 0 623 1 0 0 25 0 8 0 803916322 498524160 76147 33554432000 4194304 4625164 140735124918176 18446744073709551615 4375528 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=486840 CPUtime=6.11 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 10098 0 0 0 610 1 0 0 25 0 8 0 803916322 498524160 76147 33554432000 4194304 4625164 140735124918176 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=486840 CPUtime=6.13 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 71866 0 0 0 602 11 0 0 25 0 8 0 803916322 498524160 76147 33554432000 4194304 4625164 140735124918176 18446744073709551615 4339117 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=486840 CPUtime=6.24 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 9079 0 0 0 623 1 0 0 25 0 8 0 803916322 498524160 76147 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351918 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=486840 CPUtime=6.24 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 9900 0 0 0 623 1 0 0 25 0 8 0 803916322 498524160 76147 33554432000 4194304 4625164 140735124918176 18446744073709551615 4348817 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=486840 CPUtime=6.24 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 9974 0 0 0 622 2 0 0 25 0 8 0 803916322 498524160 76147 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=486840 CPUtime=6.24 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 8907 0 0 0 622 2 0 0 25 0 8 0 803916322 498524160 76147 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 49.81
Current children cumulated vsize (KiB) 486840

[startup+12.7013 s]
/proc/loadavg: 7.54 7.95 7.96 9/374 28493
/proc/meminfo: memFree=22552352/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=784268 CPUtime=100.93 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 244194 0 0 0 10052 41 0 0 25 0 8 0 803916318 803090432 122051 33554432000 4194304 4625164 140735124918176 18446744073709551615 4336844 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 196067 122051 348 106 0 191570 0
[pid=28485/tid=28487] ppid=28483 vsize=784268 CPUtime=12.64 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 14927 0 0 0 1262 2 0 0 25 0 8 0 803916322 803090432 122051 33554432000 4194304 4625164 140735124918176 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=784268 CPUtime=12.51 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 16302 0 0 0 1249 2 0 0 25 0 8 0 803916322 803090432 122051 33554432000 4194304 4625164 140735124918176 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=784268 CPUtime=12.46 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 130037 0 0 0 1226 20 0 0 25 0 8 0 803916322 803090432 122051 33554432000 4194304 4625164 140735124918176 18446744073709551615 4552377 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=784268 CPUtime=12.64 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 14790 0 0 0 1262 2 0 0 25 0 8 0 803916322 803090432 122051 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=784268 CPUtime=12.64 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 16622 0 0 0 1262 2 0 0 25 0 8 0 803916322 803090432 122051 33554432000 4194304 4625164 140735124918176 18446744073709551615 4435117 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=784268 CPUtime=12.64 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 21264 0 0 0 1260 4 0 0 25 0 8 0 803916322 803090432 122051 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=784268 CPUtime=12.64 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 13807 0 0 0 1262 2 0 0 25 0 8 0 803916322 803090432 122051 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 100.93
Current children cumulated vsize (KiB) 784268

[startup+25.501 s]
/proc/loadavg: 7.64 7.95 7.96 9/374 28494
/proc/meminfo: memFree=22268720/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=1093872 CPUtime=203.18 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 391979 0 0 0 20252 66 0 0 25 0 8 0 803916318 1120124928 195691 33554432000 4194304 4625164 140735124918176 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 273468 195692 657 106 0 268971 0
[pid=28485/tid=28487] ppid=28483 vsize=1093872 CPUtime=25.45 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 22433 0 0 0 2541 4 0 0 25 0 8 0 803916322 1120124928 195692 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=1093872 CPUtime=25.32 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 25332 0 0 0 2528 4 0 0 25 0 8 0 803916322 1120124928 195692 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=1093872 CPUtime=25.11 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 222533 0 0 0 2477 34 0 0 25 0 8 0 803916322 1120124928 195692 33554432000 4194304 4625164 140735124918176 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=1093872 CPUtime=25.44 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 21746 0 0 0 2541 3 0 0 25 0 8 0 803916322 1120124928 195692 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=1093872 CPUtime=25.44 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 20300 0 0 0 2541 3 0 0 25 0 8 0 803916322 1120124928 195692 33554432000 4194304 4625164 140735124918176 18446744073709551615 230808826913 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=1093872 CPUtime=25.44 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 31493 0 0 0 2538 6 0 0 25 0 8 0 803916322 1120124928 195692 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=1093872 CPUtime=25.44 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 22757 0 0 0 2540 4 0 0 25 0 8 0 803916322 1120124928 195692 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.18
Current children cumulated vsize (KiB) 1093872

[startup+51.1143 s]
/proc/loadavg: 7.84 7.97 7.97 9/374 28494
/proc/meminfo: memFree=21817072/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=1498852 CPUtime=407.78 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 647923 0 0 0 40668 110 0 0 25 0 8 0 803916318 1534824448 305426 33554432000 4194304 4625164 140735124918176 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 374713 305426 784 106 0 370216 0
[pid=28485/tid=28487] ppid=28483 vsize=1498852 CPUtime=51.06 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 34293 0 0 0 5100 6 0 0 25 0 8 0 803916322 1534824448 305426 33554432000 4194304 4625164 140735124918176 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=1498852 CPUtime=50.92 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 40348 0 0 0 5085 7 0 0 25 0 8 0 803916322 1534824448 305426 33554432000 4194304 4625164 140735124918176 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=1498852 CPUtime=50.41 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 379795 0 0 0 4985 56 0 0 25 0 8 0 803916322 1534824448 305426 33554432000 4194304 4625164 140735124918176 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=1498852 CPUtime=51.06 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 34430 0 0 0 5100 6 0 0 25 0 8 0 803916322 1534824448 305426 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=1498852 CPUtime=51.06 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 37526 0 0 0 5098 8 0 0 25 0 8 0 803916322 1534824448 305426 33554432000 4194304 4625164 140735124918176 18446744073709551615 4349152 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=1498852 CPUtime=51.06 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 49475 0 0 0 5096 10 0 0 25 0 8 0 803916322 1534824448 305426 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=1498852 CPUtime=51.06 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 34361 0 0 0 5099 7 0 0 25 0 8 0 803916322 1534824448 305426 33554432000 4194304 4625164 140735124918176 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 407.78

################
# More data... #
################

Current children cumulated vsize (KiB) 7123632

[startup+4722.3 s]
/proc/loadavg: 8.08 8.06 8.06 9/374 28631
/proc/meminfo: memFree=16597988/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=7123632 CPUtime=37719.5 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 18462191 0 0 0 3768469 3480 0 0 25 0 8 0 803916318 7294599168 1607208 33554432000 4194304 4625164 140735124918176 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 1780908 1607208 400 106 0 1776411 0
[pid=28485/tid=28487] ppid=28483 vsize=7123632 CPUtime=4722.38 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 264471 0 0 0 472180 58 0 0 25 0 8 0 803916322 7294599168 1607208 33554432000 4194304 4625164 140735124918176 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=7123632 CPUtime=4722.23 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 96281 0 0 0 472198 25 0 0 25 0 8 0 803916322 7294599168 1607208 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=7123632 CPUtime=4710.58 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 14158900 0 0 0 468515 2543 0 0 25 0 8 0 803916322 7294599168 1607208 33554432000 4194304 4625164 140735124918176 18446744073709551615 4579376 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=7123632 CPUtime=4722.36 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 265137 0 0 0 472181 55 0 0 25 0 8 0 803916322 7294599168 1607208 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=7123632 CPUtime=4722.07 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 92987 0 0 0 472181 26 0 0 25 0 8 0 803916322 7294599168 1607208 33554432000 4194304 4625164 140735124918176 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=7123632 CPUtime=4722.37 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 142028 0 0 0 472200 37 0 0 25 0 8 0 803916322 7294599168 1607208 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=7123632 CPUtime=4675.99 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 417524 0 0 0 467509 90 0 0 25 0 8 0 803916322 7294599168 1607208 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37719.5
Current children cumulated vsize (KiB) 7123632

[startup+4782.3 s]
/proc/loadavg: 8.07 8.06 8.06 9/374 28632
/proc/meminfo: memFree=16584944/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=7189168 CPUtime=38198.7 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 18649206 0 0 0 3816360 3514 0 0 25 0 8 0 803916318 7361708032 1609932 33554432000 4194304 4625164 140735124918176 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 1797292 1609932 351 106 0 1792795 0
[pid=28485/tid=28487] ppid=28483 vsize=7189168 CPUtime=4782.38 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 264485 0 0 0 478180 58 0 0 25 0 8 0 803916322 7361708032 1609932 33554432000 4194304 4625164 140735124918176 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=7189168 CPUtime=4782.24 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 96299 0 0 0 478198 26 0 0 25 0 8 0 803916322 7361708032 1609932 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=7189168 CPUtime=4770.58 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 14345703 0 0 0 474482 2576 0 0 25 0 8 0 803916322 7361708032 1609932 33554432000 4194304 4625164 140735124918176 18446744073709551615 4352522 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=7189168 CPUtime=4782.36 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 265152 0 0 0 478181 55 0 0 25 0 8 0 803916322 7361708032 1609932 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=7189168 CPUtime=4782.07 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 93013 0 0 0 478181 26 0 0 25 0 8 0 803916322 7361708032 1609932 33554432000 4194304 4625164 140735124918176 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=7189168 CPUtime=4782.37 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 142042 0 0 0 478200 37 0 0 25 0 8 0 803916322 7361708032 1609932 33554432000 4194304 4625164 140735124918176 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=7189168 CPUtime=4735.24 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 417538 0 0 0 473434 90 0 0 25 0 8 0 803916322 7361708032 1609932 33554432000 4194304 4625164 140735124918176 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38198.7
Current children cumulated vsize (KiB) 7189168

[startup+4842.3 s]
/proc/loadavg: 8.02 8.05 8.06 9/374 28634
/proc/meminfo: memFree=16568064/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=7189168 CPUtime=38678 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 18870619 0 0 0 3864243 3559 0 0 25 0 8 0 803916318 7361708032 1613072 33554432000 4194304 4625164 140735124918176 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 1797292 1613072 362 106 0 1792795 0
[pid=28485/tid=28487] ppid=28483 vsize=7189168 CPUtime=4842.38 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 264500 0 0 0 484180 58 0 0 25 0 8 0 803916322 7361708032 1613072 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=7189168 CPUtime=4842.24 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 96346 0 0 0 484198 26 0 0 25 0 8 0 803916322 7361708032 1613072 33554432000 4194304 4625164 140735124918176 18446744073709551615 4330776 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=7189168 CPUtime=4830.58 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 14566862 0 0 0 480438 2620 0 0 25 0 8 0 803916322 7361708032 1613072 33554432000 4194304 4625164 140735124918176 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=7189168 CPUtime=4842.37 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 265167 0 0 0 484182 55 0 0 25 0 8 0 803916322 7361708032 1613072 33554432000 4194304 4625164 140735124918176 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=7189168 CPUtime=4842.07 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 93047 0 0 0 484181 26 0 0 25 0 8 0 803916322 7361708032 1613072 33554432000 4194304 4625164 140735124918176 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=7189168 CPUtime=4842.37 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 142056 0 0 0 484200 37 0 0 25 0 8 0 803916322 7361708032 1613072 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=7189168 CPUtime=4794.52 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 417553 0 0 0 479362 90 0 0 25 0 8 0 803916322 7361708032 1613072 33554432000 4194304 4625164 140735124918176 18446744073709551615 4488020 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38678
Current children cumulated vsize (KiB) 7189168

[startup+4902.3 s]
/proc/loadavg: 8.01 8.04 8.05 9/374 28636
/proc/meminfo: memFree=16549196/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=7189168 CPUtime=39157.3 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 19047831 0 0 0 3912137 3592 0 0 25 0 8 0 803916318 7361708032 1618950 33554432000 4194304 4625164 140735124918176 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 1797292 1618950 379 106 0 1792795 0
[pid=28485/tid=28487] ppid=28483 vsize=7189168 CPUtime=4902.39 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 264515 0 0 0 490181 58 0 0 25 0 8 0 803916322 7361708032 1618950 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=7189168 CPUtime=4902.24 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 96365 0 0 0 490198 26 0 0 25 0 8 0 803916322 7361708032 1618950 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=7189168 CPUtime=4890.58 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 14743915 0 0 0 486404 2654 0 0 25 0 8 0 803916322 7361708032 1618950 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=7189168 CPUtime=4902.37 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 265181 0 0 0 490182 55 0 0 25 0 8 0 803916322 7361708032 1618950 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=7189168 CPUtime=4902.08 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 93070 0 0 0 490182 26 0 0 25 0 8 0 803916322 7361708032 1618950 33554432000 4194304 4625164 140735124918176 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=7189168 CPUtime=4902.38 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 142070 0 0 0 490201 37 0 0 25 0 8 0 803916322 7361708032 1618950 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=7189168 CPUtime=4853.79 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 417566 0 0 0 485289 90 0 0 25 0 8 0 803916322 7361708032 1618950 33554432000 4194304 4625164 140735124918176 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39157.3
Current children cumulated vsize (KiB) 7189168

[startup+4962.3 s]
/proc/loadavg: 8.04 8.04 8.05 9/374 28637
/proc/meminfo: memFree=16540624/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=7189168 CPUtime=39636.6 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 19237795 0 0 0 3960026 3629 0 0 25 0 8 0 803916318 7361708032 1622695 33554432000 4194304 4625164 140735124918176 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 1797292 1622695 372 106 0 1792795 0
[pid=28485/tid=28487] ppid=28483 vsize=7189168 CPUtime=4962.39 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 264529 0 0 0 496181 58 0 0 25 0 8 0 803916322 7361708032 1622695 33554432000 4194304 4625164 140735124918176 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=7189168 CPUtime=4962.24 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 96379 0 0 0 496198 26 0 0 25 0 8 0 803916322 7361708032 1622695 33554432000 4194304 4625164 140735124918176 18446744073709551615 4330779 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=7189168 CPUtime=4950.57 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 14933647 0 0 0 492367 2690 0 0 25 0 8 0 803916322 7361708032 1622695 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=7189168 CPUtime=4962.37 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 265194 0 0 0 496182 55 0 0 25 0 8 0 803916322 7361708032 1622695 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=7189168 CPUtime=4962.08 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 93101 0 0 0 496182 26 0 0 25 0 8 0 803916322 7361708032 1622695 33554432000 4194304 4625164 140735124918176 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=7189168 CPUtime=4962.38 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 142083 0 0 0 496201 37 0 0 25 0 8 0 803916322 7361708032 1622695 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331096 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=7189168 CPUtime=4913.05 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 417580 0 0 0 491215 90 0 0 25 0 8 0 803916322 7361708032 1622695 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39636.6
Current children cumulated vsize (KiB) 7189168



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5007.8 s]
/proc/loadavg: 8.07 8.05 8.05 9/374 28638
/proc/meminfo: memFree=16518660/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=7254704 CPUtime=40000.1 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) R 28483 28485 28198 0 -1 4202496 19374219 0 0 0 3996349 3659 0 0 25 0 8 0 803916318 7428816896 1626529 33554432000 4194304 4625164 140735124918176 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 1813676 1626529 443 106 0 1809179 0
[pid=28485/tid=28487] ppid=28483 vsize=7254704 CPUtime=5007.9 cores=0-7
/proc/28485/task/28487/stat : 28487 (SArTagnan) R 28483 28485 28198 0 -1 4202560 264542 0 0 0 500732 58 0 0 25 0 8 0 803916322 7428816896 1626529 33554432000 4194304 4625164 140735124918176 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28485/tid=28488] ppid=28483 vsize=7254704 CPUtime=5007.76 cores=0-7
/proc/28485/task/28488/stat : 28488 (SArTagnan) R 28483 28485 28198 0 -1 4202560 96395 0 0 0 500750 26 0 0 25 0 8 0 803916322 7428816896 1626529 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=28485/tid=28489] ppid=28483 vsize=7254704 CPUtime=4996.09 cores=0-7
/proc/28485/task/28489/stat : 28489 (SArTagnan) R 28483 28485 28198 0 -1 4202560 15069954 0 0 0 496889 2720 0 0 25 0 8 0 803916322 7428816896 1626529 33554432000 4194304 4625164 140735124918176 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28485/tid=28490] ppid=28483 vsize=7254704 CPUtime=5007.89 cores=0-7
/proc/28485/task/28490/stat : 28490 (SArTagnan) R 28483 28485 28198 0 -1 4202560 265205 0 0 0 500734 55 0 0 25 0 8 0 803916322 7428816896 1626529 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=28485/tid=28491] ppid=28483 vsize=7254704 CPUtime=5007.59 cores=0-7
/proc/28485/task/28491/stat : 28491 (SArTagnan) R 28483 28485 28198 0 -1 4202560 93120 0 0 0 500733 26 0 0 25 0 8 0 803916322 7428816896 1626529 33554432000 4194304 4625164 140735124918176 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28485/tid=28492] ppid=28483 vsize=7254704 CPUtime=5007.89 cores=0-7
/proc/28485/task/28492/stat : 28492 (SArTagnan) R 28483 28485 28198 0 -1 4202560 142098 0 0 0 500752 37 0 0 25 0 8 0 803916322 7428816896 1626529 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=7254704 CPUtime=4958 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4202560 417590 0 0 0 495710 90 0 0 25 0 8 0 803916322 7428816896 1626529 33554432000 4194304 4625164 140735124918176 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.1
Current children cumulated vsize (KiB) 7254704

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5007.92 s]
/proc/loadavg: 8.07 8.05 8.05 9/374 28638
/proc/meminfo: memFree=16518660/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=0 CPUtime=40000.2 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) Z 28483 28485 28198 0 -1 4203548 19374220 0 0 0 3996355 3669 0 0 25 0 2 0 803916318 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 0 0 0 0 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=0 CPUtime=4958.1 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4203588 417590 0 0 0 495710 100 0 0 25 0 2 0 803916322 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 0

[startup+5008 s]
/proc/loadavg: 8.07 8.05 8.05 9/374 28638
/proc/meminfo: memFree=16518660/32951124 swapFree=37148216/67111528
[pid=28485] ppid=28483 vsize=0 CPUtime=40000.3 cores=0-7
/proc/28485/stat : 28485 (SArTagnan) Z 28483 28485 28198 0 -1 4203548 19374220 0 0 0 3996355 3677 0 0 25 0 2 0 803916318 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/28485/statm: 0 0 0 0 0 0 0
[pid=28485/tid=28493] ppid=28483 vsize=0 CPUtime=4958.19 cores=0-7
/proc/28485/task/28493/stat : 28493 (SArTagnan) R 28483 28485 28198 0 -1 4203588 417590 0 0 0 495710 109 0 0 25 0 2 0 803916322 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5008.08
CPU time (s): 40000.4
CPU user time (s): 39963.6
CPU system time (s): 36.8504
CPU usage (%): 798.717
Max. virtual memory (cumulated for all children) (KiB): 7254704

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39963.6
system time used= 36.8504
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19374220
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2524
involuntary context switches= 179483

runsolver used 15.5326 second user time and 45.3711 second system time

The end

Launcher Data 

Begin job on node104 at 2011-06-01 12:12:39
IDJOB=3438776
IDBENCH=83170
IDSOLVER=1936
FILE ID=node104/3438776-1306923159
RUNJOBID= node104-1306918148-28212
PBS_JOBID= 13488524
Free space on /tmp= 73860 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-7x39.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438776-1306923159/watcher-3438776-1306923159 -o /tmp/evaluation-result-3438776-1306923159/solver-3438776-1306923159 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438776-1306923159.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f717554c4e7f802b3078c48464dbcd9d
RANDOM SEED=1846739289

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23034732 kB
Buffers:        390912 kB
Cached:        7420956 kB
SwapCached:     163872 kB
Active:        3264552 kB
Inactive:      6320480 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23034732 kB
SwapTotal:    67111528 kB
SwapFree:     37148216 kB
Dirty:            1952 kB
Writeback:           0 kB
AnonPages:     1633076 kB
Mapped:          11004 kB
Slab:           172552 kB
PageTables:      88632 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 87700164 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73860 MiB
End job on node104 at 2011-06-01 13:36:09