Trace number 3264908

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.22 1201.74

General information on the benchmark

NameSAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/
mod2c-rand3bip-sat-220-3.shuffled-as.sat05-2490.cnf
MD5SUM8e6def53b47a48972a9a9fc80e087610
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark70.2133
Satisfiable
(Un)Satisfiability was proved
Number of variables311
Number of clauses2192
Sum of the clauses size9664
Maximum clause length6
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 41352
Number of clauses of size 5784
Number of clauses of size over 556

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3264908-1304107022/watcher-3264908-1304107022 -o /tmp/evaluation-result-3264908-1304107022/solver-3264908-1304107022 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3264908-1304107022.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.61 7.78 7.94 2/173 19276
/proc/meminfo: memFree=30674764/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=49816 CPUtime=0 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 589 0 0 0 0 0 0 0 25 0 4 0 522302016 51011584 525 33554432000 4194304 4623224 140733444605360 18446744073709551615 47276771256242 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 12454 525 302 105 0 7958 0
[pid=19276/tid=19280] ppid=19274 vsize=49816 CPUtime=0 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 522302016 51011584 525 33554432000 4194304 4623224 140733444605360 18446744073709551615 47276771256242 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=49816 CPUtime=0 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 522302016 51011584 525 33554432000 4194304 4623224 140733444605360 18446744073709551615 248101495862 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=49816 CPUtime=0 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 522302016 51011584 525 33554432000 4194304 4623224 140733444605360 18446744073709551615 248089754609 0 0 4096 2 0 0 0 -1 0 0 0 0

[startup+0.057867 s]
/proc/loadavg: 6.61 7.78 7.94 2/173 19276
/proc/meminfo: memFree=30674764/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=247828 CPUtime=0.2 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 1651 0 0 0 20 0 0 0 25 0 4 0 522302016 253775872 1135 33554432000 4194304 4623224 140733444605360 18446744073709551615 4414859 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 61957 1135 344 105 0 57461 0
[pid=19276/tid=19280] ppid=19274 vsize=247828 CPUtime=0.05 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 216 0 0 0 5 0 0 0 25 0 4 0 522302016 253775872 1135 33554432000 4194304 4623224 140733444605360 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=247828 CPUtime=0.05 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 190 0 0 0 5 0 0 0 25 0 4 0 522302016 253775872 1135 33554432000 4194304 4623224 140733444605360 18446744073709551615 4330912 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=247828 CPUtime=0.04 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 269 0 0 0 4 0 0 0 25 0 4 0 522302016 253775872 1135 33554432000 4194304 4623224 140733444605360 18446744073709551615 248089347117 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 247828

[startup+0.157849 s]
/proc/loadavg: 6.61 7.78 7.94 2/173 19276
/proc/meminfo: memFree=30674764/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=248312 CPUtime=0.6 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 2209 0 0 0 60 0 0 0 25 0 4 0 522302016 254271488 1413 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 62078 1413 344 105 0 57582 0
[pid=19276/tid=19280] ppid=19274 vsize=248312 CPUtime=0.15 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 400 0 0 0 15 0 0 0 25 0 4 0 522302016 254271488 1413 33554432000 4194304 4623224 140733444605360 18446744073709551615 4289996 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=248312 CPUtime=0.15 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 317 0 0 0 15 0 0 0 25 0 4 0 522302016 254271488 1413 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=248312 CPUtime=0.14 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 488 0 0 0 14 0 0 0 25 0 4 0 522302016 254271488 1413 33554432000 4194304 4623224 140733444605360 18446744073709551615 4550495 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 248312

[startup+0.300825 s]
/proc/loadavg: 6.61 7.78 7.94 2/173 19276
/proc/meminfo: memFree=30674764/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=249988 CPUtime=1.17 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 3591 0 0 0 117 0 0 0 25 0 4 0 522302016 255987712 2019 33554432000 4194304 4623224 140733444605360 18446744073709551615 4424960 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 62497 2019 344 105 0 58001 0
[pid=19276/tid=19280] ppid=19274 vsize=249988 CPUtime=0.29 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 675 0 0 0 29 0 0 0 25 0 4 0 522302016 255987712 2019 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376617 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=249988 CPUtime=0.29 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 626 0 0 0 29 0 0 0 25 0 4 0 522302016 255987712 2019 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=249988 CPUtime=0.29 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 1080 0 0 0 29 0 0 0 25 0 4 0 522302016 255987712 2019 33554432000 4194304 4623224 140733444605360 18446744073709551615 4550479 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 249988

[startup+0.700755 s]
/proc/loadavg: 6.61 7.78 7.94 2/173 19276
/proc/meminfo: memFree=30674764/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=251344 CPUtime=2.77 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 7394 0 0 0 277 0 0 0 25 0 4 0 522302016 257376256 3055 33554432000 4194304 4623224 140733444605360 18446744073709551615 4278624 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 62836 3055 344 105 0 58340 0
[pid=19276/tid=19280] ppid=19274 vsize=251344 CPUtime=0.69 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 1197 0 0 0 69 0 0 0 25 0 4 0 522302016 257376256 3055 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=251344 CPUtime=0.69 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 1028 0 0 0 69 0 0 0 25 0 4 0 522302016 257376256 3055 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=251344 CPUtime=0.69 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 3611 0 0 0 69 0 0 0 25 0 4 0 522302016 257376256 3055 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 251344

[startup+1.50062 s]
/proc/loadavg: 6.61 7.78 7.94 9/184 19287
/proc/meminfo: memFree=30645304/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=255988 CPUtime=5.97 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 12080 0 0 0 596 1 0 0 25 0 4 0 522302016 262131712 5072 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 63997 5072 344 105 0 59501 0
[pid=19276/tid=19280] ppid=19274 vsize=255988 CPUtime=1.49 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 2482 0 0 0 149 0 0 0 25 0 4 0 522302016 262131712 5072 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=255988 CPUtime=1.49 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 1670 0 0 0 149 0 0 0 25 0 4 0 522302016 262131712 5072 33554432000 4194304 4623224 140733444605360 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=255988 CPUtime=1.48 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 5784 0 0 0 148 0 0 0 25 0 4 0 522302016 262131712 5072 33554432000 4194304 4623224 140733444605360 18446744073709551615 4550519 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 255988

[startup+3.10033 s]
/proc/loadavg: 6.72 7.79 7.94 9/184 19287
/proc/meminfo: memFree=30624468/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=263176 CPUtime=12.35 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 17811 0 0 0 1234 1 0 0 25 0 4 0 522302016 269492224 8079 33554432000 4194304 4623224 140733444605360 18446744073709551615 4517548 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 65794 8079 351 105 0 61298 0
[pid=19276/tid=19280] ppid=19274 vsize=263176 CPUtime=3.09 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 4007 0 0 0 309 0 0 0 25 0 4 0 522302016 269492224 8079 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=263176 CPUtime=3.09 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 3456 0 0 0 309 0 0 0 25 0 4 0 522302016 269492224 8079 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=263176 CPUtime=3.07 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 7464 0 0 0 307 0 0 0 25 0 4 0 522302016 269492224 8079 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376766 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 263176

[startup+6.30077 s]
/proc/loadavg: 6.72 7.79 7.94 9/184 19287
/proc/meminfo: memFree=30587772/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=270984 CPUtime=25.15 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 34944 0 0 0 2510 5 0 0 25 0 4 0 522302016 277487616 12034 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510475 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 67746 12034 352 105 0 63250 0
[pid=19276/tid=19280] ppid=19274 vsize=270984 CPUtime=6.28 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 6029 0 0 0 628 0 0 0 25 0 4 0 522302016 277487616 12034 33554432000 4194304 4623224 140733444605360 18446744073709551615 248089359393 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=270984 CPUtime=6.28 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 5290 0 0 0 628 0 0 0 25 0 4 0 522302016 277487616 12034 33554432000 4194304 4623224 140733444605360 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=270984 CPUtime=6.25 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 20067 0 0 0 623 2 0 0 25 0 4 0 522302016 277487616 12034 33554432000 4194304 4623224 140733444605360 18446744073709551615 4544928 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.15
Current children cumulated vsize (KiB) 270984

[startup+12.7006 s]
/proc/loadavg: 6.99 7.81 7.95 9/184 19288
/proc/meminfo: memFree=30536196/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=284128 CPUtime=50.71 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 73516 0 0 0 5060 11 0 0 25 0 4 0 522302016 290947072 18357 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 71032 18357 347 105 0 66536 0
[pid=19276/tid=19280] ppid=19274 vsize=284128 CPUtime=12.69 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 9665 0 0 0 1268 1 0 0 25 0 4 0 522302016 290947072 18357 33554432000 4194304 4623224 140733444605360 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=284128 CPUtime=12.69 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 8362 0 0 0 1268 1 0 0 25 0 4 0 522302016 290947072 18357 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=284128 CPUtime=12.62 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 50425 0 0 0 1254 8 0 0 25 0 4 0 522302016 290947072 18357 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 284128

[startup+25.5004 s]
/proc/loadavg: 7.14 7.82 7.95 9/184 19288
/proc/meminfo: memFree=30464796/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=304908 CPUtime=101.83 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 154855 0 0 0 10160 23 0 0 25 0 4 0 522302016 312225792 26889 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 76227 26889 446 105 0 71731 0
[pid=19276/tid=19280] ppid=19274 vsize=304908 CPUtime=25.49 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 13513 0 0 0 2547 2 0 0 25 0 4 0 522302016 312225792 26889 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=304908 CPUtime=25.48 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 12566 0 0 0 2547 1 0 0 25 0 4 0 522302016 312225792 26889 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=304908 CPUtime=25.35 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 120954 0 0 0 2517 18 0 0 25 0 4 0 522302016 312225792 26889 33554432000 4194304 4623224 140733444605360 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 304908

[startup+51.1009 s]
/proc/loadavg: 7.44 7.83 7.95 9/184 19289
/proc/meminfo: memFree=30356896/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=348956 CPUtime=204.1 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 231922 0 0 0 20374 36 0 0 25 0 4 0 522302016 357330944 40525 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 87239 40525 496 105 0 82743 0
[pid=19276/tid=19280] ppid=19274 vsize=348956 CPUtime=51.08 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 20800 0 0 0 5105 3 0 0 25 0 4 0 522302016 357330944 40525 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=348956 CPUtime=51.08 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 18205 0 0 0 5106 2 0 0 25 0 4 0 522302016 357330944 40525 33554432000 4194304 4623224 140733444605360 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=348956 CPUtime=50.81 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 180140 0 0 0 5054 27 0 0 25 0 4 0 522302016 357330944 40525 33554432000 4194304 4623224 140733444605360 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 204.1
Current children cumulated vsize (KiB) 348956

[startup+102.307 s]
/proc/loadavg: 7.77 7.86 7.95 9/184 19290
/proc/meminfo: memFree=30182024/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=437648 CPUtime=408.62 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 388944 0 0 0 40800 62 0 0 25 0 4 0 522302016 448151552 62194 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510971 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 109412 62194 949 105 0 104916 0
[pid=19276/tid=19280] ppid=19274 vsize=437648 CPUtime=102.29 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 29101 0 0 0 10223 6 0 0 25 0 4 0 522302016 448151552 62194 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=437648 CPUtime=102.27 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 25543 0 0 0 10224 3 0 0 25 0 4 0 522302016 448151552 62194 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=437648 CPUtime=101.74 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 307237 0 0 0 10126 48 0 0 25 0 4 0 522302016 448151552 62194 33554432000 4194304 4623224 140733444605360 18446744073709551615 4550495 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.62
Current children cumulated vsize (KiB) 437648

[startup+162.3 s]

################
# More data... #
################

[pid=19276] ppid=19274 vsize=827440 CPUtime=2805.28 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 3003908 0 0 0 280056 472 0 0 25 0 4 0 522302016 847298560 129247 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 206860 129247 915 105 0 202364 0
[pid=19276/tid=19280] ppid=19274 vsize=827440 CPUtime=702.27 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 51406 0 0 0 70210 17 0 0 25 0 4 0 522302016 847298560 129247 33554432000 4194304 4623224 140733444605360 18446744073709551615 4377018 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=827440 CPUtime=702.21 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 55448 0 0 0 70211 10 0 0 25 0 4 0 522302016 847298560 129247 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=827440 CPUtime=698.47 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 2804425 0 0 0 69419 428 0 0 25 0 4 0 522302016 847298560 129247 33554432000 4194304 4623224 140733444605360 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2805.28
Current children cumulated vsize (KiB) 827440

[startup+762.306 s]
/proc/loadavg: 8.00 8.03 8.00 9/184 19320
/proc/meminfo: memFree=29525600/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=831908 CPUtime=3044.97 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 3081325 0 0 0 304010 487 0 0 25 0 4 0 522302016 851873792 135766 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 207977 135766 920 105 0 203481 0
[pid=19276/tid=19280] ppid=19274 vsize=831908 CPUtime=762.28 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 52412 0 0 0 76210 18 0 0 25 0 4 0 522302016 851873792 135766 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=831908 CPUtime=762.2 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 56581 0 0 0 76209 11 0 0 25 0 4 0 522302016 851873792 135766 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=831908 CPUtime=758.14 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 2878531 0 0 0 75374 440 0 0 25 0 4 0 522302016 851873792 135766 33554432000 4194304 4623224 140733444605360 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3044.97
Current children cumulated vsize (KiB) 831908

[startup+822.301 s]
/proc/loadavg: 8.00 8.03 8.00 9/184 19321
/proc/meminfo: memFree=29491688/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=831908 CPUtime=3284.63 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 3402119 0 0 0 327921 542 0 0 25 0 4 0 522302016 851873792 138107 33554432000 4194304 4623224 140733444605360 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 207977 138107 878 105 0 203481 0
[pid=19276/tid=19280] ppid=19274 vsize=831908 CPUtime=822.27 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 52803 0 0 0 82209 18 0 0 25 0 4 0 522302016 851873792 138107 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=831908 CPUtime=822.19 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 56588 0 0 0 82208 11 0 0 25 0 4 0 522302016 851873792 138107 33554432000 4194304 4623224 140733444605360 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=831908 CPUtime=817.82 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 3197857 0 0 0 81288 494 0 0 25 0 4 0 522302016 851873792 138107 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3284.63
Current children cumulated vsize (KiB) 831908

[startup+882.301 s]
/proc/loadavg: 8.00 8.02 8.00 10/184 19323
/proc/meminfo: memFree=29466708/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=831908 CPUtime=3524.29 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 3746215 0 0 0 351833 596 0 0 25 0 4 0 522302016 851873792 143925 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510142 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 207977 143925 853 105 0 203481 0
[pid=19276/tid=19280] ppid=19274 vsize=831908 CPUtime=882.27 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 53130 0 0 0 88209 18 0 0 25 0 4 0 522302016 851873792 143925 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=831908 CPUtime=882.18 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 58825 0 0 0 88206 12 0 0 25 0 4 0 522302016 851873792 143925 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=831908 CPUtime=877.49 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 3537458 0 0 0 87202 547 0 0 25 0 4 0 522302016 851873792 143925 33554432000 4194304 4623224 140733444605360 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3524.29
Current children cumulated vsize (KiB) 831908

[startup+942.301 s]
/proc/loadavg: 8.04 8.03 8.00 9/184 19324
/proc/meminfo: memFree=29436768/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=889648 CPUtime=3763.96 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 4110665 0 0 0 375745 651 0 0 25 0 4 0 522302016 910999552 148057 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 222412 148057 852 105 0 217916 0
[pid=19276/tid=19280] ppid=19274 vsize=889648 CPUtime=942.27 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 66846 0 0 0 94207 20 0 0 25 0 4 0 522302016 910999552 148057 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=889648 CPUtime=942.17 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 58846 0 0 0 94205 12 0 0 25 0 4 0 522302016 910999552 148057 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376643 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=889648 CPUtime=937.17 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 3870455 0 0 0 93119 598 0 0 25 0 4 0 522302016 910999552 148057 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3763.96
Current children cumulated vsize (KiB) 889648

[startup+1002.3 s]
/proc/loadavg: 8.06 8.04 8.00 9/184 19326
/proc/meminfo: memFree=29414016/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=889648 CPUtime=4003.63 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 4406545 0 0 0 399665 698 0 0 25 0 4 0 522302016 910999552 151881 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 222412 151881 917 105 0 217916 0
[pid=19276/tid=19280] ppid=19274 vsize=889648 CPUtime=1002.28 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 67614 0 0 0 100207 21 0 0 25 0 4 0 522302016 910999552 151881 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=889648 CPUtime=1002.17 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 58875 0 0 0 100205 12 0 0 25 0 4 0 522302016 910999552 151881 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=889648 CPUtime=996.84 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 4164605 0 0 0 99040 644 0 0 25 0 4 0 522302016 910999552 151881 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4003.63
Current children cumulated vsize (KiB) 889648

[startup+1062.3 s]
/proc/loadavg: 8.06 8.04 8.00 9/184 19328
/proc/meminfo: memFree=29389408/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=889648 CPUtime=4243.31 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 4732021 0 0 0 423579 752 0 0 25 0 4 0 522302016 910999552 155330 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 222412 155330 899 105 0 217916 0
[pid=19276/tid=19280] ppid=19274 vsize=889648 CPUtime=1062.28 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 68764 0 0 0 106207 21 0 0 25 0 4 0 522302016 910999552 155330 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=889648 CPUtime=1062.17 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 59170 0 0 0 106204 13 0 0 25 0 4 0 522302016 910999552 155330 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=889648 CPUtime=1056.52 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 4487905 0 0 0 104955 697 0 0 25 0 4 0 522302016 910999552 155330 33554432000 4194304 4623224 140733444605360 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4243.31
Current children cumulated vsize (KiB) 889648

[startup+1122.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/184 19329
/proc/meminfo: memFree=29351916/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=954324 CPUtime=4482.98 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 5094569 0 0 0 447494 804 0 0 25 0 4 0 522302016 977227776 162638 33554432000 4194304 4623224 140733444605360 18446744073709551615 4517479 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 238581 162638 862 105 0 234085 0
[pid=19276/tid=19280] ppid=19274 vsize=954324 CPUtime=1122.28 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 69948 0 0 0 112206 22 0 0 25 0 4 0 522302016 977227776 162638 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376617 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=954324 CPUtime=1122.16 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 60576 0 0 0 112202 14 0 0 25 0 4 0 522302016 977227776 162638 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=954324 CPUtime=1116.19 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 4830188 0 0 0 110874 745 0 0 25 0 4 0 522302016 977227776 162638 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4482.98
Current children cumulated vsize (KiB) 954324

[startup+1182.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/184 19331
/proc/meminfo: memFree=29312176/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=954324 CPUtime=4722.66 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 5408576 0 0 0 471411 855 0 0 25 0 4 0 522302016 977227776 166924 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 238581 166924 803 105 0 234085 0
[pid=19276/tid=19280] ppid=19274 vsize=954324 CPUtime=1182.28 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 71163 0 0 0 118206 22 0 0 25 0 4 0 522302016 977227776 166924 33554432000 4194304 4623224 140733444605360 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=954324 CPUtime=1182.16 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 62095 0 0 0 118201 15 0 0 25 0 4 0 522302016 977227776 166924 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=954324 CPUtime=1175.87 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 5140074 0 0 0 116794 793 0 0 25 0 4 0 522302016 977227776 166924 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4722.66
Current children cumulated vsize (KiB) 954324



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.01 8.03 8.00 9/184 19331
/proc/meminfo: memFree=29296776/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=954324 CPUtime=4800.16 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 5489149 0 0 0 479147 869 0 0 25 0 4 0 522302016 977227776 170110 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510066 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 238581 170110 821 105 0 234085 0
[pid=19276/tid=19280] ppid=19274 vsize=954324 CPUtime=1201.69 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 71787 0 0 0 120146 23 0 0 25 0 4 0 522302016 977227776 170110 33554432000 4194304 4623224 140733444605360 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=954324 CPUtime=1201.56 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 62302 0 0 0 120141 15 0 0 25 0 4 0 522302016 977227776 170110 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=954324 CPUtime=1195.17 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 5219121 0 0 0 118710 807 0 0 25 0 4 0 522302016 977227776 170110 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 954324

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.01 8.03 8.00 9/184 19331
/proc/meminfo: memFree=29296776/32950928 swapFree=67111428/67111528
[pid=19276] ppid=19274 vsize=954324 CPUtime=4800.16 cores=0,2,4,6
/proc/19276/stat : 19276 (SArTagnan) R 19274 19276 19242 0 -1 4202496 5489149 0 0 0 479147 869 0 0 25 0 4 0 522302016 977227776 170110 33554432000 4194304 4623224 140733444605360 18446744073709551615 4510066 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19276/statm: 238581 170110 821 105 0 234085 0
[pid=19276/tid=19280] ppid=19274 vsize=954324 CPUtime=1201.69 cores=0,2,4,6
/proc/19276/task/19280/stat : 19280 (SArTagnan) R 19274 19276 19242 0 -1 4202560 71787 0 0 0 120146 23 0 0 25 0 4 0 522302016 977227776 170110 33554432000 4194304 4623224 140733444605360 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=19276/tid=19281] ppid=19274 vsize=954324 CPUtime=1201.56 cores=0,2,4,6
/proc/19276/task/19281/stat : 19281 (SArTagnan) R 19274 19276 19242 0 -1 4202560 62302 0 0 0 120141 15 0 0 25 0 4 0 522302016 977227776 170110 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=19276/tid=19284] ppid=19274 vsize=954324 CPUtime=1195.17 cores=0,2,4,6
/proc/19276/task/19284/stat : 19284 (SArTagnan) R 19274 19276 19242 0 -1 4202560 5219121 0 0 0 118710 807 0 0 25 0 4 0 522302016 977227776 170110 33554432000 4194304 4623224 140733444605360 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 954324

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.74
CPU time (s): 4800.22
CPU user time (s): 4791.5
CPU system time (s): 8.72467
CPU usage (%): 399.438
Max. virtual memory (cumulated for all children) (KiB): 1020204

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4791.5
system time used= 8.72467
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5489149
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 471
involuntary context switches= 29570

runsolver used 1.82172 second user time and 4.73628 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-29 21:57:02
IDJOB=3264908
IDBENCH=85357
IDSOLVER=1656
FILE ID=node123/3264908-1304107022
RUNJOBID= node123-1304107022-19260
PBS_JOBID= 13170665
Free space on /tmp= 72816 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/mod2c-rand3bip-sat-220-3.shuffled-as.sat05-2490.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3264908-1304107022/watcher-3264908-1304107022 -o /tmp/evaluation-result-3264908-1304107022/solver-3264908-1304107022 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3264908-1304107022.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8e6def53b47a48972a9a9fc80e087610
RANDOM SEED=794608829

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30674920 kB
Buffers:        570980 kB
Cached:        1276816 kB
SwapCached:        100 kB
Active:         121812 kB
Inactive:      1789984 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30674920 kB
SwapTotal:    67111528 kB
SwapFree:     67111428 kB
Dirty:             936 kB
Writeback:           0 kB
AnonPages:       64064 kB
Mapped:          13944 kB
Slab:           298264 kB
PageTables:       4996 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   187620 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72816 MiB
End job on node123 at 2011-04-29 22:17:06