Trace number 3299522

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.18 1201.83

General information on the benchmark

NameSAT04/handmade/connamacher/connm-d0.02/
connm-ue-csp-sat-n800-d0.02-s111845174.used-as.sat04-958.cnf
MD5SUM7bb85ebdeae46262f72a4c54d4e16683
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables772
Number of clauses9601
Sum of the clauses size28996
Maximum clause length4
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 39408
Number of clauses of size 4193
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...103611/instance-3299522-1304103611.cnf
0.00/0.02	c Solving...
4800.13/1201.81	
4800.13/1201.81	*** INTERRUPTED! ***
4800.13/1201.81	*** Shutting down threads...
4800.13/1201.82	s UNKNOWN
4800.13/1201.82	
4800.13/1201.82	c INTERRUPTED   : 1
4800.13/1201.82	c Models        : 0+    
4800.13/1201.82	c Time          : 1201.809s (Solving: 1201.78s 1st Model: 0.00s Unsat: 0.00s)
4800.13/1201.82	c CPU Time      : 4800.150s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299522-1304103611/watcher-3299522-1304103611 -o /tmp/evaluation-result-3299522-1304103611/solver-3299522-1304103611 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299522-1304103611.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.41 4.08 5.42 5/180 31374
/proc/meminfo: memFree=30943488/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=21620 CPUtime=0 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 734 0 0 0 0 0 0 0 25 0 1 0 521959043 22138880 651 33554432000 4194304 4964704 140736142940912 18446744073709551615 228244045579 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/31374/statm: 5405 651 396 189 0 279 0

[startup+0.00749788 s]
/proc/loadavg: 3.41 4.08 5.42 5/180 31374
/proc/meminfo: memFree=30943488/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=21884 CPUtime=0 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 781 0 0 0 0 0 0 0 25 0 1 0 521959043 22409216 698 33554432000 4194304 4964704 140736142940912 18446744073709551615 4608680 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/31374/statm: 5471 698 398 189 0 345 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 21884

[startup+0.100444 s]
/proc/loadavg: 3.41 4.08 5.42 5/180 31374
/proc/meminfo: memFree=30943488/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=169520 CPUtime=0.3 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 1370 0 0 0 30 0 0 0 25 0 4 0 521959043 173588480 1274 33554432000 4194304 4964704 140736142940912 18446744073709551615 4627540 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 42380 1274 458 189 0 36729 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 169520

[startup+0.300409 s]
/proc/loadavg: 3.41 4.08 5.42 5/180 31374
/proc/meminfo: memFree=30943488/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=169916 CPUtime=1.1 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 1749 0 0 0 110 0 0 0 25 0 4 0 521959043 173993984 1653 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668632 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 42479 1653 458 189 0 36828 0
Current children cumulated CPU time (s) 1.1
Current children cumulated vsize (KiB) 169916

[startup+0.70034 s]
/proc/loadavg: 3.41 4.08 5.42 5/180 31374
/proc/meminfo: memFree=30943488/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=170180 CPUtime=2.7 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 2033 0 0 0 270 0 0 0 25 0 4 0 521959043 174264320 1937 33554432000 4194304 4964704 140736142940912 18446744073709551615 4627978 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 42545 1937 458 189 0 36894 0
Current children cumulated CPU time (s) 2.7
Current children cumulated vsize (KiB) 170180

[startup+1.5002 s]
/proc/loadavg: 3.41 4.08 5.42 9/184 31378
/proc/meminfo: memFree=30933172/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=171584 CPUtime=5.89 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 2811 0 0 0 589 0 0 0 25 0 4 0 521959043 175702016 2715 33554432000 4194304 4964704 140736142940912 18446744073709551615 4362191 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 42896 2715 458 189 0 37245 0
[pid=31374/tid=31376] ppid=31372 vsize=171584 CPUtime=1.46 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 462 0 0 0 146 0 0 0 25 0 4 0 521959046 175702016 2715 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=171584 CPUtime=1.46 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 653 0 0 0 146 0 0 0 25 0 4 0 521959046 175702016 2715 33554432000 4194304 4964704 140736142940912 18446744073709551615 4669196 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=171584 CPUtime=1.47 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 411 0 0 0 147 0 0 0 25 0 4 0 521959046 175702016 2715 33554432000 4194304 4964704 140736142940912 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.89
Current children cumulated vsize (KiB) 171584

[startup+3.10092 s]
/proc/loadavg: 3.78 4.15 5.43 9/184 31378
/proc/meminfo: memFree=30929068/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=172984 CPUtime=12.28 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 3544 0 0 0 1228 0 0 0 25 0 4 0 521959043 177135616 3412 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668618 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 43246 3412 458 189 0 37595 0
[pid=31374/tid=31376] ppid=31372 vsize=172984 CPUtime=3.06 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 617 0 0 0 306 0 0 0 25 0 4 0 521959046 177135616 3412 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=172984 CPUtime=3.06 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 1080 0 0 0 306 0 0 0 25 0 4 0 521959046 177135616 3412 33554432000 4194304 4964704 140736142940912 18446744073709551615 4321054 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=172984 CPUtime=3.07 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 507 0 0 0 307 0 0 0 25 0 4 0 521959046 177135616 3412 33554432000 4194304 4964704 140736142940912 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.28
Current children cumulated vsize (KiB) 172984

[startup+6.30036 s]
/proc/loadavg: 3.78 4.15 5.43 9/184 31378
/proc/meminfo: memFree=30921380/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=174372 CPUtime=25.07 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 4620 0 0 0 2506 1 0 0 25 0 4 0 521959043 178556928 4398 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670233 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 43593 4398 460 189 0 37942 0
[pid=31374/tid=31376] ppid=31372 vsize=174372 CPUtime=6.26 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 907 0 0 0 626 0 0 0 25 0 4 0 521959046 178556928 4398 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670283 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=174372 CPUtime=6.26 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 1570 0 0 0 626 0 0 0 25 0 4 0 521959046 178556928 4398 33554432000 4194304 4964704 140736142940912 18446744073709551615 4361295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=174372 CPUtime=6.27 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 683 0 0 0 627 0 0 0 25 0 4 0 521959046 178556928 4398 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.07
Current children cumulated vsize (KiB) 174372

[startup+12.7002 s]
/proc/loadavg: 4.43 4.27 5.46 10/184 31408
/proc/meminfo: memFree=30917752/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=175784 CPUtime=50.64 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 5587 0 0 0 5063 1 0 0 25 0 4 0 521959043 180002816 5360 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668657 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 43946 5360 460 189 0 38295 0
[pid=31374/tid=31376] ppid=31372 vsize=175784 CPUtime=12.66 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 1294 0 0 0 1266 0 0 0 25 0 4 0 521959046 180002816 5360 33554432000 4194304 4964704 140736142940912 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=175784 CPUtime=12.66 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 1800 0 0 0 1266 0 0 0 25 0 4 0 521959046 180002816 5360 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=175784 CPUtime=12.67 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 826 0 0 0 1267 0 0 0 25 0 4 0 521959046 180002816 5360 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.64
Current children cumulated vsize (KiB) 175784

[startup+25.501 s]
/proc/loadavg: 4.98 4.39 5.48 10/184 31408
/proc/meminfo: memFree=30903944/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=177388 CPUtime=101.77 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 6851 0 0 0 10175 2 0 0 25 0 4 0 521959043 181645312 6624 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668609 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 44347 6624 460 189 0 38696 0
[pid=31374/tid=31376] ppid=31372 vsize=177388 CPUtime=25.45 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 1821 0 0 0 2545 0 0 0 25 0 4 0 521959046 181645312 6624 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=177388 CPUtime=25.46 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 2191 0 0 0 2545 1 0 0 25 0 4 0 521959046 181645312 6624 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=177388 CPUtime=25.47 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 1069 0 0 0 2547 0 0 0 25 0 4 0 521959046 181645312 6624 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.77
Current children cumulated vsize (KiB) 177388

[startup+51.1005 s]
/proc/loadavg: 6.17 4.72 5.56 10/184 31418
/proc/meminfo: memFree=30889624/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=178656 CPUtime=204.03 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 8135 0 0 0 20400 3 0 0 25 0 4 0 521959043 182943744 7905 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670416 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 44664 7905 460 189 0 39013 0
[pid=31374/tid=31376] ppid=31372 vsize=178656 CPUtime=51.06 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 2212 0 0 0 5105 1 0 0 25 0 4 0 521959046 182943744 7905 33554432000 4194304 4964704 140736142940912 18446744073709551615 4320911 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=178656 CPUtime=51.06 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 2704 0 0 0 5105 1 0 0 25 0 4 0 521959046 182943744 7905 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=178656 CPUtime=51.06 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 1359 0 0 0 5106 0 0 0 25 0 4 0 521959046 182943744 7905 33554432000 4194304 4964704 140736142940912 18446744073709551615 4332327 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 204.03
Current children cumulated vsize (KiB) 178656

[startup+102.307 s]
/proc/loadavg: 7.43 5.30 5.71 10/184 31419
/proc/meminfo: memFree=30879608/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=180796 CPUtime=408.58 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 9665 0 0 0 40854 4 0 0 25 0 4 0 521959043 185135104 9431 33554432000 4194304 4964704 140736142940912 18446744073709551615 4627204 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 45199 9431 460 189 0 39548 0
[pid=31374/tid=31376] ppid=31372 vsize=180796 CPUtime=102.26 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 2834 0 0 0 10225 1 0 0 25 0 4 0 521959046 185135104 9431 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=180796 CPUtime=102.26 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 3147 0 0 0 10225 1 0 0 25 0 4 0 521959046 185135104 9431 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=180796 CPUtime=102.26 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 1604 0 0 0 10226 0 0 0 25 0 4 0 521959046 185135104 9431 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.58
Current children cumulated vsize (KiB) 180796

[startup+162.301 s]
/proc/loadavg: 7.94 5.82 5.86 10/184 31421
/proc/meminfo: memFree=30870040/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=182496 CPUtime=648.26 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 10968 0 0 0 64820 6 0 0 25 0 4 0 521959043 186875904 10734 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668641 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 45624 10734 460 189 0 39973 0
[pid=31374/tid=31376] ppid=31372 vsize=182496 CPUtime=162.25 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 3416 0 0 0 16224 1 0 0 25 0 4 0 521959046 186875904 10734 33554432000 4194304 4964704 140736142940912 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=182496 CPUtime=162.26 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 3475 0 0 0 16224 2 0 0 25 0 4 0 521959046 186875904 10734 33554432000 4194304 4964704 140736142940912 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=182496 CPUtime=162.25 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 1829 0 0 0 16225 0 0 0 25 0 4 0 521959046 186875904 10734 33554432000 4194304 4964704 140736142940912 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 648.26
Current children cumulated vsize (KiB) 182496

[startup+222.301 s]
/proc/loadavg: 8.04 6.23 6.00 10/184 31423
/proc/meminfo: memFree=30863576/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=183704 CPUtime=887.95 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 11796 0 0 0 88788 7 0 0 25 0 4 0 521959043 188112896 11562 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668676 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 45926 11562 460 189 0 40275 0
[pid=31374/tid=31376] ppid=31372 vsize=183704 CPUtime=222.25 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 3843 0 0 0 22224 1 0 0 25 0 4 0 521959046 188112896 11562 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=183704 CPUtime=222.25 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 3705 0 0 0 22223 2 0 0 25 0 4 0 521959046 188112896 11562 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=183704 CPUtime=222.26 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 1900 0 0 0 22225 1 0 0 25 0 4 0 521959046 188112896 11562 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668618 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 887.95
Current children cumulated vsize (KiB) 183704

[startup+282.301 s]

################
# More data... #
################

[pid=31374] ppid=31372 vsize=253520 CPUtime=2565.04 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 16297 0 0 0 256489 15 0 0 25 0 4 0 521959043 259604480 16054 33554432000 4194304 4964704 140736142940912 18446744073709551615 4364587 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 63380 16054 460 189 0 57729 0
[pid=31374/tid=31376] ppid=31372 vsize=253520 CPUtime=641.47 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 6034 0 0 0 64143 4 0 0 25 0 4 0 521959046 259604480 16054 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=253520 CPUtime=642.26 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 4394 0 0 0 64223 3 0 0 25 0 4 0 521959046 259604480 16054 33554432000 4194304 4964704 140736142940912 18446744073709551615 4660304 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=253520 CPUtime=642.27 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3144 0 0 0 64224 3 0 0 25 0 4 0 521959046 259604480 16054 33554432000 4194304 4964704 140736142940912 18446744073709551615 228244007154 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2565.04
Current children cumulated vsize (KiB) 253520

[startup+702.301 s]
/proc/loadavg: 8.02 7.70 6.83 10/184 31438
/proc/meminfo: memFree=30822652/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=253732 CPUtime=2804.72 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 17022 0 0 0 280456 16 0 0 25 0 4 0 521959043 259821568 16779 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 63433 16779 460 189 0 57782 0
[pid=31374/tid=31376] ppid=31372 vsize=253732 CPUtime=701.46 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 6259 0 0 0 70142 4 0 0 25 0 4 0 521959046 259821568 16779 33554432000 4194304 4964704 140736142940912 18446744073709551615 4660034 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=253732 CPUtime=702.26 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 4776 0 0 0 70223 3 0 0 25 0 4 0 521959046 259821568 16779 33554432000 4194304 4964704 140736142940912 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=253732 CPUtime=702.27 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3190 0 0 0 70224 3 0 0 25 0 4 0 521959046 259821568 16779 33554432000 4194304 4964704 140736142940912 18446744073709551615 4669462 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2804.72
Current children cumulated vsize (KiB) 253732

[startup+762.306 s]
/proc/loadavg: 8.08 7.78 6.91 10/184 31440
/proc/meminfo: memFree=30819916/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=254104 CPUtime=3044.43 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 17285 0 0 0 304427 16 0 0 25 0 4 0 521959043 260202496 17042 33554432000 4194304 4964704 140736142940912 18446744073709551615 4653555 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 63526 17042 460 189 0 57875 0
[pid=31374/tid=31376] ppid=31372 vsize=254104 CPUtime=761.47 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 6422 0 0 0 76143 4 0 0 25 0 4 0 521959046 260202496 17042 33554432000 4194304 4964704 140736142940912 18446744073709551615 4647550 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=254104 CPUtime=762.26 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 4822 0 0 0 76223 3 0 0 25 0 4 0 521959046 260202496 17042 33554432000 4194304 4964704 140736142940912 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=254104 CPUtime=762.27 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3229 0 0 0 76224 3 0 0 25 0 4 0 521959046 260202496 17042 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3044.43
Current children cumulated vsize (KiB) 254104

[startup+822.301 s]
/proc/loadavg: 8.06 7.83 6.98 10/184 31442
/proc/meminfo: memFree=30815788/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=254280 CPUtime=3284.1 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 17889 0 0 0 328393 17 0 0 25 0 4 0 521959043 260382720 17642 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668673 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 63570 17642 460 189 0 57919 0
[pid=31374/tid=31376] ppid=31372 vsize=254280 CPUtime=821.46 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 6703 0 0 0 82142 4 0 0 25 0 4 0 521959046 260382720 17642 33554432000 4194304 4964704 140736142940912 18446744073709551615 4362287 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=254280 CPUtime=822.26 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 5028 0 0 0 82222 4 0 0 25 0 4 0 521959046 260382720 17642 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=254280 CPUtime=822.26 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3294 0 0 0 82223 3 0 0 25 0 4 0 521959046 260382720 17642 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3284.1
Current children cumulated vsize (KiB) 254280

[startup+882.3 s]
/proc/loadavg: 8.08 7.89 7.05 10/184 31443
/proc/meminfo: memFree=30813044/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=254488 CPUtime=3523.77 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 18286 0 0 0 352360 17 0 0 25 0 4 0 521959043 260595712 18027 33554432000 4194304 4964704 140736142940912 18446744073709551615 4627536 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 63622 18027 460 189 0 57971 0
[pid=31374/tid=31376] ppid=31372 vsize=254488 CPUtime=881.46 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 6908 0 0 0 88142 4 0 0 25 0 4 0 521959046 260595712 18027 33554432000 4194304 4964704 140736142940912 18446744073709551615 228244046450 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=254488 CPUtime=882.26 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 5212 0 0 0 88222 4 0 0 25 0 4 0 521959046 260595712 18027 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=254488 CPUtime=882.26 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3296 0 0 0 88223 3 0 0 25 0 4 0 521959046 260595712 18027 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3523.77
Current children cumulated vsize (KiB) 254488

[startup+942.301 s]
/proc/loadavg: 8.03 7.90 7.11 10/184 31445
/proc/meminfo: memFree=30811412/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=254864 CPUtime=3763.45 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 18483 0 0 0 376327 18 0 0 25 0 4 0 521959043 260980736 18224 33554432000 4194304 4964704 140736142940912 18446744073709551615 4660059 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 63716 18224 460 189 0 58065 0
[pid=31374/tid=31376] ppid=31372 vsize=254864 CPUtime=941.46 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 7031 0 0 0 94142 4 0 0 25 0 4 0 521959046 260980736 18224 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668721 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=254864 CPUtime=942.26 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 5226 0 0 0 94222 4 0 0 25 0 4 0 521959046 260980736 18224 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=254864 CPUtime=942.26 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3298 0 0 0 94223 3 0 0 25 0 4 0 521959046 260980736 18224 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3763.45
Current children cumulated vsize (KiB) 254864

[startup+1002.3 s]
/proc/loadavg: 8.01 7.92 7.16 10/184 31446
/proc/meminfo: memFree=30809384/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=255304 CPUtime=4003.14 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 18687 0 0 0 400295 19 0 0 25 0 4 0 521959043 261431296 18428 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668657 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 63826 18428 460 189 0 58175 0
[pid=31374/tid=31376] ppid=31372 vsize=255304 CPUtime=1001.47 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 7121 0 0 0 100142 5 0 0 25 0 4 0 521959046 261431296 18428 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=255304 CPUtime=1002.26 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 5289 0 0 0 100222 4 0 0 25 0 4 0 521959046 261431296 18428 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=255304 CPUtime=1002.27 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3320 0 0 0 100223 4 0 0 25 0 4 0 521959046 261431296 18428 33554432000 4194304 4964704 140736142940912 18446744073709551615 4627328 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4003.14
Current children cumulated vsize (KiB) 255304

[startup+1062.3 s]
/proc/loadavg: 8.00 7.93 7.21 10/184 31448
/proc/meminfo: memFree=30806640/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=255480 CPUtime=4242.83 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 19081 0 0 0 424264 19 0 0 25 0 4 0 521959043 261611520 18822 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668676 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 63870 18822 460 189 0 58219 0
[pid=31374/tid=31376] ppid=31372 vsize=255480 CPUtime=1061.47 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 7353 0 0 0 106142 5 0 0 25 0 4 0 521959046 261611520 18822 33554432000 4194304 4964704 140736142940912 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=255480 CPUtime=1062.27 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 5324 0 0 0 106222 5 0 0 25 0 4 0 521959046 261611520 18822 33554432000 4194304 4964704 140736142940912 18446744073709551615 4321013 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=255480 CPUtime=1062.27 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3424 0 0 0 106223 4 0 0 25 0 4 0 521959046 261611520 18822 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4242.83
Current children cumulated vsize (KiB) 255480

[startup+1122.3 s]
/proc/loadavg: 8.00 7.94 7.26 10/184 31450
/proc/meminfo: memFree=30803772/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=255728 CPUtime=4482.52 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 19414 0 0 0 448232 20 0 0 25 0 4 0 521959043 261865472 19152 33554432000 4194304 4964704 140736142940912 18446744073709551615 4333181 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 63932 19152 460 189 0 58281 0
[pid=31374/tid=31376] ppid=31372 vsize=255728 CPUtime=1121.47 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 7402 0 0 0 112142 5 0 0 25 0 4 0 521959046 261865472 19152 33554432000 4194304 4964704 140736142940912 18446744073709551615 4669249 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=255728 CPUtime=1122.27 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 5562 0 0 0 112222 5 0 0 25 0 4 0 521959046 261865472 19152 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=255728 CPUtime=1122.27 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3465 0 0 0 112223 4 0 0 25 0 4 0 521959046 261865472 19152 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670286 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4482.52
Current children cumulated vsize (KiB) 255728

[startup+1182.3 s]
/proc/loadavg: 8.12 7.98 7.31 10/184 31451
/proc/meminfo: memFree=30802012/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=256112 CPUtime=4722.22 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 19500 0 0 0 472201 21 0 0 25 0 4 0 521959043 262258688 19238 33554432000 4194304 4964704 140736142940912 18446744073709551615 4660345 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 64028 19238 460 189 0 58377 0
[pid=31374/tid=31376] ppid=31372 vsize=256112 CPUtime=1181.47 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 7467 0 0 0 118142 5 0 0 25 0 4 0 521959046 262258688 19238 33554432000 4194304 4964704 140736142940912 18446744073709551615 4669429 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=256112 CPUtime=1182.27 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 5562 0 0 0 118222 5 0 0 25 0 4 0 521959046 262258688 19238 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=256112 CPUtime=1182.27 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3466 0 0 0 118223 4 0 0 25 0 4 0 521959046 262258688 19238 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4722.22
Current children cumulated vsize (KiB) 256112



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.09 7.98 7.32 9/184 31452
/proc/meminfo: memFree=30801508/32951124 swapFree=67111364/67111528
[pid=31374] ppid=31372 vsize=256492 CPUtime=4800.13 cores=1,3,5,7
/proc/31374/stat : 31374 (claspmt) R 31372 31374 31273 0 -1 4202496 19567 0 0 0 479992 21 0 0 25 0 4 0 521959043 262647808 19305 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668508 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31374/statm: 64123 19305 460 189 0 58472 0
[pid=31374/tid=31376] ppid=31372 vsize=256492 CPUtime=1200.97 cores=1,3,5,7
/proc/31374/task/31376/stat : 31376 (claspmt) R 31372 31374 31273 0 -1 4202560 7490 0 0 0 120092 5 0 0 25 0 4 0 521959046 262647808 19305 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31374/tid=31377] ppid=31372 vsize=256492 CPUtime=1201.77 cores=1,3,5,7
/proc/31374/task/31377/stat : 31377 (claspmt) R 31372 31374 31273 0 -1 4202560 5605 0 0 0 120172 5 0 0 25 0 4 0 521959046 262647808 19305 33554432000 4194304 4964704 140736142940912 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31374/tid=31378] ppid=31372 vsize=256492 CPUtime=1201.78 cores=1,3,5,7
/proc/31374/task/31378/stat : 31378 (claspmt) R 31372 31374 31273 0 -1 4202560 3466 0 0 0 120174 4 0 0 25 0 4 0 521959046 262647808 19305 33554432000 4194304 4964704 140736142940912 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.13
Current children cumulated vsize (KiB) 256492

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1201.83
CPU time (s): 4800.18
CPU user time (s): 4799.96
CPU system time (s): 0.219966
CPU usage (%): 399.407
Max. virtual memory (cumulated for all children) (KiB): 256492

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.96
system time used= 0.219966
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19579
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11265
involuntary context switches= 35043

runsolver used 1.91871 second user time and 4.30234 second system time

The end

Launcher Data 

Begin job on node136 at 2011-04-29 21:00:11
IDJOB=3299522
IDBENCH=84608
IDSOLVER=1683
FILE ID=node136/3299522-1304103611
RUNJOBID= node136-1304103610-31292
PBS_JOBID= 13170640
Free space on /tmp= 72336 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT04/handmade/connamacher/connm-d0.02/connm-ue-csp-sat-n800-d0.02-s111845174.used-as.sat04-958.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299522-1304103611/watcher-3299522-1304103611 -o /tmp/evaluation-result-3299522-1304103611/solver-3299522-1304103611 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299522-1304103611.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7bb85ebdeae46262f72a4c54d4e16683
RANDOM SEED=58712881

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30943768 kB
Buffers:        584148 kB
Cached:         928100 kB
SwapCached:          0 kB
Active:         132044 kB
Inactive:      1450224 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30943768 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            1840 kB
Writeback:          64 kB
AnonPages:       69580 kB
Mapped:          15672 kB
Slab:           360292 kB
PageTables:       4880 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   223600 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72332 MiB
End job on node136 at 2011-04-29 21:20:15