Trace number 3299470

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.41 1201.82

General information on the benchmark

NameSAT02/handmade/pehoushek/plainoldcnf/
5cnf_3900_3900_220.shuffled.cnf
MD5SUMf0b7e0675915478b15cab3695fd0fd62
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.035994
Satisfiable
(Un)Satisfiability was proved
Number of variables220
Number of clauses3432
Sum of the clauses size17000
Maximum clause length5
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32
Number of clauses of size 4156
Number of clauses of size 53274
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...107163/instance-3299470-1304107163.cnf
0.00/0.01	c Solving...
4800.37/1201.81	
4800.37/1201.81	*** INTERRUPTED! ***
4800.37/1201.81	*** Shutting down threads...
4800.37/1201.81	s UNKNOWN
4800.37/1201.81	
4800.37/1201.81	c INTERRUPTED   : 1
4800.37/1201.81	c Models        : 0+    
4800.37/1201.81	c Time          : 1201.808s (Solving: 1201.80s 1st Model: 0.00s Unsat: 0.00s)
4800.37/1201.81	c CPU Time      : 4800.390s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299470-1304107163/watcher-3299470-1304107163 -o /tmp/evaluation-result-3299470-1304107163/solver-3299470-1304107163 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299470-1304107163.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.63 7.18 6.88 6/180 27879
/proc/meminfo: memFree=22862208/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=21140 CPUtime=0 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 592 0 0 0 0 0 0 0 25 0 1 0 522317253 21647360 520 33554432000 4194304 4964704 140735580447328 18446744073709551615 270612771525 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/27879/statm: 5285 520 396 189 0 159 0

[startup+0.0795381 s]
/proc/loadavg: 7.63 7.18 6.88 6/180 27879
/proc/meminfo: memFree=22862208/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=169052 CPUtime=0.27 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 1365 0 0 0 27 0 0 0 25 0 4 0 522317253 173109248 1292 33554432000 4194304 4964704 140735580447328 18446744073709551615 4462643 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 42263 1292 457 189 0 36612 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 169052

[startup+0.107829 s]
/proc/loadavg: 7.63 7.18 6.88 6/180 27879
/proc/meminfo: memFree=22862208/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=169052 CPUtime=0.38 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 1397 0 0 0 38 0 0 0 25 0 4 0 522317253 173109248 1324 33554432000 4194304 4964704 140735580447328 18446744073709551615 270613215775 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 42263 1324 457 189 0 36612 0
Current children cumulated CPU time (s) 0.38
Current children cumulated vsize (KiB) 169052

[startup+0.30014 s]
/proc/loadavg: 7.63 7.18 6.88 6/180 27879
/proc/meminfo: memFree=22862208/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=169708 CPUtime=1.15 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 1845 0 0 0 115 0 0 0 25 0 4 0 522317253 173780992 1772 33554432000 4194304 4964704 140735580447328 18446744073709551615 4658145 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 42427 1772 457 189 0 36776 0
Current children cumulated CPU time (s) 1.15
Current children cumulated vsize (KiB) 169708

[startup+0.70007 s]
/proc/loadavg: 7.63 7.18 6.88 6/180 27879
/proc/meminfo: memFree=22862208/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=170764 CPUtime=2.75 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 2782 0 0 0 274 1 0 0 25 0 4 0 522317253 174862336 2709 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 42691 2709 458 189 0 37040 0
Current children cumulated CPU time (s) 2.75
Current children cumulated vsize (KiB) 170764

[startup+1.50093 s]
/proc/loadavg: 7.63 7.18 6.88 10/184 27883
/proc/meminfo: memFree=22852264/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=172084 CPUtime=5.95 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 3423 0 0 0 594 1 0 0 25 0 4 0 522317253 176214016 3350 33554432000 4194304 4964704 140735580447328 18446744073709551615 4332434 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 43021 3350 458 189 0 37370 0
[pid=27879/tid=27881] ppid=27877 vsize=172084 CPUtime=1.48 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 646 0 0 0 148 0 0 0 20 0 4 0 522317254 176214016 3350 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320993 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=172084 CPUtime=1.47 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 841 0 0 0 147 0 0 0 25 0 4 0 522317254 176214016 3350 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=172084 CPUtime=1.48 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 607 0 0 0 148 0 0 0 25 0 4 0 522317254 176214016 3350 33554432000 4194304 4964704 140735580447328 18446744073709551615 4653264 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 172084

[startup+3.10065 s]
/proc/loadavg: 7.63 7.18 6.88 10/184 27883
/proc/meminfo: memFree=22848912/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=172732 CPUtime=12.34 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 4057 0 0 0 1233 1 0 0 25 0 4 0 522317253 176877568 3984 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670263 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 43183 3984 458 189 0 37532 0
[pid=27879/tid=27881] ppid=27877 vsize=172732 CPUtime=3.08 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 804 0 0 0 308 0 0 0 25 0 4 0 522317254 176877568 3984 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=172732 CPUtime=3.06 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 1044 0 0 0 306 0 0 0 25 0 4 0 522317254 176877568 3984 33554432000 4194304 4964704 140735580447328 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=172732 CPUtime=3.08 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 758 0 0 0 308 0 0 0 25 0 4 0 522317254 176877568 3984 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 172732

[startup+6.30108 s]
/proc/loadavg: 7.66 7.19 6.88 9/184 27884
/proc/meminfo: memFree=22845996/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=173476 CPUtime=25.12 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 4700 0 0 0 2510 2 0 0 25 0 4 0 522317253 177639424 4627 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 43369 4627 458 189 0 37718 0
[pid=27879/tid=27881] ppid=27877 vsize=173476 CPUtime=6.28 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 1016 0 0 0 628 0 0 0 25 0 4 0 522317254 177639424 4627 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=173476 CPUtime=6.25 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 1188 0 0 0 625 0 0 0 25 0 4 0 522317254 177639424 4627 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=173476 CPUtime=6.28 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 848 0 0 0 628 0 0 0 25 0 4 0 522317254 177639424 4627 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 173476

[startup+12.7009 s]
/proc/loadavg: 7.69 7.20 6.89 10/184 27884
/proc/meminfo: memFree=22841176/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=175188 CPUtime=50.69 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 5746 0 0 0 5066 3 0 0 25 0 4 0 522317253 179392512 5673 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 43797 5673 458 189 0 38146 0
[pid=27879/tid=27881] ppid=27877 vsize=175188 CPUtime=12.67 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 1334 0 0 0 1267 0 0 0 25 0 4 0 522317254 179392512 5673 33554432000 4194304 4964704 140735580447328 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=175188 CPUtime=12.62 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 1512 0 0 0 1262 0 0 0 25 0 4 0 522317254 179392512 5673 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=175188 CPUtime=12.67 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 1055 0 0 0 1267 0 0 0 25 0 4 0 522317254 179392512 5673 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 175188

[startup+25.5007 s]
/proc/loadavg: 7.76 7.24 6.91 9/184 27884
/proc/meminfo: memFree=22836112/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=176676 CPUtime=101.82 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 6931 0 0 0 10176 6 0 0 25 0 4 0 522317253 180916224 6858 33554432000 4194304 4964704 140735580447328 18446744073709551615 4653161 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 44169 6858 458 189 0 38518 0
[pid=27879/tid=27881] ppid=27877 vsize=176676 CPUtime=25.47 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 1799 0 0 0 2546 1 0 0 25 0 4 0 522317254 180916224 6858 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=176676 CPUtime=25.36 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 1852 0 0 0 2535 1 0 0 25 0 4 0 522317254 180916224 6858 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670288 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=176676 CPUtime=25.47 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 1250 0 0 0 2546 1 0 0 25 0 4 0 522317254 180916224 6858 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 176676

[startup+51.1012 s]
/proc/loadavg: 7.92 7.32 6.94 10/184 27885
/proc/meminfo: memFree=22829120/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=178928 CPUtime=204.08 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 8743 0 0 0 20398 10 0 0 25 0 4 0 522317253 183222272 8669 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 44732 8669 458 189 0 39081 0
[pid=27879/tid=27881] ppid=27877 vsize=178928 CPUtime=51.07 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 2469 0 0 0 5105 2 0 0 25 0 4 0 522317254 183222272 8669 33554432000 4194304 4964704 140735580447328 18446744073709551615 4644854 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=178928 CPUtime=50.84 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 2363 0 0 0 5082 2 0 0 25 0 4 0 522317254 183222272 8669 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=178928 CPUtime=51.07 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 1626 0 0 0 5104 3 0 0 25 0 4 0 522317254 183222272 8669 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 204.08
Current children cumulated vsize (KiB) 178928

[startup+102.306 s]
/proc/loadavg: 7.96 7.42 6.99 10/184 27895
/proc/meminfo: memFree=22815952/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=246052 CPUtime=408.63 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 11216 0 0 0 40846 17 0 0 25 0 4 0 522317253 251957248 11113 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 61513 11113 458 189 0 55862 0
[pid=27879/tid=27881] ppid=27877 vsize=246052 CPUtime=102.25 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 3180 0 0 0 10221 4 0 0 25 0 4 0 522317254 251957248 11113 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=246052 CPUtime=101.8 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 2959 0 0 0 10177 3 0 0 25 0 4 0 522317254 251957248 11113 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670298 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=246052 CPUtime=102.26 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 2283 0 0 0 10222 4 0 0 25 0 4 0 522317254 251957248 11113 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 408.63
Current children cumulated vsize (KiB) 246052

[startup+162.3 s]
/proc/loadavg: 8.16 7.58 7.08 10/184 27897
/proc/meminfo: memFree=22811120/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=247420 CPUtime=648.3 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 12585 0 0 0 64810 20 0 0 25 0 4 0 522317253 253358080 12482 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321150 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 61855 12482 458 189 0 56204 0
[pid=27879/tid=27881] ppid=27877 vsize=247420 CPUtime=162.24 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 3668 0 0 0 16219 5 0 0 25 0 4 0 522317254 253358080 12482 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=247420 CPUtime=161.52 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 3323 0 0 0 16148 4 0 0 25 0 4 0 522317254 253358080 12482 33554432000 4194304 4964704 140735580447328 18446744073709551615 4660115 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=247420 CPUtime=162.25 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 2469 0 0 0 16220 5 0 0 25 0 4 0 522317254 253358080 12482 33554432000 4194304 4964704 140735580447328 18446744073709551615 270612808310 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 648.3
Current children cumulated vsize (KiB) 247420

[startup+222.301 s]
/proc/loadavg: 8.13 7.67 7.14 10/184 27898
/proc/meminfo: memFree=22805280/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=248272 CPUtime=888 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 13929 0 0 0 88774 26 0 0 25 0 4 0 522317253 254230528 13764 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670250 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 62068 13764 458 189 0 56417 0
[pid=27879/tid=27881] ppid=27877 vsize=248272 CPUtime=222.24 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 4040 0 0 0 22217 7 0 0 25 0 4 0 522317254 254230528 13764 33554432000 4194304 4964704 140735580447328 18446744073709551615 4658498 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=248272 CPUtime=221.24 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 3820 0 0 0 22119 5 0 0 25 0 4 0 522317254 254230528 13764 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=248272 CPUtime=222.24 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 2830 0 0 0 22218 6 0 0 25 0 4 0 522317254 254230528 13764 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 888
Current children cumulated vsize (KiB) 248272

[startup+282.3 s]

################
# More data... #
################

[pid=27879] ppid=27877 vsize=252496 CPUtime=2565.15 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 18132 0 0 0 256460 55 0 0 25 0 4 0 522317253 258555904 17907 33554432000 4194304 4964704 140735580447328 18446744073709551615 4653570 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63124 17907 458 189 0 57473 0
[pid=27879/tid=27881] ppid=27877 vsize=252496 CPUtime=642.2 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 4928 0 0 0 64207 13 0 0 25 0 4 0 522317254 258555904 17907 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=252496 CPUtime=639.3 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 5386 0 0 0 63917 13 0 0 25 0 4 0 522317254 258555904 17907 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=252496 CPUtime=641.8 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 3727 0 0 0 64167 13 0 0 25 0 4 0 522317254 258555904 17907 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2565.15
Current children cumulated vsize (KiB) 252496

[startup+702.301 s]
/proc/loadavg: 8.11 8.02 7.52 9/184 27914
/proc/meminfo: memFree=22783196/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=253116 CPUtime=2804.84 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 18423 0 0 0 280425 59 0 0 25 0 4 0 522317253 259190784 18198 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320942 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63279 18198 458 189 0 57628 0
[pid=27879/tid=27881] ppid=27877 vsize=253116 CPUtime=702.19 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 4988 0 0 0 70205 14 0 0 25 0 4 0 522317254 259190784 18198 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=253116 CPUtime=699.03 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 5448 0 0 0 69889 14 0 0 25 0 4 0 522317254 259190784 18198 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=253116 CPUtime=701.78 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 3828 0 0 0 70164 14 0 0 25 0 4 0 522317254 259190784 18198 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670354 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2804.84
Current children cumulated vsize (KiB) 253116

[startup+762.306 s]
/proc/loadavg: 7.82 7.97 7.54 9/184 27947
/proc/meminfo: memFree=22837848/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=253264 CPUtime=3044.56 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 18637 0 0 0 304393 63 0 0 25 0 4 0 522317253 259342336 18412 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63316 18412 458 189 0 57665 0
[pid=27879/tid=27881] ppid=27877 vsize=253264 CPUtime=762.18 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 5019 0 0 0 76203 15 0 0 25 0 4 0 522317254 259342336 18412 33554432000 4194304 4964704 140735580447328 18446744073709551615 4660292 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=253264 CPUtime=758.75 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 5519 0 0 0 75860 15 0 0 25 0 4 0 522317254 259342336 18412 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=253264 CPUtime=761.78 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 3897 0 0 0 76163 15 0 0 25 0 4 0 522317254 259342336 18412 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3044.56
Current children cumulated vsize (KiB) 253264

[startup+822.301 s]
/proc/loadavg: 7.99 7.99 7.57 9/184 27948
/proc/meminfo: memFree=22834480/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=253564 CPUtime=3284.25 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 18887 0 0 0 328358 67 0 0 25 0 4 0 522317253 259649536 18662 33554432000 4194304 4964704 140735580447328 18446744073709551615 4362220 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63391 18662 458 189 0 57740 0
[pid=27879/tid=27881] ppid=27877 vsize=253564 CPUtime=822.17 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 5081 0 0 0 82201 16 0 0 25 0 4 0 522317254 259649536 18662 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670312 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=253564 CPUtime=818.46 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 5599 0 0 0 81831 15 0 0 25 0 4 0 522317254 259649536 18662 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=253564 CPUtime=821.77 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 3936 0 0 0 82161 16 0 0 25 0 4 0 522317254 259649536 18662 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3284.25
Current children cumulated vsize (KiB) 253564

[startup+882.301 s]
/proc/loadavg: 8.09 8.02 7.60 9/184 28040
/proc/meminfo: memFree=22821176/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=253732 CPUtime=3523.94 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 19027 0 0 0 352324 70 0 0 25 0 4 0 522317253 259821568 18802 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670266 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63433 18802 458 189 0 57782 0
[pid=27879/tid=27881] ppid=27877 vsize=253732 CPUtime=882.16 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 5096 0 0 0 88199 17 0 0 25 0 4 0 522317254 259821568 18802 33554432000 4194304 4964704 140735580447328 18446744073709551615 4665428 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=253732 CPUtime=878.19 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 5661 0 0 0 87803 16 0 0 25 0 4 0 522317254 259821568 18802 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=253732 CPUtime=881.75 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 3975 0 0 0 88158 17 0 0 25 0 4 0 522317254 259821568 18802 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670057 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3523.94
Current children cumulated vsize (KiB) 253732

[startup+942.301 s]
/proc/loadavg: 8.03 8.01 7.62 9/184 28041
/proc/meminfo: memFree=22815300/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=254072 CPUtime=3763.63 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 19302 0 0 0 376290 73 0 0 25 0 4 0 522317253 260169728 19077 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670184 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63518 19077 458 189 0 57867 0
[pid=27879/tid=27881] ppid=27877 vsize=254072 CPUtime=942.16 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 5115 0 0 0 94198 18 0 0 25 0 4 0 522317254 260169728 19077 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321093 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=254072 CPUtime=937.9 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 5837 0 0 0 93773 17 0 0 25 0 4 0 522317254 260169728 19077 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=254072 CPUtime=941.75 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 4000 0 0 0 94156 19 0 0 25 0 4 0 522317254 260169728 19077 33554432000 4194304 4964704 140735580447328 18446744073709551615 4342154 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3763.63
Current children cumulated vsize (KiB) 254072

[startup+1002.3 s]
/proc/loadavg: 8.04 8.02 7.65 9/184 28073
/proc/meminfo: memFree=22824456/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=254540 CPUtime=4003.33 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 19618 0 0 0 400256 77 0 0 25 0 4 0 522317253 260648960 19393 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63635 19393 458 189 0 57984 0
[pid=27879/tid=27881] ppid=27877 vsize=254540 CPUtime=1002.14 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 5144 0 0 0 100196 18 0 0 25 0 4 0 522317254 260648960 19393 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=254540 CPUtime=997.62 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 6009 0 0 0 99744 18 0 0 20 0 4 0 522317254 260648960 19393 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670337 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=254540 CPUtime=1001.74 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 4055 0 0 0 100154 20 0 0 25 0 4 0 522317254 260648960 19393 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4003.33
Current children cumulated vsize (KiB) 254540

[startup+1062.3 s]
/proc/loadavg: 8.15 8.05 7.68 9/184 28075
/proc/meminfo: memFree=22820580/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=254840 CPUtime=4243.03 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 19854 0 0 0 424222 81 0 0 25 0 4 0 522317253 260956160 19629 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670266 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63710 19629 458 189 0 58059 0
[pid=27879/tid=27881] ppid=27877 vsize=254840 CPUtime=1062.14 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 5168 0 0 0 106195 19 0 0 25 0 4 0 522317254 260956160 19629 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=254840 CPUtime=1057.34 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 6119 0 0 0 105715 19 0 0 25 0 4 0 522317254 260956160 19629 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=254840 CPUtime=1061.73 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 4123 0 0 0 106152 21 0 0 25 0 4 0 522317254 260956160 19629 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4243.03
Current children cumulated vsize (KiB) 254840

[startup+1122.3 s]
/proc/loadavg: 8.05 8.04 7.69 9/184 28076
/proc/meminfo: memFree=22818720/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=255176 CPUtime=4482.73 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 20031 0 0 0 448187 86 0 0 25 0 4 0 522317253 261300224 19806 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63794 19806 458 189 0 58143 0
[pid=27879/tid=27881] ppid=27877 vsize=255176 CPUtime=1122.13 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 5200 0 0 0 112193 20 0 0 25 0 4 0 522317254 261300224 19806 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=255176 CPUtime=1117.07 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 6157 0 0 0 111687 20 0 0 25 0 4 0 522317254 261300224 19806 33554432000 4194304 4964704 140735580447328 18446744073709551615 4627290 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=255176 CPUtime=1121.72 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 4192 0 0 0 112149 23 0 0 25 0 4 0 522317254 261300224 19806 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4482.73
Current children cumulated vsize (KiB) 255176

[startup+1182.3 s]
/proc/loadavg: 8.09 8.04 7.72 9/184 28078
/proc/meminfo: memFree=22816844/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=255344 CPUtime=4722.45 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 20170 0 0 0 472157 88 0 0 25 0 4 0 522317253 261472256 19945 33554432000 4194304 4964704 140735580447328 18446744073709551615 4653279 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63836 19945 458 189 0 58185 0
[pid=27879/tid=27881] ppid=27877 vsize=255344 CPUtime=1182.13 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 5202 0 0 0 118192 21 0 0 25 0 4 0 522317254 261472256 19945 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=255344 CPUtime=1176.78 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 6205 0 0 0 117658 20 0 0 25 0 4 0 522317254 261472256 19945 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=255344 CPUtime=1181.72 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 4257 0 0 0 118149 23 0 0 25 0 4 0 522317254 261472256 19945 33554432000 4194304 4964704 140735580447328 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4722.45
Current children cumulated vsize (KiB) 255344



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.06 8.04 7.72 9/184 28078
/proc/meminfo: memFree=22816344/32951124 swapFree=67111524/67111528
[pid=27879] ppid=27877 vsize=255344 CPUtime=4800.37 cores=0,2,4,6
/proc/27879/stat : 27879 (claspmt) R 27877 27879 27138 0 -1 4202496 20204 0 0 0 479948 89 0 0 25 0 4 0 522317253 261472256 19979 33554432000 4194304 4964704 140735580447328 18446744073709551615 4332213 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/27879/statm: 63836 19979 458 189 0 58185 0
[pid=27879/tid=27881] ppid=27877 vsize=255344 CPUtime=1201.63 cores=0,2,4,6
/proc/27879/task/27881/stat : 27881 (claspmt) R 27877 27879 27138 0 -1 4202560 5202 0 0 0 120142 21 0 0 25 0 4 0 522317254 261472256 19979 33554432000 4194304 4964704 140735580447328 18446744073709551615 4660083 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27879/tid=27882] ppid=27877 vsize=255344 CPUtime=1196.2 cores=0,2,4,6
/proc/27879/task/27882/stat : 27882 (claspmt) R 27877 27879 27138 0 -1 4202560 6216 0 0 0 119599 21 0 0 25 0 4 0 522317254 261472256 19979 33554432000 4194304 4964704 140735580447328 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=27879/tid=27883] ppid=27877 vsize=255344 CPUtime=1201.22 cores=0,2,4,6
/proc/27879/task/27883/stat : 27883 (claspmt) R 27877 27879 27138 0 -1 4202560 4279 0 0 0 120099 23 0 0 25 0 4 0 522317254 261472256 19979 33554432000 4194304 4964704 140735580447328 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.37
Current children cumulated vsize (KiB) 255344

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1201.82
CPU time (s): 4800.41
CPU user time (s): 4799.51
CPU system time (s): 0.896863
CPU usage (%): 399.428
Max. virtual memory (cumulated for all children) (KiB): 255344

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.51
system time used= 0.896863
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20216
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 138110
involuntary context switches= 24830

runsolver used 1.70974 second user time and 3.79042 second system time

The end

Launcher Data 

Begin job on node108 at 2011-04-29 21:59:23
IDJOB=3299470
IDBENCH=87453
IDSOLVER=1683
FILE ID=node108/3299470-1304107163
RUNJOBID= node108-1304106715-27604
PBS_JOBID= 13170636
Free space on /tmp= 72120 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT02/handmade/pehoushek/plainoldcnf/5cnf_3900_3900_220.shuffled.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299470-1304107163/watcher-3299470-1304107163 -o /tmp/evaluation-result-3299470-1304107163/solver-3299470-1304107163 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299470-1304107163.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f0b7e0675915478b15cab3695fd0fd62
RANDOM SEED=551164932

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22862364 kB
Buffers:       1984188 kB
Cached:        7413240 kB
SwapCached:          4 kB
Active:         404372 kB
Inactive:      9112212 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22862364 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            1104 kB
Writeback:           0 kB
AnonPages:      119088 kB
Mapped:          15772 kB
Slab:           509276 kB
PageTables:       4968 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   275772 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72120 MiB
End job on node108 at 2011-04-29 22:19:27