Trace number 3299513

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.45 1202.84

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_15_90_1-log.shuffled-as.sat03-137.cnf
MD5SUM808fa775df860c59a1178e77fc60f410
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3416.66
Satisfiable
(Un)Satisfiability was proved
Number of variables75
Number of clauses25452
Sum of the clauses size254370
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530
Number of clauses of size over 525422

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...098195/instance-3299513-1304098195.cnf
1.39/1.40	c Solving...
4800.39/1202.81	
4800.39/1202.81	*** INTERRUPTED! ***
4800.39/1202.81	*** Shutting down threads...
4800.39/1202.83	s UNKNOWN
4800.39/1202.83	
4800.39/1202.83	c INTERRUPTED   : 1
4800.39/1202.83	c Models        : 0+    
4800.39/1202.83	c Time          : 1202.809s (Solving: 1201.40s 1st Model: 0.00s Unsat: 0.00s)
4800.39/1202.83	c CPU Time      : 4800.410s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299513-1304098195/watcher-3299513-1304098195 -o /tmp/evaluation-result-3299513-1304098195/solver-3299513-1304098195 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299513-1304098195.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 8.10 7.83 5/180 6858
/proc/meminfo: memFree=18732976/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=21144 CPUtime=0 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 589 0 0 0 0 0 0 0 25 0 1 0 521419291 21651456 519 33554432000 4194304 4964704 140734532597952 18446744073709551615 237278540485 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/6858/statm: 5286 519 385 189 0 160 0

[startup+0.0212359 s]
/proc/loadavg: 8.12 8.10 7.83 5/180 6858
/proc/meminfo: memFree=18732976/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=23168 CPUtime=0.01 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 1117 0 0 0 1 0 0 0 25 0 1 0 521419291 23724032 1011 33554432000 4194304 4964704 140734532597952 18446744073709551615 4615921 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/6858/statm: 5792 1011 396 189 0 666 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 23168

[startup+0.100221 s]
/proc/loadavg: 8.12 8.10 7.83 5/180 6858
/proc/meminfo: memFree=18732976/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=24260 CPUtime=0.09 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 1409 0 0 0 9 0 0 0 25 0 1 0 521419291 24842240 1303 33554432000 4194304 4964704 140734532597952 18446744073709551615 4607477 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/6858/statm: 6065 1303 398 189 0 939 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 24260

[startup+0.300185 s]
/proc/loadavg: 8.12 8.10 7.83 5/180 6858
/proc/meminfo: memFree=18732976/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=24260 CPUtime=0.29 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 1410 0 0 0 29 0 0 0 25 0 1 0 521419291 24842240 1304 33554432000 4194304 4964704 140734532597952 18446744073709551615 4607562 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/6858/statm: 6065 1304 398 189 0 939 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 24260

[startup+0.700114 s]
/proc/loadavg: 8.12 8.10 7.83 5/180 6858
/proc/meminfo: memFree=18732976/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=24424 CPUtime=0.69 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 1437 0 0 0 69 0 0 0 25 0 1 0 521419291 25010176 1331 33554432000 4194304 4964704 140734532597952 18446744073709551615 4607472 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/6858/statm: 6106 1331 398 189 0 980 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 24424

[startup+1.50098 s]
/proc/loadavg: 8.12 8.10 7.83 6/181 6859
/proc/meminfo: memFree=18728984/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=238096 CPUtime=1.75 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 3104 0 0 0 175 0 0 0 25 0 4 0 521419291 243810304 2907 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670193 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 59524 2907 458 189 0 53873 0
Current children cumulated CPU time (s) 1.75
Current children cumulated vsize (KiB) 238096

[startup+3.1007 s]
/proc/loadavg: 8.12 8.10 7.83 9/184 6862
/proc/meminfo: memFree=18718544/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=240788 CPUtime=8.15 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 5421 0 0 0 814 1 0 0 25 0 4 0 521419291 246566912 5224 33554432000 4194304 4964704 140734532597952 18446744073709551615 237278540485 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 60197 5224 460 189 0 54546 0
[pid=6858/tid=6860] ppid=6856 vsize=240788 CPUtime=1.68 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 749 0 0 0 168 0 0 0 25 0 4 0 521419431 246566912 5224 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=240788 CPUtime=1.68 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 1502 0 0 0 168 0 0 0 25 0 4 0 521419431 246566912 5224 33554432000 4194304 4964704 140734532597952 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=240788 CPUtime=1.68 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 927 0 0 0 168 0 0 0 25 0 4 0 521419431 246566912 5224 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 8.15
Current children cumulated vsize (KiB) 240788

[startup+6.30113 s]
/proc/loadavg: 8.11 8.09 7.83 9/184 6862
/proc/meminfo: memFree=18707688/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=242072 CPUtime=20.93 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 7354 0 0 0 2091 2 0 0 25 0 4 0 521419291 247881728 7076 33554432000 4194304 4964704 140734532597952 18446744073709551615 4660034 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 60518 7076 460 189 0 54867 0
[pid=6858/tid=6860] ppid=6856 vsize=242072 CPUtime=4.86 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 1101 0 0 0 486 0 0 0 25 0 4 0 521419431 247881728 7076 33554432000 4194304 4964704 140734532597952 18446744073709551615 4626984 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=242072 CPUtime=4.88 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 2502 0 0 0 488 0 0 0 25 0 4 0 521419431 247881728 7076 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=242072 CPUtime=4.88 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 1113 0 0 0 488 0 0 0 25 0 4 0 521419431 247881728 7076 33554432000 4194304 4964704 140734532597952 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 20.93
Current children cumulated vsize (KiB) 242072

[startup+12.701 s]
/proc/loadavg: 8.18 8.11 7.84 9/184 6863
/proc/meminfo: memFree=18698164/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=244756 CPUtime=46.49 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 9449 0 0 0 4646 3 0 0 25 0 4 0 521419291 250630144 9144 33554432000 4194304 4964704 140734532597952 18446744073709551615 4627299 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 61189 9144 460 189 0 55538 0
[pid=6858/tid=6860] ppid=6856 vsize=244756 CPUtime=11.22 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 1743 0 0 0 1122 0 0 0 25 0 4 0 521419431 250630144 9144 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=244756 CPUtime=11.28 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 3430 0 0 0 1128 0 0 0 25 0 4 0 521419431 250630144 9144 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=244756 CPUtime=11.28 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 1435 0 0 0 1128 0 0 0 25 0 4 0 521419431 250630144 9144 33554432000 4194304 4964704 140734532597952 18446744073709551615 4660000 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 46.49
Current children cumulated vsize (KiB) 244756

[startup+25.5007 s]
/proc/loadavg: 8.21 8.12 7.84 9/184 6863
/proc/meminfo: memFree=18687348/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=248440 CPUtime=97.63 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 12156 0 0 0 9758 5 0 0 25 0 4 0 521419291 254402560 11834 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 62110 11834 460 189 0 56459 0
[pid=6858/tid=6860] ppid=6856 vsize=248440 CPUtime=23.95 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 2767 0 0 0 2394 1 0 0 25 0 4 0 521419431 254402560 11834 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=248440 CPUtime=24.08 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 4251 0 0 0 2407 1 0 0 25 0 4 0 521419431 254402560 11834 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=248440 CPUtime=24.08 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 1883 0 0 0 2407 1 0 0 25 0 4 0 521419431 254402560 11834 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 97.63
Current children cumulated vsize (KiB) 248440

[startup+51.1012 s]
/proc/loadavg: 8.14 8.11 7.84 9/184 6864
/proc/meminfo: memFree=18677736/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=250880 CPUtime=199.89 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 14768 0 0 0 19983 6 0 0 25 0 4 0 521419291 256901120 14374 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670312 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 62720 14374 460 189 0 57069 0
[pid=6858/tid=6860] ppid=6856 vsize=250880 CPUtime=49.42 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 3741 0 0 0 4941 1 0 0 25 0 4 0 521419431 256901120 14374 33554432000 4194304 4964704 140734532597952 18446744073709551615 237278577266 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=250880 CPUtime=49.67 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 5281 0 0 0 4966 1 0 0 25 0 4 0 521419431 256901120 14374 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=250880 CPUtime=49.68 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 2207 0 0 0 4967 1 0 0 25 0 4 0 521419431 256901120 14374 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 199.89
Current children cumulated vsize (KiB) 250880

[startup+102.306 s]
/proc/loadavg: 7.99 8.06 7.84 9/184 6897
/proc/meminfo: memFree=19808684/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=253108 CPUtime=404.43 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 17591 0 0 0 40435 8 0 0 25 0 4 0 521419291 259182592 17035 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670230 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 63277 17035 460 189 0 57626 0
[pid=6858/tid=6860] ppid=6856 vsize=253108 CPUtime=100.4 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 4604 0 0 0 10039 1 0 0 25 0 4 0 521419431 259182592 17035 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=253108 CPUtime=100.88 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 6667 0 0 0 10086 2 0 0 25 0 4 0 521419431 259182592 17035 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=253108 CPUtime=100.83 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 2564 0 0 0 10082 1 0 0 25 0 4 0 521419431 259182592 17035 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 404.43
Current children cumulated vsize (KiB) 253108

[startup+162.3 s]
/proc/loadavg: 8.08 8.08 7.86 9/184 6899
/proc/meminfo: memFree=19784044/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=256572 CPUtime=644.08 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 19927 0 0 0 64398 10 0 0 25 0 4 0 521419291 262729728 19218 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670243 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 64143 19218 460 189 0 58492 0
[pid=6858/tid=6860] ppid=6856 vsize=256572 CPUtime=160.39 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 5426 0 0 0 16037 2 0 0 25 0 4 0 521419431 262729728 19218 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=256572 CPUtime=160.87 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 7563 0 0 0 16084 3 0 0 25 0 4 0 521419431 262729728 19218 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=256572 CPUtime=160.51 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 2651 0 0 0 16049 2 0 0 25 0 4 0 521419431 262729728 19218 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 644.08
Current children cumulated vsize (KiB) 256572

[startup+222.301 s]
/proc/loadavg: 8.09 8.08 7.87 9/184 6900
/proc/meminfo: memFree=19768708/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=259516 CPUtime=883.74 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 21440 0 0 0 88363 11 0 0 25 0 4 0 521419291 265744384 20618 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 64879 20618 460 189 0 59228 0
[pid=6858/tid=6860] ppid=6856 vsize=259516 CPUtime=220.38 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 6214 0 0 0 22036 2 0 0 25 0 4 0 521419431 265744384 20618 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=259516 CPUtime=220.87 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 7962 0 0 0 22084 3 0 0 25 0 4 0 521419431 265744384 20618 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=259516 CPUtime=220.18 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 2821 0 0 0 22016 2 0 0 25 0 4 0 521419431 265744384 20618 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 883.74
Current children cumulated vsize (KiB) 259516

[startup+282.301 s]
/proc/loadavg: 8.03 8.06 7.87 9/184 6902
/proc/meminfo: memFree=19759924/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=259516 CPUtime=1123.44 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 22586 0 0 0 112331 13 0 0 25 0 4 0 521419291 265744384 21619 33554432000 4194304 4964704 140734532597952 18446744073709551615 4342174 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 64879 21619 460 189 0 59228 0
[pid=6858/tid=6860] ppid=6856 vsize=259516 CPUtime=280.39 cores=0,2,4,6

################
# More data... #
################

[pid=6858] ppid=6856 vsize=263964 CPUtime=2561.48 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 27936 0 0 0 256126 22 0 0 25 0 4 0 521419291 270299136 26462 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 65991 26462 460 189 0 60340 0
[pid=6858/tid=6860] ppid=6856 vsize=263964 CPUtime=640.39 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 9370 0 0 0 64033 6 0 0 25 0 4 0 521419431 270299136 26462 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=263964 CPUtime=640.83 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 10285 0 0 0 64078 5 0 0 25 0 4 0 521419431 270299136 26462 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=263964 CPUtime=637.94 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3287 0 0 0 63789 5 0 0 25 0 4 0 521419431 270299136 26462 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2561.48
Current children cumulated vsize (KiB) 263964

[startup+702.3 s]
/proc/loadavg: 8.13 8.09 7.94 9/184 6913
/proc/meminfo: memFree=19708348/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=264264 CPUtime=2801.14 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 28475 0 0 0 280090 24 0 0 25 0 4 0 521419291 270606336 26915 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670193 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 66066 26915 460 189 0 60415 0
[pid=6858/tid=6860] ppid=6856 vsize=264264 CPUtime=700.37 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 9771 0 0 0 70031 6 0 0 25 0 4 0 521419431 270606336 26915 33554432000 4194304 4964704 140734532597952 18446744073709551615 4653432 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=264264 CPUtime=700.82 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 10334 0 0 0 70077 5 0 0 25 0 4 0 521419431 270606336 26915 33554432000 4194304 4964704 140734532597952 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=264264 CPUtime=697.63 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3332 0 0 0 69757 6 0 0 25 0 4 0 521419431 270606336 26915 33554432000 4194304 4964704 140734532597952 18446744073709551615 4626894 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2801.14
Current children cumulated vsize (KiB) 264264

[startup+762.307 s]
/proc/loadavg: 8.11 8.08 7.94 9/184 6915
/proc/meminfo: memFree=19702684/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=264644 CPUtime=3040.82 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 29160 0 0 0 304057 25 0 0 25 0 4 0 521419291 270995456 27518 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 66161 27518 460 189 0 60510 0
[pid=6858/tid=6860] ppid=6856 vsize=264644 CPUtime=760.38 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 9888 0 0 0 76031 7 0 0 25 0 4 0 521419431 270995456 27518 33554432000 4194304 4964704 140734532597952 18446744073709551615 4312160 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=264644 CPUtime=760.82 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 10797 0 0 0 76077 5 0 0 25 0 4 0 521419431 270995456 27518 33554432000 4194304 4964704 140734532597952 18446744073709551615 4363081 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=264644 CPUtime=757.3 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3387 0 0 0 75724 6 0 0 25 0 4 0 521419431 270995456 27518 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3040.82
Current children cumulated vsize (KiB) 264644

[startup+822.301 s]
/proc/loadavg: 8.04 8.07 7.94 9/184 6916
/proc/meminfo: memFree=19697148/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=266732 CPUtime=3280.47 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 29993 0 0 0 328020 27 0 0 25 0 4 0 521419291 273133568 28351 33554432000 4194304 4964704 140734532597952 18446744073709551615 4312192 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 66683 28351 460 189 0 61032 0
[pid=6858/tid=6860] ppid=6856 vsize=266732 CPUtime=820.36 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 10299 0 0 0 82029 7 0 0 25 0 4 0 521419431 273133568 28351 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=266732 CPUtime=820.81 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 11048 0 0 0 82075 6 0 0 25 0 4 0 521419431 273133568 28351 33554432000 4194304 4964704 140734532597952 18446744073709551615 4321013 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=266732 CPUtime=816.99 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3477 0 0 0 81692 7 0 0 25 0 4 0 521419431 273133568 28351 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3280.47
Current children cumulated vsize (KiB) 266732

[startup+882.3 s]
/proc/loadavg: 8.01 8.05 7.94 9/184 6918
/proc/meminfo: memFree=19693464/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=267016 CPUtime=3520.13 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 30469 0 0 0 351985 28 0 0 25 0 4 0 521419291 273424384 28812 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670255 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 66754 28812 460 189 0 61103 0
[pid=6858/tid=6860] ppid=6856 vsize=267016 CPUtime=880.37 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 10378 0 0 0 88029 8 0 0 25 0 4 0 521419431 273424384 28812 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=267016 CPUtime=880.8 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 11308 0 0 0 88074 6 0 0 25 0 4 0 521419431 273424384 28812 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=267016 CPUtime=876.65 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3571 0 0 0 87658 7 0 0 25 0 4 0 521419431 273424384 28812 33554432000 4194304 4964704 140734532597952 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3520.13
Current children cumulated vsize (KiB) 267016

[startup+942.301 s]
/proc/loadavg: 8.00 8.04 7.94 9/184 6919
/proc/meminfo: memFree=19682332/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=267964 CPUtime=3759.81 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 30714 0 0 0 375950 31 0 0 25 0 4 0 521419291 274395136 29057 33554432000 4194304 4964704 140734532597952 18446744073709551615 4320993 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 66991 29057 460 189 0 61340 0
[pid=6858/tid=6860] ppid=6856 vsize=267964 CPUtime=940.36 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 10383 0 0 0 94028 8 0 0 25 0 4 0 521419431 274395136 29057 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=267964 CPUtime=940.8 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 11467 0 0 0 94073 7 0 0 25 0 4 0 521419431 274395136 29057 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=267964 CPUtime=936.33 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3652 0 0 0 93626 7 0 0 25 0 4 0 521419431 274395136 29057 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3759.81
Current children cumulated vsize (KiB) 267964

[startup+1002.3 s]
/proc/loadavg: 8.05 8.05 7.95 9/184 6921
/proc/meminfo: memFree=19677784/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=268816 CPUtime=3999.48 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 31069 0 0 0 399916 32 0 0 25 0 4 0 521419291 275267584 29412 33554432000 4194304 4964704 140734532597952 18446744073709551615 4364587 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 67204 29412 460 189 0 61553 0
[pid=6858/tid=6860] ppid=6856 vsize=268816 CPUtime=1000.36 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 10389 0 0 0 100027 9 0 0 25 0 4 0 521419431 275267584 29412 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=268816 CPUtime=1000.79 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 11684 0 0 0 100072 7 0 0 25 0 4 0 521419431 275267584 29412 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=268816 CPUtime=996.01 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3704 0 0 0 99593 8 0 0 25 0 4 0 521419431 275267584 29412 33554432000 4194304 4964704 140734532597952 18446744073709551615 4644156 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3999.48
Current children cumulated vsize (KiB) 268816

[startup+1062.3 s]
/proc/loadavg: 8.07 8.05 7.95 9/184 6923
/proc/meminfo: memFree=19673112/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=269436 CPUtime=4239.14 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 31543 0 0 0 423880 34 0 0 25 0 4 0 521419291 275902464 29886 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670215 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 67359 29886 460 189 0 61708 0
[pid=6858/tid=6860] ppid=6856 vsize=269436 CPUtime=1060.36 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 10393 0 0 0 106026 10 0 0 25 0 4 0 521419431 275902464 29886 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670466 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=269436 CPUtime=1060.79 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 12069 0 0 0 106071 8 0 0 25 0 4 0 521419431 275902464 29886 33554432000 4194304 4964704 140734532597952 18446744073709551615 4644874 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=269436 CPUtime=1055.69 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3707 0 0 0 105561 8 0 0 25 0 4 0 521419431 275902464 29886 33554432000 4194304 4964704 140734532597952 18446744073709551615 4627368 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4239.14
Current children cumulated vsize (KiB) 269436

[startup+1122.3 s]
/proc/loadavg: 8.07 8.05 7.96 9/184 6924
/proc/meminfo: memFree=19670052/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=270244 CPUtime=4478.83 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 32055 0 0 0 447847 36 0 0 25 0 4 0 521419291 276729856 30359 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 67561 30359 460 189 0 61910 0
[pid=6858/tid=6860] ppid=6856 vsize=270244 CPUtime=1120.35 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 10542 0 0 0 112025 10 0 0 25 0 4 0 521419431 276729856 30359 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=270244 CPUtime=1120.77 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 12273 0 0 0 112069 8 0 0 25 0 4 0 521419431 276729856 30359 33554432000 4194304 4964704 140734532597952 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=270244 CPUtime=1115.38 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3748 0 0 0 111530 8 0 0 25 0 4 0 521419431 276729856 30359 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4478.83
Current children cumulated vsize (KiB) 270244

[startup+1182.3 s]
/proc/loadavg: 8.10 8.07 7.97 9/184 6926
/proc/meminfo: memFree=19664244/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=270908 CPUtime=4718.49 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 32859 0 0 0 471812 37 0 0 25 0 4 0 521419291 277409792 31163 33554432000 4194304 4964704 140734532597952 18446744073709551615 4626968 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 67727 31163 460 189 0 62076 0
[pid=6858/tid=6860] ppid=6856 vsize=270908 CPUtime=1180.35 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 10893 0 0 0 118025 10 0 0 25 0 4 0 521419431 277409792 31163 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=270908 CPUtime=1180.76 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 12556 0 0 0 118068 8 0 0 25 0 4 0 521419431 277409792 31163 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=270908 CPUtime=1175.05 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3754 0 0 0 117497 8 0 0 25 0 4 0 521419431 277409792 31163 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4718.49
Current children cumulated vsize (KiB) 270908



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.8 s]
/proc/loadavg: 8.19 8.10 7.98 9/184 6926
/proc/meminfo: memFree=19661856/32950904 swapFree=67082284/67111528
[pid=6858] ppid=6856 vsize=271380 CPUtime=4800.39 cores=0,2,4,6
/proc/6858/stat : 6858 (claspmt) R 6856 6858 6445 0 -1 4202496 33241 0 0 0 480002 37 0 0 25 0 4 0 521419291 277893120 31545 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670184 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/6858/statm: 67845 31545 460 189 0 62194 0
[pid=6858/tid=6860] ppid=6856 vsize=271380 CPUtime=1200.86 cores=0,2,4,6
/proc/6858/task/6860/stat : 6860 (claspmt) R 6856 6858 6445 0 -1 4202560 11114 0 0 0 120076 10 0 0 25 0 4 0 521419431 277893120 31545 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=6858/tid=6861] ppid=6856 vsize=271380 CPUtime=1201.27 cores=0,2,4,6
/proc/6858/task/6861/stat : 6861 (claspmt) R 6856 6858 6445 0 -1 4202560 12610 0 0 0 120119 8 0 0 25 0 4 0 521419431 277893120 31545 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=6858/tid=6862] ppid=6856 vsize=271380 CPUtime=1195.43 cores=0,2,4,6
/proc/6858/task/6862/stat : 6862 (claspmt) R 6856 6858 6445 0 -1 4202560 3800 0 0 0 119535 8 0 0 25 0 4 0 521419431 277893120 31545 33554432000 4194304 4964704 140734532597952 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 271380

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1202.84
CPU time (s): 4800.45
CPU user time (s): 4800.06
CPU system time (s): 0.387941
CPU usage (%): 399.094
Max. virtual memory (cumulated for all children) (KiB): 271380

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4800.06
system time used= 0.387941
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33253
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 25891
involuntary context switches= 22396

runsolver used 2.04969 second user time and 4.35034 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-29 19:29:55
IDJOB=3299513
IDBENCH=83921
IDSOLVER=1683
FILE ID=node121/3299513-1304098195
RUNJOBID= node121-1304096537-6463
PBS_JOBID= 13170609
Free space on /tmp= 72652 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_15_90_1-log.shuffled-as.sat03-137.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299513-1304098195/watcher-3299513-1304098195 -o /tmp/evaluation-result-3299513-1304098195/solver-3299513-1304098195 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299513-1304098195.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 808fa775df860c59a1178e77fc60f410
RANDOM SEED=1654446863

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      18733132 kB
Buffers:       2183712 kB
Cached:       10276180 kB
SwapCached:       2776 kB
Active:       10327032 kB
Inactive:      3370424 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      18733132 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:            1588 kB
Writeback:           0 kB
AnonPages:     1235444 kB
Mapped:          14720 kB
Slab:           455732 kB
PageTables:       7108 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:  1419836 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72652 MiB
End job on node121 at 2011-04-29 19:50:00