Trace number 3299609

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.16 1203.04

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_80_17_90_7-log.shuffled-as.sat03-190.cnf
MD5SUMad30956261e72142648a01bc7c025dba
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables85
Number of clauses29282
Sum of the clauses size292650
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 534
Number of clauses of size over 529248

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...098255/instance-3299609-1304098255.cnf
1.69/1.74	c Solving...
4800.10/1203.01	
4800.10/1203.01	*** INTERRUPTED! ***
4800.10/1203.01	*** Shutting down threads...
4800.10/1203.03	s UNKNOWN
4800.10/1203.03	
4800.10/1203.03	c INTERRUPTED   : 1
4800.10/1203.03	c Models        : 0+    
4800.10/1203.03	c Time          : 1203.010s (Solving: 1201.27s 1st Model: 0.00s Unsat: 0.00s)
4800.10/1203.03	c CPU Time      : 4800.120s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299609-1304098255/watcher-3299609-1304098255 -o /tmp/evaluation-result-3299609-1304098255/solver-3299609-1304098255 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299609-1304098255.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.80 8.04 7.82 5/180 6892
/proc/meminfo: memFree=19874936/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=21276 CPUtime=0 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 601 0 0 0 0 0 0 0 25 0 1 0 521425240 21786624 530 33554432000 4194304 4964704 140735725958800 18446744073709551615 237278540485 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/6892/statm: 5319 530 385 189 0 193 0

[startup+0.017764 s]
/proc/loadavg: 7.80 8.04 7.82 5/180 6892
/proc/meminfo: memFree=19874936/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=22620 CPUtime=0.01 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 983 0 0 0 1 0 0 0 25 0 1 0 521425240 23162880 876 33554432000 4194304 4964704 140735725958800 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/6892/statm: 5655 877 385 189 0 529 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 22620

[startup+0.100752 s]
/proc/loadavg: 7.80 8.04 7.82 5/180 6892
/proc/meminfo: memFree=19874936/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=25008 CPUtime=0.09 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 1616 0 0 0 9 0 0 0 25 0 1 0 521425240 25608192 1455 33554432000 4194304 4964704 140735725958800 18446744073709551615 4607477 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/6892/statm: 6252 1455 398 189 0 1126 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25008

[startup+0.300714 s]
/proc/loadavg: 7.80 8.04 7.82 5/180 6892
/proc/meminfo: memFree=19874936/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=25008 CPUtime=0.29 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 1617 0 0 0 29 0 0 0 25 0 1 0 521425240 25608192 1456 33554432000 4194304 4964704 140735725958800 18446744073709551615 4607570 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/6892/statm: 6252 1456 398 189 0 1126 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 25008

[startup+0.700642 s]
/proc/loadavg: 7.80 8.04 7.82 5/180 6892
/proc/meminfo: memFree=19874936/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=25008 CPUtime=0.69 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 1617 0 0 0 69 0 0 0 25 0 1 0 521425240 25608192 1456 33554432000 4194304 4964704 140735725958800 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/6892/statm: 6252 1456 398 189 0 1126 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 25008

[startup+1.5005 s]
/proc/loadavg: 7.80 8.04 7.82 6/181 6893
/proc/meminfo: memFree=19870392/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=25008 CPUtime=1.49 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 1624 0 0 0 149 0 0 0 25 0 1 0 521425240 25608192 1463 33554432000 4194304 4964704 140735725958800 18446744073709551615 4607562 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/6892/statm: 6252 1463 398 189 0 1126 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 25008

[startup+3.10022 s]
/proc/loadavg: 7.80 8.04 7.82 9/184 6896
/proc/meminfo: memFree=19860332/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=175368 CPUtime=7.15 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 5454 0 0 0 714 1 0 0 25 0 4 0 521425240 179576832 5229 33554432000 4194304 4964704 140735725958800 18446744073709551615 4660050 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 43842 5229 458 189 0 38191 0
[pid=6892/tid=6894] ppid=6890 vsize=175368 CPUtime=1.35 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 846 0 0 0 135 0 0 0 19 0 4 0 521425415 179576832 5229 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=175368 CPUtime=1.35 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 1140 0 0 0 135 0 0 0 25 0 4 0 521425415 179576832 5229 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=175368 CPUtime=1.35 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 870 0 0 0 135 0 0 0 25 0 4 0 521425415 179576832 5229 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7.15
Current children cumulated vsize (KiB) 175368

[startup+6.30066 s]
/proc/loadavg: 7.89 8.05 7.83 9/184 6896
/proc/meminfo: memFree=19846156/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=179560 CPUtime=19.94 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 7710 0 0 0 1992 2 0 0 25 0 4 0 521425240 183869440 7485 33554432000 4194304 4964704 140735725958800 18446744073709551615 4684009 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 44890 7485 460 189 0 39239 0
[pid=6892/tid=6894] ppid=6890 vsize=179560 CPUtime=4.55 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 1354 0 0 0 455 0 0 0 25 0 4 0 521425415 183869440 7485 33554432000 4194304 4964704 140735725958800 18446744073709551615 4660059 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=179560 CPUtime=4.55 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 2084 0 0 0 455 0 0 0 25 0 4 0 521425415 183869440 7485 33554432000 4194304 4964704 140735725958800 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=179560 CPUtime=4.55 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 1217 0 0 0 455 0 0 0 25 0 4 0 521425415 183869440 7485 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 19.94
Current children cumulated vsize (KiB) 179560

[startup+12.7005 s]
/proc/loadavg: 7.90 8.05 7.83 9/184 6896
/proc/meminfo: memFree=19834768/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=182716 CPUtime=45.49 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 10053 0 0 0 4546 3 0 0 25 0 4 0 521425240 187101184 9661 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 45679 9661 460 189 0 40028 0
[pid=6892/tid=6894] ppid=6890 vsize=182716 CPUtime=10.94 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 1862 0 0 0 1094 0 0 0 25 0 4 0 521425415 187101184 9661 33554432000 4194304 4964704 140735725958800 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=182716 CPUtime=10.94 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 3266 0 0 0 1094 0 0 0 25 0 4 0 521425415 187101184 9661 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=182716 CPUtime=10.94 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 1503 0 0 0 1094 0 0 0 25 0 4 0 521425415 187101184 9661 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 45.49
Current children cumulated vsize (KiB) 182716

[startup+25.5002 s]
/proc/loadavg: 7.99 8.06 7.84 9/184 6896
/proc/meminfo: memFree=19821000/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=186884 CPUtime=96.61 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 12919 0 0 0 9656 5 0 0 25 0 4 0 521425240 191369216 12520 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670233 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 46721 12520 460 189 0 41070 0
[pid=6892/tid=6894] ppid=6890 vsize=186884 CPUtime=23.75 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 2726 0 0 0 2374 1 0 0 25 0 4 0 521425415 191369216 12520 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=186884 CPUtime=23.75 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 4345 0 0 0 2374 1 0 0 25 0 4 0 521425415 191369216 12520 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670458 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=186884 CPUtime=23.75 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 1896 0 0 0 2374 1 0 0 25 0 4 0 521425415 191369216 12520 33554432000 4194304 4964704 140735725958800 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 96.61
Current children cumulated vsize (KiB) 186884

[startup+51.1007 s]
/proc/loadavg: 7.99 8.06 7.84 10/184 6897
/proc/meminfo: memFree=19804452/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=192084 CPUtime=198.87 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 15900 0 0 0 19879 8 0 0 25 0 4 0 521425240 196694016 15451 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670266 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 48021 15451 460 189 0 42370 0
[pid=6892/tid=6894] ppid=6890 vsize=192084 CPUtime=49.34 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 3591 0 0 0 4933 1 0 0 25 0 4 0 521425415 196694016 15451 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=192084 CPUtime=49.34 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 5759 0 0 0 4933 1 0 0 25 0 4 0 521425415 196694016 15451 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=192084 CPUtime=49.34 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 2223 0 0 0 4933 1 0 0 25 0 4 0 521425415 196694016 15451 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670440 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 198.87
Current children cumulated vsize (KiB) 192084

[startup+102.307 s]
/proc/loadavg: 8.08 8.08 7.86 9/184 6899
/proc/meminfo: memFree=19784044/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=195876 CPUtime=403.41 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 19103 0 0 0 40329 12 0 0 25 0 4 0 521425240 200577024 18594 33554432000 4194304 4964704 140735725958800 18446744073709551615 4364587 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 48969 18594 460 189 0 43318 0
[pid=6892/tid=6894] ppid=6890 vsize=195876 CPUtime=100.55 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 4447 0 0 0 10052 3 0 0 25 0 4 0 521425415 200577024 18594 33554432000 4194304 4964704 140735725958800 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=195876 CPUtime=100.55 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 7061 0 0 0 10053 2 0 0 25 0 4 0 521425415 200577024 18594 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=195876 CPUtime=100.55 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 2792 0 0 0 10052 3 0 0 25 0 4 0 521425415 200577024 18594 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 403.41
Current children cumulated vsize (KiB) 195876

[startup+162.301 s]
/proc/loadavg: 8.09 8.08 7.87 9/184 6900
/proc/meminfo: memFree=19768708/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=198796 CPUtime=643.05 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 21685 0 0 0 64289 16 0 0 25 0 4 0 521425240 203567104 21030 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670255 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 49699 21030 460 189 0 44048 0
[pid=6892/tid=6894] ppid=6890 vsize=198796 CPUtime=160.53 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 5314 0 0 0 16050 3 0 0 25 0 4 0 521425415 203567104 21030 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=198796 CPUtime=160.54 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 8305 0 0 0 16050 4 0 0 25 0 4 0 521425415 203567104 21030 33554432000 4194304 4964704 140735725958800 18446744073709551615 4644840 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=198796 CPUtime=160.54 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 2928 0 0 0 16050 4 0 0 25 0 4 0 521425415 203567104 21030 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 643.05
Current children cumulated vsize (KiB) 198796

[startup+222.3 s]
/proc/loadavg: 8.03 8.06 7.87 9/184 6902
/proc/meminfo: memFree=19759924/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=200712 CPUtime=882.71 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 23090 0 0 0 88251 20 0 0 25 0 4 0 521425240 205529088 22359 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670263 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 50178 22359 460 189 0 44527 0
[pid=6892/tid=6894] ppid=6890 vsize=200712 CPUtime=220.53 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 5842 0 0 0 22049 4 0 0 25 0 4 0 521425415 205529088 22359 33554432000 4194304 4964704 140735725958800 18446744073709551615 4312148 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=200712 CPUtime=220.55 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 8837 0 0 0 22050 5 0 0 25 0 4 0 521425415 205529088 22359 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=200712 CPUtime=220.53 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 3160 0 0 0 22049 4 0 0 25 0 4 0 521425415 205529088 22359 33554432000 4194304 4964704 140735725958800 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 882.71
Current children cumulated vsize (KiB) 200712

[startup+282.301 s]
/proc/loadavg: 8.01 8.05 7.88 10/184 6903
/proc/meminfo: memFree=19750660/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=203036 CPUtime=1122.38 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 24882 0 0 0 112215 23 0 0 25 0 4 0 521425240 207908864 24017 33554432000 4194304 4964704 140735725958800 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 50759 24017 460 189 0 45108 0
[pid=6892/tid=6894] ppid=6890 vsize=203036 CPUtime=280.52 cores=1,3,5,7

################
# More data... #
################

[pid=6892] ppid=6890 vsize=212172 CPUtime=2560.41 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 31742 0 0 0 255991 50 0 0 25 0 4 0 521425240 217264128 29825 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 53043 29825 460 189 0 47392 0
[pid=6892/tid=6894] ppid=6890 vsize=212172 CPUtime=640.53 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 9539 0 0 0 64040 13 0 0 25 0 4 0 521425415 217264128 29825 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=212172 CPUtime=640.54 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 11689 0 0 0 64042 12 0 0 25 0 4 0 521425415 217264128 29825 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=212172 CPUtime=640.53 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 4282 0 0 0 64042 11 0 0 25 0 4 0 521425415 217264128 29825 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2560.41
Current children cumulated vsize (KiB) 212172

[startup+702.301 s]
/proc/loadavg: 8.11 8.08 7.94 10/184 6915
/proc/meminfo: memFree=19702808/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=214056 CPUtime=2800.05 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 32690 0 0 0 279952 53 0 0 25 0 4 0 521425240 219193344 30640 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670184 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 53514 30640 460 189 0 47863 0
[pid=6892/tid=6894] ppid=6890 vsize=214056 CPUtime=700.51 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 9957 0 0 0 70038 13 0 0 21 0 4 0 521425415 219193344 30640 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=214056 CPUtime=700.53 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 12028 0 0 0 70040 13 0 0 25 0 4 0 521425415 219193344 30640 33554432000 4194304 4964704 140735725958800 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=214056 CPUtime=700.52 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 4344 0 0 0 70040 12 0 0 25 0 4 0 521425415 219193344 30640 33554432000 4194304 4964704 140735725958800 18446744073709551615 4644156 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2800.05
Current children cumulated vsize (KiB) 214056

[startup+762.307 s]
/proc/loadavg: 8.04 8.07 7.94 9/184 6916
/proc/meminfo: memFree=19697148/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=215680 CPUtime=3039.74 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 33361 0 0 0 303918 56 0 0 25 0 4 0 521425240 220856320 31254 33554432000 4194304 4964704 140735725958800 18446744073709551615 4684027 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 53920 31254 460 189 0 48269 0
[pid=6892/tid=6894] ppid=6890 vsize=215680 CPUtime=760.52 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 10280 0 0 0 76038 14 0 0 25 0 4 0 521425415 220856320 31254 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=215680 CPUtime=760.54 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 12209 0 0 0 76040 14 0 0 25 0 4 0 521425415 220856320 31254 33554432000 4194304 4964704 140735725958800 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=215680 CPUtime=760.53 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 4352 0 0 0 76040 13 0 0 25 0 4 0 521425415 220856320 31254 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3039.74
Current children cumulated vsize (KiB) 215680

[startup+822.301 s]
/proc/loadavg: 8.01 8.05 7.94 9/184 6918
/proc/meminfo: memFree=19693464/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=216440 CPUtime=3279.39 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 33989 0 0 0 327880 59 0 0 25 0 4 0 521425240 221634560 31752 33554432000 4194304 4964704 140735725958800 18446744073709551615 4338788 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 54110 31752 460 189 0 48459 0
[pid=6892/tid=6894] ppid=6890 vsize=216440 CPUtime=820.51 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 10627 0 0 0 82036 15 0 0 25 0 4 0 521425415 221634560 31752 33554432000 4194304 4964704 140735725958800 18446744073709551615 237278984735 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=216440 CPUtime=820.53 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 12430 0 0 0 82038 15 0 0 25 0 4 0 521425415 221634560 31752 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=216440 CPUtime=820.52 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 4366 0 0 0 82038 14 0 0 25 0 4 0 521425415 221634560 31752 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3279.39
Current children cumulated vsize (KiB) 216440

[startup+882.301 s]
/proc/loadavg: 8.00 8.04 7.94 9/184 6919
/proc/meminfo: memFree=19682332/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=282260 CPUtime=3519.05 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 36686 0 0 0 351841 64 0 0 25 0 4 0 521425240 289034240 34240 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670243 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 70565 34240 460 189 0 64914 0
[pid=6892/tid=6894] ppid=6890 vsize=282260 CPUtime=880.51 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 12097 0 0 0 88034 17 0 0 25 0 4 0 521425415 289034240 34240 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=282260 CPUtime=880.53 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 12667 0 0 0 88038 15 0 0 25 0 4 0 521425415 289034240 34240 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=282260 CPUtime=880.51 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 4705 0 0 0 88037 14 0 0 25 0 4 0 521425415 289034240 34240 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3519.05
Current children cumulated vsize (KiB) 282260

[startup+942.3 s]
/proc/loadavg: 8.05 8.05 7.95 9/184 6921
/proc/meminfo: memFree=19677784/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=282260 CPUtime=3758.72 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 37449 0 0 0 375806 66 0 0 25 0 4 0 521425240 289034240 34946 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 70565 34946 460 189 0 64914 0
[pid=6892/tid=6894] ppid=6890 vsize=282260 CPUtime=940.5 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 12234 0 0 0 94032 18 0 0 25 0 4 0 521425415 289034240 34946 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=282260 CPUtime=940.53 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 12937 0 0 0 94037 16 0 0 25 0 4 0 521425415 289034240 34946 33554432000 4194304 4964704 140735725958800 18446744073709551615 4628046 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=282260 CPUtime=940.52 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 5039 0 0 0 94037 15 0 0 25 0 4 0 521425415 289034240 34946 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3758.72
Current children cumulated vsize (KiB) 282260

[startup+1002.3 s]
/proc/loadavg: 8.07 8.05 7.95 9/184 6923
/proc/meminfo: memFree=19673112/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=283116 CPUtime=3998.39 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 38211 0 0 0 399770 69 0 0 25 0 4 0 521425240 289910784 35674 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670243 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 70779 35674 460 189 0 65128 0
[pid=6892/tid=6894] ppid=6890 vsize=283116 CPUtime=1000.5 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 12375 0 0 0 100032 18 0 0 25 0 4 0 521425415 289910784 35674 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=283116 CPUtime=1000.53 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 13080 0 0 0 100037 16 0 0 25 0 4 0 521425415 289910784 35674 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=283116 CPUtime=1000.51 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 5057 0 0 0 100036 15 0 0 25 0 4 0 521425415 289910784 35674 33554432000 4194304 4964704 140735725958800 18446744073709551615 4644844 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3998.39
Current children cumulated vsize (KiB) 283116

[startup+1062.3 s]
/proc/loadavg: 8.07 8.05 7.96 9/184 6924
/proc/meminfo: memFree=19670300/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=284156 CPUtime=4238.05 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 38624 0 0 0 423736 69 0 0 25 0 4 0 521425240 290975744 36030 33554432000 4194304 4964704 140735725958800 18446744073709551615 4312160 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 71039 36030 460 189 0 65388 0
[pid=6892/tid=6894] ppid=6890 vsize=284156 CPUtime=1060.49 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 12606 0 0 0 106031 18 0 0 25 0 4 0 521425415 290975744 36030 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=284156 CPUtime=1060.53 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 13101 0 0 0 106037 16 0 0 25 0 4 0 521425415 290975744 36030 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=284156 CPUtime=1060.51 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 5189 0 0 0 106036 15 0 0 25 0 4 0 521425415 290975744 36030 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4238.05
Current children cumulated vsize (KiB) 284156

[startup+1122.3 s]
/proc/loadavg: 8.10 8.07 7.97 9/184 6926
/proc/meminfo: memFree=19664244/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=284836 CPUtime=4477.72 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 39352 0 0 0 447702 70 0 0 25 0 4 0 521425240 291672064 36705 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670230 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 71209 36705 460 189 0 65558 0
[pid=6892/tid=6894] ppid=6890 vsize=284836 CPUtime=1120.49 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 12835 0 0 0 112030 19 0 0 25 0 4 0 521425415 291672064 36705 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=284836 CPUtime=1120.53 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 13517 0 0 0 112036 17 0 0 25 0 4 0 521425415 291672064 36705 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=284836 CPUtime=1120.51 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 5196 0 0 0 112036 15 0 0 25 0 4 0 521425415 291672064 36705 33554432000 4194304 4964704 140735725958800 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4477.72
Current children cumulated vsize (KiB) 284836

[startup+1182.3 s]
/proc/loadavg: 8.15 8.10 7.98 9/184 6958
/proc/meminfo: memFree=19678860/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=284836 CPUtime=4717.4 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 39892 0 0 0 471668 72 0 0 25 0 4 0 521425240 291672064 37173 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670281 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 71209 37173 460 189 0 65558 0
[pid=6892/tid=6894] ppid=6890 vsize=284836 CPUtime=1180.49 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 12954 0 0 0 118030 19 0 0 25 0 4 0 521425415 291672064 37173 33554432000 4194304 4964704 140735725958800 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=284836 CPUtime=1180.53 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 13701 0 0 0 118036 17 0 0 25 0 4 0 521425415 291672064 37173 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=284836 CPUtime=1180.51 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 5301 0 0 0 118035 16 0 0 25 0 4 0 521425415 291672064 37173 33554432000 4194304 4964704 140735725958800 18446744073709551615 4465573 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4717.4
Current children cumulated vsize (KiB) 284836



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203 s]
/proc/loadavg: 8.24 8.12 8.00 9/184 6959
/proc/meminfo: memFree=19664088/32950904 swapFree=67082284/67111528
[pid=6892] ppid=6890 vsize=284836 CPUtime=4800.1 cores=1,3,5,7
/proc/6892/stat : 6892 (claspmt) R 6890 6892 6445 0 -1 4202496 40105 0 0 0 479938 72 0 0 25 0 4 0 521425240 291672064 37347 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670332 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/6892/statm: 71209 37347 460 189 0 65558 0
[pid=6892/tid=6894] ppid=6890 vsize=284836 CPUtime=1201.19 cores=1,3,5,7
/proc/6892/task/6894/stat : 6894 (claspmt) R 6890 6892 6445 0 -1 4202560 12954 0 0 0 120100 19 0 0 25 0 4 0 521425415 291672064 37347 33554432000 4194304 4964704 140735725958800 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=6892/tid=6895] ppid=6890 vsize=284836 CPUtime=1201.24 cores=1,3,5,7
/proc/6892/task/6895/stat : 6895 (claspmt) R 6890 6892 6445 0 -1 4202560 13907 0 0 0 120107 17 0 0 25 0 4 0 521425415 291672064 37347 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=6892/tid=6896] ppid=6890 vsize=284836 CPUtime=1201.22 cores=1,3,5,7
/proc/6892/task/6896/stat : 6896 (claspmt) R 6890 6892 6445 0 -1 4202560 5308 0 0 0 120106 16 0 0 25 0 4 0 521425415 291672064 37347 33554432000 4194304 4964704 140735725958800 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 284836

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1203.04
CPU time (s): 4800.16
CPU user time (s): 4799.43
CPU system time (s): 0.734888
CPU usage (%): 399.003
Max. virtual memory (cumulated for all children) (KiB): 284836

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.43
system time used= 0.734888
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 40117
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 37003
involuntary context switches= 34999

runsolver used 1.87671 second user time and 4.69229 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-29 19:30:55
IDJOB=3299609
IDBENCH=83924
IDSOLVER=1683
FILE ID=node121/3299609-1304098255
RUNJOBID= node121-1304096537-6464
PBS_JOBID= 13170609
Free space on /tmp= 72652 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_80_17_90_7-log.shuffled-as.sat03-190.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299609-1304098255/watcher-3299609-1304098255 -o /tmp/evaluation-result-3299609-1304098255/solver-3299609-1304098255 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299609-1304098255.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ad30956261e72142648a01bc7c025dba
RANDOM SEED=508462736

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      19875092 kB
Buffers:       2183720 kB
Cached:       10276092 kB
SwapCached:       2776 kB
Active:        9187004 kB
Inactive:      3370448 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      19875092 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:            1576 kB
Writeback:           0 kB
AnonPages:       95328 kB
Mapped:          14720 kB
Slab:           455804 kB
PageTables:       4488 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   280668 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72652 MiB
End job on node121 at 2011-04-29 19:51:00