Trace number 3299577

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.36 1201.73

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-17-33-sat.cnf
MD5SUMff3a31481d1bf95f014a91f5192a55fa
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.038993
Satisfiable
(Un)Satisfiability was proved
Number of variables561
Number of clauses4777
Sum of the clauses size18513
Maximum clause length33
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24488
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5289

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...090725/instance-3299577-1304090725.cnf
0.00/0.01	c Solving...
4800.31/1201.71	
4800.31/1201.71	*** INTERRUPTED! ***
4800.31/1201.71	*** Shutting down threads...
4800.31/1201.72	s UNKNOWN
4800.31/1201.72	
4800.31/1201.72	c INTERRUPTED   : 1
4800.31/1201.72	c Models        : 0+    
4800.31/1201.72	c Time          : 1201.708s (Solving: 1201.70s 1st Model: 0.00s Unsat: 0.00s)
4800.31/1201.72	c CPU Time      : 4800.340s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299577-1304090725/watcher-3299577-1304090725 -o /tmp/evaluation-result-3299577-1304090725/solver-3299577-1304090725 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299577-1304090725.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.15 7.85 6.94 7/180 16970
/proc/meminfo: memFree=30665444/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=21348 CPUtime=0 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 651 0 0 0 0 0 0 0 25 0 1 0 520672265 21860352 572 33554432000 4194304 4964704 140734137922720 18446744073709551615 4618467 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/16970/statm: 5337 572 396 189 0 211 0

[startup+0.0170099 s]
/proc/loadavg: 8.15 7.85 6.94 7/180 16970
/proc/meminfo: memFree=30665444/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=168316 CPUtime=0.02 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 879 0 0 0 2 0 0 0 25 0 4 0 520672265 172355584 799 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320944 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 42079 799 454 189 0 36428 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 168316

[startup+0.123212 s]
/proc/loadavg: 8.15 7.85 6.94 7/180 16970
/proc/meminfo: memFree=30665444/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=235576 CPUtime=0.43 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 2459 0 0 0 43 0 0 0 25 0 4 0 520672265 241229824 2379 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 58894 2379 458 189 0 53243 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 235576

[startup+0.300833 s]
/proc/loadavg: 8.15 7.85 6.94 7/180 16970
/proc/meminfo: memFree=30665444/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=236360 CPUtime=1.14 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 3479 0 0 0 113 1 0 0 25 0 4 0 520672265 242032640 3399 33554432000 4194304 4964704 140734137922720 18446744073709551615 4342199 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 59090 3399 458 189 0 53439 0
Current children cumulated CPU time (s) 1.14
Current children cumulated vsize (KiB) 236360

[startup+0.700763 s]
/proc/loadavg: 8.15 7.85 6.94 7/180 16970
/proc/meminfo: memFree=30665444/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=239168 CPUtime=2.74 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 5410 0 0 0 273 1 0 0 25 0 4 0 520672265 244908032 5331 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320970 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 59792 5331 458 189 0 54141 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 239168

[startup+1.50066 s]
/proc/loadavg: 8.15 7.85 6.94 9/184 16974
/proc/meminfo: memFree=30643100/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=240876 CPUtime=5.93 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 9198 0 0 0 590 3 0 0 25 0 4 0 520672265 246657024 9118 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670416 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 60219 9118 458 189 0 54568 0
[pid=16970/tid=16972] ppid=16968 vsize=240876 CPUtime=1.47 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 1744 0 0 0 147 0 0 0 25 0 4 0 520672266 246657024 9118 33554432000 4194304 4964704 140734137922720 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=240876 CPUtime=1.48 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 3335 0 0 0 147 1 0 0 25 0 4 0 520672266 246657024 9118 33554432000 4194304 4964704 140734137922720 18446744073709551615 4363605 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=240876 CPUtime=1.47 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 1627 0 0 0 147 0 0 0 25 0 4 0 520672266 246657024 9118 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670440 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 240876

[startup+3.10034 s]
/proc/loadavg: 8.14 7.85 6.95 9/184 16974
/proc/meminfo: memFree=30627588/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=244972 CPUtime=12.32 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 12291 0 0 0 1228 4 0 0 25 0 4 0 520672265 250851328 12211 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320944 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 61243 12211 458 189 0 55592 0
[pid=16970/tid=16972] ppid=16968 vsize=244972 CPUtime=3.06 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 3111 0 0 0 306 0 0 0 25 0 4 0 520672266 250851328 12211 33554432000 4194304 4964704 140734137922720 18446744073709551615 4343849 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=244972 CPUtime=3.08 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 4117 0 0 0 307 1 0 0 25 0 4 0 520672266 250851328 12211 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=244972 CPUtime=3.07 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 1627 0 0 0 307 0 0 0 25 0 4 0 520672266 250851328 12211 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 244972

[startup+6.30078 s]
/proc/loadavg: 8.14 7.85 6.95 9/184 16974
/proc/meminfo: memFree=30609980/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=251464 CPUtime=25.12 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 15729 0 0 0 2506 6 0 0 25 0 4 0 520672265 257499136 15648 33554432000 4194304 4964704 140734137922720 18446744073709551615 4342174 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 62866 15648 460 189 0 57215 0
[pid=16970/tid=16972] ppid=16968 vsize=251464 CPUtime=6.25 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 4005 0 0 0 624 1 0 0 25 0 4 0 520672266 257499136 15648 33554432000 4194304 4964704 140734137922720 18446744073709551615 4343485 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=251464 CPUtime=6.28 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 4835 0 0 0 627 1 0 0 25 0 4 0 520672266 257499136 15648 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670288 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=251464 CPUtime=6.28 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 2583 0 0 0 627 1 0 0 25 0 4 0 520672266 257499136 15648 33554432000 4194304 4964704 140734137922720 18446744073709551615 4653264 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 251464

[startup+12.7006 s]
/proc/loadavg: 8.12 7.86 6.96 9/184 16974
/proc/meminfo: memFree=30596732/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=251424 CPUtime=50.67 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 18120 0 0 0 5060 7 0 0 25 0 4 0 520672265 257458176 18039 33554432000 4194304 4964704 140734137922720 18446744073709551615 4334279 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 62856 18039 460 189 0 57205 0
[pid=16970/tid=16972] ppid=16968 vsize=251424 CPUtime=12.61 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 4139 0 0 0 1260 1 0 0 25 0 4 0 520672266 257458176 18039 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=251424 CPUtime=12.67 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 5970 0 0 0 1266 1 0 0 25 0 4 0 520672266 257458176 18039 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=251424 CPUtime=12.67 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 2642 0 0 0 1266 1 0 0 25 0 4 0 520672266 257458176 18039 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 251424

[startup+25.5004 s]
/proc/loadavg: 8.10 7.86 6.97 9/184 16974
/proc/meminfo: memFree=30586052/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=255568 CPUtime=101.79 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 20422 0 0 0 10170 9 0 0 25 0 4 0 520672265 261701632 20296 33554432000 4194304 4964704 140734137922720 18446744073709551615 4683962 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 63892 20296 460 189 0 58241 0
[pid=16970/tid=16972] ppid=16968 vsize=255568 CPUtime=25.35 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 4534 0 0 0 2533 2 0 0 25 0 4 0 520672266 261701632 20296 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=255568 CPUtime=25.47 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 6117 0 0 0 2545 2 0 0 25 0 4 0 520672266 261701632 20296 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332351 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=255568 CPUtime=25.46 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 3141 0 0 0 2545 1 0 0 25 0 4 0 520672266 261701632 20296 33554432000 4194304 4964704 140734137922720 18446744073709551615 4683955 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 255568

[startup+51.1009 s]
/proc/loadavg: 8.06 7.87 7.00 9/184 16975
/proc/meminfo: memFree=30565176/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=258124 CPUtime=204.06 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 25883 0 0 0 20392 14 0 0 25 0 4 0 520672265 264318976 25279 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332566 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 64531 25279 460 189 0 58880 0
[pid=16970/tid=16972] ppid=16968 vsize=258124 CPUtime=50.81 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 5136 0 0 0 5078 3 0 0 25 0 4 0 520672266 264318976 25279 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=258124 CPUtime=51.06 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 9300 0 0 0 5103 3 0 0 25 0 4 0 520672266 264318976 25279 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=258124 CPUtime=51.07 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 3910 0 0 0 5105 2 0 0 25 0 4 0 520672266 264318976 25279 33554432000 4194304 4964704 140734137922720 18446744073709551615 4653336 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 258124

[startup+102.307 s]
/proc/loadavg: 8.09 7.91 7.06 9/184 16976
/proc/meminfo: memFree=30549760/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=258452 CPUtime=408.61 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 30922 0 0 0 40842 19 0 0 25 0 4 0 520672265 264654848 29027 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332557 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 64613 29027 460 189 0 58962 0
[pid=16970/tid=16972] ppid=16968 vsize=258452 CPUtime=101.77 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 5898 0 0 0 10172 5 0 0 25 0 4 0 520672266 264654848 29027 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332494 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=258452 CPUtime=102.27 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 11963 0 0 0 10222 5 0 0 25 0 4 0 520672266 264654848 29027 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=258452 CPUtime=102.27 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 5375 0 0 0 10224 3 0 0 25 0 4 0 520672266 264654848 29027 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332475 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.61
Current children cumulated vsize (KiB) 258452

[startup+162.3 s]
/proc/loadavg: 8.03 7.92 7.11 9/184 16978
/proc/meminfo: memFree=30533344/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=266028 CPUtime=648.26 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 35188 0 0 0 64801 25 0 0 25 0 4 0 520672265 272412672 33039 33554432000 4194304 4964704 140734137922720 18446744073709551615 4321099 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 66507 33039 460 189 0 60856 0
[pid=16970/tid=16972] ppid=16968 vsize=266028 CPUtime=161.46 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 7883 0 0 0 16139 7 0 0 25 0 4 0 520672266 272412672 33039 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332351 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=266028 CPUtime=162.25 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 12668 0 0 0 16219 6 0 0 25 0 4 0 520672266 272412672 33039 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=266028 CPUtime=162.26 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 6146 0 0 0 16222 4 0 0 25 0 4 0 520672266 272412672 33039 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 648.26
Current children cumulated vsize (KiB) 266028

[startup+222.301 s]
/proc/loadavg: 8.07 7.95 7.17 9/184 16980
/proc/meminfo: memFree=30521016/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=267400 CPUtime=887.94 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 39986 0 0 0 88763 31 0 0 25 0 4 0 520672265 273817600 36114 33554432000 4194304 4964704 140734137922720 18446744073709551615 4653275 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 66850 36114 460 189 0 61199 0
[pid=16970/tid=16972] ppid=16968 vsize=267400 CPUtime=221.16 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 8662 0 0 0 22107 9 0 0 25 0 4 0 520672266 273817600 36114 33554432000 4194304 4964704 140734137922720 18446744073709551615 4362191 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=267400 CPUtime=222.23 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 16184 0 0 0 22215 8 0 0 25 0 4 0 520672266 273817600 36114 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=267400 CPUtime=222.26 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 6551 0 0 0 22220 6 0 0 25 0 4 0 520672266 273817600 36114 33554432000 4194304 4964704 140734137922720 18446744073709551615 4653279 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 887.94
Current children cumulated vsize (KiB) 267400

[startup+282.301 s]

################
# More data... #
################

[pid=16970] ppid=16968 vsize=278136 CPUtime=2805.4 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 65648 0 0 0 280469 71 0 0 25 0 4 0 520672265 284811264 47191 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 69534 47191 460 189 0 63883 0
[pid=16970/tid=16972] ppid=16968 vsize=278136 CPUtime=698.78 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 16613 0 0 0 69855 23 0 0 25 0 4 0 520672266 284811264 47191 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=278136 CPUtime=702.17 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 28355 0 0 0 70200 17 0 0 25 0 4 0 520672266 284811264 47191 33554432000 4194304 4964704 140734137922720 18446744073709551615 4325302 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=278136 CPUtime=702.21 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 8189 0 0 0 70207 14 0 0 25 0 4 0 520672266 284811264 47191 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2805.4
Current children cumulated vsize (KiB) 278136

[startup+762.306 s]
/proc/loadavg: 8.09 8.06 7.56 9/184 17175
/proc/meminfo: memFree=29950404/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=280316 CPUtime=3045.1 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 67563 0 0 0 304435 75 0 0 25 0 4 0 520672265 287043584 47263 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670215 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 70079 47263 460 189 0 64428 0
[pid=16970/tid=16972] ppid=16968 vsize=280316 CPUtime=758.49 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 17153 0 0 0 75824 25 0 0 25 0 4 0 520672266 287043584 47263 33554432000 4194304 4964704 140734137922720 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=280316 CPUtime=762.17 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 29537 0 0 0 76199 18 0 0 25 0 4 0 520672266 287043584 47263 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=280316 CPUtime=762.2 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 8371 0 0 0 76206 14 0 0 25 0 4 0 520672266 287043584 47263 33554432000 4194304 4964704 140734137922720 18446744073709551615 4343230 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3045.1
Current children cumulated vsize (KiB) 280316

[startup+822.301 s]
/proc/loadavg: 8.22 8.10 7.60 9/184 17177
/proc/meminfo: memFree=29931152/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=279740 CPUtime=3284.75 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 69411 0 0 0 328397 78 0 0 25 0 4 0 520672265 286453760 47711 33554432000 4194304 4964704 140734137922720 18446744073709551615 4654508 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 69935 47711 460 189 0 64284 0
[pid=16970/tid=16972] ppid=16968 vsize=279740 CPUtime=818.18 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 17406 0 0 0 81792 26 0 0 18 0 4 0 520672266 286453760 47711 33554432000 4194304 4964704 140734137922720 18446744073709551615 4342144 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=279740 CPUtime=822.17 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 29987 0 0 0 82197 20 0 0 25 0 4 0 520672266 286453760 47711 33554432000 4194304 4964704 140734137922720 18446744073709551615 4660050 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=279740 CPUtime=822.19 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 9512 0 0 0 82204 15 0 0 25 0 4 0 520672266 286453760 47711 33554432000 4194304 4964704 140734137922720 18446744073709551615 4343128 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3284.75
Current children cumulated vsize (KiB) 279740

[startup+882.301 s]
/proc/loadavg: 8.18 8.10 7.64 9/184 17178
/proc/meminfo: memFree=29912256/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=282708 CPUtime=3524.44 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 77194 0 0 0 352360 84 0 0 25 0 4 0 520672265 289492992 48578 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 70677 48578 460 189 0 65026 0
[pid=16970/tid=16972] ppid=16968 vsize=282708 CPUtime=877.88 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 19244 0 0 0 87760 28 0 0 25 0 4 0 520672266 289492992 48578 33554432000 4194304 4964704 140734137922720 18446744073709551615 4342149 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=282708 CPUtime=882.16 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 34496 0 0 0 88194 22 0 0 25 0 4 0 520672266 289492992 48578 33554432000 4194304 4964704 140734137922720 18446744073709551615 4342174 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=282708 CPUtime=882.18 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 9533 0 0 0 88202 16 0 0 25 0 4 0 520672266 289492992 48578 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3524.44
Current children cumulated vsize (KiB) 282708

[startup+942.3 s]
/proc/loadavg: 8.11 8.10 7.66 9/184 17180
/proc/meminfo: memFree=29843028/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=282232 CPUtime=3764.12 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 80615 0 0 0 376322 90 0 0 25 0 4 0 520672265 289005568 49243 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332499 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 70558 49243 460 189 0 64907 0
[pid=16970/tid=16972] ppid=16968 vsize=282232 CPUtime=937.59 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 19494 0 0 0 93729 30 0 0 25 0 4 0 520672266 289005568 49243 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332560 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=282232 CPUtime=942.16 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 37181 0 0 0 94193 23 0 0 25 0 4 0 520672266 289005568 49243 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=282232 CPUtime=942.17 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 9994 0 0 0 94200 17 0 0 25 0 4 0 520672266 289005568 49243 33554432000 4194304 4964704 140734137922720 18446744073709551615 4333097 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3764.12
Current children cumulated vsize (KiB) 282232

[startup+1002.3 s]
/proc/loadavg: 8.17 8.12 7.69 9/184 17181
/proc/meminfo: memFree=29746368/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=283096 CPUtime=4003.8 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 82135 0 0 0 400285 95 0 0 23 0 4 0 520672265 289890304 50501 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 70774 50501 460 189 0 65123 0
[pid=16970/tid=16972] ppid=16968 vsize=283096 CPUtime=997.29 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 19677 0 0 0 99697 32 0 0 25 0 4 0 520672266 289890304 50501 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=283096 CPUtime=1002.15 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 37945 0 0 0 100191 24 0 0 19 0 4 0 520672266 289890304 50501 33554432000 4194304 4964704 140734137922720 18446744073709551615 4342213 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=283096 CPUtime=1002.17 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 9994 0 0 0 100199 18 0 0 25 0 4 0 520672266 289890304 50501 33554432000 4194304 4964704 140734137922720 18446744073709551615 4654520 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4003.8
Current children cumulated vsize (KiB) 283096

[startup+1062.3 s]
/proc/loadavg: 8.11 8.11 7.71 9/184 17183
/proc/meminfo: memFree=29662384/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=284636 CPUtime=4243.49 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 84014 0 0 0 424250 99 0 0 25 0 4 0 520672265 291467264 51446 33554432000 4194304 4964704 140734137922720 18446744073709551615 4342232 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 71159 51446 460 189 0 65508 0
[pid=16970/tid=16972] ppid=16968 vsize=284636 CPUtime=1056.99 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 20931 0 0 0 105665 34 0 0 25 0 4 0 520672266 291467264 51446 33554432000 4194304 4964704 140734137922720 18446744073709551615 4653154 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=284636 CPUtime=1062.15 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 37945 0 0 0 106190 25 0 0 25 0 4 0 520672266 291467264 51446 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=284636 CPUtime=1062.16 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 10619 0 0 0 106197 19 0 0 25 0 4 0 520672266 291467264 51446 33554432000 4194304 4964704 140734137922720 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4243.49
Current children cumulated vsize (KiB) 284636

[startup+1122.3 s]
/proc/loadavg: 8.07 8.10 7.74 9/184 17185
/proc/meminfo: memFree=29612856/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=284636 CPUtime=4483.15 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 84483 0 0 0 448212 103 0 0 25 0 4 0 520672265 291467264 51915 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332462 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 71159 51915 460 189 0 65508 0
[pid=16970/tid=16972] ppid=16968 vsize=284636 CPUtime=1116.67 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 21395 0 0 0 111632 35 0 0 25 0 4 0 520672266 291467264 51915 33554432000 4194304 4964704 140734137922720 18446744073709551615 4362231 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=284636 CPUtime=1122.14 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 37950 0 0 0 112188 26 0 0 25 0 4 0 520672266 291467264 51915 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332355 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=284636 CPUtime=1122.15 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 10619 0 0 0 112196 19 0 0 25 0 4 0 520672266 291467264 51915 33554432000 4194304 4964704 140734137922720 18446744073709551615 4660115 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4483.15
Current children cumulated vsize (KiB) 284636

[startup+1182.3 s]
/proc/loadavg: 8.07 8.10 7.75 9/184 17186
/proc/meminfo: memFree=29534820/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=285484 CPUtime=4722.83 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 86768 0 0 0 472177 106 0 0 25 0 4 0 520672265 292335616 52656 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 71371 52656 460 189 0 65720 0
[pid=16970/tid=16972] ppid=16968 vsize=285484 CPUtime=1176.37 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 22984 0 0 0 117600 37 0 0 19 0 4 0 520672266 292335616 52656 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=285484 CPUtime=1182.14 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 38377 0 0 0 118187 27 0 0 25 0 4 0 520672266 292335616 52656 33554432000 4194304 4964704 140734137922720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=285484 CPUtime=1182.16 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 10885 0 0 0 118196 20 0 0 25 0 4 0 520672266 292335616 52656 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332519 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4722.83
Current children cumulated vsize (KiB) 285484



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.10 8.10 7.76 9/184 17187
/proc/meminfo: memFree=29534560/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=285456 CPUtime=4800.31 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 87165 0 0 0 479924 107 0 0 25 0 4 0 520672265 292306944 52567 33554432000 4194304 4964704 140734137922720 18446744073709551615 4362240 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 71364 52567 460 189 0 65713 0
[pid=16970/tid=16972] ppid=16968 vsize=285456 CPUtime=1195.66 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 22984 0 0 0 119529 37 0 0 25 0 4 0 520672266 292306944 52567 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332496 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=285456 CPUtime=1201.54 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 38766 0 0 0 120126 28 0 0 25 0 4 0 520672266 292306944 52567 33554432000 4194304 4964704 140734137922720 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=285456 CPUtime=1201.55 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 10888 0 0 0 120135 20 0 0 25 0 4 0 520672266 292306944 52567 33554432000 4194304 4964704 140734137922720 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.31
Current children cumulated vsize (KiB) 285456

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.10 8.10 7.76 9/184 17187
/proc/meminfo: memFree=29534560/32950928 swapFree=67111428/67111528
[pid=16970] ppid=16968 vsize=285456 CPUtime=4800.31 cores=0,2,4,6
/proc/16970/stat : 16970 (claspmt) R 16968 16970 16787 0 -1 4202496 87165 0 0 0 479924 107 0 0 25 0 4 0 520672265 292306944 52567 33554432000 4194304 4964704 140734137922720 18446744073709551615 4362240 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/16970/statm: 71364 52567 460 189 0 65713 0
[pid=16970/tid=16972] ppid=16968 vsize=285456 CPUtime=1195.66 cores=0,2,4,6
/proc/16970/task/16972/stat : 16972 (claspmt) R 16968 16970 16787 0 -1 4202560 22984 0 0 0 119529 37 0 0 25 0 4 0 520672266 292306944 52567 33554432000 4194304 4964704 140734137922720 18446744073709551615 4332496 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=16970/tid=16973] ppid=16968 vsize=285456 CPUtime=1201.54 cores=0,2,4,6
/proc/16970/task/16973/stat : 16973 (claspmt) R 16968 16970 16787 0 -1 4202560 38766 0 0 0 120126 28 0 0 25 0 4 0 520672266 292306944 52567 33554432000 4194304 4964704 140734137922720 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=16970/tid=16974] ppid=16968 vsize=285456 CPUtime=1201.55 cores=0,2,4,6
/proc/16970/task/16974/stat : 16974 (claspmt) R 16968 16970 16787 0 -1 4202560 10888 0 0 0 120135 20 0 0 25 0 4 0 520672266 292306944 52567 33554432000 4194304 4964704 140734137922720 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.31
Current children cumulated vsize (KiB) 285456

Child status: 0
Real time (s): 1201.73
CPU time (s): 4800.36
CPU user time (s): 4799.28
CPU system time (s): 1.08883
CPU usage (%): 399.455
Max. virtual memory (cumulated for all children) (KiB): 285688

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.28
system time used= 1.08883
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 87178
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 173387
involuntary context switches= 22441

runsolver used 1.77673 second user time and 3.82542 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-29 17:25:25
IDJOB=3299577
IDBENCH=83234
IDSOLVER=1683
FILE ID=node123/3299577-1304090725
RUNJOBID= node123-1304089895-16805
PBS_JOBID= 13170573
Free space on /tmp= 72816 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-17-33-sat.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299577-1304090725/watcher-3299577-1304090725 -o /tmp/evaluation-result-3299577-1304090725/solver-3299577-1304090725 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299577-1304090725.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ff3a31481d1bf95f014a91f5192a55fa
RANDOM SEED=955934360

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30665732 kB
Buffers:        557924 kB
Cached:        1267380 kB
SwapCached:        100 kB
Active:         154720 kB
Inactive:      1769208 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30665732 kB
SwapTotal:    67111528 kB
SwapFree:     67111428 kB
Dirty:             948 kB
Writeback:           0 kB
AnonPages:       97828 kB
Mapped:          15592 kB
Slab:           298140 kB
PageTables:       4160 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   253828 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72812 MiB
End job on node123 at 2011-04-29 17:45:28