Trace number 3299408

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.12 1201.95

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-23_508.cnf
MD5SUMb891f70c80006fb02dca40f266c0cec1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables254
Number of clauses34661
Sum of the clauses size157137
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 285
Number of clauses of size 331908
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52668

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...638338/instance-3299408-1307638338.cnf
0.19/0.26	c Solving...
4800.05/1201.91	
4800.05/1201.91	*** INTERRUPTED! ***
4800.05/1201.91	*** Shutting down threads...
4800.05/1201.94	s UNKNOWN
4800.05/1201.94	
4800.05/1201.94	c INTERRUPTED   : 1
4800.05/1201.94	c Models        : 0+    
4800.05/1201.94	c Time          : 1201.909s (Solving: 1201.65s 1st Model: 0.00s Unsat: 0.00s)
4800.05/1201.94	c CPU Time      : 4800.070s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299408-1307638338/watcher-3299408-1307638338 -o /tmp/evaluation-result-3299408-1307638338/solver-3299408-1307638338 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299408-1307638338.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.91 8.04 8.14 5/180 20636
/proc/meminfo: memFree=32082968/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=21536 CPUtime=0 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 667 0 0 0 0 0 0 0 25 0 1 0 875434723 22052864 596 33554432000 4194304 4964704 140737386640048 18446744073709551615 270612771525 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/20636/statm: 5384 598 385 189 0 258 0

[startup+0.0635891 s]
/proc/loadavg: 7.91 8.04 8.14 5/180 20636
/proc/meminfo: memFree=32082968/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=24392 CPUtime=0.05 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 1493 0 0 0 5 0 0 0 25 0 1 0 875434723 24977408 1330 33554432000 4194304 4964704 140737386640048 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/20636/statm: 6098 1330 398 189 0 972 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 24392

[startup+0.100583 s]
/proc/loadavg: 7.91 8.04 8.14 5/180 20636
/proc/meminfo: memFree=32082968/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=24392 CPUtime=0.09 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 1493 0 0 0 9 0 0 0 25 0 1 0 875434723 24977408 1330 33554432000 4194304 4964704 140737386640048 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/20636/statm: 6098 1330 398 189 0 972 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 24392

[startup+0.300512 s]
/proc/loadavg: 7.91 8.04 8.14 5/180 20636
/proc/meminfo: memFree=32082968/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=170744 CPUtime=0.39 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 1884 0 0 0 39 0 0 0 18 0 4 0 875434723 174841856 1646 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627263 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 42686 1646 457 189 0 37035 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 170744

[startup+0.700443 s]
/proc/loadavg: 7.91 8.04 8.14 5/180 20636
/proc/meminfo: memFree=32082968/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=171428 CPUtime=2 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 3001 0 0 0 199 1 0 0 18 0 4 0 875434723 175542272 2763 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668725 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 42857 2764 458 189 0 37206 0
Current children cumulated CPU time (s) 2
Current children cumulated vsize (KiB) 171428

[startup+1.5003 s]
/proc/loadavg: 7.91 8.04 8.14 9/184 20640
/proc/meminfo: memFree=32071824/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=173812 CPUtime=5.19 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 4287 0 0 0 518 1 0 0 19 0 4 0 875434723 177983488 4049 33554432000 4194304 4964704 140737386640048 18446744073709551615 4626984 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 43453 4049 458 189 0 37802 0
[pid=20636/tid=20638] ppid=20634 vsize=173812 CPUtime=1.22 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 612 0 0 0 122 0 0 0 25 0 4 0 875434750 177983488 4049 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=173812 CPUtime=1.22 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 849 0 0 0 122 0 0 0 25 0 4 0 875434750 177983488 4049 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668603 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=173812 CPUtime=1.23 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 606 0 0 0 123 0 0 0 19 0 4 0 875434750 177983488 4049 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670466 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.19
Current children cumulated vsize (KiB) 173812

[startup+3.10102 s]
/proc/loadavg: 7.91 8.04 8.14 9/184 20640
/proc/meminfo: memFree=32067856/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=174744 CPUtime=11.58 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 5124 0 0 0 1157 1 0 0 23 0 4 0 875434723 178937856 4886 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627443 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 43686 4886 460 189 0 38035 0
[pid=20636/tid=20638] ppid=20634 vsize=174744 CPUtime=2.82 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 827 0 0 0 282 0 0 0 25 0 4 0 875434750 178937856 4886 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668668 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=174744 CPUtime=2.82 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 1115 0 0 0 282 0 0 0 25 0 4 0 875434750 178937856 4886 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=174744 CPUtime=2.83 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 759 0 0 0 283 0 0 0 23 0 4 0 875434750 178937856 4886 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.58
Current children cumulated vsize (KiB) 174744

[startup+6.30046 s]
/proc/loadavg: 7.91 8.04 8.14 9/184 20640
/proc/meminfo: memFree=32061396/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=176324 CPUtime=24.36 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 6676 0 0 0 2434 2 0 0 25 0 4 0 875434723 180555776 6438 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668609 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 44081 6438 460 189 0 38430 0
[pid=20636/tid=20638] ppid=20634 vsize=176324 CPUtime=6.02 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 1184 0 0 0 602 0 0 0 25 0 4 0 875434750 180555776 6438 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627293 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=176324 CPUtime=5.99 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 1821 0 0 0 599 0 0 0 25 0 4 0 875434750 180555776 6438 33554432000 4194304 4964704 140737386640048 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=176324 CPUtime=6.03 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 994 0 0 0 603 0 0 0 25 0 4 0 875434750 180555776 6438 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627218 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.36
Current children cumulated vsize (KiB) 176324

[startup+12.7003 s]
/proc/loadavg: 7.92 8.04 8.14 9/184 20640
/proc/meminfo: memFree=32046112/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=182548 CPUtime=49.92 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 10242 0 0 0 4989 3 0 0 25 0 4 0 875434723 186929152 9883 33554432000 4194304 4964704 140737386640048 18446744073709551615 4660083 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 45637 9883 460 189 0 39986 0
[pid=20636/tid=20638] ppid=20634 vsize=182548 CPUtime=12.42 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 1988 0 0 0 1242 0 0 0 25 0 4 0 875434750 186929152 9883 33554432000 4194304 4964704 140737386640048 18446744073709551615 4342232 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=182548 CPUtime=12.36 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 3375 0 0 0 1235 1 0 0 25 0 4 0 875434750 186929152 9883 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670431 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=182548 CPUtime=12.43 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 1608 0 0 0 1243 0 0 0 25 0 4 0 875434750 186929152 9883 33554432000 4194304 4964704 140737386640048 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 49.92
Current children cumulated vsize (KiB) 182548

[startup+25.5011 s]
/proc/loadavg: 7.94 8.04 8.14 9/184 20640
/proc/meminfo: memFree=32030976/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=187092 CPUtime=101.05 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 13985 0 0 0 10100 5 0 0 25 0 4 0 875434723 191582208 13424 33554432000 4194304 4964704 140737386640048 18446744073709551615 4659143 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 46773 13424 460 189 0 41122 0
[pid=20636/tid=20638] ppid=20634 vsize=187092 CPUtime=25.21 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 2970 0 0 0 2521 0 0 0 25 0 4 0 875434750 191582208 13424 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=187092 CPUtime=25.09 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 5096 0 0 0 2507 2 0 0 25 0 4 0 875434750 191582208 13424 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=187092 CPUtime=25.22 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 2144 0 0 0 2522 0 0 0 25 0 4 0 875434750 191582208 13424 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.05
Current children cumulated vsize (KiB) 187092

[startup+51.1005 s]
/proc/loadavg: 8.03 8.05 8.14 9/184 20641
/proc/meminfo: memFree=32016792/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=189740 CPUtime=203.3 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 17551 0 0 0 20322 8 0 0 25 0 4 0 875434723 194293760 16956 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670230 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 47435 16956 460 189 0 41784 0
[pid=20636/tid=20638] ppid=20634 vsize=189740 CPUtime=50.8 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 3869 0 0 0 5079 1 0 0 25 0 4 0 875434750 194293760 16956 33554432000 4194304 4964704 140737386640048 18446744073709551615 4660369 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=189740 CPUtime=50.55 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 6864 0 0 0 5053 2 0 0 25 0 4 0 875434750 194293760 16956 33554432000 4194304 4964704 140737386640048 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=189740 CPUtime=50.82 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 2822 0 0 0 5081 1 0 0 25 0 4 0 875434750 194293760 16956 33554432000 4194304 4964704 140737386640048 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.3
Current children cumulated vsize (KiB) 189740

[startup+102.306 s]
/proc/loadavg: 8.05 8.05 8.13 9/184 20684
/proc/meminfo: memFree=32021748/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=199940 CPUtime=407.81 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 22197 0 0 0 40771 10 0 0 25 0 4 0 875434723 204738560 21395 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670323 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 49985 21395 460 189 0 44334 0
[pid=20636/tid=20638] ppid=20634 vsize=199940 CPUtime=102 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 5520 0 0 0 10198 2 0 0 25 0 4 0 875434750 204738560 21395 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=199940 CPUtime=101.47 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 8834 0 0 0 10144 3 0 0 25 0 4 0 875434750 204738560 21395 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=199940 CPUtime=102.03 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 3380 0 0 0 10201 2 0 0 25 0 4 0 875434750 204738560 21395 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627338 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.81
Current children cumulated vsize (KiB) 199940

[startup+162.301 s]
/proc/loadavg: 8.06 8.06 8.13 9/184 20686
/proc/meminfo: memFree=31980616/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=202796 CPUtime=647.46 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 24667 0 0 0 64733 13 0 0 25 0 4 0 875434723 207663104 23641 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627365 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 50699 23641 460 189 0 45048 0
[pid=20636/tid=20638] ppid=20634 vsize=202796 CPUtime=161.98 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 6363 0 0 0 16195 3 0 0 25 0 4 0 875434750 207663104 23641 33554432000 4194304 4964704 140737386640048 18446744073709551615 4684720 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=202796 CPUtime=161.14 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 9991 0 0 0 16110 4 0 0 25 0 4 0 875434750 207663104 23641 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=202796 CPUtime=162.02 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 3702 0 0 0 16200 2 0 0 25 0 4 0 875434750 207663104 23641 33554432000 4194304 4964704 140737386640048 18446744073709551615 4660043 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 647.46
Current children cumulated vsize (KiB) 202796

[startup+222.3 s]
/proc/loadavg: 8.16 8.09 8.13 9/184 20688
/proc/meminfo: memFree=31959104/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=205984 CPUtime=887.12 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 27215 0 0 0 88697 15 0 0 25 0 4 0 875434723 210927616 25998 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668632 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 51496 25998 460 189 0 45845 0
[pid=20636/tid=20638] ppid=20634 vsize=205984 CPUtime=221.97 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 7029 0 0 0 22194 3 0 0 25 0 4 0 875434750 210927616 25998 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=205984 CPUtime=220.81 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 11052 0 0 0 22076 5 0 0 25 0 4 0 875434750 210927616 25998 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=205984 CPUtime=222.02 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 4292 0 0 0 22199 3 0 0 25 0 4 0 875434750 210927616 25998 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 887.12
Current children cumulated vsize (KiB) 205984

[startup+282.301 s]

################
# More data... #
################

[pid=20636] ppid=20634 vsize=219824 CPUtime=2804.41 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 37661 0 0 0 280413 28 0 0 25 0 4 0 875434723 225099776 34592 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627828 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 54956 34592 460 189 0 49305 0
[pid=20636/tid=20638] ppid=20634 vsize=219824 CPUtime=701.9 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 11372 0 0 0 70184 6 0 0 25 0 4 0 875434750 225099776 34592 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668629 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=219824 CPUtime=698.62 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 16269 0 0 0 69852 10 0 0 25 0 4 0 875434750 225099776 34592 33554432000 4194304 4964704 140737386640048 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=219824 CPUtime=701.58 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 4826 0 0 0 70152 6 0 0 25 0 4 0 875434750 225099776 34592 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627338 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2804.41
Current children cumulated vsize (KiB) 219824

[startup+762.307 s]
/proc/loadavg: 8.23 8.18 8.14 9/184 20714
/proc/meminfo: memFree=31858928/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=220264 CPUtime=3044.1 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 38181 0 0 0 304380 30 0 0 25 0 4 0 875434723 225550336 34877 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627301 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 55066 34877 460 189 0 49415 0
[pid=20636/tid=20638] ppid=20634 vsize=220264 CPUtime=761.91 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 11738 0 0 0 76184 7 0 0 25 0 4 0 875434750 225550336 34877 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=220264 CPUtime=758.29 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 16339 0 0 0 75819 10 0 0 19 0 4 0 875434750 225550336 34877 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=220264 CPUtime=761.58 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 4858 0 0 0 76152 6 0 0 25 0 4 0 875434750 225550336 34877 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627526 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3044.1
Current children cumulated vsize (KiB) 220264

[startup+822.301 s]
/proc/loadavg: 8.14 8.16 8.14 9/184 20716
/proc/meminfo: memFree=31851700/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=221908 CPUtime=3283.73 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 39297 0 0 0 328342 31 0 0 25 0 4 0 875434723 227233792 35804 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627360 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 55477 35804 460 189 0 49826 0
[pid=20636/tid=20638] ppid=20634 vsize=221908 CPUtime=821.89 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 12450 0 0 0 82182 7 0 0 25 0 4 0 875434750 227233792 35804 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=221908 CPUtime=817.96 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 16442 0 0 0 81786 10 0 0 25 0 4 0 875434750 227233792 35804 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=221908 CPUtime=821.58 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 5081 0 0 0 82151 7 0 0 25 0 4 0 875434750 227233792 35804 33554432000 4194304 4964704 140737386640048 18446744073709551615 4654503 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3283.73
Current children cumulated vsize (KiB) 221908

[startup+882.3 s]
/proc/loadavg: 8.08 8.14 8.13 9/184 20717
/proc/meminfo: memFree=31846068/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=223840 CPUtime=3523.4 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 40418 0 0 0 352307 33 0 0 25 0 4 0 875434723 229212160 36722 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668652 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 55960 36722 460 189 0 50309 0
[pid=20636/tid=20638] ppid=20634 vsize=223840 CPUtime=881.89 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 12954 0 0 0 88181 8 0 0 25 0 4 0 875434750 229212160 36722 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=223840 CPUtime=877.62 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 17034 0 0 0 87752 10 0 0 25 0 4 0 875434750 229212160 36722 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=223840 CPUtime=881.58 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 5105 0 0 0 88151 7 0 0 25 0 4 0 875434750 229212160 36722 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3523.4
Current children cumulated vsize (KiB) 223840

[startup+942.301 s]
/proc/loadavg: 8.12 8.14 8.13 9/184 20719
/proc/meminfo: memFree=31827416/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=289800 CPUtime=3763.07 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 44400 0 0 0 376268 39 0 0 25 0 4 0 875434723 296755200 40562 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670277 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 72450 40562 460 189 0 66799 0
[pid=20636/tid=20638] ppid=20634 vsize=289800 CPUtime=941.88 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 13946 0 0 0 94179 9 0 0 25 0 4 0 875434750 296755200 40562 33554432000 4194304 4964704 140737386640048 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=289800 CPUtime=937.3 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 18252 0 0 0 93718 12 0 0 25 0 4 0 875434750 296755200 40562 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=289800 CPUtime=941.58 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 6329 0 0 0 94149 9 0 0 25 0 4 0 875434750 296755200 40562 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627227 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3763.07
Current children cumulated vsize (KiB) 289800

[startup+1002.3 s]
/proc/loadavg: 8.19 8.16 8.13 9/184 20720
/proc/meminfo: memFree=31818928/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=293472 CPUtime=4002.73 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 46271 0 0 0 400232 41 0 0 25 0 4 0 875434723 300515328 42276 33554432000 4194304 4964704 140737386640048 18446744073709551615 4321093 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 73368 42276 460 189 0 67717 0
[pid=20636/tid=20638] ppid=20634 vsize=293472 CPUtime=1001.88 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 14565 0 0 0 100178 10 0 0 25 0 4 0 875434750 300515328 42276 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=293472 CPUtime=996.97 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 18564 0 0 0 99685 12 0 0 25 0 4 0 875434750 300515328 42276 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=293472 CPUtime=1001.58 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 7016 0 0 0 100148 10 0 0 25 0 4 0 875434750 300515328 42276 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668629 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4002.73
Current children cumulated vsize (KiB) 293472

[startup+1062.3 s]
/proc/loadavg: 8.19 8.16 8.13 9/184 20722
/proc/meminfo: memFree=31811308/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=293756 CPUtime=4242.41 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 47969 0 0 0 424198 43 0 0 25 0 4 0 875434723 300806144 43783 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 73439 43783 460 189 0 67788 0
[pid=20636/tid=20638] ppid=20634 vsize=293756 CPUtime=1061.87 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 15325 0 0 0 106177 10 0 0 25 0 4 0 875434750 300806144 43783 33554432000 4194304 4964704 140737386640048 18446744073709551615 4668737 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=293756 CPUtime=1056.64 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 18847 0 0 0 105652 12 0 0 25 0 4 0 875434750 300806144 43783 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=293756 CPUtime=1061.58 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 7036 0 0 0 106148 10 0 0 25 0 4 0 875434750 300806144 43783 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4242.41
Current children cumulated vsize (KiB) 293756

[startup+1122.3 s]
/proc/loadavg: 8.16 8.15 8.13 9/184 20724
/proc/meminfo: memFree=31804448/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=294104 CPUtime=4482.08 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 48868 0 0 0 448164 44 0 0 25 0 4 0 875434723 301162496 44397 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 73526 44397 460 189 0 67875 0
[pid=20636/tid=20638] ppid=20634 vsize=294104 CPUtime=1121.87 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 15651 0 0 0 112176 11 0 0 25 0 4 0 875434750 301162496 44397 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=294104 CPUtime=1116.32 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 19011 0 0 0 111619 13 0 0 25 0 4 0 875434750 301162496 44397 33554432000 4194304 4964704 140737386640048 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=294104 CPUtime=1121.58 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 7445 0 0 0 112148 10 0 0 25 0 4 0 875434750 301162496 44397 33554432000 4194304 4964704 140737386640048 18446744073709551615 4320890 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4482.08
Current children cumulated vsize (KiB) 294104

[startup+1182.3 s]
/proc/loadavg: 8.10 8.14 8.13 9/184 20725
/proc/meminfo: memFree=31799188/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=295036 CPUtime=4721.74 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 49757 0 0 0 472129 45 0 0 25 0 4 0 875434723 302116864 45152 33554432000 4194304 4964704 140737386640048 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 73759 45152 460 189 0 68108 0
[pid=20636/tid=20638] ppid=20634 vsize=295036 CPUtime=1181.85 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 16125 0 0 0 118174 11 0 0 25 0 4 0 875434750 302116864 45152 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=295036 CPUtime=1176 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 19374 0 0 0 117587 13 0 0 25 0 4 0 875434750 302116864 45152 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=295036 CPUtime=1181.58 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 7451 0 0 0 118148 10 0 0 25 0 4 0 875434750 302116864 45152 33554432000 4194304 4964704 140737386640048 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4721.74
Current children cumulated vsize (KiB) 295036



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.13 8.14 8.13 9/184 20726
/proc/meminfo: memFree=31797416/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=295036 CPUtime=4800.05 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 49852 0 0 0 479960 45 0 0 25 0 4 0 875434723 302116864 45199 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 73759 45199 460 189 0 68108 0
[pid=20636/tid=20638] ppid=20634 vsize=295036 CPUtime=1201.46 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 16173 0 0 0 120135 11 0 0 25 0 4 0 875434750 302116864 45199 33554432000 4194304 4964704 140737386640048 18446744073709551615 4626928 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=295036 CPUtime=1195.49 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 19413 0 0 0 119536 13 0 0 25 0 4 0 875434750 302116864 45199 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=295036 CPUtime=1201.18 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 7458 0 0 0 120108 10 0 0 25 0 4 0 875434750 302116864 45199 33554432000 4194304 4964704 140737386640048 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.05
Current children cumulated vsize (KiB) 295036

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.9 s]
/proc/loadavg: 8.13 8.14 8.13 9/184 20726
/proc/meminfo: memFree=31797416/32951124 swapFree=67052292/67111528
[pid=20636] ppid=20634 vsize=295036 CPUtime=4800.05 cores=1,3,5,7
/proc/20636/stat : 20636 (claspmt) R 20634 20636 19795 0 -1 4202496 49852 0 0 0 479960 45 0 0 25 0 4 0 875434723 302116864 45199 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20636/statm: 73759 45199 460 189 0 68108 0
[pid=20636/tid=20638] ppid=20634 vsize=295036 CPUtime=1201.46 cores=1,3,5,7
/proc/20636/task/20638/stat : 20638 (claspmt) R 20634 20636 19795 0 -1 4202560 16173 0 0 0 120135 11 0 0 25 0 4 0 875434750 302116864 45199 33554432000 4194304 4964704 140737386640048 18446744073709551615 4626928 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20636/tid=20639] ppid=20634 vsize=295036 CPUtime=1195.49 cores=1,3,5,7
/proc/20636/task/20639/stat : 20639 (claspmt) R 20634 20636 19795 0 -1 4202560 19413 0 0 0 119536 13 0 0 25 0 4 0 875434750 302116864 45199 33554432000 4194304 4964704 140737386640048 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20636/tid=20640] ppid=20634 vsize=295036 CPUtime=1201.18 cores=1,3,5,7
/proc/20636/task/20640/stat : 20640 (claspmt) R 20634 20636 19795 0 -1 4202560 7458 0 0 0 120108 10 0 0 25 0 4 0 875434750 302116864 45199 33554432000 4194304 4964704 140737386640048 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.05
Current children cumulated vsize (KiB) 295036

Child status: 0
Real time (s): 1201.95
CPU time (s): 4800.12
CPU user time (s): 4799.65
CPU system time (s): 0.468928
CPU usage (%): 399.362
Max. virtual memory (cumulated for all children) (KiB): 295036

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.65
system time used= 0.468928
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 49864
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15360
involuntary context switches= 33486

runsolver used 1.9597 second user time and 4.6043 second system time

The end

Launcher Data 

Begin job on node108 at 2011-06-09 18:52:18
IDJOB=3299408
IDBENCH=83275
IDSOLVER=1683
FILE ID=node108/3299408-1307638338
RUNJOBID= node108-1307635897-20210
PBS_JOBID= 13549383
Free space on /tmp= 74084 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/VanDerWaerden_pd_2-3-23_508.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299408-1307638338/watcher-3299408-1307638338 -o /tmp/evaluation-result-3299408-1307638338/solver-3299408-1307638338 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299408-1307638338.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b891f70c80006fb02dca40f266c0cec1
RANDOM SEED=1406090838

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32083776 kB
Buffers:        214320 kB
Cached:         339528 kB
SwapCached:      25900 kB
Active:         409068 kB
Inactive:       247440 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32083776 kB
SwapTotal:    67111528 kB
SwapFree:     67052292 kB
Dirty:            1668 kB
Writeback:           0 kB
AnonPages:       97352 kB
Mapped:           9924 kB
Slab:           147116 kB
PageTables:       5104 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   294704 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74084 MiB
End job on node108 at 2011-06-09 19:12:22