Trace number 3299922

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.28 1202.04

General information on the benchmark

NameAPPLICATIONS/bitverif/
smulo/smulo064.cnf
MD5SUM472e9d10d7fd1a82d06da0809d0002df
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables47129
Number of clauses141002
Sum of the clauses size329002
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 294000
Number of clauses of size 347000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...042665/instance-3299922-1304042665.cnf
0.29/0.30	c Solving...
4800.11/1201.91	
4800.11/1201.91	*** INTERRUPTED! ***
4800.11/1201.91	*** Shutting down threads...
4800.24/1202.02	s UNKNOWN
4800.24/1202.02	
4800.24/1202.02	c INTERRUPTED   : 1
4800.24/1202.02	c Models        : 0+    
4800.24/1202.02	c Time          : 1201.907s (Solving: 1201.61s 1st Model: 0.00s Unsat: 0.00s)
4800.24/1202.02	c CPU Time      : 4800.140s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299922-1304042665/watcher-3299922-1304042665 -o /tmp/evaluation-result-3299922-1304042665/solver-3299922-1304042665 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299922-1304042665.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.56 4.61 4.72 2/174 27047
/proc/meminfo: memFree=16017956/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=26920 CPUtime=0 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 843 0 1 0 0 0 0 0 21 0 1 0 515865319 27566080 774 33554432000 4194304 4964704 140737317277152 18446744073709551615 4700332 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/27047/statm: 6730 782 375 189 0 1604 0

[startup+0.0932251 s]
/proc/loadavg: 3.56 4.61 4.72 2/174 27047
/proc/meminfo: memFree=16017956/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=44700 CPUtime=0.08 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 7756 0 1 0 8 0 0 0 21 0 1 0 515865319 45772800 6115 33554432000 4194304 4964704 140737317277152 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/27047/statm: 11175 6115 402 189 0 6049 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 44700

[startup+0.100221 s]
/proc/loadavg: 3.56 4.61 4.72 2/174 27047
/proc/meminfo: memFree=16017956/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=44700 CPUtime=0.08 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 7757 0 1 0 8 0 0 0 21 0 1 0 515865319 45772800 6116 33554432000 4194304 4964704 140737317277152 18446744073709551615 4614540 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/27047/statm: 11175 6116 403 189 0 6049 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 44700

[startup+0.300258 s]
/proc/loadavg: 3.56 4.61 4.72 2/174 27047
/proc/meminfo: memFree=16017956/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=49320 CPUtime=0.29 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 8926 0 1 0 28 1 0 0 22 0 1 0 515865319 50503680 7285 33554432000 4194304 4964704 140737317277152 18446744073709551615 268272338312 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/27047/statm: 12330 7285 404 189 0 7204 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 49320

[startup+0.701115 s]
/proc/loadavg: 3.56 4.61 4.72 2/174 27047
/proc/meminfo: memFree=16017956/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=266156 CPUtime=1.83 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 15100 0 2 0 179 4 0 0 24 0 4 0 515865319 272543744 11616 33554432000 4194304 4964704 140737317277152 18446744073709551615 4370264 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 66539 11616 458 189 0 60888 0
Current children cumulated CPU time (s) 1.83
Current children cumulated vsize (KiB) 266156

[startup+1.50092 s]
/proc/loadavg: 3.56 4.61 4.72 6/181 27057
/proc/meminfo: memFree=15910768/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=266288 CPUtime=5.03 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 16174 0 2 0 497 6 0 0 25 0 4 0 515865319 272678912 12690 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668871 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 66572 12690 458 189 0 60921 0
[pid=27047/tid=27055] ppid=27045 vsize=266288 CPUtime=1.18 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 1835 0 0 0 117 1 0 0 25 0 4 0 515865350 272678912 12690 33554432000 4194304 4964704 140737317277152 18446744073709551615 4370224 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=266288 CPUtime=1.18 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 2828 0 0 0 118 0 0 0 25 0 4 0 515865350 272678912 12690 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668931 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=266288 CPUtime=1.17 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 2433 0 0 0 115 2 0 0 25 0 4 0 515865350 272678912 12690 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.03
Current children cumulated vsize (KiB) 266288

[startup+3.10064 s]
/proc/loadavg: 3.92 4.66 4.74 9/184 27060
/proc/meminfo: memFree=15874164/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=267268 CPUtime=11.42 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 17887 0 2 0 1135 7 0 0 25 0 4 0 515865319 273682432 14403 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 66817 14403 458 189 0 61166 0
[pid=27047/tid=27055] ppid=27045 vsize=267268 CPUtime=2.77 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 1972 0 0 0 276 1 0 0 25 0 4 0 515865350 273682432 14403 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=267268 CPUtime=2.78 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 3449 0 0 0 277 1 0 0 25 0 4 0 515865350 273682432 14403 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670114 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=267268 CPUtime=2.77 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 3141 0 0 0 274 3 0 0 25 0 4 0 515865350 273682432 14403 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668931 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.42
Current children cumulated vsize (KiB) 267268

[startup+6.30107 s]
/proc/loadavg: 3.92 4.66 4.74 9/184 27060
/proc/meminfo: memFree=15849476/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=268720 CPUtime=24.2 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 20955 0 2 0 2410 10 0 0 25 0 4 0 515865319 275169280 17471 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 67180 17471 458 189 0 61529 0
[pid=27047/tid=27055] ppid=27045 vsize=268720 CPUtime=5.97 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 2227 0 0 0 596 1 0 0 25 0 4 0 515865350 275169280 17471 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=268720 CPUtime=5.99 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 4464 0 0 0 597 2 0 0 25 0 4 0 515865350 275169280 17471 33554432000 4194304 4964704 140737317277152 18446744073709551615 4669200 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=268720 CPUtime=5.98 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 4592 0 0 0 593 5 0 0 25 0 4 0 515865350 275169280 17471 33554432000 4194304 4964704 140737317277152 18446744073709551615 4653275 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.2
Current children cumulated vsize (KiB) 268720

[startup+12.7009 s]
/proc/loadavg: 4.54 4.77 4.77 9/184 27060
/proc/meminfo: memFree=15820872/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=269380 CPUtime=49.76 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 23485 0 2 0 4964 12 0 0 25 0 4 0 515865319 275845120 20001 33554432000 4194304 4964704 140737317277152 18446744073709551615 4652133 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 67345 20001 460 189 0 61694 0
[pid=27047/tid=27055] ppid=27045 vsize=269380 CPUtime=12.37 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 2562 0 0 0 1236 1 0 0 25 0 4 0 515865350 275845120 20001 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=269380 CPUtime=12.38 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 6088 0 0 0 1235 3 0 0 25 0 4 0 515865350 275845120 20001 33554432000 4194304 4964704 140737317277152 18446744073709551615 4669477 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=269380 CPUtime=12.37 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 4993 0 0 0 1232 5 0 0 25 0 4 0 515865350 275845120 20001 33554432000 4194304 4964704 140737317277152 18446744073709551615 4669056 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 49.76
Current children cumulated vsize (KiB) 269380

[startup+25.5007 s]
/proc/loadavg: 5.08 4.88 4.81 9/184 27060
/proc/meminfo: memFree=15756144/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=273272 CPUtime=100.89 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 30370 0 2 0 10070 19 0 0 25 0 4 0 515865319 279830528 26886 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 68318 26886 460 189 0 62667 0
[pid=27047/tid=27055] ppid=27045 vsize=273272 CPUtime=25.18 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 3272 0 0 0 2516 2 0 0 25 0 4 0 515865350 279830528 26886 33554432000 4194304 4964704 140737317277152 18446744073709551615 4660059 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=273272 CPUtime=25.18 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 10380 0 0 0 2510 8 0 0 25 0 4 0 515865350 279830528 26886 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=273272 CPUtime=25.18 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 5914 0 0 0 2511 7 0 0 25 0 4 0 515865350 279830528 26886 33554432000 4194304 4964704 140737317277152 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 100.89
Current children cumulated vsize (KiB) 273272

[startup+51.1011 s]
/proc/loadavg: 6.07 5.13 4.89 9/184 27061
/proc/meminfo: memFree=15703572/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=273800 CPUtime=203.16 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 37618 0 2 0 20290 26 0 0 25 0 4 0 515865319 280371200 34134 33554432000 4194304 4964704 140737317277152 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 68450 34134 460 189 0 62799 0
[pid=27047/tid=27055] ppid=27045 vsize=273800 CPUtime=50.77 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 4107 0 0 0 5075 2 0 0 25 0 4 0 515865350 280371200 34134 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=273800 CPUtime=50.79 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 14011 0 0 0 5068 11 0 0 25 0 4 0 515865350 280371200 34134 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=273800 CPUtime=50.78 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 8582 0 0 0 5068 10 0 0 25 0 4 0 515865350 280371200 34134 33554432000 4194304 4964704 140737317277152 18446744073709551615 4320934 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.16
Current children cumulated vsize (KiB) 273800

[startup+102.307 s]
/proc/loadavg: 7.30 5.62 5.07 9/184 27063
/proc/meminfo: memFree=15547544/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=346096 CPUtime=407.71 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 54170 0 2 0 40731 40 0 0 25 0 4 0 515865319 354402304 50685 33554432000 4194304 4964704 140737317277152 18446744073709551615 4370264 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 86524 50685 460 189 0 80873 0
[pid=27047/tid=27055] ppid=27045 vsize=346096 CPUtime=101.98 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 5413 0 0 0 10195 3 0 0 25 0 4 0 515865350 354402304 50685 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=346096 CPUtime=101.99 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 26014 0 0 0 10177 22 0 0 25 0 4 0 515865350 354402304 50685 33554432000 4194304 4964704 140737317277152 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=346096 CPUtime=101.98 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 10143 0 0 0 10187 11 0 0 25 0 4 0 515865350 354402304 50685 33554432000 4194304 4964704 140737317277152 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.71
Current children cumulated vsize (KiB) 346096

[startup+162.3 s]
/proc/loadavg: 7.74 6.05 5.25 9/184 27064
/proc/meminfo: memFree=15397828/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=350416 CPUtime=647.35 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 59005 0 2 0 64692 43 0 0 25 0 4 0 515865319 358825984 55496 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 87604 55496 460 189 0 81953 0
[pid=27047/tid=27055] ppid=27045 vsize=350416 CPUtime=161.98 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 6392 0 0 0 16193 5 0 0 25 0 4 0 515865350 358825984 55496 33554432000 4194304 4964704 140737317277152 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=350416 CPUtime=161.98 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 27542 0 0 0 16175 23 0 0 25 0 4 0 515865350 358825984 55496 33554432000 4194304 4964704 140737317277152 18446744073709551615 4361114 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=350416 CPUtime=161.97 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 11423 0 0 0 16186 11 0 0 25 0 4 0 515865350 358825984 55496 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 647.35
Current children cumulated vsize (KiB) 350416

[startup+222.301 s]
/proc/loadavg: 7.90 6.40 5.42 9/184 27066
/proc/meminfo: memFree=15236460/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=351620 CPUtime=887.02 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 69792 0 2 0 88652 50 0 0 25 0 4 0 515865319 360058880 66246 33554432000 4194304 4964704 140737317277152 18446744073709551615 4332253 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 87905 66246 460 189 0 82254 0
[pid=27047/tid=27055] ppid=27045 vsize=351620 CPUtime=221.98 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 7707 0 0 0 22192 6 0 0 25 0 4 0 515865350 360058880 66246 33554432000 4194304 4964704 140737317277152 18446744073709551615 4647541 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=351620 CPUtime=221.98 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 34164 0 0 0 22172 26 0 0 25 0 4 0 515865350 360058880 66246 33554432000 4194304 4964704 140737317277152 18446744073709551615 4320996 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=351620 CPUtime=221.97 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 13964 0 0 0 22183 14 0 0 25 0 4 0 515865350 360058880 66246 33554432000 4194304 4964704 140737317277152 18446744073709551615 4321013 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 887.02
Current children cumulated vsize (KiB) 351620

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2564.77
Current children cumulated vsize (KiB) 501516

[startup+702.3 s]
/proc/loadavg: 8.07 7.72 6.47 9/184 27079
/proc/meminfo: memFree=14481712/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=571964 CPUtime=2804.42 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 106596 0 2 0 280357 85 0 0 25 0 4 0 515865319 585691136 102027 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 142991 102027 460 189 0 137340 0
[pid=27047/tid=27055] ppid=27045 vsize=571964 CPUtime=701.99 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 17092 0 0 0 70185 14 0 0 25 0 4 0 515865350 585691136 102027 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=571964 CPUtime=702 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 52339 0 0 0 70154 46 0 0 25 0 4 0 515865350 585691136 102027 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670440 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=571964 CPUtime=701.97 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 18199 0 0 0 70179 18 0 0 25 0 4 0 515865350 585691136 102027 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2804.42
Current children cumulated vsize (KiB) 571964

[startup+762.307 s]
/proc/loadavg: 8.02 7.77 6.56 9/184 27080
/proc/meminfo: memFree=14389784/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=577292 CPUtime=3044.12 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 113351 0 2 0 304321 91 0 0 25 0 4 0 515865319 591147008 108656 33554432000 4194304 4964704 140737317277152 18446744073709551615 4653504 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 144323 108656 460 189 0 138672 0
[pid=27047/tid=27055] ppid=27045 vsize=577292 CPUtime=762 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 17376 0 0 0 76186 14 0 0 25 0 4 0 515865350 591147008 108656 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668925 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=577292 CPUtime=762.01 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 57360 0 0 0 76150 51 0 0 25 0 4 0 515865350 591147008 108656 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=577292 CPUtime=761.97 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 18330 0 0 0 76179 18 0 0 25 0 4 0 515865350 591147008 108656 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3044.12
Current children cumulated vsize (KiB) 577292

[startup+822.301 s]
/proc/loadavg: 8.04 7.82 6.65 9/184 27082
/proc/meminfo: memFree=14372876/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=644820 CPUtime=3283.76 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 114158 0 2 0 328285 91 0 0 25 0 4 0 515865319 660295680 109463 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 161205 109463 460 189 0 155554 0
[pid=27047/tid=27055] ppid=27045 vsize=644820 CPUtime=821.99 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 17620 0 0 0 82185 14 0 0 25 0 4 0 515865350 660295680 109463 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=644820 CPUtime=822 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 57362 0 0 0 82149 51 0 0 25 0 4 0 515865350 660295680 109463 33554432000 4194304 4964704 140737317277152 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=644820 CPUtime=821.96 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 18380 0 0 0 82178 18 0 0 25 0 4 0 515865350 660295680 109463 33554432000 4194304 4964704 140737317277152 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3283.76
Current children cumulated vsize (KiB) 644820

[startup+882.3 s]
/proc/loadavg: 8.21 7.90 6.75 9/184 27083
/proc/meminfo: memFree=14241884/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=644820 CPUtime=3523.44 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 130057 0 2 0 352236 108 0 0 25 0 4 0 515865319 660295680 125256 33554432000 4194304 4964704 140737317277152 18446744073709551615 4660415 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 161205 125256 460 189 0 155554 0
[pid=27047/tid=27055] ppid=27045 vsize=644820 CPUtime=881.99 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 19200 0 0 0 88183 16 0 0 25 0 4 0 515865350 660295680 125256 33554432000 4194304 4964704 140737317277152 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=644820 CPUtime=882 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 64583 0 0 0 88143 57 0 0 25 0 4 0 515865350 660295680 125256 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=644820 CPUtime=881.95 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 25478 0 0 0 88169 26 0 0 25 0 4 0 515865350 660295680 125256 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3523.44
Current children cumulated vsize (KiB) 644820

[startup+942.301 s]
/proc/loadavg: 8.22 7.95 6.84 9/184 27085
/proc/meminfo: memFree=14091200/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=713620 CPUtime=3763.12 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 148285 0 2 0 376187 125 0 0 25 0 4 0 515865319 730746880 143484 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670269 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 178405 143484 460 189 0 172754 0
[pid=27047/tid=27055] ppid=27045 vsize=713620 CPUtime=941.99 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 19354 0 0 0 94183 16 0 0 25 0 4 0 515865350 730746880 143484 33554432000 4194304 4964704 140737317277152 18446744073709551615 4653459 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=713620 CPUtime=942 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 81394 0 0 0 94127 73 0 0 25 0 4 0 515865350 730746880 143484 33554432000 4194304 4964704 140737317277152 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=713620 CPUtime=941.95 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 25925 0 0 0 94168 27 0 0 25 0 4 0 515865350 730746880 143484 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3763.12
Current children cumulated vsize (KiB) 713620

[startup+1002.3 s]
/proc/loadavg: 8.15 7.97 6.91 9/184 27087
/proc/meminfo: memFree=13958100/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=714144 CPUtime=4002.79 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 149174 0 2 0 400153 126 0 0 25 0 4 0 515865319 731283456 144254 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668931 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 178536 144254 460 189 0 172885 0
[pid=27047/tid=27055] ppid=27045 vsize=714144 CPUtime=1002 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 19910 0 0 0 100183 17 0 0 25 0 4 0 515865350 731283456 144254 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=714144 CPUtime=1002 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 81629 0 0 0 100127 73 0 0 25 0 4 0 515865350 731283456 144254 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668931 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=714144 CPUtime=1001.94 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 25932 0 0 0 100167 27 0 0 25 0 4 0 515865350 731283456 144254 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4002.79
Current children cumulated vsize (KiB) 714144

[startup+1062.3 s]
/proc/loadavg: 8.11 7.99 6.98 9/184 27088
/proc/meminfo: memFree=13904236/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=714644 CPUtime=4242.46 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 149726 0 2 0 424120 126 0 0 25 0 4 0 515865319 731795456 144806 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 178661 144806 460 189 0 173010 0
[pid=27047/tid=27055] ppid=27045 vsize=714644 CPUtime=1062 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 19949 0 0 0 106183 17 0 0 25 0 4 0 515865350 731795456 144806 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668635 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=714644 CPUtime=1062.01 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 82005 0 0 0 106127 74 0 0 25 0 4 0 515865350 731795456 144806 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=714644 CPUtime=1061.94 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 25944 0 0 0 106167 27 0 0 25 0 4 0 515865350 731795456 144806 33554432000 4194304 4964704 140737317277152 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4242.46
Current children cumulated vsize (KiB) 714644

[startup+1122.3 s]
/proc/loadavg: 8.16 8.02 7.05 9/184 27090
/proc/meminfo: memFree=13848396/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=781736 CPUtime=4482.13 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 157933 0 2 0 448078 135 0 0 25 0 4 0 515865319 800497664 152878 33554432000 4194304 4964704 140737317277152 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 195434 152878 460 189 0 189783 0
[pid=27047/tid=27055] ppid=27045 vsize=781736 CPUtime=1122 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 22611 0 0 0 112180 20 0 0 25 0 4 0 515865350 800497664 152878 33554432000 4194304 4964704 140737317277152 18446744073709551615 4660085 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=781736 CPUtime=1122.01 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 87179 0 0 0 112121 80 0 0 25 0 4 0 515865350 800497664 152878 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=781736 CPUtime=1121.94 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 25944 0 0 0 112167 27 0 0 25 0 4 0 515865350 800497664 152878 33554432000 4194304 4964704 140737317277152 18446744073709551615 4660415 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4482.13
Current children cumulated vsize (KiB) 781736

[startup+1182.3 s]
/proc/loadavg: 8.17 8.04 7.12 9/184 27091
/proc/meminfo: memFree=13792048/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=785476 CPUtime=4721.8 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 163181 0 2 0 472039 141 0 0 25 0 4 0 515865319 804327424 158126 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 196369 158126 460 189 0 190718 0
[pid=27047/tid=27055] ppid=27045 vsize=785476 CPUtime=1182 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 22757 0 0 0 118180 20 0 0 25 0 4 0 515865350 804327424 158126 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=785476 CPUtime=1182.01 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 90735 0 0 0 118116 85 0 0 25 0 4 0 515865350 804327424 158126 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=785476 CPUtime=1181.93 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 26576 0 0 0 118165 28 0 0 25 0 4 0 515865350 804327424 158126 33554432000 4194304 4964704 140737317277152 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4721.8
Current children cumulated vsize (KiB) 785476



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.12 8.04 7.14 9/184 27092
/proc/meminfo: memFree=13771836/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=785476 CPUtime=4800.11 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 163281 0 2 0 479870 141 0 0 25 0 4 0 515865319 804327424 158226 33554432000 4194304 4964704 140737317277152 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/27047/statm: 196369 158226 460 189 0 190718 0
[pid=27047/tid=27055] ppid=27045 vsize=785476 CPUtime=1201.61 cores=0,2,4,6
/proc/27047/task/27055/stat : 27055 (claspmt) R 27045 27047 27015 0 -1 4202560 22766 0 0 0 120141 20 0 0 25 0 4 0 515865350 804327424 158226 33554432000 4194304 4964704 140737317277152 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=27047/tid=27056] ppid=27045 vsize=785476 CPUtime=1201.62 cores=0,2,4,6
/proc/27047/task/27056/stat : 27056 (claspmt) R 27045 27047 27015 0 -1 4202560 90735 0 0 0 120077 85 0 0 25 0 4 0 515865350 804327424 158226 33554432000 4194304 4964704 140737317277152 18446744073709551615 4660077 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=27047/tid=27057] ppid=27045 vsize=785476 CPUtime=1201.54 cores=0,2,4,6
/proc/27047/task/27057/stat : 27057 (claspmt) R 27045 27047 27015 0 -1 4202560 26664 0 0 0 120126 28 0 0 25 0 4 0 515865350 804327424 158226 33554432000 4194304 4964704 140737317277152 18446744073709551615 4332418 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.11
Current children cumulated vsize (KiB) 785476

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.01 s]
/proc/loadavg: 8.12 8.04 7.14 9/184 27092
/proc/meminfo: memFree=13771836/32950928 swapFree=67111528/67111528
[pid=27047] ppid=27045 vsize=638228 CPUtime=4800.24 cores=0,2,4,6
/proc/27047/stat : 27047 (claspmt) R 27045 27047 27015 0 -1 4202496 163292 0 2 0 479882 142 0 0 25 0 1 0 515865319 653545472 136253 33554432000 4194304 4964704 140737317277152 18446744073709551615 268272732519 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/27047/statm: 159557 135742 471 189 0 153906 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 638228

Child status: 0
Real time (s): 1202.04
CPU time (s): 4800.28
CPU user time (s): 4798.83
CPU system time (s): 1.44478
CPU usage (%): 399.343
Max. virtual memory (cumulated for all children) (KiB): 785476

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.83
system time used= 1.44478
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 163293
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 530
involuntary context switches= 20983

runsolver used 1.93371 second user time and 4.6203 second system time

The end

Launcher Data 

Begin job on node122 at 2011-04-29 04:04:25
IDJOB=3299922
IDBENCH=70791
IDSOLVER=1683
FILE ID=node122/3299922-1304042665
RUNJOBID= node122-1304042665-27033
PBS_JOBID= 13170386
Free space on /tmp= 71660 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT09/APPLICATIONS/bitverif/smulo/smulo064.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299922-1304042665/watcher-3299922-1304042665 -o /tmp/evaluation-result-3299922-1304042665/solver-3299922-1304042665 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299922-1304042665.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 472e9d10d7fd1a82d06da0809d0002df
RANDOM SEED=1348593178

node122.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      16018360 kB
Buffers:       1732720 kB
Cached:       14564260 kB
SwapCached:          0 kB
Active:        5311996 kB
Inactive:     11053544 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      16018360 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            8448 kB
Writeback:           0 kB
AnonPages:       67908 kB
Mapped:          14136 kB
Slab:           501272 kB
PageTables:       4632 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   193840 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71656 MiB
End job on node122 at 2011-04-29 04:24:29