Trace number 3380513

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)UNSAT 28754.5 3600.33

General information on the benchmark

Nameindustrial/fuhs/hard/
AProVE07-01.cnf
MD5SUMd2f77e32530988f77dca5112174eee00
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2476.89
Satisfiable
(Un)Satisfiability was proved
Number of variables7502
Number of clauses28770
Sum of the clauses size76290
Maximum clause length847
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 215814
Number of clauses of size 311119
Number of clauses of size 4733
Number of clauses of size 5172
Number of clauses of size over 5931

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...481204/instance-3380513-1305481204.cnf
0.00/0.06	c Solving...
28754.44/3600.32	s UNSATISFIABLE
28754.44/3600.32	
28754.44/3600.32	c Models        : 0     
28754.44/3600.32	c Time          : 3600.281s (Solving: 3600.23s 1st Model: 0.00s Unsat: 3600.23s)
28754.44/3600.32	c CPU Time      : 28754.420s

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380513-1305481204/watcher-3380513-1305481204 -o /tmp/evaluation-result-3380513-1305481204/solver-3380513-1305481204 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380513-1305481204.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 1/356 4836
/proc/meminfo: memFree=26459792/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=22456 CPUtime=0 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 950 0 1 0 0 0 0 0 24 0 1 0 659718897 22994944 824 33554432000 4194304 4964800 140735330764304 18446744073709551615 210204647168 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/4836/statm: 5614 825 389 189 0 488 0

[startup+0.0958551 s]
/proc/loadavg: 0.00 0.00 0.00 1/356 4836
/proc/meminfo: memFree=26459792/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=322980 CPUtime=0.13 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 4468 0 2 0 12 1 0 0 18 0 8 0 659718897 330731520 3705 33554432000 4194304 4964800 140735330764304 18446744073709551615 4342186 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/4836/statm: 80745 3705 454 189 0 75094 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 322980

[startup+0.111188 s]
/proc/loadavg: 0.00 0.00 0.00 1/356 4836
/proc/meminfo: memFree=26459792/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=323244 CPUtime=0.98 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 5097 0 2 0 96 2 0 0 18 0 8 0 659718897 331001856 4334 33554432000 4194304 4964800 140735330764304 18446744073709551615 4652258 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4836/statm: 80811 4335 464 189 0 75160 0
Current children cumulated CPU time (s) 0.98
Current children cumulated vsize (KiB) 323244

[startup+0.38909 s]
/proc/loadavg: 0.00 0.00 0.00 1/356 4836
/proc/meminfo: memFree=26459792/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=324192 CPUtime=2.65 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 6264 0 2 0 262 3 0 0 19 0 8 0 659718897 331972608 5501 33554432000 4194304 4964800 140735330764304 18446744073709551615 4684058 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/4836/statm: 81048 5501 464 189 0 75397 0
Current children cumulated CPU time (s) 2.65
Current children cumulated vsize (KiB) 324192

[startup+0.729715 s]
/proc/loadavg: 0.00 0.00 0.00 1/356 4836
/proc/meminfo: memFree=26459792/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=324588 CPUtime=5.05 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 7011 0 2 0 502 3 0 0 19 0 8 0 659718897 332378112 6248 33554432000 4194304 4964800 140735330764304 18446744073709551615 4370264 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/4836/statm: 81147 6249 464 189 0 75496 0
Current children cumulated CPU time (s) 5.05
Current children cumulated vsize (KiB) 324588

[startup+1.50059 s]
/proc/loadavg: 0.64 0.13 0.04 9/364 4844
/proc/meminfo: memFree=26431156/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=325668 CPUtime=11.2 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 8470 0 2 0 1116 4 0 0 20 0 8 0 659718897 333484032 7707 33554432000 4194304 4964800 140735330764304 18446744073709551615 4321161 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/4836/statm: 81417 7707 464 189 0 75766 0
[pid=4836/tid=4838] ppid=4834 vsize=325668 CPUtime=1.41 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 731 0 0 0 141 0 0 0 19 0 8 0 659718903 333484032 7707 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=325668 CPUtime=1.4 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 1121 0 0 0 140 0 0 0 19 0 8 0 659718903 333484032 7707 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=325668 CPUtime=1.41 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 761 0 0 0 140 1 0 0 19 0 8 0 659718903 333484032 7707 33554432000 4194304 4964800 140735330764304 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=325668 CPUtime=1.4 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 843 0 0 0 140 0 0 0 19 0 8 0 659718903 333484032 7707 33554432000 4194304 4964800 140735330764304 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=325668 CPUtime=1.42 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 717 0 0 0 142 0 0 0 20 0 8 0 659718903 333484032 7707 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=325668 CPUtime=1.39 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 759 0 0 0 139 0 0 0 19 0 8 0 659718903 333484032 7707 33554432000 4194304 4964800 140735330764304 18446744073709551615 4668672 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=325668 CPUtime=1.4 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 1262 0 0 0 140 0 0 0 19 0 8 0 659718903 333484032 7707 33554432000 4194304 4964800 140735330764304 18446744073709551615 4660495 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.2
Current children cumulated vsize (KiB) 325668

[startup+3.10032 s]
/proc/loadavg: 0.64 0.13 0.04 9/364 4844
/proc/meminfo: memFree=26425576/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=328048 CPUtime=23.98 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 10089 0 2 0 2393 5 0 0 25 0 8 0 659718897 335921152 9326 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/4836/statm: 82012 9326 464 189 0 76361 0
[pid=4836/tid=4838] ppid=4834 vsize=328048 CPUtime=3 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 862 0 0 0 300 0 0 0 23 0 8 0 659718903 335921152 9326 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=328048 CPUtime=3 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 1404 0 0 0 300 0 0 0 23 0 8 0 659718903 335921152 9326 33554432000 4194304 4964800 140735330764304 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=328048 CPUtime=3.01 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 804 0 0 0 300 1 0 0 25 0 8 0 659718903 335921152 9326 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=328048 CPUtime=3 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 1017 0 0 0 300 0 0 0 24 0 8 0 659718903 335921152 9326 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=328048 CPUtime=3.02 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 851 0 0 0 302 0 0 0 25 0 8 0 659718903 335921152 9326 33554432000 4194304 4964800 140735330764304 18446744073709551615 4321143 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=328048 CPUtime=2.99 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 806 0 0 0 299 0 0 0 24 0 8 0 659718903 335921152 9326 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=328048 CPUtime=3.01 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 2018 0 0 0 300 1 0 0 25 0 8 0 659718903 335921152 9326 33554432000 4194304 4964800 140735330764304 18446744073709551615 4660080 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 23.98
Current children cumulated vsize (KiB) 328048

[startup+6.30078 s]
/proc/loadavg: 0.64 0.13 0.04 9/364 4844
/proc/meminfo: memFree=26416288/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=329784 CPUtime=49.55 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 13093 0 2 0 4948 7 0 0 25 0 8 0 659718897 337698816 12330 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669153 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/4836/statm: 82446 12330 464 189 0 76795 0
[pid=4836/tid=4838] ppid=4834 vsize=329784 CPUtime=6.21 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 1072 0 0 0 620 1 0 0 25 0 8 0 659718903 337698816 12330 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=329784 CPUtime=6.2 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 1895 0 0 0 620 0 0 0 25 0 8 0 659718903 337698816 12330 33554432000 4194304 4964800 140735330764304 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=329784 CPUtime=6.21 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 972 0 0 0 620 1 0 0 25 0 8 0 659718903 337698816 12330 33554432000 4194304 4964800 140735330764304 18446744073709551615 4361114 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=329784 CPUtime=6.2 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 1486 0 0 0 620 0 0 0 25 0 8 0 659718903 337698816 12330 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670678 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=329784 CPUtime=6.22 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 1185 0 0 0 622 0 0 0 25 0 8 0 659718903 337698816 12330 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=329784 CPUtime=6.19 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 960 0 0 0 619 0 0 0 25 0 8 0 659718903 337698816 12330 33554432000 4194304 4964800 140735330764304 18446744073709551615 4321174 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=329784 CPUtime=6.2 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 3039 0 0 0 619 1 0 0 25 0 8 0 659718903 337698816 12330 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.55
Current children cumulated vsize (KiB) 329784

[startup+12.7007 s]
/proc/loadavg: 1.77 0.39 0.13 9/364 4844
/proc/meminfo: memFree=26400796/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=333464 CPUtime=100.66 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 16111 0 2 0 10058 8 0 0 25 0 8 0 659718897 341467136 15348 33554432000 4194304 4964800 140735330764304 18446744073709551615 4660114 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/4836/statm: 83366 15348 466 189 0 77715 0
[pid=4836/tid=4838] ppid=4834 vsize=333464 CPUtime=12.61 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 1237 0 0 0 1260 1 0 0 25 0 8 0 659718903 341467136 15348 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=333464 CPUtime=12.59 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 2591 0 0 0 1259 0 0 0 25 0 8 0 659718903 341467136 15348 33554432000 4194304 4964800 140735330764304 18446744073709551615 4660157 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=333464 CPUtime=12.61 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 1063 0 0 0 1260 1 0 0 25 0 8 0 659718903 341467136 15348 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=333464 CPUtime=12.6 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 2034 0 0 0 1260 0 0 0 25 0 8 0 659718903 341467136 15348 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=333464 CPUtime=12.61 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 1735 0 0 0 1261 0 0 0 25 0 8 0 659718903 341467136 15348 33554432000 4194304 4964800 140735330764304 18446744073709551615 210204305817 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=333464 CPUtime=12.59 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 1106 0 0 0 1259 0 0 0 25 0 8 0 659718903 341467136 15348 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=333464 CPUtime=12.61 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 3771 0 0 0 1259 2 0 0 25 0 8 0 659718903 341467136 15348 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.66
Current children cumulated vsize (KiB) 333464

[startup+25.5136 s]
/proc/loadavg: 2.73 0.64 0.21 9/364 4845
/proc/meminfo: memFree=26383648/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=336396 CPUtime=202.99 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 20502 0 2 0 20288 11 0 0 25 0 8 0 659718897 344469504 19658 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669542 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/4836/statm: 84099 19658 466 189 0 78448 0
[pid=4836/tid=4838] ppid=4834 vsize=336396 CPUtime=25.41 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 1448 0 0 0 2540 1 0 0 25 0 8 0 659718903 344469504 19658 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669500 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=336396 CPUtime=25.41 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 3383 0 0 0 2540 1 0 0 25 0 8 0 659718903 344469504 19658 33554432000 4194304 4964800 140735330764304 18446744073709551615 4660123 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=336396 CPUtime=25.42 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 1265 0 0 0 2541 1 0 0 25 0 8 0 659718903 344469504 19658 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=336396 CPUtime=25.41 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 2448 0 0 0 2541 0 0 0 25 0 8 0 659718903 344469504 19658 33554432000 4194304 4964800 140735330764304 18446744073709551615 4660442 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=336396 CPUtime=25.43 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 2232 0 0 0 2542 1 0 0 25 0 8 0 659718903 344469504 19658 33554432000 4194304 4964800 140735330764304 18446744073709551615 4362367 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=336396 CPUtime=25.39 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 1256 0 0 0 2539 0 0 0 25 0 8 0 659718903 344469504 19658 33554432000 4194304 4964800 140735330764304 18446744073709551615 4653547 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=336396 CPUtime=25.41 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 5711 0 0 0 2539 2 0 0 25 0 8 0 659718903 344469504 19658 33554432000 4194304 4964800 140735330764304 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 202.99
Current children cumulated vsize (KiB) 336396

[startup+51.1013 s]
/proc/loadavg: 4.53 1.23 0.42 9/364 4845
/proc/meminfo: memFree=26371352/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=338424 CPUtime=407.37 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 23643 0 2 0 40723 14 0 0 25 0 8 0 659718897 346546176 22799 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669476 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/4836/statm: 84606 22799 466 189 0 78955 0
[pid=4836/tid=4838] ppid=4834 vsize=338424 CPUtime=50.99 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 1852 0 0 0 5098 1 0 0 25 0 8 0 659718903 346546176 22799 33554432000 4194304 4964800 140735330764304 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=338424 CPUtime=50.99 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 3709 0 0 0 5098 1 0 0 25 0 8 0 659718903 346546176 22799 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=338424 CPUtime=51 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 1504 0 0 0 5099 1 0 0 25 0 8 0 659718903 346546176 22799 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=338424 CPUtime=50.99 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 3221 0 0 0 5098 1 0 0 25 0 8 0 659718903 346546176 22799 33554432000 4194304 4964800 140735330764304 18446744073709551615 4370224 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=338424 CPUtime=51.02 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 2639 0 0 0 5101 1 0 0 25 0 8 0 659718903 346546176 22799 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=338424 CPUtime=50.99 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 1470 0 0 0 5098 1 0 0 25 0 8 0 659718903 346546176 22799 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670392 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=338424 CPUtime=50.87 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 6316 0 0 0 5084 3 0 0 25 0 8 0 659718903 346546176 22799 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.37

################
# More data... #
################

/proc/loadavg: 8.04 8.05 7.85 9/364 4951
/proc/meminfo: memFree=26136764/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=391852 CPUtime=28610.8 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 82448 0 2 0 2860914 171 0 0 25 0 8 0 659718897 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669523 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4836/statm: 97963 80773 466 189 0 92312 0
[pid=4836/tid=4838] ppid=4834 vsize=391852 CPUtime=3559.72 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 6598 0 0 0 355952 20 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=391852 CPUtime=3581.91 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 12172 0 0 0 358167 24 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=391852 CPUtime=3581.87 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 3873 0 0 0 358175 12 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669153 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=391852 CPUtime=3578.38 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 9596 0 0 0 357818 20 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4320921 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=391852 CPUtime=3581.94 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 9958 0 0 0 358171 23 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=391852 CPUtime=3581.17 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 3638 0 0 0 358106 11 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4653542 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=391852 CPUtime=3575.92 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 31167 0 0 0 357549 43 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 28610.9
Current children cumulated vsize (KiB) 391852

Solver just ended. Dumping a history of the last processes samples

[startup+3584.1 s]
/proc/loadavg: 8.04 8.05 7.85 9/364 4951
/proc/meminfo: memFree=26136884/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=391852 CPUtime=28625.2 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 82448 0 2 0 2862351 171 0 0 25 0 8 0 659718897 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4836/statm: 97963 80773 466 189 0 92312 0
[pid=4836/tid=4838] ppid=4834 vsize=391852 CPUtime=3561.49 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 6598 0 0 0 356129 20 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4653507 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=391852 CPUtime=3583.71 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 12172 0 0 0 358347 24 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670313 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=391852 CPUtime=3583.67 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 3873 0 0 0 358355 12 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=391852 CPUtime=3580.18 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 9596 0 0 0 357998 20 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=391852 CPUtime=3583.74 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 9958 0 0 0 358351 23 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=391852 CPUtime=3582.97 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 3638 0 0 0 358286 11 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669532 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=391852 CPUtime=3577.72 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 31167 0 0 0 357729 43 0 0 25 0 8 0 659718903 401256448 80773 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 28625.2
Current children cumulated vsize (KiB) 391852

[startup+3590.5 s]
/proc/loadavg: 8.04 8.05 7.85 9/364 4952
/proc/meminfo: memFree=26136864/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=391852 CPUtime=28676.4 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 82450 0 2 0 2867469 171 0 0 25 0 8 0 659718897 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4836/statm: 97963 80775 466 189 0 92312 0
[pid=4836/tid=4838] ppid=4834 vsize=391852 CPUtime=3567.83 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 6598 0 0 0 356763 20 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4362287 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=391852 CPUtime=3590.12 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 12172 0 0 0 358988 24 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=391852 CPUtime=3590.08 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 3875 0 0 0 358996 12 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=391852 CPUtime=3586.59 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 9596 0 0 0 358639 20 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=391852 CPUtime=3590.15 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 9958 0 0 0 358992 23 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=391852 CPUtime=3589.38 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 3638 0 0 0 358927 11 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670538 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=391852 CPUtime=3584.13 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 31167 0 0 0 358370 43 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 28676.4
Current children cumulated vsize (KiB) 391852

[startup+3596.9 s]
/proc/loadavg: 8.03 8.05 7.85 9/364 4952
/proc/meminfo: memFree=26136864/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=391852 CPUtime=28727.5 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 82450 0 2 0 2872575 171 0 0 25 0 8 0 659718897 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4653144 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4836/statm: 97963 80775 466 189 0 92312 0
[pid=4836/tid=4838] ppid=4834 vsize=391852 CPUtime=3574.15 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 6598 0 0 0 357395 20 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669410 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=391852 CPUtime=3596.51 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 12172 0 0 0 359627 24 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=391852 CPUtime=3596.48 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 3875 0 0 0 359635 13 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=391852 CPUtime=3592.98 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 9596 0 0 0 359278 20 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=391852 CPUtime=3596.53 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 9958 0 0 0 359630 23 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=391852 CPUtime=3595.77 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 3638 0 0 0 359566 11 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669396 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=391852 CPUtime=3590.51 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 31167 0 0 0 359008 43 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4668753 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 28727.5
Current children cumulated vsize (KiB) 391852

[startup+3598.5 s]
/proc/loadavg: 8.03 8.05 7.85 9/364 4952
/proc/meminfo: memFree=26136864/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=391852 CPUtime=28740.2 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 82450 0 2 0 2873852 171 0 0 25 0 8 0 659718897 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4320928 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4836/statm: 97963 80775 466 189 0 92312 0
[pid=4836/tid=4838] ppid=4834 vsize=391852 CPUtime=3575.72 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 6598 0 0 0 357552 20 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=391852 CPUtime=3598.11 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 12172 0 0 0 359787 24 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=391852 CPUtime=3598.08 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 3875 0 0 0 359795 13 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=391852 CPUtime=3594.57 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 9596 0 0 0 359437 20 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670361 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=391852 CPUtime=3598.13 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 9958 0 0 0 359790 23 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=391852 CPUtime=3597.37 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 3638 0 0 0 359726 11 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4660139 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=391852 CPUtime=3592.11 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 31167 0 0 0 359168 43 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 28740.2
Current children cumulated vsize (KiB) 391852

[startup+3599.3 s]
/proc/loadavg: 8.03 8.05 7.85 9/364 4952
/proc/meminfo: memFree=26136864/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=391852 CPUtime=28746.7 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 82450 0 2 0 2874497 171 0 0 25 0 8 0 659718897 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670678 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4836/statm: 97963 80775 466 189 0 92312 0
[pid=4836/tid=4838] ppid=4834 vsize=391852 CPUtime=3576.52 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 6598 0 0 0 357632 20 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669221 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=391852 CPUtime=3598.92 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 12172 0 0 0 359868 24 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=391852 CPUtime=3598.89 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 3875 0 0 0 359876 13 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669011 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=391852 CPUtime=3595.39 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 9596 0 0 0 359519 20 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=391852 CPUtime=3598.95 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 9958 0 0 0 359872 23 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=391852 CPUtime=3598.18 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 3638 0 0 0 359807 11 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=391852 CPUtime=3592.93 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 31167 0 0 0 359250 43 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 28746.7
Current children cumulated vsize (KiB) 391852

[startup+3600.1 s]
/proc/loadavg: 8.03 8.05 7.85 9/364 4952
/proc/meminfo: memFree=26136864/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=391852 CPUtime=28753 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 82450 0 2 0 2875131 171 0 0 25 0 8 0 659718897 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4836/statm: 97963 80775 466 189 0 92312 0
[pid=4836/tid=4838] ppid=4834 vsize=391852 CPUtime=3577.31 cores=0-7
/proc/4836/task/4838/stat : 4838 (claspmt) R 4834 4836 4810 0 -1 4202560 6598 0 0 0 357711 20 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4836/tid=4839] ppid=4834 vsize=391852 CPUtime=3599.71 cores=0-7
/proc/4836/task/4839/stat : 4839 (claspmt) R 4834 4836 4810 0 -1 4202560 12172 0 0 0 359947 24 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4836/tid=4840] ppid=4834 vsize=391852 CPUtime=3599.68 cores=0-7
/proc/4836/task/4840/stat : 4840 (claspmt) R 4834 4836 4810 0 -1 4202560 3875 0 0 0 359955 13 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4324688 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4836/tid=4841] ppid=4834 vsize=391852 CPUtime=3596.18 cores=0-7
/proc/4836/task/4841/stat : 4841 (claspmt) R 4834 4836 4810 0 -1 4202560 9596 0 0 0 359598 20 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=4836/tid=4842] ppid=4834 vsize=391852 CPUtime=3599.73 cores=0-7
/proc/4836/task/4842/stat : 4842 (claspmt) R 4834 4836 4810 0 -1 4202560 9958 0 0 0 359950 23 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4836/tid=4843] ppid=4834 vsize=391852 CPUtime=3598.97 cores=0-7
/proc/4836/task/4843/stat : 4843 (claspmt) R 4834 4836 4810 0 -1 4202560 3638 0 0 0 359886 11 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4836/tid=4844] ppid=4834 vsize=391852 CPUtime=3593.71 cores=0-7
/proc/4836/task/4844/stat : 4844 (claspmt) R 4834 4836 4810 0 -1 4202560 31167 0 0 0 359328 43 0 0 25 0 8 0 659718903 401256448 80775 33554432000 4194304 4964800 140735330764304 18446744073709551615 4669574 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 28753
Current children cumulated vsize (KiB) 391852

[startup+3600.3 s]
/proc/loadavg: 8.03 8.05 7.85 9/364 4952
/proc/meminfo: memFree=26136864/32951124 swapFree=63649232/67111528
[pid=4836] ppid=4834 vsize=385696 CPUtime=28754.4 cores=0-7
/proc/4836/stat : 4836 (claspmt) R 4834 4836 4810 0 -1 4202496 82460 0 2 0 2875269 175 0 0 17 0 1 0 659718897 394952704 79317 33554432000 4194304 4964800 140735330764304 18446744073709551615 210204690567 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4836/statm: 96424 79317 476 189 0 90773 0
Current children cumulated CPU time (s) 28754.4
Current children cumulated vsize (KiB) 385696

Child status: 20
Real time (s): 3600.33
CPU time (s): 28754.5
CPU user time (s): 28752.7
CPU system time (s): 1.76973
CPU usage (%): 798.663
Max. virtual memory (cumulated for all children) (KiB): 391852

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 28752.7
system time used= 1.76973
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 82461
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 142143
involuntary context switches= 139584

runsolver used 12.3931 second user time and 30.1654 second system time

The end

Launcher Data 

Begin job on node130 at 2011-05-15 19:40:04
IDJOB=3380513
IDBENCH=20399
IDSOLVER=1865
FILE ID=node130/3380513-1305481204
RUNJOBID= node130-1305481204-4824
PBS_JOBID= 13325350
Free space on /tmp= 73396 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT07/industrial/fuhs/hard/AProVE07-01.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380513-1305481204/watcher-3380513-1305481204 -o /tmp/evaluation-result-3380513-1305481204/solver-3380513-1305481204 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380513-1305481204.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= d2f77e32530988f77dca5112174eee00
RANDOM SEED=1761809335

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26460072 kB
Buffers:        297492 kB
Cached:        4096808 kB
SwapCached:      10248 kB
Active:        2259460 kB
Inactive:      3942324 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26460072 kB
SwapTotal:    67111528 kB
SwapFree:     63649232 kB
Dirty:            1212 kB
Writeback:           4 kB
AnonPages:     1805704 kB
Mapped:          20292 kB
Slab:           188804 kB
PageTables:      33608 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 88881924 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73396 MiB
End job on node130 at 2011-05-15 20:40:04