Trace number 3380647

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)UNSAT 7280.84 1297.15

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UTI-20-10p0.cnf
MD5SUM209f7789e3588d11f275f2003f2c6a67
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark335.143
Satisfiable
(Un)Satisfiability was proved
Number of variables259616
Number of clauses1374599
Sum of the clauses size3310772
Maximum clause length10
Minimum clause length1
Number of clauses of size 113149
Number of clauses of size 2982807
Number of clauses of size 3313283
Number of clauses of size 47260
Number of clauses of size 529040
Number of clauses of size over 529060

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...658143/instance-3380647-1307658143.cnf
2.39/2.40	c Solving...
7280.78/1297.13	s UNSATISFIABLE
7280.78/1297.13	
7280.78/1297.13	c Models        : 0     
7280.78/1297.13	c Time          : 1296.503s (Solving: 1294.10s 1st Model: 0.00s Unsat: 1294.10s)
7280.78/1297.13	c CPU Time      : 7280.180s

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380647-1307658143/watcher-3380647-1307658143 -o /tmp/evaluation-result-3380647-1307658143/solver-3380647-1307658143 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380647-1307658143.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.52 5.62 3.82 1/170 15363
/proc/meminfo: memFree=32170784/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=53844 CPUtime=0 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 632 0 0 0 0 0 0 0 23 0 1 0 956045072 55136256 561 33554432000 4194304 4964800 140736406535040 18446744073709551615 4686341 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/15363/statm: 13461 562 375 189 0 8335 0

[startup+0.00639309 s]
/proc/loadavg: 7.52 5.62 3.82 1/170 15363
/proc/meminfo: memFree=32170784/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=53844 CPUtime=0 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 843 0 0 0 0 0 0 0 23 0 1 0 956045072 55136256 772 33554432000 4194304 4964800 140736406535040 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/15363/statm: 13461 782 376 189 0 8335 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 53844

[startup+0.100414 s]
/proc/loadavg: 7.52 5.62 3.82 1/170 15363
/proc/meminfo: memFree=32170784/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=79888 CPUtime=0.09 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 17777 0 0 0 7 2 0 0 23 0 1 0 956045072 81805312 14934 33554432000 4194304 4964800 140736406535040 18446744073709551615 224284586693 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/15363/statm: 20005 14937 386 189 0 14879 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 79888

[startup+0.300382 s]
/proc/loadavg: 7.52 5.62 3.82 1/170 15363
/proc/meminfo: memFree=32170784/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=111812 CPUtime=0.29 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 28843 0 0 0 25 4 0 0 24 0 1 0 956045072 114495488 22706 33554432000 4194304 4964800 140736406535040 18446744073709551615 224284925696 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/15363/statm: 27953 22708 386 189 0 22827 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 111812

[startup+0.700313 s]
/proc/loadavg: 7.52 5.62 3.82 1/170 15363
/proc/meminfo: memFree=32170784/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=169024 CPUtime=0.69 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 47350 0 0 0 63 6 0 0 25 0 1 0 956045072 173080576 36563 33554432000 4194304 4964800 140736406535040 18446744073709551615 4615312 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/15363/statm: 42256 36563 400 189 0 37130 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 169024

[startup+1.50018 s]
/proc/loadavg: 7.00 5.55 3.80 2/171 15364
/proc/meminfo: memFree=32016544/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=179276 CPUtime=1.49 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 49704 0 0 0 143 6 0 0 25 0 1 0 956045072 183578624 38917 33554432000 4194304 4964800 140736406535040 18446744073709551615 4624048 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/15363/statm: 44819 38917 404 189 0 39693 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 179276

[startup+3.10095 s]
/proc/loadavg: 7.00 5.55 3.80 2/171 15364
/proc/meminfo: memFree=32016856/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=672948 CPUtime=3.61 cores=0-7
/proc/15363/stat : 15363 (claspmt) S 15361 15363 15286 0 -1 4202496 118460 0 0 0 328 33 0 0 18 0 8 0 956045072 689098752 88239 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15363/statm: 168237 88239 442 189 0 162586 0
Current children cumulated CPU time (s) 3.61
Current children cumulated vsize (KiB) 672948

[startup+6.30038 s]
/proc/loadavg: 7.00 5.55 3.80 2/178 15371
/proc/meminfo: memFree=31820396/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=672948 CPUtime=6.81 cores=0-7
/proc/15363/stat : 15363 (claspmt) S 15361 15363 15286 0 -1 4202496 118570 0 0 0 648 33 0 0 18 0 8 0 956045072 689098752 88349 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15363/statm: 168237 88349 442 189 0 162586 0
[pid=15363/tid=15365] ppid=15361 vsize=672948 CPUtime=0.08 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) S 15361 15363 15286 0 -1 4202560 9280 0 0 0 6 2 0 0 18 0 8 0 956045312 689098752 88349 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=672948 CPUtime=0.09 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) S 15361 15363 15286 0 -1 4202560 10236 0 0 0 5 4 0 0 18 0 8 0 956045312 689098752 88349 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=672948 CPUtime=0.09 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) S 15361 15363 15286 0 -1 4202560 11305 0 0 0 5 4 0 0 18 0 8 0 956045312 689098752 88349 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=672948 CPUtime=0.08 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) S 15361 15363 15286 0 -1 4202560 6952 0 0 0 6 2 0 0 18 0 8 0 956045312 689098752 88349 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=672948 CPUtime=3.76 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 8847 0 0 0 372 4 0 0 25 0 8 0 956045312 689098752 88349 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=672948 CPUtime=0.11 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) S 15361 15363 15286 0 -1 4202560 11291 0 0 0 8 3 0 0 18 0 8 0 956045312 689098752 88349 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=672948 CPUtime=0.13 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) S 15361 15363 15286 0 -1 4202560 9764 0 0 0 10 3 0 0 18 0 8 0 956045312 689098752 88349 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6.81
Current children cumulated vsize (KiB) 672948

[startup+12.7003 s]
/proc/loadavg: 6.08 5.40 3.77 2/178 15371
/proc/meminfo: memFree=31820160/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=672948 CPUtime=13.21 cores=0-7
/proc/15363/stat : 15363 (claspmt) S 15361 15363 15286 0 -1 4202496 118717 0 0 0 1288 33 0 0 18 0 8 0 956045072 689098752 88496 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15363/statm: 168237 88496 442 189 0 162586 0
[pid=15363/tid=15365] ppid=15361 vsize=672948 CPUtime=0.08 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) S 15361 15363 15286 0 -1 4202560 9280 0 0 0 6 2 0 0 18 0 8 0 956045312 689098752 88496 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=672948 CPUtime=0.09 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) S 15361 15363 15286 0 -1 4202560 10236 0 0 0 5 4 0 0 18 0 8 0 956045312 689098752 88496 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=672948 CPUtime=0.09 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) S 15361 15363 15286 0 -1 4202560 11305 0 0 0 5 4 0 0 18 0 8 0 956045312 689098752 88496 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=672948 CPUtime=0.08 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) S 15361 15363 15286 0 -1 4202560 6952 0 0 0 6 2 0 0 18 0 8 0 956045312 689098752 88496 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=672948 CPUtime=10.16 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 8994 0 0 0 1012 4 0 0 25 0 8 0 956045312 689098752 88496 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669153 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=672948 CPUtime=0.11 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) S 15361 15363 15286 0 -1 4202560 11291 0 0 0 8 3 0 0 18 0 8 0 956045312 689098752 88496 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=672948 CPUtime=0.13 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) S 15361 15363 15286 0 -1 4202560 9764 0 0 0 10 3 0 0 18 0 8 0 956045312 689098752 88496 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 13.21
Current children cumulated vsize (KiB) 672948

[startup+25.5012 s]
/proc/loadavg: 5.29 5.25 3.74 2/178 15371
/proc/meminfo: memFree=31820512/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=672948 CPUtime=26.01 cores=0-7
/proc/15363/stat : 15363 (claspmt) S 15361 15363 15286 0 -1 4202496 118917 0 0 0 2568 33 0 0 18 0 8 0 956045072 689098752 88696 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15363/statm: 168237 88696 442 189 0 162586 0
[pid=15363/tid=15365] ppid=15361 vsize=672948 CPUtime=0.08 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) S 15361 15363 15286 0 -1 4202560 9280 0 0 0 6 2 0 0 18 0 8 0 956045312 689098752 88696 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=672948 CPUtime=0.09 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) S 15361 15363 15286 0 -1 4202560 10236 0 0 0 5 4 0 0 18 0 8 0 956045312 689098752 88696 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=672948 CPUtime=0.09 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) S 15361 15363 15286 0 -1 4202560 11305 0 0 0 5 4 0 0 18 0 8 0 956045312 689098752 88696 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=672948 CPUtime=0.08 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) S 15361 15363 15286 0 -1 4202560 6952 0 0 0 6 2 0 0 18 0 8 0 956045312 689098752 88696 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=672948 CPUtime=22.96 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 9194 0 0 0 2292 4 0 0 25 0 8 0 956045312 689098752 88696 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=672948 CPUtime=0.11 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) S 15361 15363 15286 0 -1 4202560 11291 0 0 0 8 3 0 0 18 0 8 0 956045312 689098752 88696 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=672948 CPUtime=0.13 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) S 15361 15363 15286 0 -1 4202560 9764 0 0 0 10 3 0 0 18 0 8 0 956045312 689098752 88696 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 26.01
Current children cumulated vsize (KiB) 672948

[startup+51.1009 s]
/proc/loadavg: 3.60 4.84 3.65 2/178 15373
/proc/meminfo: memFree=31819840/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=672948 CPUtime=51.61 cores=0-7
/proc/15363/stat : 15363 (claspmt) S 15361 15363 15286 0 -1 4202496 119046 0 0 0 5128 33 0 0 18 0 8 0 956045072 689098752 88825 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15363/statm: 168237 88825 442 189 0 162586 0
[pid=15363/tid=15365] ppid=15361 vsize=672948 CPUtime=0.08 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) S 15361 15363 15286 0 -1 4202560 9280 0 0 0 6 2 0 0 18 0 8 0 956045312 689098752 88825 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=672948 CPUtime=0.09 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) S 15361 15363 15286 0 -1 4202560 10236 0 0 0 5 4 0 0 18 0 8 0 956045312 689098752 88825 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=672948 CPUtime=0.09 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) S 15361 15363 15286 0 -1 4202560 11305 0 0 0 5 4 0 0 18 0 8 0 956045312 689098752 88825 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=672948 CPUtime=0.08 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) S 15361 15363 15286 0 -1 4202560 6952 0 0 0 6 2 0 0 18 0 8 0 956045312 689098752 88825 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=672948 CPUtime=48.56 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 9323 0 0 0 4852 4 0 0 25 0 8 0 956045312 689098752 88825 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669011 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=672948 CPUtime=0.11 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) S 15361 15363 15286 0 -1 4202560 11291 0 0 0 8 3 0 0 18 0 8 0 956045312 689098752 88825 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=672948 CPUtime=0.13 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) S 15361 15363 15286 0 -1 4202560 9764 0 0 0 10 3 0 0 18 0 8 0 956045312 689098752 88825 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 51.61
Current children cumulated vsize (KiB) 672948

[startup+102.306 s]
/proc/loadavg: 2.13 4.25 3.51 2/178 15373
/proc/meminfo: memFree=31817328/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=672948 CPUtime=102.81 cores=0-7
/proc/15363/stat : 15363 (claspmt) S 15361 15363 15286 0 -1 4202496 119599 0 0 0 10248 33 0 0 18 0 8 0 956045072 689098752 89378 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15363/statm: 168237 89378 442 189 0 162586 0
[pid=15363/tid=15365] ppid=15361 vsize=672948 CPUtime=0.08 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) S 15361 15363 15286 0 -1 4202560 9280 0 0 0 6 2 0 0 18 0 8 0 956045312 689098752 89378 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=672948 CPUtime=0.09 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) S 15361 15363 15286 0 -1 4202560 10236 0 0 0 5 4 0 0 18 0 8 0 956045312 689098752 89378 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=672948 CPUtime=0.09 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) S 15361 15363 15286 0 -1 4202560 11305 0 0 0 5 4 0 0 18 0 8 0 956045312 689098752 89378 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=672948 CPUtime=0.08 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) S 15361 15363 15286 0 -1 4202560 6952 0 0 0 6 2 0 0 18 0 8 0 956045312 689098752 89378 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=672948 CPUtime=99.77 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 9876 0 0 0 9972 5 0 0 25 0 8 0 956045312 689098752 89378 33554432000 4194304 4964800 140736406535040 18446744073709551615 4399372 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=672948 CPUtime=0.11 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) S 15361 15363 15286 0 -1 4202560 11291 0 0 0 8 3 0 0 18 0 8 0 956045312 689098752 89378 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=672948 CPUtime=0.13 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) S 15361 15363 15286 0 -1 4202560 9764 0 0 0 10 3 0 0 18 0 8 0 956045312 689098752 89378 33554432000 4194304 4964800 140736406535040 18446744073709551615 224296741785 0 0 4096 18946 18446604453905189696 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 102.81
Current children cumulated vsize (KiB) 672948

[startup+162.3 s]
/proc/loadavg: 1.41 3.65 3.35 2/178 15375
/proc/meminfo: memFree=31816916/32951124 swapFree=67049456/67111528

################
# More data... #
################

[pid=15363/tid=15367] ppid=15361 vsize=2239276 CPUtime=800.88 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) R 15361 15363 15286 0 -1 4202560 45007 0 0 0 80044 44 0 0 25 0 8 0 956045312 2293018624 505772 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=2239276 CPUtime=801.56 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) R 15361 15363 15286 0 -1 4202560 52800 0 0 0 80091 65 0 0 25 0 8 0 956045312 2293018624 505772 33554432000 4194304 4964800 140736406535040 18446744073709551615 4678036 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=2239276 CPUtime=1235.32 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 10222 0 0 0 123526 6 0 0 25 0 8 0 956045312 2293018624 505772 33554432000 4194304 4964800 140736406535040 18446744073709551615 4678036 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=2239276 CPUtime=801.59 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) R 15361 15363 15286 0 -1 4202560 46129 0 0 0 80101 58 0 0 25 0 8 0 956045312 2293018624 505772 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=2239276 CPUtime=801.47 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) R 15361 15363 15286 0 -1 4202560 119749 0 0 0 80042 105 0 0 25 0 8 0 956045312 2293018624 505772 33554432000 4194304 4964800 140736406535040 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6847.77
Current children cumulated vsize (KiB) 2239276

Solver just ended. Dumping a history of the last processes samples

[startup+1254.3 s]
/proc/loadavg: 8.00 7.65 5.81 9/178 15408
/proc/meminfo: memFree=30148656/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=2239276 CPUtime=6943.7 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 536087 0 0 0 693895 475 0 0 25 0 8 0 956045072 2293018624 505774 33554432000 4194304 4964800 140736406535040 18446744073709551615 4668924 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/15363/statm: 559819 505774 466 189 0 554168 0
[pid=15363/tid=15365] ppid=15361 vsize=2239276 CPUtime=813.52 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) R 15361 15363 15286 0 -1 4202560 24915 0 0 0 81323 29 0 0 25 0 8 0 956045312 2293018624 505774 33554432000 4194304 4964800 140736406535040 18446744073709551615 4370266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=2239276 CPUtime=813.56 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) R 15361 15363 15286 0 -1 4202560 169205 0 0 0 81223 133 0 0 25 0 8 0 956045312 2293018624 505774 33554432000 4194304 4964800 140736406535040 18446744073709551615 4313751 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=2239276 CPUtime=812.88 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) R 15361 15363 15286 0 -1 4202560 45007 0 0 0 81244 44 0 0 25 0 8 0 956045312 2293018624 505774 33554432000 4194304 4964800 140736406535040 18446744073709551615 4632355 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=2239276 CPUtime=813.56 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) R 15361 15363 15286 0 -1 4202560 52800 0 0 0 81291 65 0 0 25 0 8 0 956045312 2293018624 505774 33554432000 4194304 4964800 140736406535040 18446744073709551615 4370224 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=2239276 CPUtime=1247.26 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 10222 0 0 0 124720 6 0 0 25 0 8 0 956045312 2293018624 505774 33554432000 4194304 4964800 140736406535040 18446744073709551615 4668998 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=2239276 CPUtime=813.59 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) R 15361 15363 15286 0 -1 4202560 46129 0 0 0 81301 58 0 0 25 0 8 0 956045312 2293018624 505774 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=2239276 CPUtime=813.47 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) R 15361 15363 15286 0 -1 4202560 119749 0 0 0 81242 105 0 0 25 0 8 0 956045312 2293018624 505774 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6943.7
Current children cumulated vsize (KiB) 2239276

[startup+1279.9 s]
/proc/loadavg: 8.00 7.67 5.87 9/178 15408
/proc/meminfo: memFree=30148528/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=2239276 CPUtime=7148.35 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 536088 0 0 0 714360 475 0 0 25 0 8 0 956045072 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669136 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/15363/statm: 559819 505775 466 189 0 554168 0
[pid=15363/tid=15365] ppid=15361 vsize=2239276 CPUtime=839.12 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) R 15361 15363 15286 0 -1 4202560 24915 0 0 0 83883 29 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=2239276 CPUtime=839.15 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) R 15361 15363 15286 0 -1 4202560 169206 0 0 0 83782 133 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4313753 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=2239276 CPUtime=838.48 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) R 15361 15363 15286 0 -1 4202560 45007 0 0 0 83804 44 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=2239276 CPUtime=839.16 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) R 15361 15363 15286 0 -1 4202560 52800 0 0 0 83851 65 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4668951 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=2239276 CPUtime=1272.72 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 10222 0 0 0 127266 6 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669011 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=2239276 CPUtime=839.19 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) R 15361 15363 15286 0 -1 4202560 46129 0 0 0 83861 58 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=2239276 CPUtime=839.07 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) R 15361 15363 15286 0 -1 4202560 119749 0 0 0 83802 105 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669011 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7148.35
Current children cumulated vsize (KiB) 2239276

[startup+1286.3 s]
/proc/loadavg: 8.00 7.68 5.89 9/178 15408
/proc/meminfo: memFree=30148520/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=2239276 CPUtime=7199.52 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 536088 0 0 0 719477 475 0 0 25 0 8 0 956045072 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/15363/statm: 559819 505775 466 189 0 554168 0
[pid=15363/tid=15365] ppid=15361 vsize=2239276 CPUtime=845.52 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) R 15361 15363 15286 0 -1 4202560 24915 0 0 0 84523 29 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=2239276 CPUtime=845.55 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) R 15361 15363 15286 0 -1 4202560 169206 0 0 0 84422 133 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=2239276 CPUtime=844.88 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) R 15361 15363 15286 0 -1 4202560 45007 0 0 0 84444 44 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=2239276 CPUtime=845.56 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) R 15361 15363 15286 0 -1 4202560 52800 0 0 0 84491 65 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4660442 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=2239276 CPUtime=1279.08 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 10222 0 0 0 127902 6 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=2239276 CPUtime=845.59 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) R 15361 15363 15286 0 -1 4202560 46129 0 0 0 84501 58 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=2239276 CPUtime=845.47 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) R 15361 15363 15286 0 -1 4202560 119749 0 0 0 84442 105 0 0 25 0 8 0 956045312 2293018624 505775 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7199.52
Current children cumulated vsize (KiB) 2239276

[startup+1292.7 s]
/proc/loadavg: 8.00 7.69 5.90 9/178 15408
/proc/meminfo: memFree=30146152/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=2239276 CPUtime=7250.67 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 536670 0 0 0 724591 476 0 0 25 0 8 0 956045072 2293018624 506357 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669509 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/15363/statm: 559819 506357 466 189 0 554168 0
[pid=15363/tid=15365] ppid=15361 vsize=2239276 CPUtime=851.92 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) R 15361 15363 15286 0 -1 4202560 24915 0 0 0 85163 29 0 0 25 0 8 0 956045312 2293018624 506357 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670155 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=2239276 CPUtime=851.96 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) R 15361 15363 15286 0 -1 4202560 169786 0 0 0 85062 134 0 0 25 0 8 0 956045312 2293018624 506357 33554432000 4194304 4964800 140736406535040 18446744073709551615 4668977 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=2239276 CPUtime=851.28 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) R 15361 15363 15286 0 -1 4202560 45007 0 0 0 85084 44 0 0 25 0 8 0 956045312 2293018624 506357 33554432000 4194304 4964800 140736406535040 18446744073709551615 4678036 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=2239276 CPUtime=851.96 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) R 15361 15363 15286 0 -1 4202560 52802 0 0 0 85131 65 0 0 25 0 8 0 956045312 2293018624 506357 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669283 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=2239276 CPUtime=1285.45 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 10222 0 0 0 128539 6 0 0 25 0 8 0 956045312 2293018624 506357 33554432000 4194304 4964800 140736406535040 18446744073709551615 4660277 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=2239276 CPUtime=851.99 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) R 15361 15363 15286 0 -1 4202560 46129 0 0 0 85141 58 0 0 25 0 8 0 956045312 2293018624 506357 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669011 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=2239276 CPUtime=851.87 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) R 15361 15363 15286 0 -1 4202560 119749 0 0 0 85082 105 0 0 25 0 8 0 956045312 2293018624 506357 33554432000 4194304 4964800 140736406535040 18446744073709551615 4668909 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7250.67
Current children cumulated vsize (KiB) 2239276

[startup+1294.3 s]
/proc/loadavg: 8.00 7.69 5.90 9/178 15408
/proc/meminfo: memFree=30146152/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=2239276 CPUtime=7263.47 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 536672 0 0 0 725871 476 0 0 25 0 8 0 956045072 2293018624 506359 33554432000 4194304 4964800 140736406535040 18446744073709551615 4629970 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/15363/statm: 559819 506359 466 189 0 554168 0
[pid=15363/tid=15365] ppid=15361 vsize=2239276 CPUtime=853.52 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) R 15361 15363 15286 0 -1 4202560 24915 0 0 0 85323 29 0 0 25 0 8 0 956045312 2293018624 506359 33554432000 4194304 4964800 140736406535040 18446744073709551615 4313761 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=2239276 CPUtime=853.56 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) R 15361 15363 15286 0 -1 4202560 169786 0 0 0 85222 134 0 0 25 0 8 0 956045312 2293018624 506359 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=2239276 CPUtime=852.88 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) R 15361 15363 15286 0 -1 4202560 45007 0 0 0 85244 44 0 0 25 0 8 0 956045312 2293018624 506359 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=2239276 CPUtime=853.56 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) R 15361 15363 15286 0 -1 4202560 52802 0 0 0 85291 65 0 0 25 0 8 0 956045312 2293018624 506359 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=2239276 CPUtime=1287.04 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 10224 0 0 0 128698 6 0 0 25 0 8 0 956045312 2293018624 506359 33554432000 4194304 4964800 140736406535040 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=2239276 CPUtime=853.59 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) R 15361 15363 15286 0 -1 4202560 46129 0 0 0 85301 58 0 0 25 0 8 0 956045312 2293018624 506359 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=2239276 CPUtime=853.47 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) R 15361 15363 15286 0 -1 4202560 119749 0 0 0 85242 105 0 0 25 0 8 0 956045312 2293018624 506359 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7263.47
Current children cumulated vsize (KiB) 2239276

[startup+1295.9 s]
/proc/loadavg: 8.00 7.69 5.91 9/178 15408
/proc/meminfo: memFree=30146028/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=2239276 CPUtime=7276.24 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 536673 0 0 0 727148 476 0 0 25 0 8 0 956045072 2293018624 506360 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/15363/statm: 559819 506360 466 189 0 554168 0
[pid=15363/tid=15365] ppid=15361 vsize=2239276 CPUtime=855.12 cores=0-7
/proc/15363/task/15365/stat : 15365 (claspmt) R 15361 15363 15286 0 -1 4202560 24915 0 0 0 85483 29 0 0 25 0 8 0 956045312 2293018624 506360 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15363/tid=15366] ppid=15361 vsize=2239276 CPUtime=855.16 cores=0-7
/proc/15363/task/15366/stat : 15366 (claspmt) R 15361 15363 15286 0 -1 4202560 169786 0 0 0 85382 134 0 0 19 0 8 0 956045312 2293018624 506360 33554432000 4194304 4964800 140736406535040 18446744073709551615 4313807 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15363/tid=15367] ppid=15361 vsize=2239276 CPUtime=854.48 cores=0-7
/proc/15363/task/15367/stat : 15367 (claspmt) R 15361 15363 15286 0 -1 4202560 45007 0 0 0 85404 44 0 0 25 0 8 0 956045312 2293018624 506360 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669410 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15363/tid=15368] ppid=15361 vsize=2239276 CPUtime=855.16 cores=0-7
/proc/15363/task/15368/stat : 15368 (claspmt) R 15361 15363 15286 0 -1 4202560 52802 0 0 0 85451 65 0 0 25 0 8 0 956045312 2293018624 506360 33554432000 4194304 4964800 140736406535040 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15363/tid=15369] ppid=15361 vsize=2239276 CPUtime=1288.63 cores=0-7
/proc/15363/task/15369/stat : 15369 (claspmt) R 15361 15363 15286 0 -1 4202560 10225 0 0 0 128857 6 0 0 25 0 8 0 956045312 2293018624 506360 33554432000 4194304 4964800 140736406535040 18446744073709551615 4669294 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15363/tid=15370] ppid=15361 vsize=2239276 CPUtime=855.18 cores=0-7
/proc/15363/task/15370/stat : 15370 (claspmt) R 15361 15363 15286 0 -1 4202560 46129 0 0 0 85460 58 0 0 25 0 8 0 956045312 2293018624 506360 33554432000 4194304 4964800 140736406535040 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15363/tid=15371] ppid=15361 vsize=2239276 CPUtime=855.07 cores=0-7
/proc/15363/task/15371/stat : 15371 (claspmt) R 15361 15363 15286 0 -1 4202560 119749 0 0 0 85402 105 0 0 25 0 8 0 956045312 2293018624 506360 33554432000 4194304 4964800 140736406535040 18446744073709551615 4313845 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7276.24
Current children cumulated vsize (KiB) 2239276

[startup+1296.7 s]
/proc/loadavg: 8.00 7.69 5.91 9/178 15408
/proc/meminfo: memFree=30146028/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=2206564 CPUtime=7280.38 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 536683 0 0 0 727562 476 0 0 25 0 1 0 956045072 2259521536 498192 33554432000 4194304 4964800 140736406535040 18446744073709551615 224284583698 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/15363/statm: 551641 498192 476 189 0 545990 0
Current children cumulated CPU time (s) 7280.38
Current children cumulated vsize (KiB) 2206564

[startup+1297.1 s]
/proc/loadavg: 8.00 7.69 5.91 2/171 15408
/proc/meminfo: memFree=30178696/32951124 swapFree=67049456/67111528
[pid=15363] ppid=15361 vsize=1476768 CPUtime=7280.78 cores=0-7
/proc/15363/stat : 15363 (claspmt) R 15361 15363 15286 0 -1 4202496 536683 0 0 0 727598 480 0 0 25 0 1 0 956045072 1512210432 300691 33554432000 4194304 4964800 140736406535040 18446744073709551615 224284969319 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/15363/statm: 369192 300255 476 189 0 363541 0
Current children cumulated CPU time (s) 7280.78
Current children cumulated vsize (KiB) 1476768

Child status: 20
Real time (s): 1297.15
CPU time (s): 7280.84
CPU user time (s): 7275.99
CPU system time (s): 4.85526
CPU usage (%): 561.293
Max. virtual memory (cumulated for all children) (KiB): 2239276

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 7275.99
system time used= 4.85526
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 536684
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 26781
involuntary context switches= 32031

runsolver used 1.91471 second user time and 4.76427 second system time

The end

Launcher Data 

Begin job on node118 at 2011-06-10 00:22:24
IDJOB=3380647
IDBENCH=71037
IDSOLVER=1865
FILE ID=node118/3380647-1307658143
RUNJOBID= node118-1307658060-15300
PBS_JOBID= 13549425
Free space on /tmp= 74152 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UTI-20-10p0.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380647-1307658143/watcher-3380647-1307658143 -o /tmp/evaluation-result-3380647-1307658143/solver-3380647-1307658143 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380647-1307658143.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 209f7789e3588d11f275f2003f2c6a67
RANDOM SEED=137154627

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32171700 kB
Buffers:        194324 kB
Cached:         369520 kB
SwapCached:      15436 kB
Active:         327360 kB
Inactive:       255424 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32171700 kB
SwapTotal:    67111528 kB
SwapFree:     67049456 kB
Dirty:           27116 kB
Writeback:           0 kB
AnonPages:       16732 kB
Mapped:           8644 kB
Slab:           129732 kB
PageTables:       4316 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187568 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74152 MiB
End job on node118 at 2011-06-10 00:44:01