Trace number 3310187

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 4718.35 591.934

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UTI-20-10p0.cnf
MD5SUM209f7789e3588d11f275f2003f2c6a67
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark335.143
Satisfiable
(Un)Satisfiability was proved
Number of variables259616
Number of clauses1374599
Sum of the clauses size3310772
Maximum clause length10
Minimum clause length1
Number of clauses of size 113149
Number of clauses of size 2982807
Number of clauses of size 3313283
Number of clauses of size 47260
Number of clauses of size 529040
Number of clauses of size over 529060

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
4718.16/591.90	s UNSATISFIABLE
4718.16/591.93	solver [1] cryptominisat 2.7.1 answered
4718.16/591.93	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310187-1304003672/watcher-3310187-1304003672 -o /tmp/evaluation-result-3310187-1304003672/solver-3310187-1304003672 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310187-1304003672.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.07 8.10 8.03 1/168 4478
/proc/meminfo: memFree=23304332/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) R 4476 4478 4279 0 -1 4194304 499 0 0 0 0 0 0 0 24 0 1 0 511966005 18763776 387 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970552247 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/4478/statm: 4581 387 339 23 0 91 0

[startup+0.0968289 s]
/proc/loadavg: 8.07 8.10 8.03 1/168 4478
/proc/meminfo: memFree=23304332/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100821 s]
/proc/loadavg: 8.07 8.10 8.03 1/168 4478
/proc/meminfo: memFree=23304332/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300791 s]
/proc/loadavg: 8.07 8.10 8.03 1/168 4478
/proc/meminfo: memFree=23304332/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700723 s]
/proc/loadavg: 8.07 8.10 8.03 1/168 4478
/proc/meminfo: memFree=23304332/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 19 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50058 s]
/proc/loadavg: 8.07 8.10 8.03 6/174 4489
/proc/meminfo: memFree=22709828/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 19 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
[pid=4479] ppid=4478 vsize=188772 CPUtime=1.49 cores=0
/proc/4479/stat : 4479 (cryptominisat) R 4478 4478 4279 0 -1 4202496 33245 0 0 0 144 5 0 0 25 0 1 0 511966005 193302528 32444 33554432000 4194304 4587354 140736619133808 18446744073709551615 4230288 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4479/statm: 47193 32444 310 96 0 43755 0
[pid=4480] ppid=4478 vsize=153516 CPUtime=1.49 cores=1
/proc/4480/stat : 4480 (clasp) R 4478 4478 4279 0 -1 4202496 43319 0 0 0 142 7 0 0 20 0 1 0 511966005 157200384 34377 33554432000 4194304 4785740 140735400509328 18446744073709551615 4488995 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4480/statm: 38379 34377 319 145 0 35424 0
[pid=4481] ppid=4478 vsize=531196 CPUtime=1.49 cores=2
/proc/4481/stat : 4481 (TNM) R 4478 4478 4279 0 -1 4202496 26702 0 0 0 146 3 0 0 20 0 1 0 511966005 543944704 26599 33554432000 134512640 134534564 4294068416 18446744073709551615 134524577 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4481/statm: 132799 26599 91 6 0 131465 0
[pid=4482] ppid=4478 vsize=184576 CPUtime=1.48 cores=3
/proc/4482/stat : 4482 (march_hi) R 4478 4478 4279 0 -1 4194304 40979 0 0 0 142 6 0 0 25 0 1 0 511966005 189005824 29499 33554432000 4194304 4331988 140737459762000 18446744073709551615 4251963 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4482/statm: 46144 29499 132 34 0 44586 0
[pid=4483] ppid=4478 vsize=210316 CPUtime=1.48 cores=4-7
/proc/4483/stat : 4483 (plingeling) R 4478 4478 4279 0 -1 4202496 51402 1258 0 0 142 6 0 0 25 0 1 0 511966005 215363584 51242 33554432000 4194304 4356188 140735906790912 18446744073709551615 242970550016 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/4483/statm: 52579 51242 132 40 0 51123 0
Current children cumulated CPU time (s) 7.43
Current children cumulated vsize (KiB) 1286700

[startup+3.10128 s]
/proc/loadavg: 8.07 8.10 8.03 9/178 4493
/proc/meminfo: memFree=22542464/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
[pid=4479] ppid=4478 vsize=246000 CPUtime=3.08 cores=0
/proc/4479/stat : 4479 (cryptominisat) R 4478 4478 4279 0 -1 4202496 47532 0 0 0 302 6 0 0 25 0 1 0 511966005 251904000 46731 33554432000 4194304 4587354 140736619133808 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4479/statm: 61500 46731 326 96 0 58062 0
[pid=4480] ppid=4478 vsize=143756 CPUtime=3.09 cores=1
/proc/4480/stat : 4480 (clasp) R 4478 4478 4279 0 -1 4202496 46439 0 0 0 302 7 0 0 25 0 1 0 511966005 147206144 32303 33554432000 4194304 4785740 140735400509328 18446744073709551615 4553097 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4480/statm: 35939 32303 332 145 0 32984 0
[pid=4481] ppid=4478 vsize=545980 CPUtime=3.09 cores=2
/proc/4481/stat : 4481 (TNM) R 4478 4478 4279 0 -1 4202496 41064 0 0 0 304 5 0 0 25 0 1 0 511966005 559083520 40961 33554432000 134512640 134534564 4294068416 18446744073709551615 134529352 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4481/statm: 136495 40961 95 6 0 135161 0
[pid=4482] ppid=4478 vsize=174932 CPUtime=3.09 cores=3
/proc/4482/stat : 4482 (march_hi) R 4478 4478 4279 0 -1 4194304 82721 0 0 0 296 13 0 0 25 0 1 0 511966005 179130368 28903 33554432000 4194304 4331988 140737459762000 18446744073709551615 242970217490 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4482/statm: 43733 28903 129 34 0 42175 0
[pid=4483] ppid=4478 vsize=334224 CPUtime=7.18 cores=4-7
/proc/4483/stat : 4483 (plingeling) S 4478 4478 4279 0 -1 4202496 102501 1258 0 0 704 14 0 0 25 0 5 0 511966005 342245376 58215 33554432000 4194304 4356188 140735906790912 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4483/statm: 83556 58215 154 40 0 82100 0
[pid=4483/tid=4490] ppid=4478 vsize=334224 CPUtime=1.35 cores=4-7
/proc/4483/task/4490/stat : 4490 (plingeling) R 4478 4478 4279 0 -1 4202560 12898 1258 0 0 134 1 0 0 20 0 5 0 511966177 342245376 58215 33554432000 4194304 4356188 140735906790912 18446744073709551615 4258285 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4483/tid=4491] ppid=4478 vsize=334224 CPUtime=1.36 cores=4-7
/proc/4483/task/4491/stat : 4491 (plingeling) R 4478 4478 4279 0 -1 4202560 15789 1258 0 0 135 1 0 0 19 0 5 0 511966177 342245376 58215 33554432000 4194304 4356188 140735906790912 18446744073709551615 4261946 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4483/tid=4492] ppid=4478 vsize=334224 CPUtime=1.36 cores=4-7
/proc/4483/task/4492/stat : 4492 (plingeling) R 4478 4478 4279 0 -1 4202560 13447 1258 0 0 134 2 0 0 25 0 5 0 511966177 342245376 58215 33554432000 4194304 4356188 140735906790912 18446744073709551615 4261920 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4483/tid=4493] ppid=4478 vsize=334224 CPUtime=1.36 cores=4-7
/proc/4483/task/4493/stat : 4493 (plingeling) R 4478 4478 4279 0 -1 4202560 8953 1258 0 0 135 1 0 0 19 0 5 0 511966177 342245376 58215 33554432000 4194304 4356188 140735906790912 18446744073709551615 4259356 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 19.53
Current children cumulated vsize (KiB) 1463216

[startup+6.30073 s]
/proc/loadavg: 8.07 8.10 8.03 9/178 4493
/proc/meminfo: memFree=22464476/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
[pid=4479] ppid=4478 vsize=247784 CPUtime=6.28 cores=0
/proc/4479/stat : 4479 (cryptominisat) R 4478 4478 4279 0 -1 4202496 47971 0 0 0 622 6 0 0 25 0 1 0 511966005 253730816 47159 33554432000 4194304 4587354 140736619133808 18446744073709551615 242970208018 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4479/statm: 61946 47159 317 96 0 58508 0
[pid=4480] ppid=4478 vsize=143756 CPUtime=6.29 cores=1
/proc/4480/stat : 4480 (clasp) R 4478 4478 4279 0 -1 4202496 46456 0 0 0 622 7 0 0 25 0 1 0 511966005 147206144 32320 33554432000 4194304 4785740 140735400509328 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4480/statm: 35939 32320 340 145 0 32984 0
[pid=4481] ppid=4478 vsize=545980 CPUtime=4.62 cores=2
/proc/4481/stat : 4481 (TNM) R 4478 4478 4279 0 -1 4202496 41064 0 0 0 409 53 0 0 25 0 1 0 511966005 559083520 40961 33554432000 134512640 134534564 4294068416 18446744073709551615 134529953 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4481/statm: 136495 40961 95 6 0 135161 0
[pid=4482] ppid=4478 vsize=197204 CPUtime=6.29 cores=3
/proc/4482/stat : 4482 (march_hi) R 4478 4478 4279 0 -1 4202496 175888 0 0 0 602 27 0 0 25 0 1 0 511966005 201936896 34208 33554432000 4194304 4331988 140737459762000 18446744073709551615 4271067 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4482/statm: 49301 34208 151 34 0 47743 0
[pid=4483] ppid=4478 vsize=349128 CPUtime=19.96 cores=4-7
/proc/4483/stat : 4483 (plingeling) S 4478 4478 4279 0 -1 4202496 106229 1258 0 0 1981 15 0 0 25 0 5 0 511966005 357507072 59376 33554432000 4194304 4356188 140735906790912 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4483/statm: 87282 59376 164 40 0 85826 0
[pid=4483/tid=4490] ppid=4478 vsize=349128 CPUtime=4.53 cores=4-7
/proc/4483/task/4490/stat : 4490 (plingeling) R 4478 4478 4279 0 -1 4202560 13351 1258 0 0 452 1 0 0 25 0 5 0 511966177 357507072 59376 33554432000 4194304 4356188 140735906790912 18446744073709551615 4210605 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4483/tid=4491] ppid=4478 vsize=349128 CPUtime=4.56 cores=4-7
/proc/4483/task/4491/stat : 4491 (plingeling) R 4478 4478 4279 0 -1 4202560 17139 1258 0 0 454 2 0 0 25 0 5 0 511966177 357507072 59376 33554432000 4194304 4356188 140735906790912 18446744073709551615 4233675 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4483/tid=4492] ppid=4478 vsize=349128 CPUtime=4.56 cores=4-7
/proc/4483/task/4492/stat : 4492 (plingeling) R 4478 4478 4279 0 -1 4202560 15368 1258 0 0 454 2 0 0 25 0 5 0 511966177 357507072 59376 33554432000 4194304 4356188 140735906790912 18446744073709551615 4254610 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4483/tid=4493] ppid=4478 vsize=349128 CPUtime=4.56 cores=4-7
/proc/4483/task/4493/stat : 4493 (plingeling) R 4478 4478 4279 0 -1 4202560 8957 1258 0 0 455 1 0 0 25 0 5 0 511966177 357507072 59376 33554432000 4194304 4356188 140735906790912 18446744073709551615 4331328 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 43.44
Current children cumulated vsize (KiB) 1502176

[startup+12.7006 s]
/proc/loadavg: 8.30 8.15 8.04 10/178 4493
/proc/meminfo: memFree=22245200/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
[pid=4479] ppid=4478 vsize=314716 CPUtime=12.69 cores=0
/proc/4479/stat : 4479 (cryptominisat) R 4478 4478 4279 0 -1 4202496 80260 0 0 0 1258 11 0 0 25 0 1 0 511966005 322269184 64347 33554432000 4194304 4587354 140736619133808 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4479/statm: 78679 64347 333 96 0 75241 0
[pid=4480] ppid=4478 vsize=143756 CPUtime=8 cores=1
/proc/4480/stat : 4480 (clasp) R 4478 4478 4279 0 -1 4202496 46456 0 0 0 684 116 0 0 25 0 1 0 511966005 147206144 32320 33554432000 4194304 4785740 140735400509328 18446744073709551615 4552553 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4480/statm: 35939 32320 340 145 0 32984 0
[pid=4481] ppid=4478 vsize=545980 CPUtime=10.58 cores=2
/proc/4481/stat : 4481 (TNM) R 4478 4478 4279 0 -1 4202496 41064 0 0 0 998 60 0 0 25 0 1 0 511966005 559083520 40961 33554432000 134512640 134534564 4294068416 18446744073709551615 134529352 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4481/statm: 136495 40961 95 6 0 135161 0
[pid=4482] ppid=4478 vsize=563356 CPUtime=12.69 cores=3
/proc/4482/stat : 4482 (march_hi) R 4478 4478 4279 0 -1 4202496 262265 0 0 0 1231 38 0 0 25 0 1 0 511966005 576876544 67388 33554432000 4194304 4331988 140737459762000 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4482/statm: 140839 67388 175 34 0 139281 0
[pid=4483] ppid=4478 vsize=351828 CPUtime=45.52 cores=4-7
/proc/4483/stat : 4483 (plingeling) S 4478 4478 4279 0 -1 4202496 107123 1258 0 0 4534 18 0 0 25 0 5 0 511966005 360271872 60051 33554432000 4194304 4356188 140735906790912 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4483/statm: 87957 60051 164 40 0 86501 0
[pid=4483/tid=4490] ppid=4478 vsize=351828 CPUtime=10.9 cores=4-7
/proc/4483/task/4490/stat : 4490 (plingeling) R 4478 4478 4279 0 -1 4202560 14245 1258 0 0 1088 2 0 0 25 0 5 0 511966177 360271872 60051 33554432000 4194304 4356188 140735906790912 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4483/tid=4491] ppid=4478 vsize=351828 CPUtime=10.95 cores=4-7
/proc/4483/task/4491/stat : 4491 (plingeling) R 4478 4478 4279 0 -1 4202560 17139 1258 0 0 1093 2 0 0 25 0 5 0 511966177 360271872 60051 33554432000 4194304 4356188 140735906790912 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4483/tid=4492] ppid=4478 vsize=351828 CPUtime=10.96 cores=4-7
/proc/4483/task/4492/stat : 4492 (plingeling) R 4478 4478 4279 0 -1 4202560 15368 1258 0 0 1094 2 0 0 25 0 5 0 511966177 360271872 60051 33554432000 4194304 4356188 140735906790912 18446744073709551615 4331007 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4483/tid=4493] ppid=4478 vsize=351828 CPUtime=10.96 cores=4-7
/proc/4483/task/4493/stat : 4493 (plingeling) R 4478 4478 4279 0 -1 4202560 8957 1258 0 0 1094 2 0 0 25 0 5 0 511966177 360271872 60051 33554432000 4194304 4356188 140735906790912 18446744073709551615 4241608 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 89.48
Current children cumulated vsize (KiB) 1937960

[startup+25.5014 s]
/proc/loadavg: 8.44 8.19 8.06 9/178 4494
/proc/meminfo: memFree=22239068/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
[pid=4479] ppid=4478 vsize=314716 CPUtime=25.49 cores=0
/proc/4479/stat : 4479 (cryptominisat) R 4478 4478 4279 0 -1 4202496 81499 0 0 0 2537 12 0 0 25 0 1 0 511966005 322269184 65569 33554432000 4194304 4587354 140736619133808 18446744073709551615 4236545 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4479/statm: 78679 65569 333 96 0 75241 0
[pid=4480] ppid=4478 vsize=143756 CPUtime=19.5 cores=1
/proc/4480/stat : 4480 (clasp) R 4478 4478 4279 0 -1 4202496 46456 0 0 0 1799 151 0 0 25 0 1 0 511966005 147206144 32320 33554432000 4194304 4785740 140735400509328 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4480/statm: 35939 32320 340 145 0 32984 0
[pid=4481] ppid=4478 vsize=545980 CPUtime=23.38 cores=2
/proc/4481/stat : 4481 (TNM) R 4478 4478 4279 0 -1 4202496 41064 0 0 0 2278 60 0 0 25 0 1 0 511966005 559083520 40961 33554432000 134512640 134534564 4294068416 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4481/statm: 136495 40961 95 6 0 135161 0
[pid=4482] ppid=4478 vsize=567172 CPUtime=25.49 cores=3

################
# More data... #
################

[pid=4483/tid=4491] ppid=4478 vsize=513344 CPUtime=580.4 cores=4-7
/proc/4483/task/4491/stat : 4491 (plingeling) R 4478 4478 4279 0 -1 4202560 104662 1258 0 0 58025 15 0 0 25 0 5 0 511966177 525664256 99919 33554432000 4194304 4356188 140735906790912 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4483/tid=4492] ppid=4478 vsize=513344 CPUtime=580.28 cores=4-7
/proc/4483/task/4492/stat : 4492 (plingeling) R 4478 4478 4279 0 -1 4202560 88852 1258 0 0 58009 19 0 0 25 0 5 0 511966177 525664256 99919 33554432000 4194304 4356188 140735906790912 18446744073709551615 4262815 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4483/tid=4493] ppid=4478 vsize=513344 CPUtime=580.56 cores=4-7
/proc/4483/task/4493/stat : 4493 (plingeling) R 4478 4478 4279 0 -1 4202560 108102 1258 0 0 58041 15 0 0 25 0 5 0 511966177 525664256 99919 33554432000 4194304 4356188 140735906790912 18446744073709551615 4241599 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4641.42
Current children cumulated vsize (KiB) 4514880

Solver just ended. Dumping a history of the last processes samples

[startup+588.701 s]
/proc/loadavg: 8.00 8.03 8.01 9/178 4509
/proc/meminfo: memFree=21552792/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
[pid=4479] ppid=4478 vsize=2448196 CPUtime=588.7 cores=0
/proc/4479/stat : 4479 (cryptominisat) R 4478 4478 4279 0 -1 4202496 116884 0 0 0 58840 30 0 0 25 0 1 0 511966005 2506952704 72941 33554432000 4194304 4587354 140736619133808 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4479/statm: 612049 72941 341 96 0 608611 0
[pid=4480] ppid=4478 vsize=574712 CPUtime=582.66 cores=1
/proc/4480/stat : 4480 (clasp) R 4478 4478 4279 0 -1 4202496 154239 0 0 0 58056 210 0 0 25 0 1 0 511966005 588505088 140103 33554432000 4194304 4785740 140735400509328 18446744073709551615 4290592 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4480/statm: 143678 140103 340 145 0 140723 0
[pid=4481] ppid=4478 vsize=545980 CPUtime=586.59 cores=2
/proc/4481/stat : 4481 (TNM) R 4478 4478 4279 0 -1 4202496 41064 0 0 0 58599 60 0 0 25 0 1 0 511966005 559083520 40961 33554432000 134512640 134534564 4294068416 18446744073709551615 134530126 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4481/statm: 136495 40961 95 6 0 135161 0
[pid=4482] ppid=4478 vsize=637576 CPUtime=588.68 cores=3
/proc/4482/stat : 4482 (march_hi) R 4478 4478 4279 0 -1 4202496 278191 0 0 0 58826 42 0 0 25 0 1 0 511966005 652877824 83314 33554432000 4194304 4331988 140737459762000 18446744073709551615 242969945293 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4482/statm: 159394 83314 175 34 0 157836 0
[pid=4483] ppid=4478 vsize=523584 CPUtime=2345.94 cores=4-7
/proc/4483/stat : 4483 (plingeling) S 4478 4478 4279 0 -1 4202496 436425 1258 0 0 234525 69 0 0 25 0 5 0 511966005 536150016 100943 33554432000 4194304 4356188 140735906790912 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4483/statm: 130896 100943 164 40 0 129440 0
[pid=4483/tid=4490] ppid=4478 vsize=523584 CPUtime=583.78 cores=4-7
/proc/4483/task/4490/stat : 4490 (plingeling) R 4478 4478 4279 0 -1 4202560 74178 1258 0 0 58367 11 0 0 25 0 5 0 511966177 536150016 100943 33554432000 4194304 4356188 140735906790912 18446744073709551615 4237226 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4483/tid=4491] ppid=4478 vsize=523584 CPUtime=586.79 cores=4-7
/proc/4483/task/4491/stat : 4491 (plingeling) R 4478 4478 4279 0 -1 4202560 104662 1258 0 0 58664 15 0 0 25 0 5 0 511966177 536150016 100943 33554432000 4194304 4356188 140735906790912 18446744073709551615 4236874 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4483/tid=4492] ppid=4478 vsize=523584 CPUtime=586.66 cores=4-7
/proc/4483/task/4492/stat : 4492 (plingeling) R 4478 4478 4279 0 -1 4202560 98069 1258 0 0 58646 20 0 0 25 0 5 0 511966177 536150016 100943 33554432000 4194304 4356188 140735906790912 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4483/tid=4493] ppid=4478 vsize=523584 CPUtime=586.96 cores=4-7
/proc/4483/task/4493/stat : 4493 (plingeling) R 4478 4478 4279 0 -1 4202560 108102 1258 0 0 58681 15 0 0 25 0 5 0 511966177 536150016 100943 33554432000 4194304 4356188 140735906790912 18446744073709551615 4210587 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4692.57
Current children cumulated vsize (KiB) 4748372

[startup+590.301 s]
/proc/loadavg: 8.00 8.03 8.01 9/178 4509
/proc/meminfo: memFree=21552544/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
[pid=4479] ppid=4478 vsize=2448196 CPUtime=590.3 cores=0
/proc/4479/stat : 4479 (cryptominisat) R 4478 4478 4279 0 -1 4202496 116884 0 0 0 59000 30 0 0 25 0 1 0 511966005 2506952704 72941 33554432000 4194304 4587354 140736619133808 18446744073709551615 4238297 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4479/statm: 612049 72941 341 96 0 608611 0
[pid=4480] ppid=4478 vsize=574848 CPUtime=584.26 cores=1
/proc/4480/stat : 4480 (clasp) R 4478 4478 4279 0 -1 4202496 154264 0 0 0 58216 210 0 0 25 0 1 0 511966005 588644352 140128 33554432000 4194304 4785740 140735400509328 18446744073709551615 4290592 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4480/statm: 143712 140128 340 145 0 140757 0
[pid=4481] ppid=4478 vsize=545980 CPUtime=588.2 cores=2
/proc/4481/stat : 4481 (TNM) R 4478 4478 4279 0 -1 4202496 41064 0 0 0 58760 60 0 0 25 0 1 0 511966005 559083520 40961 33554432000 134512640 134534564 4294068416 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4481/statm: 136495 40961 95 6 0 135161 0
[pid=4482] ppid=4478 vsize=637576 CPUtime=590.28 cores=3
/proc/4482/stat : 4482 (march_hi) R 4478 4478 4279 0 -1 4202496 278191 0 0 0 58986 42 0 0 25 0 1 0 511966005 652877824 83314 33554432000 4194304 4331988 140737459762000 18446744073709551615 4246743 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4482/statm: 159394 83314 175 34 0 157836 0
[pid=4483] ppid=4478 vsize=522712 CPUtime=2352.33 cores=4-7
/proc/4483/stat : 4483 (plingeling) S 4478 4478 4279 0 -1 4202496 436425 1258 0 0 235164 69 0 0 25 0 5 0 511966005 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4483/statm: 130678 100725 164 40 0 129222 0
[pid=4483/tid=4490] ppid=4478 vsize=522712 CPUtime=585.37 cores=4-7
/proc/4483/task/4490/stat : 4490 (plingeling) R 4478 4478 4279 0 -1 4202560 74178 1258 0 0 58526 11 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4211042 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4483/tid=4491] ppid=4478 vsize=522712 CPUtime=588.4 cores=4-7
/proc/4483/task/4491/stat : 4491 (plingeling) R 4478 4478 4279 0 -1 4202560 104662 1258 0 0 58825 15 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4238090 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4483/tid=4492] ppid=4478 vsize=522712 CPUtime=588.26 cores=4-7
/proc/4483/task/4492/stat : 4492 (plingeling) R 4478 4478 4279 0 -1 4202560 98069 1258 0 0 58806 20 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4236925 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4483/tid=4493] ppid=4478 vsize=522712 CPUtime=588.56 cores=4-7
/proc/4483/task/4493/stat : 4493 (plingeling) R 4478 4478 4279 0 -1 4202560 108102 1258 0 0 58841 15 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4705.37
Current children cumulated vsize (KiB) 4747636

[startup+591.101 s]
/proc/loadavg: 8.00 8.03 8.01 9/178 4509
/proc/meminfo: memFree=21552792/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
[pid=4479] ppid=4478 vsize=2448196 CPUtime=591.1 cores=0
/proc/4479/stat : 4479 (cryptominisat) R 4478 4478 4279 0 -1 4202496 116884 0 0 0 59080 30 0 0 25 0 1 0 511966005 2506952704 72941 33554432000 4194304 4587354 140736619133808 18446744073709551615 4236698 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4479/statm: 612049 72941 341 96 0 608611 0
[pid=4480] ppid=4478 vsize=574848 CPUtime=585.06 cores=1
/proc/4480/stat : 4480 (clasp) R 4478 4478 4279 0 -1 4202496 154264 0 0 0 58296 210 0 0 25 0 1 0 511966005 588644352 140128 33554432000 4194304 4785740 140735400509328 18446744073709551615 4290633 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4480/statm: 143712 140128 340 145 0 140757 0
[pid=4481] ppid=4478 vsize=545980 CPUtime=589 cores=2
/proc/4481/stat : 4481 (TNM) R 4478 4478 4279 0 -1 4202496 41064 0 0 0 58840 60 0 0 25 0 1 0 511966005 559083520 40961 33554432000 134512640 134534564 4294068416 18446744073709551615 134525873 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4481/statm: 136495 40961 95 6 0 135161 0
[pid=4482] ppid=4478 vsize=637576 CPUtime=591.08 cores=3
/proc/4482/stat : 4482 (march_hi) R 4478 4478 4279 0 -1 4202496 278191 0 0 0 59066 42 0 0 25 0 1 0 511966005 652877824 83314 33554432000 4194304 4331988 140737459762000 18446744073709551615 4263227 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4482/statm: 159394 83314 175 34 0 157836 0
[pid=4483] ppid=4478 vsize=522712 CPUtime=2355.53 cores=4-7
/proc/4483/stat : 4483 (plingeling) S 4478 4478 4279 0 -1 4202496 436425 1258 0 0 235484 69 0 0 25 0 5 0 511966005 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4483/statm: 130678 100725 164 40 0 129222 0
[pid=4483/tid=4490] ppid=4478 vsize=522712 CPUtime=586.16 cores=4-7
/proc/4483/task/4490/stat : 4490 (plingeling) R 4478 4478 4279 0 -1 4202560 74178 1258 0 0 58605 11 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4483/tid=4491] ppid=4478 vsize=522712 CPUtime=589.2 cores=4-7
/proc/4483/task/4491/stat : 4491 (plingeling) R 4478 4478 4279 0 -1 4202560 104662 1258 0 0 58905 15 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4483/tid=4492] ppid=4478 vsize=522712 CPUtime=589.06 cores=4-7
/proc/4483/task/4492/stat : 4492 (plingeling) R 4478 4478 4279 0 -1 4202560 98069 1258 0 0 58886 20 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4236874 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4483/tid=4493] ppid=4478 vsize=522712 CPUtime=589.36 cores=4-7
/proc/4483/task/4493/stat : 4493 (plingeling) R 4478 4478 4279 0 -1 4202560 108102 1258 0 0 58921 15 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4711.77
Current children cumulated vsize (KiB) 4747636

[startup+591.501 s]
/proc/loadavg: 8.00 8.03 8.01 9/178 4509
/proc/meminfo: memFree=21552792/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
[pid=4479] ppid=4478 vsize=2448196 CPUtime=591.5 cores=0
/proc/4479/stat : 4479 (cryptominisat) R 4478 4478 4279 0 -1 4202496 116884 0 0 0 59120 30 0 0 25 0 1 0 511966005 2506952704 72941 33554432000 4194304 4587354 140736619133808 18446744073709551615 4238314 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4479/statm: 612049 72941 341 96 0 608611 0
[pid=4480] ppid=4478 vsize=574980 CPUtime=585.46 cores=1
/proc/4480/stat : 4480 (clasp) R 4478 4478 4279 0 -1 4202496 154295 0 0 0 58336 210 0 0 25 0 1 0 511966005 588779520 140159 33554432000 4194304 4785740 140735400509328 18446744073709551615 4290592 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4480/statm: 143745 140159 340 145 0 140790 0
[pid=4481] ppid=4478 vsize=545980 CPUtime=589.4 cores=2
/proc/4481/stat : 4481 (TNM) R 4478 4478 4279 0 -1 4202496 41064 0 0 0 58880 60 0 0 25 0 1 0 511966005 559083520 40961 33554432000 134512640 134534564 4294068416 18446744073709551615 134529640 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4481/statm: 136495 40961 95 6 0 135161 0
[pid=4482] ppid=4478 vsize=637576 CPUtime=591.48 cores=3
/proc/4482/stat : 4482 (march_hi) R 4478 4478 4279 0 -1 4202496 278191 0 0 0 59106 42 0 0 25 0 1 0 511966005 652877824 83314 33554432000 4194304 4331988 140737459762000 18446744073709551615 4226474 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4482/statm: 159394 83314 175 34 0 157836 0
[pid=4483] ppid=4478 vsize=522712 CPUtime=2357.13 cores=4-7
/proc/4483/stat : 4483 (plingeling) S 4478 4478 4279 0 -1 4202496 436425 1258 0 0 235644 69 0 0 25 0 5 0 511966005 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4483/statm: 130678 100725 164 40 0 129222 0
[pid=4483/tid=4490] ppid=4478 vsize=522712 CPUtime=586.56 cores=4-7
/proc/4483/task/4490/stat : 4490 (plingeling) R 4478 4478 4279 0 -1 4202560 74178 1258 0 0 58645 11 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4483/tid=4491] ppid=4478 vsize=522712 CPUtime=589.6 cores=4-7
/proc/4483/task/4491/stat : 4491 (plingeling) R 4478 4478 4279 0 -1 4202560 104662 1258 0 0 58945 15 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4483/tid=4492] ppid=4478 vsize=522712 CPUtime=589.46 cores=4-7
/proc/4483/task/4492/stat : 4492 (plingeling) R 4478 4478 4279 0 -1 4202560 98069 1258 0 0 58926 20 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4236829 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4483/tid=4493] ppid=4478 vsize=522712 CPUtime=589.76 cores=4-7
/proc/4483/task/4493/stat : 4493 (plingeling) R 4478 4478 4279 0 -1 4202560 108102 1258 0 0 58961 15 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4714.97
Current children cumulated vsize (KiB) 4747768

[startup+591.901 s]
/proc/loadavg: 8.00 8.03 8.01 9/178 4509
/proc/meminfo: memFree=21552792/32951132 swapFree=67111364/67111528
[pid=4478] ppid=4476 vsize=18324 CPUtime=0 cores=0-7
/proc/4478/stat : 4478 (ppfolio) S 4476 4478 4279 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 511966005 18763776 389 33554432000 4194304 4287625 140737391635952 18446744073709551615 242970570255 0 0 4096 65536 3905043368568160255 0 0 17 6 0 0 0
/proc/4478/statm: 4581 389 341 23 0 91 0
[pid=4479] ppid=4478 vsize=2392708 CPUtime=591.9 cores=0
/proc/4479/stat : 4479 (cryptominisat) R 4478 4478 4279 0 -1 4202496 116895 0 0 0 59160 30 0 0 25 0 1 0 511966005 2450132992 61717 33554432000 4194304 4587354 140736619133808 18446744073709551615 242970205458 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4479/statm: 598177 61717 351 96 0 594739 0
[pid=4480] ppid=4478 vsize=574980 CPUtime=585.86 cores=1
/proc/4480/stat : 4480 (clasp) R 4478 4478 4279 0 -1 4202496 154295 0 0 0 58376 210 0 0 25 0 1 0 511966005 588779520 140159 33554432000 4194304 4785740 140735400509328 18446744073709551615 4290592 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4480/statm: 143745 140159 340 145 0 140790 0
[pid=4481] ppid=4478 vsize=545980 CPUtime=589.8 cores=2
/proc/4481/stat : 4481 (TNM) R 4478 4478 4279 0 -1 4202496 41064 0 0 0 58920 60 0 0 25 0 1 0 511966005 559083520 40961 33554432000 134512640 134534564 4294068416 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4481/statm: 136495 40961 95 6 0 135161 0
[pid=4482] ppid=4478 vsize=637576 CPUtime=591.88 cores=3
/proc/4482/stat : 4482 (march_hi) R 4478 4478 4279 0 -1 4202496 278191 0 0 0 59146 42 0 0 25 0 1 0 511966005 652877824 83314 33554432000 4194304 4331988 140737459762000 18446744073709551615 4228335 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4482/statm: 159394 83314 175 34 0 157836 0
[pid=4483] ppid=4478 vsize=522712 CPUtime=2358.72 cores=4-7
/proc/4483/stat : 4483 (plingeling) S 4478 4478 4279 0 -1 4202496 436425 1258 0 0 235803 69 0 0 25 0 5 0 511966005 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4483/statm: 130678 100725 164 40 0 129222 0
[pid=4483/tid=4490] ppid=4478 vsize=522712 CPUtime=586.96 cores=4-7
/proc/4483/task/4490/stat : 4490 (plingeling) R 4478 4478 4279 0 -1 4202560 74178 1258 0 0 58685 11 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4242674 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4483/tid=4491] ppid=4478 vsize=522712 CPUtime=590 cores=4-7
/proc/4483/task/4491/stat : 4491 (plingeling) R 4478 4478 4279 0 -1 4202560 104662 1258 0 0 58985 15 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4330995 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4483/tid=4492] ppid=4478 vsize=522712 CPUtime=589.86 cores=4-7
/proc/4483/task/4492/stat : 4492 (plingeling) R 4478 4478 4279 0 -1 4202560 98069 1258 0 0 58966 20 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4483/tid=4493] ppid=4478 vsize=522712 CPUtime=590.16 cores=4-7
/proc/4483/task/4493/stat : 4493 (plingeling) R 4478 4478 4279 0 -1 4202560 108102 1258 0 0 59001 15 0 0 25 0 5 0 511966177 535257088 100725 33554432000 4194304 4356188 140735906790912 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4718.16
Current children cumulated vsize (KiB) 4692280

Child status: 0
Real time (s): 591.934
CPU time (s): 4718.35
CPU user time (s): 4714.11
CPU system time (s): 4.23635
CPU usage (%): 797.107
Max. virtual memory (cumulated for all children) (KiB): 6184916

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4714.11
system time used= 4.23635
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1028666
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 575
involuntary context switches= 22037

runsolver used 0.949855 second user time and 2.28265 second system time

The end

Launcher Data 

Begin job on node128 at 2011-04-28 17:14:34
IDJOB=3310187
IDBENCH=71037
IDSOLVER=1638
FILE ID=node128/3310187-1304003672
RUNJOBID= node128-1304002189-4293
PBS_JOBID= 13168789
Free space on /tmp= 66948 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UTI-20-10p0.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310187-1304003672/watcher-3310187-1304003672 -o /tmp/evaluation-result-3310187-1304003672/solver-3310187-1304003672 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310187-1304003672.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 209f7789e3588d11f275f2003f2c6a67
RANDOM SEED=299507280

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      23304736 kB
Buffers:       1359480 kB
Cached:        7597092 kB
SwapCached:        160 kB
Active:        2198884 kB
Inactive:      6822040 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      23304736 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           36004 kB
Writeback:           0 kB
AnonPages:       64340 kB
Mapped:          14836 kB
Slab:           560580 kB
PageTables:       4300 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   184504 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66940 MiB
End job on node128 at 2011-04-28 17:24:26