Trace number 3310147

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 2241.99 281.22

General information on the benchmark

Namemanol-pipe-c10nidw.cnf
MD5SUM943fd86d922b13236c21a74c4f82b6d0
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark132.277
Satisfiable
(Un)Satisfiability was proved
Number of variables433601
Number of clauses1291714
Sum of the clauses size3013998
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2861142
Number of clauses of size 3430571
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
2241.28/281.18	s UNSATISFIABLE
2241.92/281.22	solver [5] plingeling 276-6264d55-100731 answered
2241.92/281.22	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310147-1303995745/watcher-3310147-1303995745 -o /tmp/evaluation-result-3310147-1303995745/solver-3310147-1303995745 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310147-1303995745.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.00 7.04 7.27 1/170 9782
/proc/meminfo: memFree=18021404/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) R 9780 9782 9584 0 -1 4202496 522 0 0 0 0 0 0 0 23 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0

[startup+0.0458929 s]
/proc/loadavg: 7.00 7.04 7.27 1/170 9782
/proc/meminfo: memFree=18021404/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 23 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100882 s]
/proc/loadavg: 7.00 7.04 7.27 1/170 9782
/proc/meminfo: memFree=18021404/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 23 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300849 s]
/proc/loadavg: 7.00 7.04 7.27 1/170 9782
/proc/meminfo: memFree=18021404/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 23 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700779 s]
/proc/loadavg: 7.00 7.04 7.27 1/170 9782
/proc/meminfo: memFree=18021404/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 18 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50064 s]
/proc/loadavg: 6.84 7.00 7.26 6/176 9793
/proc/meminfo: memFree=17341092/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 18 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
[pid=9783] ppid=9782 vsize=204784 CPUtime=1.48 cores=0
/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4202496 37678 0 0 0 143 5 0 0 20 0 1 0 511177179 209698816 36658 33554432000 4194304 4587354 140737361031136 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9783/statm: 51196 36658 306 96 0 47758 0
[pid=9784] ppid=9782 vsize=222436 CPUtime=1.49 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4202496 61952 0 0 0 141 8 0 0 20 0 1 0 511177179 227774464 50906 33554432000 4194304 4785740 140733406298432 18446744073709551615 216634176197 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9784/statm: 55609 50906 319 145 0 52654 0
[pid=9785] ppid=9782 vsize=529216 CPUtime=1.48 cores=2
/proc/9785/stat : 9785 (TNM) R 9782 9782 9584 0 -1 4202496 26744 0 0 0 146 2 0 0 20 0 1 0 511177179 541917184 26640 33554432000 134512640 134534564 4290496304 18446744073709551615 134524573 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9785/statm: 132304 26640 91 6 0 130970 0
[pid=9786] ppid=9782 vsize=273872 CPUtime=1.49 cores=3
/proc/9786/stat : 9786 (march_hi) R 9782 9782 9584 0 -1 4194304 68068 0 0 0 140 9 0 0 20 0 1 0 511177179 280444928 54077 33554432000 4194304 4331988 140735716630864 18446744073709551615 216634176197 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9786/statm: 68501 54081 127 34 0 66943 0
[pid=9787] ppid=9782 vsize=265628 CPUtime=1.48 cores=4-7
/proc/9787/stat : 9787 (plingeling) R 9782 9782 9584 0 -1 4202496 65439 1249 0 0 140 8 0 0 25 0 1 0 511177179 272003072 65070 33554432000 4194304 4356188 140733267472640 18446744073709551615 216634515200 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/9787/statm: 66407 65070 132 40 0 64951 0
Current children cumulated CPU time (s) 7.42
Current children cumulated vsize (KiB) 1514260

[startup+3.10133 s]
/proc/loadavg: 6.84 7.00 7.26 9/180 9797
/proc/meminfo: memFree=17042300/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
[pid=9783] ppid=9782 vsize=279832 CPUtime=3.08 cores=0
/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4202496 56364 0 0 0 301 7 0 0 25 0 1 0 511177179 286547968 55344 33554432000 4194304 4587354 140737361031136 18446744073709551615 4421072 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9783/statm: 69958 55344 312 96 0 66520 0
[pid=9784] ppid=9782 vsize=264256 CPUtime=3.09 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4202496 72143 0 0 0 299 10 0 0 25 0 1 0 511177179 270598144 61097 33554432000 4194304 4785740 140733406298432 18446744073709551615 216634176545 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9784/statm: 66064 61097 319 145 0 63109 0
[pid=9785] ppid=9782 vsize=542284 CPUtime=3.08 cores=2
/proc/9785/stat : 9785 (TNM) R 9782 9782 9584 0 -1 4202496 44513 0 0 0 304 4 0 0 25 0 1 0 511177179 555298816 44409 33554432000 134512640 134534564 4290496304 18446744073709551615 134529366 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9785/statm: 135571 44409 95 6 0 134237 0
[pid=9786] ppid=9782 vsize=279416 CPUtime=3.09 cores=3
/proc/9786/stat : 9786 (march_hi) R 9782 9782 9584 0 -1 4194304 127629 0 0 0 291 18 0 0 25 0 1 0 511177179 286121984 45926 33554432000 4194304 4331988 140735716630864 18446744073709551615 216634541162 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9786/statm: 69854 45926 128 34 0 68296 0
[pid=9787] ppid=9782 vsize=387544 CPUtime=7.27 cores=4-7
/proc/9787/stat : 9787 (plingeling) S 9782 9782 9584 0 -1 4202496 125141 1249 0 0 710 17 0 0 25 0 5 0 511177179 396845056 77982 33554432000 4194304 4356188 140733267472640 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/9787/statm: 96886 77982 152 40 0 95430 0
[pid=9787/tid=9794] ppid=9782 vsize=387544 CPUtime=1.39 cores=4-7
/proc/9787/task/9794/stat : 9794 (plingeling) R 9782 9782 9584 0 -1 4202560 11404 1249 0 0 138 1 0 0 20 0 5 0 511177349 396845056 77982 33554432000 4194304 4356188 140733267472640 18446744073709551615 4259390 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9787/tid=9795] ppid=9782 vsize=387544 CPUtime=1.38 cores=4-7
/proc/9787/task/9795/stat : 9795 (plingeling) R 9782 9782 9584 0 -1 4202560 22220 1249 0 0 136 2 0 0 25 0 5 0 511177349 396845056 77982 33554432000 4194304 4356188 140733267472640 18446744073709551615 4247719 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9787/tid=9796] ppid=9782 vsize=387544 CPUtime=1.39 cores=4-7
/proc/9787/task/9796/stat : 9796 (plingeling) R 9782 9782 9584 0 -1 4202560 17173 1249 0 0 137 2 0 0 18 0 5 0 511177349 396845056 77982 33554432000 4194304 4356188 140733267472640 18446744073709551615 4247188 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9797] ppid=9782 vsize=387544 CPUtime=1.39 cores=4-7
/proc/9787/task/9797/stat : 9797 (plingeling) R 9782 9782 9584 0 -1 4202560 8893 1249 0 0 138 1 0 0 25 0 5 0 511177349 396845056 77982 33554432000 4194304 4356188 140733267472640 18446744073709551615 216634209332 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 19.61
Current children cumulated vsize (KiB) 1771656

[startup+6.30077 s]
/proc/loadavg: 6.84 7.00 7.26 9/180 9798
/proc/meminfo: memFree=16834988/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
[pid=9783] ppid=9782 vsize=354768 CPUtime=6.29 cores=0
/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4202496 87447 0 0 0 617 12 0 0 25 0 1 0 511177179 363282432 77448 33554432000 4194304 4587354 140737361031136 18446744073709551615 216634211815 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9783/statm: 88692 77448 317 96 0 85254 0
[pid=9784] ppid=9782 vsize=289648 CPUtime=6.29 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4202496 78207 0 0 0 617 12 0 0 25 0 1 0 511177179 296599552 67161 33554432000 4194304 4785740 140733406298432 18446744073709551615 4495836 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9784/statm: 72412 67161 319 145 0 69457 0
[pid=9785] ppid=9782 vsize=542284 CPUtime=6.28 cores=2
/proc/9785/stat : 9785 (TNM) R 9782 9782 9584 0 -1 4202496 44513 0 0 0 623 5 0 0 25 0 1 0 511177179 555298816 44409 33554432000 134512640 134534564 4290496304 18446744073709551615 134529366 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9785/statm: 135571 44409 95 6 0 134237 0
[pid=9786] ppid=9782 vsize=234344 CPUtime=6.29 cores=3
/proc/9786/stat : 9786 (march_hi) R 9782 9782 9584 0 -1 4202496 266355 0 0 0 591 38 0 0 25 0 1 0 511177179 239968256 43680 33554432000 4194304 4331988 140735716630864 18446744073709551615 4271172 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9786/statm: 58586 43680 143 34 0 57028 0
[pid=9787] ppid=9782 vsize=376596 CPUtime=20.04 cores=4-7
/proc/9787/stat : 9787 (plingeling) S 9782 9782 9584 0 -1 4202496 164476 1249 0 0 1981 23 0 0 25 0 5 0 511177179 385634304 66237 33554432000 4194304 4356188 140733267472640 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/9787/statm: 94149 66237 164 40 0 92693 0
[pid=9787/tid=9794] ppid=9782 vsize=376596 CPUtime=4.6 cores=4-7
/proc/9787/task/9794/stat : 9794 (plingeling) R 9782 9782 9584 0 -1 4202560 18351 1249 0 0 457 3 0 0 25 0 5 0 511177349 385634304 66237 33554432000 4194304 4356188 140733267472640 18446744073709551615 4322106 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9787/tid=9795] ppid=9782 vsize=376596 CPUtime=4.58 cores=4-7
/proc/9787/task/9795/stat : 9795 (plingeling) R 9782 9782 9584 0 -1 4202560 27355 1249 0 0 455 3 0 0 25 0 5 0 511177349 385634304 66237 33554432000 4194304 4356188 140733267472640 18446744073709551615 4232827 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9787/tid=9796] ppid=9782 vsize=376596 CPUtime=4.58 cores=4-7
/proc/9787/task/9796/stat : 9796 (plingeling) R 9782 9782 9584 0 -1 4202560 21453 1249 0 0 456 2 0 0 25 0 5 0 511177349 385634304 66237 33554432000 4194304 4356188 140733267472640 18446744073709551615 4302317 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9797] ppid=9782 vsize=376596 CPUtime=4.56 cores=4-7
/proc/9787/task/9797/stat : 9797 (plingeling) R 9782 9782 9584 0 -1 4202560 31866 1249 0 0 451 5 0 0 25 0 5 0 511177349 385634304 66237 33554432000 4194304 4356188 140733267472640 18446744073709551615 4241608 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 45.19
Current children cumulated vsize (KiB) 1815964

[startup+12.7006 s]
/proc/loadavg: 7.02 7.03 7.27 9/180 9798
/proc/meminfo: memFree=16269476/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
[pid=9783] ppid=9782 vsize=399728 CPUtime=12.68 cores=0
/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4202496 111254 0 0 0 1253 15 0 0 25 0 1 0 511177179 409321472 89009 33554432000 4194304 4587354 140737361031136 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9783/statm: 99932 89009 330 96 0 96494 0
[pid=9784] ppid=9782 vsize=278196 CPUtime=12.69 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4202496 82786 0 0 0 1257 12 0 0 25 0 1 0 511177179 284872704 64982 33554432000 4194304 4785740 140733406298432 18446744073709551615 4553429 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9784/statm: 69549 64982 340 145 0 66594 0
[pid=9785] ppid=9782 vsize=542284 CPUtime=12.68 cores=2
/proc/9785/stat : 9785 (TNM) R 9782 9782 9584 0 -1 4202496 44513 0 0 0 1263 5 0 0 25 0 1 0 511177179 555298816 44409 33554432000 134512640 134534564 4290496304 18446744073709551615 134529352 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9785/statm: 135571 44409 95 6 0 134237 0
[pid=9786] ppid=9782 vsize=834244 CPUtime=12.68 cores=3
/proc/9786/stat : 9786 (march_hi) R 9782 9782 9584 0 -1 4202496 424516 0 0 0 1212 56 0 0 25 0 1 0 511177179 854265856 141654 33554432000 4194304 4331988 140735716630864 18446744073709551615 4263143 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9786/statm: 208561 141654 173 34 0 207003 0
[pid=9787] ppid=9782 vsize=574228 CPUtime=45.6 cores=4-7
/proc/9787/stat : 9787 (plingeling) S 9782 9782 9584 0 -1 4202496 213890 1249 0 0 4530 30 0 0 25 0 5 0 511177179 588009472 115651 33554432000 4194304 4356188 140733267472640 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/9787/statm: 143557 115651 164 40 0 142101 0
[pid=9787/tid=9794] ppid=9782 vsize=574228 CPUtime=11 cores=4-7
/proc/9787/task/9794/stat : 9794 (plingeling) R 9782 9782 9584 0 -1 4202560 28597 1249 0 0 1096 4 0 0 25 0 5 0 511177349 588009472 115651 33554432000 4194304 4356188 140733267472640 18446744073709551615 4232885 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9787/tid=9795] ppid=9782 vsize=574228 CPUtime=10.98 cores=4-7
/proc/9787/task/9795/stat : 9795 (plingeling) R 9782 9782 9584 0 -1 4202560 46812 1249 0 0 1092 6 0 0 25 0 5 0 511177349 588009472 115651 33554432000 4194304 4356188 140733267472640 18446744073709551615 4217742 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9787/tid=9796] ppid=9782 vsize=574228 CPUtime=10.98 cores=4-7
/proc/9787/task/9796/stat : 9796 (plingeling) R 9782 9782 9584 0 -1 4202560 40908 1249 0 0 1093 5 0 0 25 0 5 0 511177349 588009472 115651 33554432000 4194304 4356188 140733267472640 18446744073709551615 4233419 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9797] ppid=9782 vsize=574228 CPUtime=10.93 cores=4-7
/proc/9787/task/9797/stat : 9797 (plingeling) R 9782 9782 9584 0 -1 4202560 32122 1249 0 0 1088 5 0 0 25 0 5 0 511177349 588009472 115651 33554432000 4194304 4356188 140733267472640 18446744073709551615 4241608 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 96.33
Current children cumulated vsize (KiB) 2647004

[startup+25.5014 s]
/proc/loadavg: 7.17 7.07 7.28 9/180 9798
/proc/meminfo: memFree=16088600/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
[pid=9783] ppid=9782 vsize=399728 CPUtime=25.49 cores=0
/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4202496 111656 0 0 0 2533 16 0 0 25 0 1 0 511177179 409321472 89391 33554432000 4194304 4587354 140737361031136 18446744073709551615 4234955 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9783/statm: 99932 89391 335 96 0 96494 0
[pid=9784] ppid=9782 vsize=278196 CPUtime=25.49 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4202496 82786 0 0 0 2537 12 0 0 25 0 1 0 511177179 284872704 64982 33554432000 4194304 4785740 140733406298432 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9784/statm: 69549 64982 340 145 0 66594 0
[pid=9785] ppid=9782 vsize=542284 CPUtime=25.48 cores=2
/proc/9785/stat : 9785 (TNM) R 9782 9782 9584 0 -1 4202496 44513 0 0 0 2543 5 0 0 25 0 1 0 511177179 555298816 44409 33554432000 134512640 134534564 4290496304 18446744073709551615 134529953 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9785/statm: 135571 44409 95 6 0 134237 0
[pid=9786] ppid=9782 vsize=835452 CPUtime=25.49 cores=3

################
# More data... #
################

/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4202496 153947 0 0 0 27480 28 0 0 25 0 1 0 511177179 1442156544 108594 33554432000 4194304 4587354 140737361031136 18446744073709551615 4238608 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9783/statm: 352089 108594 336 96 0 348651 0
[pid=9784] ppid=9782 vsize=304452 CPUtime=275.09 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4202496 89330 0 0 0 27494 15 0 0 25 0 1 0 511177179 311758848 71526 33554432000 4194304 4785740 140733406298432 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9784/statm: 76113 71526 340 145 0 73158 0
[pid=9785] ppid=9782 vsize=542284 CPUtime=274.27 cores=2
/proc/9785/stat : 9785 (TNM) R 9782 9782 9584 0 -1 4202496 44513 0 0 0 27422 5 0 0 25 0 1 0 511177179 555298816 44409 33554432000 134512640 134534564 4290496304 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9785/statm: 135571 44409 95 6 0 134237 0
[pid=9786] ppid=9782 vsize=835452 CPUtime=275.09 cores=3
/proc/9786/stat : 9786 (march_hi) R 9782 9782 9584 0 -1 4202496 452989 0 0 0 27449 60 0 0 25 0 1 0 511177179 855502848 170127 33554432000 4194304 4331988 140735716630864 18446744073709551615 4229471 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9786/statm: 208863 170127 173 34 0 207305 0
[pid=9787] ppid=9782 vsize=570044 CPUtime=1093.78 cores=4-7
/proc/9787/stat : 9787 (plingeling) S 9782 9782 9584 0 -1 4202496 238501 1249 0 0 109345 33 0 0 25 0 5 0 511177179 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/9787/statm: 142511 114605 164 40 0 141055 0
[pid=9787/tid=9794] ppid=9782 vsize=570044 CPUtime=273.4 cores=4-7
/proc/9787/task/9794/stat : 9794 (plingeling) R 9782 9782 9584 0 -1 4202560 36790 1249 0 0 27335 5 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9787/tid=9795] ppid=9782 vsize=570044 CPUtime=273.38 cores=4-7
/proc/9787/task/9795/stat : 9795 (plingeling) R 9782 9782 9584 0 -1 4202560 55005 1249 0 0 27331 7 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9787/tid=9796] ppid=9782 vsize=570044 CPUtime=273.38 cores=4-7
/proc/9787/task/9796/stat : 9796 (plingeling) R 9782 9782 9584 0 -1 4202560 49133 1249 0 0 27332 6 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9797] ppid=9782 vsize=570044 CPUtime=271.9 cores=4-7
/proc/9787/task/9797/stat : 9797 (plingeling) R 9782 9782 9584 0 -1 4202560 32122 1249 0 0 27185 5 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2193.31
Current children cumulated vsize (KiB) 3678912

[startup+278.307 s]
/proc/loadavg: 8.05 7.67 7.47 9/180 9808
/proc/meminfo: memFree=15986180/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
[pid=9783] ppid=9782 vsize=1408356 CPUtime=278.29 cores=0
/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4202496 154114 0 0 0 27801 28 0 0 25 0 1 0 511177179 1442156544 108751 33554432000 4194304 4587354 140737361031136 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9783/statm: 352089 108751 336 96 0 348651 0
[pid=9784] ppid=9782 vsize=304452 CPUtime=278.29 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4202496 89330 0 0 0 27814 15 0 0 25 0 1 0 511177179 311758848 71526 33554432000 4194304 4785740 140733406298432 18446744073709551615 4552628 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9784/statm: 76113 71526 340 145 0 73158 0
[pid=9785] ppid=9782 vsize=542284 CPUtime=277.48 cores=2
/proc/9785/stat : 9785 (TNM) R 9782 9782 9584 0 -1 4202496 44513 0 0 0 27743 5 0 0 25 0 1 0 511177179 555298816 44409 33554432000 134512640 134534564 4290496304 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9785/statm: 135571 44409 95 6 0 134237 0
[pid=9786] ppid=9782 vsize=835452 CPUtime=278.3 cores=3
/proc/9786/stat : 9786 (march_hi) R 9782 9782 9584 0 -1 4202496 452989 0 0 0 27770 60 0 0 25 0 1 0 511177179 855502848 170127 33554432000 4194304 4331988 140735716630864 18446744073709551615 4299872 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9786/statm: 208863 170127 173 34 0 207305 0
[pid=9787] ppid=9782 vsize=570044 CPUtime=1106.58 cores=4-7
/proc/9787/stat : 9787 (plingeling) S 9782 9782 9584 0 -1 4202496 238501 1249 0 0 110625 33 0 0 25 0 5 0 511177179 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/9787/statm: 142511 114605 164 40 0 141055 0
[pid=9787/tid=9794] ppid=9782 vsize=570044 CPUtime=276.61 cores=4-7
/proc/9787/task/9794/stat : 9794 (plingeling) R 9782 9782 9584 0 -1 4202560 36790 1249 0 0 27656 5 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9787/tid=9795] ppid=9782 vsize=570044 CPUtime=276.58 cores=4-7
/proc/9787/task/9795/stat : 9795 (plingeling) R 9782 9782 9584 0 -1 4202560 55005 1249 0 0 27651 7 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9787/tid=9796] ppid=9782 vsize=570044 CPUtime=276.58 cores=4-7
/proc/9787/task/9796/stat : 9796 (plingeling) R 9782 9782 9584 0 -1 4202560 49133 1249 0 0 27652 6 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9797] ppid=9782 vsize=570044 CPUtime=275.09 cores=4-7
/proc/9787/task/9797/stat : 9797 (plingeling) R 9782 9782 9584 0 -1 4202560 32122 1249 0 0 27504 5 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4241608 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2218.94
Current children cumulated vsize (KiB) 3678912

[startup+279.901 s]
/proc/loadavg: 8.05 7.67 7.47 9/180 9808
/proc/meminfo: memFree=15985932/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
[pid=9783] ppid=9782 vsize=1408356 CPUtime=279.88 cores=0
/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4202496 154196 0 0 0 27960 28 0 0 25 0 1 0 511177179 1442156544 108830 33554432000 4194304 4587354 140737361031136 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9783/statm: 352089 108830 336 96 0 348651 0
[pid=9784] ppid=9782 vsize=304452 CPUtime=279.89 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4202496 89330 0 0 0 27974 15 0 0 25 0 1 0 511177179 311758848 71526 33554432000 4194304 4785740 140733406298432 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9784/statm: 76113 71526 340 145 0 73158 0
[pid=9785] ppid=9782 vsize=542284 CPUtime=279.07 cores=2
/proc/9785/stat : 9785 (TNM) R 9782 9782 9584 0 -1 4202496 44513 0 0 0 27902 5 0 0 25 0 1 0 511177179 555298816 44409 33554432000 134512640 134534564 4290496304 18446744073709551615 134528380 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9785/statm: 135571 44409 95 6 0 134237 0
[pid=9786] ppid=9782 vsize=835452 CPUtime=279.89 cores=3
/proc/9786/stat : 9786 (march_hi) R 9782 9782 9584 0 -1 4202496 452989 0 0 0 27929 60 0 0 25 0 1 0 511177179 855502848 170127 33554432000 4194304 4331988 140735716630864 18446744073709551615 4299840 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9786/statm: 208863 170127 173 34 0 207305 0
[pid=9787] ppid=9782 vsize=570044 CPUtime=1112.95 cores=4-7
/proc/9787/stat : 9787 (plingeling) S 9782 9782 9584 0 -1 4202496 238501 1249 0 0 111262 33 0 0 25 0 5 0 511177179 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/9787/statm: 142511 114605 164 40 0 141055 0
[pid=9787/tid=9794] ppid=9782 vsize=570044 CPUtime=278.2 cores=4-7
/proc/9787/task/9794/stat : 9794 (plingeling) R 9782 9782 9584 0 -1 4202560 36790 1249 0 0 27815 5 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9787/tid=9795] ppid=9782 vsize=570044 CPUtime=278.18 cores=4-7
/proc/9787/task/9795/stat : 9795 (plingeling) R 9782 9782 9584 0 -1 4202560 55005 1249 0 0 27811 7 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4279656 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9787/tid=9796] ppid=9782 vsize=570044 CPUtime=278.18 cores=4-7
/proc/9787/task/9796/stat : 9796 (plingeling) R 9782 9782 9584 0 -1 4202560 49133 1249 0 0 27812 6 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4331728 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9797] ppid=9782 vsize=570044 CPUtime=276.68 cores=4-7
/proc/9787/task/9797/stat : 9797 (plingeling) R 9782 9782 9584 0 -1 4202560 32122 1249 0 0 27663 5 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4241608 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2231.68
Current children cumulated vsize (KiB) 3678912

[startup+280.701 s]
/proc/loadavg: 8.05 7.67 7.47 9/180 9808
/proc/meminfo: memFree=15985808/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
[pid=9783] ppid=9782 vsize=1408356 CPUtime=280.68 cores=0
/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4202496 154232 0 0 0 28040 28 0 0 25 0 1 0 511177179 1442156544 108864 33554432000 4194304 4587354 140737361031136 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9783/statm: 352089 108864 336 96 0 348651 0
[pid=9784] ppid=9782 vsize=304452 CPUtime=280.69 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4202496 89330 0 0 0 28054 15 0 0 25 0 1 0 511177179 311758848 71526 33554432000 4194304 4785740 140733406298432 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9784/statm: 76113 71526 340 145 0 73158 0
[pid=9785] ppid=9782 vsize=542284 CPUtime=279.87 cores=2
/proc/9785/stat : 9785 (TNM) R 9782 9782 9584 0 -1 4202496 44513 0 0 0 27982 5 0 0 25 0 1 0 511177179 555298816 44409 33554432000 134512640 134534564 4290496304 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9785/statm: 135571 44409 95 6 0 134237 0
[pid=9786] ppid=9782 vsize=835452 CPUtime=280.69 cores=3
/proc/9786/stat : 9786 (march_hi) R 9782 9782 9584 0 -1 4202496 452989 0 0 0 28009 60 0 0 25 0 1 0 511177179 855502848 170127 33554432000 4194304 4331988 140735716630864 18446744073709551615 4229533 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9786/statm: 208863 170127 173 34 0 207305 0
[pid=9787] ppid=9782 vsize=570044 CPUtime=1116.15 cores=4-7
/proc/9787/stat : 9787 (plingeling) S 9782 9782 9584 0 -1 4202496 238501 1249 0 0 111582 33 0 0 25 0 5 0 511177179 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/9787/statm: 142511 114605 164 40 0 141055 0
[pid=9787/tid=9794] ppid=9782 vsize=570044 CPUtime=279 cores=4-7
/proc/9787/task/9794/stat : 9794 (plingeling) R 9782 9782 9584 0 -1 4202560 36790 1249 0 0 27895 5 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9787/tid=9795] ppid=9782 vsize=570044 CPUtime=278.98 cores=4-7
/proc/9787/task/9795/stat : 9795 (plingeling) R 9782 9782 9584 0 -1 4202560 55005 1249 0 0 27891 7 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9787/tid=9796] ppid=9782 vsize=570044 CPUtime=278.98 cores=4-7
/proc/9787/task/9796/stat : 9796 (plingeling) R 9782 9782 9584 0 -1 4202560 49133 1249 0 0 27892 6 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4210992 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9797] ppid=9782 vsize=570044 CPUtime=277.47 cores=4-7
/proc/9787/task/9797/stat : 9797 (plingeling) R 9782 9782 9584 0 -1 4202560 32122 1249 0 0 27742 5 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2238.08
Current children cumulated vsize (KiB) 3678912

[startup+281.1 s]
/proc/loadavg: 8.05 7.67 7.47 9/180 9808
/proc/meminfo: memFree=15985808/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=0 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 511177179 18763776 390 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4576484883081199615 0 0 17 4 0 0 0
/proc/9782/statm: 4581 390 341 23 0 91 0
[pid=9783] ppid=9782 vsize=1408356 CPUtime=281.08 cores=0
/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4202496 154250 0 0 0 28080 28 0 0 25 0 1 0 511177179 1442156544 108881 33554432000 4194304 4587354 140737361031136 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/9783/statm: 352089 108881 336 96 0 348651 0
[pid=9784] ppid=9782 vsize=304452 CPUtime=281.09 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4202496 89330 0 0 0 28094 15 0 0 25 0 1 0 511177179 311758848 71526 33554432000 4194304 4785740 140733406298432 18446744073709551615 4552993 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/9784/statm: 76113 71526 340 145 0 73158 0
[pid=9785] ppid=9782 vsize=542284 CPUtime=280.27 cores=2
/proc/9785/stat : 9785 (TNM) R 9782 9782 9584 0 -1 4202496 44513 0 0 0 28022 5 0 0 25 0 1 0 511177179 555298816 44409 33554432000 134512640 134534564 4290496304 18446744073709551615 134529374 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/9785/statm: 135571 44409 95 6 0 134237 0
[pid=9786] ppid=9782 vsize=835452 CPUtime=281.09 cores=3
/proc/9786/stat : 9786 (march_hi) R 9782 9782 9584 0 -1 4202496 452989 0 0 0 28049 60 0 0 25 0 1 0 511177179 855502848 170127 33554432000 4194304 4331988 140735716630864 18446744073709551615 4229292 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/9786/statm: 208863 170127 173 34 0 207305 0
[pid=9787] ppid=9782 vsize=570044 CPUtime=1117.75 cores=4-7
/proc/9787/stat : 9787 (plingeling) S 9782 9782 9584 0 -1 4202496 238501 1249 0 0 111742 33 0 0 25 0 5 0 511177179 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 216646318053 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/9787/statm: 142511 114605 164 40 0 141055 0
[pid=9787/tid=9794] ppid=9782 vsize=570044 CPUtime=279.4 cores=4-7
/proc/9787/task/9794/stat : 9794 (plingeling) R 9782 9782 9584 0 -1 4202560 36790 1249 0 0 27935 5 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9787/tid=9795] ppid=9782 vsize=570044 CPUtime=279.38 cores=4-7
/proc/9787/task/9795/stat : 9795 (plingeling) R 9782 9782 9584 0 -1 4202560 55005 1249 0 0 27931 7 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4274144 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=9787/tid=9796] ppid=9782 vsize=570044 CPUtime=279.38 cores=4-7
/proc/9787/task/9796/stat : 9796 (plingeling) R 9782 9782 9584 0 -1 4202560 49133 1249 0 0 27932 6 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4236874 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=9787/tid=9797] ppid=9782 vsize=570044 CPUtime=277.87 cores=4-7
/proc/9787/task/9797/stat : 9797 (plingeling) R 9782 9782 9584 0 -1 4202560 32122 1249 0 0 27782 5 0 0 25 0 5 0 511177349 583725056 114605 33554432000 4194304 4356188 140733267472640 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2241.28
Current children cumulated vsize (KiB) 3678912

[startup+281.201 s]
/proc/loadavg: 8.05 7.67 7.47 9/180 9808
/proc/meminfo: memFree=15985808/32951124 swapFree=67111528/67111528
[pid=9782] ppid=9780 vsize=18324 CPUtime=1398.36 cores=0-7
/proc/9782/stat : 9782 (ppfolio) S 9780 9782 9584 0 -1 4202496 524 284267 0 0 0 0 139794 42 15 0 1 0 511177179 18763776 391 33554432000 4194304 4287625 140736211703376 18446744073709551615 216634535439 0 0 4096 65536 4398046478596 0 0 17 4 0 0 0
/proc/9782/statm: 4581 391 342 23 0 91 0
[pid=9783] ppid=9782 vsize=0 CPUtime=281.18 cores=0
/proc/9783/stat : 9783 (cryptominisat) R 9782 9782 9584 0 -1 4203524 154255 0 0 0 28089 29 0 0 25 0 1 0 511177179 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/9783/statm: 0 0 0 0 0 0 0
[pid=9784] ppid=9782 vsize=0 CPUtime=281.18 cores=1
/proc/9784/stat : 9784 (clasp) R 9782 9782 9584 0 -1 4203524 89330 0 0 0 28102 16 0 0 25 0 1 0 511177179 0 0 33554432000 0 0 0 0 0 0 0 4096 16386 18446744073709551615 0 0 17 1 0 0 0
/proc/9784/statm: 0 0 0 0 0 0 0
[pid=9786] ppid=9782 vsize=0 CPUtime=281.2 cores=3
/proc/9786/stat : 9786 (march_hi) R 9782 9782 9584 0 -1 4203524 452989 0 0 0 28058 62 0 0 25 0 1 0 511177179 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/9786/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 2241.92
Current children cumulated vsize (KiB) 18324

Child status: 0
Real time (s): 281.22
CPU time (s): 2241.99
CPU user time (s): 2240.45
CPU system time (s): 1.54377
CPU usage (%): 797.237
Max. virtual memory (cumulated for all children) (KiB): 3864444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2240.45
system time used= 1.54377
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 981383
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 629
involuntary context switches= 10913

runsolver used 0.45493 second user time and 1.08183 second system time

The end

Launcher Data 

Begin job on node103 at 2011-04-28 15:02:26
IDJOB=3310147
IDBENCH=69591
IDSOLVER=1638
FILE ID=node103/3310147-1303995745
RUNJOBID= node103-1303994164-9598
PBS_JOBID= 13168779
Free space on /tmp= 71496 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT_RACE08/cnf/manol-pipe-c10nidw.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310147-1303995745/watcher-3310147-1303995745 -o /tmp/evaluation-result-3310147-1303995745/solver-3310147-1303995745 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310147-1303995745.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 943fd86d922b13236c21a74c4f82b6d0
RANDOM SEED=1646256390

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18021684 kB
Buffers:       2142180 kB
Cached:       12135568 kB
SwapCached:          0 kB
Active:        5504876 kB
Inactive:      8838484 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18021684 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           33788 kB
Writeback:           0 kB
AnonPages:       65936 kB
Mapped:          14700 kB
Slab:           517852 kB
PageTables:       4100 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186348 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71484 MiB
End job on node103 at 2011-04-28 15:07:07