Trace number 3276366

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.3 5003.72

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m62-q1504.5-n60-p30-s88600538.cnf
MD5SUM76c30bc0971bc865c2b988ddaca89385
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.464928
Satisfiable
(Un)Satisfiability was proved
Number of variables3651
Number of clauses926696
Sum of the clauses size1856923
Maximum clause length62
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2926636
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 560

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3276366-1304176037/watcher-3276366-1304176037 -o /tmp/evaluation-result-3276366-1304176037/solver-3276366-1304176037 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3276366-1304176037.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.11 8.06 8.00 2/170 29536
/proc/meminfo: memFree=30466956/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0

[startup+0.0850711 s]
/proc/loadavg: 8.11 8.06 8.00 2/170 29536
/proc/meminfo: memFree=30466956/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.101051 s]
/proc/loadavg: 8.11 8.06 8.00 2/170 29536
/proc/meminfo: memFree=30466956/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.30102 s]
/proc/loadavg: 8.11 8.06 8.00 2/170 29536
/proc/meminfo: memFree=30466956/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 17 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700914 s]
/proc/loadavg: 8.11 8.06 8.00 2/170 29536
/proc/meminfo: memFree=30466956/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50076 s]
/proc/loadavg: 8.11 8.06 8.00 9/180 29551
/proc/meminfo: memFree=30036980/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
[pid=29537] ppid=29536 vsize=139008 CPUtime=1.49 cores=0
/proc/29537/stat : 29537 (cryptominisat) R 29536 29536 28844 0 -1 4202496 29069 0 0 0 145 4 0 0 25 0 1 0 607834365 142344192 28955 33554432000 4194304 4587354 140734422037664 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29537/statm: 34752 28955 314 96 0 31314 0
[pid=29538] ppid=29536 vsize=68572 CPUtime=1.49 cores=1
/proc/29538/stat : 29538 (clasp) R 29536 29536 28844 0 -1 4202496 18295 0 0 0 147 2 0 0 20 0 1 0 607834365 70217728 14114 33554432000 4194304 4785740 140735064749152 18446744073709551615 4495784 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29538/statm: 17143 14114 313 145 0 14188 0
[pid=29539] ppid=29536 vsize=495424 CPUtime=1.49 cores=2
/proc/29539/stat : 29539 (TNM) R 29536 29536 28844 0 -1 4202496 14755 0 0 0 147 2 0 0 20 0 1 0 607834365 507314176 14652 33554432000 134512640 134534564 4293063184 18446744073709551615 134524681 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29539/statm: 123856 14652 91 6 0 122522 0
[pid=29540] ppid=29536 vsize=97820 CPUtime=1.48 cores=3
/proc/29540/stat : 29540 (march_hi) R 29536 29536 28844 0 -1 4202496 48327 0 0 0 143 5 0 0 25 0 1 0 607834365 100167680 13985 33554432000 4194304 4331988 140735487292384 18446744073709551615 4257032 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29540/statm: 24455 13985 149 34 0 22897 0
[pid=29541] ppid=29536 vsize=270440 CPUtime=4.15 cores=4-7
/proc/29541/stat : 29541 (plingeling) S 29536 29536 28844 0 -1 4202496 56374 1254 0 0 406 9 0 0 18 0 5 0 607834366 276930560 39652 33554432000 4194304 4356188 140737438926800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/29541/statm: 67610 39652 163 40 0 66154 0
[pid=29541/tid=29548] ppid=29536 vsize=270440 CPUtime=0.87 cores=4-7
/proc/29541/task/29548/stat : 29548 (plingeling) R 29536 29536 28844 0 -1 4202560 4902 1254 0 0 87 0 0 0 19 0 5 0 607834425 276930560 39652 33554432000 4194304 4356188 140737438926800 18446744073709551615 4270728 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29541/tid=29549] ppid=29536 vsize=270440 CPUtime=0.88 cores=4-7
/proc/29541/task/29549/stat : 29549 (plingeling) R 29536 29536 28844 0 -1 4202560 5826 1254 0 0 87 1 0 0 25 0 5 0 607834425 276930560 39652 33554432000 4194304 4356188 140737438926800 18446744073709551615 4271296 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29541/tid=29550] ppid=29536 vsize=270440 CPUtime=0.88 cores=4-7
/proc/29541/task/29550/stat : 29550 (plingeling) R 29536 29536 28844 0 -1 4202560 5605 1254 0 0 87 1 0 0 21 0 5 0 607834425 276930560 39652 33554432000 4194304 4356188 140737438926800 18446744073709551615 4270780 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29541/tid=29551] ppid=29536 vsize=270440 CPUtime=0.89 cores=4-7
/proc/29541/task/29551/stat : 29551 (plingeling) R 29536 29536 28844 0 -1 4202560 6586 1254 0 0 88 1 0 0 18 0 5 0 607834425 276930560 39652 33554432000 4194304 4356188 140737438926800 18446744073709551615 4297890 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10.1
Current children cumulated vsize (KiB) 1089588

[startup+3.10047 s]
/proc/loadavg: 8.11 8.06 8.00 9/180 29551
/proc/meminfo: memFree=30013796/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
[pid=29537] ppid=29536 vsize=152948 CPUtime=3.09 cores=0
/proc/29537/stat : 29537 (cryptominisat) R 29536 29536 28844 0 -1 4202496 36216 0 0 0 305 4 0 0 25 0 1 0 607834365 156618752 30656 33554432000 4194304 4587354 140734422037664 18446744073709551615 4365504 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29537/statm: 38237 30656 315 96 0 34799 0
[pid=29538] ppid=29536 vsize=68572 CPUtime=3.09 cores=1
/proc/29538/stat : 29538 (clasp) R 29536 29536 28844 0 -1 4202496 18295 0 0 0 307 2 0 0 25 0 1 0 607834365 70217728 14114 33554432000 4194304 4785740 140735064749152 18446744073709551615 4495597 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29538/statm: 17143 14114 313 145 0 14188 0
[pid=29539] ppid=29536 vsize=495424 CPUtime=3.08 cores=2
/proc/29539/stat : 29539 (TNM) R 29536 29536 28844 0 -1 4202496 14755 0 0 0 306 2 0 0 25 0 1 0 607834365 507314176 14652 33554432000 134512640 134534564 4293063184 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29539/statm: 123856 14652 91 6 0 122522 0
[pid=29540] ppid=29536 vsize=128032 CPUtime=3.09 cores=3
/proc/29540/stat : 29540 (march_hi) R 29536 29536 28844 0 -1 4202496 71988 0 0 0 300 9 0 0 25 0 1 0 607834365 131104768 15380 33554432000 4194304 4331988 140735487292384 18446744073709551615 4226464 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29540/statm: 32008 15380 170 34 0 30450 0
[pid=29541] ppid=29536 vsize=313064 CPUtime=10.54 cores=4-7
/proc/29541/stat : 29541 (plingeling) S 29536 29536 28844 0 -1 4202496 64983 1254 0 0 1044 10 0 0 18 0 5 0 607834366 320577536 48261 33554432000 4194304 4356188 140737438926800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/29541/statm: 78266 48261 163 40 0 76810 0
[pid=29541/tid=29548] ppid=29536 vsize=313064 CPUtime=2.47 cores=4-7
/proc/29541/task/29548/stat : 29548 (plingeling) R 29536 29536 28844 0 -1 4202560 4902 1254 0 0 247 0 0 0 22 0 5 0 607834425 320577536 48261 33554432000 4194304 4356188 140737438926800 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29541/tid=29549] ppid=29536 vsize=313064 CPUtime=2.48 cores=4-7
/proc/29541/task/29549/stat : 29549 (plingeling) R 29536 29536 28844 0 -1 4202560 5826 1254 0 0 247 1 0 0 25 0 5 0 607834425 320577536 48261 33554432000 4194304 4356188 140737438926800 18446744073709551615 4248496 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29541/tid=29550] ppid=29536 vsize=313064 CPUtime=2.48 cores=4-7
/proc/29541/task/29550/stat : 29550 (plingeling) R 29536 29536 28844 0 -1 4202560 6533 1254 0 0 247 1 0 0 25 0 5 0 607834425 320577536 48261 33554432000 4194304 4356188 140737438926800 18446744073709551615 4210575 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29541/tid=29551] ppid=29536 vsize=313064 CPUtime=2.49 cores=4-7
/proc/29541/task/29551/stat : 29551 (plingeling) R 29536 29536 28844 0 -1 4202560 14267 1254 0 0 247 2 0 0 22 0 5 0 607834425 320577536 48261 33554432000 4194304 4356188 140737438926800 18446744073709551615 4332003 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 22.89
Current children cumulated vsize (KiB) 1176364

[startup+6.30088 s]
/proc/loadavg: 8.10 8.06 8.00 9/180 29551
/proc/meminfo: memFree=29964688/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
[pid=29537] ppid=29536 vsize=198028 CPUtime=6.29 cores=0
/proc/29537/stat : 29537 (cryptominisat) R 29536 29536 28844 0 -1 4202496 53895 0 0 0 622 7 0 0 25 0 1 0 607834365 202780672 34909 33554432000 4194304 4587354 140734422037664 18446744073709551615 4238766 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29537/statm: 49507 34909 326 96 0 46069 0
[pid=29538] ppid=29536 vsize=70028 CPUtime=6.29 cores=1
/proc/29538/stat : 29538 (clasp) R 29536 29536 28844 0 -1 4202496 18655 0 0 0 627 2 0 0 25 0 1 0 607834365 71708672 14474 33554432000 4194304 4785740 140735064749152 18446744073709551615 4482881 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29538/statm: 17507 14474 316 145 0 14552 0
[pid=29539] ppid=29536 vsize=495424 CPUtime=6.28 cores=2
/proc/29539/stat : 29539 (TNM) R 29536 29536 28844 0 -1 4202496 14755 0 0 0 626 2 0 0 25 0 1 0 607834365 507314176 14652 33554432000 134512640 134534564 4293063184 18446744073709551615 134524500 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29539/statm: 123856 14652 91 6 0 122522 0
[pid=29540] ppid=29536 vsize=128164 CPUtime=6.29 cores=3
/proc/29540/stat : 29540 (march_hi) R 29536 29536 28844 0 -1 4202496 72007 0 0 0 620 9 0 0 25 0 1 0 607834365 131239936 15399 33554432000 4194304 4331988 140735487292384 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29540/statm: 32041 15399 171 34 0 30483 0
[pid=29541] ppid=29536 vsize=331496 CPUtime=23.32 cores=4-7
/proc/29541/stat : 29541 (plingeling) S 29536 29536 28844 0 -1 4202496 71127 1254 0 0 2322 10 0 0 18 0 5 0 607834366 339451904 54405 33554432000 4194304 4356188 140737438926800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/29541/statm: 82874 54405 163 40 0 81418 0
[pid=29541/tid=29548] ppid=29536 vsize=331496 CPUtime=5.65 cores=4-7
/proc/29541/task/29548/stat : 29548 (plingeling) R 29536 29536 28844 0 -1 4202560 5414 1254 0 0 565 0 0 0 25 0 5 0 607834425 339451904 54405 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29541/tid=29549] ppid=29536 vsize=331496 CPUtime=5.68 cores=4-7
/proc/29541/task/29549/stat : 29549 (plingeling) R 29536 29536 28844 0 -1 4202560 6338 1254 0 0 567 1 0 0 25 0 5 0 607834425 339451904 54405 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29541/tid=29550] ppid=29536 vsize=331496 CPUtime=5.69 cores=4-7
/proc/29541/task/29550/stat : 29550 (plingeling) R 29536 29536 28844 0 -1 4202560 10629 1254 0 0 567 2 0 0 25 0 5 0 607834425 339451904 54405 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29541/tid=29551] ppid=29536 vsize=331496 CPUtime=5.69 cores=4-7
/proc/29541/task/29551/stat : 29551 (plingeling) R 29536 29536 28844 0 -1 4202560 15291 1254 0 0 567 2 0 0 25 0 5 0 607834425 339451904 54405 33554432000 4194304 4356188 140737438926800 18446744073709551615 4219670 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 48.47
Current children cumulated vsize (KiB) 1241464

[startup+12.7007 s]
/proc/loadavg: 8.09 8.06 8.00 9/180 29551
/proc/meminfo: memFree=29905412/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
[pid=29537] ppid=29536 vsize=1491288 CPUtime=12.69 cores=0
/proc/29537/stat : 29537 (cryptominisat) R 29536 29536 28844 0 -1 4202496 57711 0 0 0 1261 8 0 0 25 0 1 0 607834365 1527078912 35148 33554432000 4194304 4587354 140734422037664 18446744073709551615 4365288 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29537/statm: 372822 35148 337 96 0 369384 0
[pid=29538] ppid=29536 vsize=66976 CPUtime=12.68 cores=1
/proc/29538/stat : 29538 (clasp) R 29536 29536 28844 0 -1 4202496 19960 0 0 0 1266 2 0 0 25 0 1 0 607834365 68583424 13969 33554432000 4194304 4785740 140735064749152 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29538/statm: 16744 13969 340 145 0 13789 0
[pid=29539] ppid=29536 vsize=502684 CPUtime=12.68 cores=2
/proc/29539/stat : 29539 (TNM) R 29536 29536 28844 0 -1 4202496 21418 0 0 0 1265 3 0 0 25 0 1 0 607834365 514748416 21315 33554432000 134512640 134534564 4293063184 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29539/statm: 125671 21315 95 6 0 124337 0
[pid=29540] ppid=29536 vsize=128264 CPUtime=12.69 cores=3
/proc/29540/stat : 29540 (march_hi) R 29536 29536 28844 0 -1 4202496 72058 0 0 0 1260 9 0 0 25 0 1 0 607834365 131342336 15450 33554432000 4194304 4331988 140735487292384 18446744073709551615 4226479 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29540/statm: 32066 15450 171 34 0 30508 0
[pid=29541] ppid=29536 vsize=369384 CPUtime=48.88 cores=4-7
/proc/29541/stat : 29541 (plingeling) S 29536 29536 28844 0 -1 4202496 79063 1254 0 0 4877 11 0 0 18 0 5 0 607834366 378249216 62341 33554432000 4194304 4356188 140737438926800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/29541/statm: 92346 62341 163 40 0 90890 0
[pid=29541/tid=29548] ppid=29536 vsize=369384 CPUtime=12.01 cores=4-7
/proc/29541/task/29548/stat : 29548 (plingeling) R 29536 29536 28844 0 -1 4202560 5414 1254 0 0 1201 0 0 0 25 0 5 0 607834425 378249216 62341 33554432000 4194304 4356188 140737438926800 18446744073709551615 4287168 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29541/tid=29549] ppid=29536 vsize=369384 CPUtime=12.08 cores=4-7
/proc/29541/task/29549/stat : 29549 (plingeling) R 29536 29536 28844 0 -1 4202560 9923 1254 0 0 1207 1 0 0 25 0 5 0 607834425 378249216 62341 33554432000 4194304 4356188 140737438926800 18446744073709551615 4211772 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29541/tid=29550] ppid=29536 vsize=369384 CPUtime=12.09 cores=4-7
/proc/29541/task/29550/stat : 29550 (plingeling) R 29536 29536 28844 0 -1 4202560 11396 1254 0 0 1207 2 0 0 25 0 5 0 607834425 378249216 62341 33554432000 4194304 4356188 140737438926800 18446744073709551615 4322024 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29541/tid=29551] ppid=29536 vsize=369384 CPUtime=12.08 cores=4-7
/proc/29541/task/29551/stat : 29551 (plingeling) R 29536 29536 28844 0 -1 4202560 18875 1254 0 0 1206 2 0 0 25 0 5 0 607834425 378249216 62341 33554432000 4194304 4356188 140737438926800 18446744073709551615 4244632 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 99.62
Current children cumulated vsize (KiB) 2576920

[startup+25.5013 s]
/proc/loadavg: 8.07 8.06 8.00 9/180 29551
/proc/meminfo: memFree=29784848/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
[pid=29537] ppid=29536 vsize=1491288 CPUtime=25.49 cores=0
/proc/29537/stat : 29537 (cryptominisat) R 29536 29536 28844 0 -1 4202496 57711 0 0 0 2541 8 0 0 25 0 1 0 607834365 1527078912 35148 33554432000 4194304 4587354 140734422037664 18446744073709551615 4365232 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=29539] ppid=29536 vsize=502684 CPUtime=4841.78 cores=2
/proc/29539/stat : 29539 (TNM) R 29536 29536 28844 0 -1 4202496 21418 0 0 0 484173 5 0 0 25 0 1 0 607834365 514748416 21315 33554432000 134512640 134534564 4293063184 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29539/statm: 125671 21315 95 6 0 124337 0
[pid=29540] ppid=29536 vsize=432984 CPUtime=4842.44 cores=3
/proc/29540/stat : 29540 (march_hi) R 29536 29536 28844 0 -1 4202496 142641 0 0 0 484187 57 0 0 25 0 1 0 607834365 443375616 86033 33554432000 4194304 4331988 140735487292384 18446744073709551615 4228243 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29540/statm: 108246 86033 175 34 0 106688 0
[pid=29541] ppid=29536 vsize=1147412 CPUtime=19340.9 cores=4-7
/proc/29541/stat : 29541 (plingeling) S 29536 29536 28844 0 -1 4202496 2614307 1254 0 0 1933750 344 0 0 18 0 5 0 607834366 1174949888 258895 33554432000 4194304 4356188 140737438926800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/29541/statm: 286853 258895 163 40 0 285397 0
[pid=29541/tid=29548] ppid=29536 vsize=1147412 CPUtime=4815.42 cores=4-7
/proc/29541/task/29548/stat : 29548 (plingeling) R 29536 29536 28844 0 -1 4202560 834345 1254 0 0 481426 116 0 0 25 0 5 0 607834425 1174949888 258895 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29541/tid=29549] ppid=29536 vsize=1147412 CPUtime=4841.21 cores=4-7
/proc/29541/task/29549/stat : 29549 (plingeling) R 29536 29536 28844 0 -1 4202560 214820 1254 0 0 484089 32 0 0 25 0 5 0 607834425 1174949888 258895 33554432000 4194304 4356188 140737438926800 18446744073709551615 4330827 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29541/tid=29550] ppid=29536 vsize=1147412 CPUtime=4841.84 cores=4-7
/proc/29541/task/29550/stat : 29550 (plingeling) R 29536 29536 28844 0 -1 4202560 178506 1254 0 0 484159 25 0 0 25 0 5 0 607834425 1174949888 258895 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29541/tid=29551] ppid=29536 vsize=1147412 CPUtime=4841.84 cores=4-7
/proc/29541/task/29551/stat : 29551 (plingeling) R 29536 29536 28844 0 -1 4202560 1353181 1254 0 0 484019 165 0 0 25 0 5 0 607834425 1174949888 258895 33554432000 4194304 4356188 140737438926800 18446744073709551615 4298667 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38709.9
Current children cumulated vsize (KiB) 5804336

[startup+4902.3 s]
/proc/loadavg: 8.01 8.04 8.00 9/180 29693
/proc/meminfo: memFree=26743404/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
[pid=29537] ppid=29536 vsize=2003208 CPUtime=4902.44 cores=0
/proc/29537/stat : 29537 (cryptominisat) R 29536 29536 28844 0 -1 4202496 1596736 0 0 0 489579 665 0 0 25 0 1 0 607834365 2051284992 162845 33554432000 4194304 4587354 140734422037664 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29537/statm: 500802 162845 337 96 0 497364 0
[pid=29538] ppid=29536 vsize=1676936 CPUtime=4902.28 cores=1
/proc/29538/stat : 29538 (clasp) R 29536 29536 28844 0 -1 4202496 406072 0 0 0 490095 133 0 0 25 0 1 0 607834365 1717182464 400081 33554432000 4194304 4785740 140735064749152 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29538/statm: 419234 400081 340 145 0 416279 0
[pid=29539] ppid=29536 vsize=502684 CPUtime=4901.78 cores=2
/proc/29539/stat : 29539 (TNM) R 29536 29536 28844 0 -1 4202496 21418 0 0 0 490173 5 0 0 25 0 1 0 607834365 514748416 21315 33554432000 134512640 134534564 4293063184 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29539/statm: 125671 21315 95 6 0 124337 0
[pid=29540] ppid=29536 vsize=432984 CPUtime=4902.44 cores=3
/proc/29540/stat : 29540 (march_hi) R 29536 29536 28844 0 -1 4202496 143500 0 0 0 490187 57 0 0 25 0 1 0 607834365 443375616 86892 33554432000 4194304 4331988 140735487292384 18446744073709551615 4284609 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29540/statm: 108246 86892 175 34 0 106688 0
[pid=29541] ppid=29536 vsize=1147412 CPUtime=19580.6 cores=4-7
/proc/29541/stat : 29541 (plingeling) S 29536 29536 28844 0 -1 4202496 2667555 1254 0 0 1957711 350 0 0 18 0 5 0 607834366 1174949888 258895 33554432000 4194304 4356188 140737438926800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/29541/statm: 286853 258895 163 40 0 285397 0
[pid=29541/tid=29548] ppid=29536 vsize=1147412 CPUtime=4875.1 cores=4-7
/proc/29541/task/29548/stat : 29548 (plingeling) R 29536 29536 28844 0 -1 4202560 848681 1254 0 0 487392 118 0 0 25 0 5 0 607834425 1174949888 258895 33554432000 4194304 4356188 140737438926800 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29541/tid=29549] ppid=29536 vsize=1147412 CPUtime=4901.21 cores=4-7
/proc/29541/task/29549/stat : 29549 (plingeling) R 29536 29536 28844 0 -1 4202560 216868 1254 0 0 490089 32 0 0 25 0 5 0 607834425 1174949888 258895 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29541/tid=29550] ppid=29536 vsize=1147412 CPUtime=4901.83 cores=4-7
/proc/29541/task/29550/stat : 29550 (plingeling) R 29536 29536 28844 0 -1 4202560 186698 1254 0 0 490158 25 0 0 25 0 5 0 607834425 1174949888 258895 33554432000 4194304 4356188 140737438926800 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29541/tid=29551] ppid=29536 vsize=1147412 CPUtime=4901.83 cores=4-7
/proc/29541/task/29551/stat : 29551 (plingeling) R 29536 29536 28844 0 -1 4202560 1381853 1254 0 0 490015 168 0 0 25 0 5 0 607834425 1174949888 258895 33554432000 4194304 4356188 140737438926800 18446744073709551615 4210581 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39189.6
Current children cumulated vsize (KiB) 5781548

[startup+4962.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 29695
/proc/meminfo: memFree=26606284/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
[pid=29537] ppid=29536 vsize=1918188 CPUtime=4962.45 cores=0
/proc/29537/stat : 29537 (cryptominisat) R 29536 29536 28844 0 -1 4202496 1615946 0 0 0 495569 676 0 0 25 0 1 0 607834365 1964224512 168663 33554432000 4194304 4587354 140734422037664 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29537/statm: 479547 168663 337 96 0 476109 0
[pid=29538] ppid=29536 vsize=1682336 CPUtime=4962.28 cores=1
/proc/29538/stat : 29538 (clasp) R 29536 29536 28844 0 -1 4202496 407222 0 0 0 496094 134 0 0 25 0 1 0 607834365 1722712064 401231 33554432000 4194304 4785740 140735064749152 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29538/statm: 420584 401231 340 145 0 417629 0
[pid=29539] ppid=29536 vsize=502684 CPUtime=4961.79 cores=2
/proc/29539/stat : 29539 (TNM) R 29536 29536 28844 0 -1 4202496 21418 0 0 0 496174 5 0 0 25 0 1 0 607834365 514748416 21315 33554432000 134512640 134534564 4293063184 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29539/statm: 125671 21315 95 6 0 124337 0
[pid=29540] ppid=29536 vsize=432984 CPUtime=4962.44 cores=3
/proc/29540/stat : 29540 (march_hi) R 29536 29536 28844 0 -1 4202496 144347 0 0 0 496186 58 0 0 25 0 1 0 607834365 443375616 87739 33554432000 4194304 4331988 140735487292384 18446744073709551615 4265493 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29540/statm: 108246 87739 175 34 0 106688 0
[pid=29541] ppid=29536 vsize=1253908 CPUtime=19820.3 cores=4-7
/proc/29541/stat : 29541 (plingeling) S 29536 29536 28844 0 -1 4202496 2726947 1254 0 0 1981672 357 0 0 18 0 5 0 607834366 1284001792 285519 33554432000 4194304 4356188 140737438926800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/29541/statm: 313477 285519 163 40 0 312021 0
[pid=29541/tid=29548] ppid=29536 vsize=1253908 CPUtime=4934.78 cores=4-7
/proc/29541/task/29548/stat : 29548 (plingeling) R 29536 29536 28844 0 -1 4202560 881449 1254 0 0 493356 122 0 0 25 0 5 0 607834425 1284001792 285519 33554432000 4194304 4356188 140737438926800 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29541/tid=29549] ppid=29536 vsize=1253908 CPUtime=4961.21 cores=4-7
/proc/29541/task/29549/stat : 29549 (plingeling) R 29536 29536 28844 0 -1 4202560 227108 1254 0 0 496087 34 0 0 25 0 5 0 607834425 1284001792 285519 33554432000 4194304 4356188 140737438926800 18446744073709551615 4281795 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29541/tid=29550] ppid=29536 vsize=1253908 CPUtime=4961.83 cores=4-7
/proc/29541/task/29550/stat : 29550 (plingeling) R 29536 29536 28844 0 -1 4202560 186698 1254 0 0 496158 25 0 0 25 0 5 0 607834425 1284001792 285519 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29541/tid=29551] ppid=29536 vsize=1253908 CPUtime=4961.83 cores=4-7
/proc/29541/task/29551/stat : 29551 (plingeling) R 29536 29536 28844 0 -1 4202560 1398237 1254 0 0 496014 169 0 0 25 0 5 0 607834425 1284001792 285519 33554432000 4194304 4356188 140737438926800 18446744073709551615 4210587 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39669.3
Current children cumulated vsize (KiB) 5808424



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.7 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 29696
/proc/meminfo: memFree=26743016/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
[pid=29537] ppid=29536 vsize=2008392 CPUtime=5003.85 cores=0
/proc/29537/stat : 29537 (cryptominisat) R 29536 29536 28844 0 -1 4202496 1627055 0 0 0 499704 681 0 0 25 0 1 0 607834365 2056593408 164911 33554432000 4194304 4587354 140734422037664 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29537/statm: 502098 164911 337 96 0 498660 0
[pid=29538] ppid=29536 vsize=1697748 CPUtime=5003.69 cores=1
/proc/29538/stat : 29538 (clasp) R 29536 29536 28844 0 -1 4202496 410866 0 0 0 500233 136 0 0 25 0 1 0 607834365 1738493952 404875 33554432000 4194304 4785740 140735064749152 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29538/statm: 424437 404875 340 145 0 421482 0
[pid=29539] ppid=29536 vsize=502684 CPUtime=5003.19 cores=2
/proc/29539/stat : 29539 (TNM) R 29536 29536 28844 0 -1 4202496 21418 0 0 0 500314 5 0 0 25 0 1 0 607834365 514748416 21315 33554432000 134512640 134534564 4293063184 18446744073709551615 134528737 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29539/statm: 125671 21315 95 6 0 124337 0
[pid=29540] ppid=29536 vsize=432984 CPUtime=5003.85 cores=3
/proc/29540/stat : 29540 (march_hi) R 29536 29536 28844 0 -1 4202496 144925 0 0 0 500326 59 0 0 25 0 1 0 607834365 443375616 88317 33554432000 4194304 4331988 140735487292384 18446744073709551615 4287242 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29540/statm: 108246 88317 175 34 0 106688 0
[pid=29541] ppid=29536 vsize=1114644 CPUtime=19985.7 cores=4-7
/proc/29541/stat : 29541 (plingeling) S 29536 29536 28844 0 -1 4202496 2745379 1254 0 0 1998209 359 0 0 18 0 5 0 607834366 1141395456 250703 33554432000 4194304 4356188 140737438926800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/29541/statm: 278661 250703 163 40 0 277205 0
[pid=29541/tid=29548] ppid=29536 vsize=1114644 CPUtime=4975.95 cores=4-7
/proc/29541/task/29548/stat : 29548 (plingeling) R 29536 29536 28844 0 -1 4202560 889641 1254 0 0 497472 123 0 0 25 0 5 0 607834425 1141395456 250703 33554432000 4194304 4356188 140737438926800 18446744073709551615 4279375 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29541/tid=29549] ppid=29536 vsize=1114644 CPUtime=5002.61 cores=4-7
/proc/29541/task/29549/stat : 29549 (plingeling) R 29536 29536 28844 0 -1 4202560 229156 1254 0 0 500227 34 0 0 25 0 5 0 607834425 1141395456 250703 33554432000 4194304 4356188 140737438926800 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29541/tid=29550] ppid=29536 vsize=1114644 CPUtime=5003.24 cores=4-7
/proc/29541/task/29550/stat : 29550 (plingeling) R 29536 29536 28844 0 -1 4202560 186698 1254 0 0 500299 25 0 0 25 0 5 0 607834425 1141395456 250703 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29541/tid=29551] ppid=29536 vsize=1114644 CPUtime=5003.24 cores=4-7
/proc/29541/task/29551/stat : 29551 (plingeling) R 29536 29536 28844 0 -1 4202560 1406429 1254 0 0 500154 170 0 0 25 0 5 0 607834425 1141395456 250703 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 5774776

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.7 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 29696
/proc/meminfo: memFree=26743016/32951124 swapFree=67111464/67111528
[pid=29536] ppid=29534 vsize=18324 CPUtime=0 cores=0-7
/proc/29536/stat : 29536 (ppfolio) S 29534 29536 28844 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607834365 18763776 390 33554432000 4194304 4287625 140734457689936 18446744073709551615 260020416015 0 0 4096 65536 674932605665148927 0 0 17 6 0 0 0
/proc/29536/statm: 4581 390 341 23 0 91 0
[pid=29537] ppid=29536 vsize=2008392 CPUtime=5003.85 cores=0
/proc/29537/stat : 29537 (cryptominisat) R 29536 29536 28844 0 -1 4202496 1627055 0 0 0 499704 681 0 0 25 0 1 0 607834365 2056593408 164911 33554432000 4194304 4587354 140734422037664 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29537/statm: 502098 164911 337 96 0 498660 0
[pid=29538] ppid=29536 vsize=1697748 CPUtime=5003.69 cores=1
/proc/29538/stat : 29538 (clasp) R 29536 29536 28844 0 -1 4202496 410866 0 0 0 500233 136 0 0 25 0 1 0 607834365 1738493952 404875 33554432000 4194304 4785740 140735064749152 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29538/statm: 424437 404875 340 145 0 421482 0
[pid=29539] ppid=29536 vsize=502684 CPUtime=5003.19 cores=2
/proc/29539/stat : 29539 (TNM) R 29536 29536 28844 0 -1 4202496 21418 0 0 0 500314 5 0 0 25 0 1 0 607834365 514748416 21315 33554432000 134512640 134534564 4293063184 18446744073709551615 134528737 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29539/statm: 125671 21315 95 6 0 124337 0
[pid=29540] ppid=29536 vsize=432984 CPUtime=5003.85 cores=3
/proc/29540/stat : 29540 (march_hi) R 29536 29536 28844 0 -1 4202496 144925 0 0 0 500326 59 0 0 25 0 1 0 607834365 443375616 88317 33554432000 4194304 4331988 140735487292384 18446744073709551615 4287242 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29540/statm: 108246 88317 175 34 0 106688 0
[pid=29541] ppid=29536 vsize=1114644 CPUtime=19985.7 cores=4-7
/proc/29541/stat : 29541 (plingeling) S 29536 29536 28844 0 -1 4202496 2745379 1254 0 0 1998209 359 0 0 18 0 5 0 607834366 1141395456 250703 33554432000 4194304 4356188 140737438926800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/29541/statm: 278661 250703 163 40 0 277205 0
[pid=29541/tid=29548] ppid=29536 vsize=1114644 CPUtime=4975.95 cores=4-7
/proc/29541/task/29548/stat : 29548 (plingeling) R 29536 29536 28844 0 -1 4202560 889641 1254 0 0 497472 123 0 0 25 0 5 0 607834425 1141395456 250703 33554432000 4194304 4356188 140737438926800 18446744073709551615 4279375 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29541/tid=29549] ppid=29536 vsize=1114644 CPUtime=5002.61 cores=4-7
/proc/29541/task/29549/stat : 29549 (plingeling) R 29536 29536 28844 0 -1 4202560 229156 1254 0 0 500227 34 0 0 25 0 5 0 607834425 1141395456 250703 33554432000 4194304 4356188 140737438926800 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29541/tid=29550] ppid=29536 vsize=1114644 CPUtime=5003.24 cores=4-7
/proc/29541/task/29550/stat : 29550 (plingeling) R 29536 29536 28844 0 -1 4202560 186698 1254 0 0 500299 25 0 0 25 0 5 0 607834425 1141395456 250703 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29541/tid=29551] ppid=29536 vsize=1114644 CPUtime=5003.24 cores=4-7
/proc/29541/task/29551/stat : 29551 (plingeling) R 29536 29536 28844 0 -1 4202560 1406429 1254 0 0 500154 170 0 0 25 0 5 0 607834425 1141395456 250703 33554432000 4194304 4356188 140737438926800 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 5774776

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29536 and gives
#  childrusage.ru_utime.tv_sec=5003
#  childrusage.ru_utime.tv_usec=150405
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=62990
# CPU time returned by wait4() is 5003.21
# while last known CPU time is 40000.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.72
CPU time (s): 40000.3
CPU user time (s): 39987.9
CPU system time (s): 12.4
CPU usage (%): 799.411
Max. virtual memory (cumulated for all children) (KiB): 7255380

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5003.15
system time used= 0.06299
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21942
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 391
involuntary context switches= 8091

runsolver used 8.00378 second user time and 19.2991 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-30 17:07:18
IDJOB=3276366
IDBENCH=88219
IDSOLVER=1638
FILE ID=node110/3276366-1304176037
RUNJOBID= node110-1304161023-28858
PBS_JOBID= 13170927
Free space on /tmp= 73464 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m62-q1504.5-n60-p30-s88600538.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3276366-1304176037/watcher-3276366-1304176037 -o /tmp/evaluation-result-3276366-1304176037/solver-3276366-1304176037 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3276366-1304176037.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 76c30bc0971bc865c2b988ddaca89385
RANDOM SEED=105412941

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30467236 kB
Buffers:       1000052 kB
Cached:        1004444 kB
SwapCached:         64 kB
Active:         304456 kB
Inactive:      1764060 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30467236 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:           22136 kB
Writeback:           0 kB
AnonPages:       64152 kB
Mapped:          14704 kB
Slab:           349124 kB
PageTables:       4656 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185000 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73452 MiB
End job on node110 at 2011-04-30 18:30:44