Trace number 3317883

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4800.19 1218.17

General information on the benchmark

NameAPPLICATIONS/bitverif/countbitswegner/
countbitswegner128.cnf
MD5SUM4b75ef7fb46928f50793af1d74c176e2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4342.44
Satisfiable
(Un)Satisfiability was proved
Number of variables98048
Number of clauses293759
Sum of the clauses size685435
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2195838
Number of clauses of size 397919
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.35/0.67	c INFO: solving HOME/instance-3317883-1304267441.cnf
0.35/0.67	c INFO: computing task features
1.22/1.51	c INFO: computed variable-clause graph statistics
1.22/1.54	c INFO: computed clause balance statistics
5.52/5.88	c INFO: computed variable balance statistics
8.72/9.09	c INFO: computed small-clause counts
8.82/9.13	c INFO: computed Horn-clause counts
20.02/20.35	c INFO: computed variable graph statistics
20.02/20.35	c INFO: collected features for HOME/instance-3317883-1304267441.cnf in 19.66 s
20.02/20.38	c INFO: running SApperloT@0 for 97 with 4780 remaining (b = 0.27)
20.13/20.40	c INFO: running lingeling-276@0 for 97 with 4780 remaining (b = 0.20)
20.13/20.42	c INFO: running lingeling-276@0 for 1164 with 4780 remaining (b = 0.48)
20.13/20.45	c INFO: running cryptominisat-2.9.0@0 for 485 with 4780 remaining (b = 0.33)
415.88/119.56	c INFO: running lingeling-276@0 for 776 with 4681 remaining (b = 0.32)
419.87/120.53	c INFO: running precosat-570@0 for 388 with 4680 remaining (b = 0.31)
1977.42/510.58	c INFO: running lingeling-276@0 for 97 with 4290 remaining (b = 0.12)
1991.38/514.03	c INFO: running cryptominisat-2.9.0@99 for 388 with 4286 remaining (b = 0.21)
2377.54/610.73	c INFO: running lingeling-276@391 for 97 with 4189 remaining (b = 0.04)
2757.37/705.87	c INFO: running cryptominisat-2.9.0@0 for 1940 with 4094 remaining (b = 0.55)
3531.13/899.62	c INFO: running lingeling-276@0 for 97 with 3901 remaining (b = 0.08)
3550.63/904.50	c INFO: running cryptominisat-2.9.0@198 for 291 with 3896 remaining (b = 0.15)
3926.01/998.78	c INFO: running lingeling-276@779 for 97 with 3801 remaining (b = 0.04)
4329.23/1099.93	c INFO: running precosat-570@489 for 194 with 3700 remaining (b = 0.11)
4687.42/1189.84	c INFO: running precosat-570@0 for 194 with 3610 remaining (b = 0.14)
4713.33/1196.38	c INFO: running cryptominisat-2.9.0@297 for 194 with 3604 remaining (b = 0.13)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317883-1304267441/watcher-3317883-1304267441 -o /tmp/evaluation-result-3317883-1304267441/solver-3317883-1304267441 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317883-1304267441.cnf -seed 867666104 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.51 1.90 0.68 6/189 25486
/proc/meminfo: memFree=20662452/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/25486/stat : 25486 (python) S 25484 25486 25339 0 -1 4202496 733 0 0 0 0 0 0 0 25 0 1 0 538343852 15548416 622 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/25486/statm: 3796 622 322 364 0 283 0

[startup+0.0357351 s]
/proc/loadavg: 5.51 1.90 0.68 6/189 25486
/proc/meminfo: memFree=20662452/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=16812 CPUtime=0.01 cores=1,3,5,7
/proc/25486/stat : 25486 (python) S 25484 25486 25339 0 -1 4202496 1228 0 0 0 1 0 0 0 25 0 1 0 538343852 17215488 1086 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/25486/statm: 4203 1086 417 364 0 690 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16812

[startup+0.100751 s]
/proc/loadavg: 5.51 1.90 0.68 6/189 25486
/proc/meminfo: memFree=20662452/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=87708 CPUtime=0.06 cores=1,3,5,7
/proc/25486/stat : 25486 (python) R 25484 25486 25339 0 -1 4202496 2638 0 0 0 4 2 0 0 17 0 1 0 538343852 89812992 2355 33554432000 4194304 5683644 140733809416048 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/25486/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87708

[startup+0.300684 s]
/proc/loadavg: 5.51 1.90 0.68 6/189 25486
/proc/meminfo: memFree=20662452/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=135748 CPUtime=0.19 cores=1,3,5,7
/proc/25486/stat : 25486 (python) S 25484 25486 25339 0 -1 4202496 5960 932 1 0 13 6 0 0 17 0 1 0 538343852 139005952 4150 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278875653 0 2147483391 16781312 2 18446744071699199166 0 0 17 3 0 0 0
/proc/25486/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700581 s]
/proc/loadavg: 5.51 1.90 0.68 6/189 25486
/proc/meminfo: memFree=20662452/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=284820 CPUtime=0.42 cores=1,3,5,7
/proc/25486/stat : 25486 (python) R 25484 25486 25339 0 -1 4202496 10837 932 1 0 31 11 0 0 15 0 1 0 538343852 291655680 8519 33554432000 4194304 5683644 140733809416048 18446744073709551615 4603041 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25486/statm: 71205 8519 1761 364 0 7129 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 284820

[startup+1.50042 s]
/proc/loadavg: 5.51 1.90 0.68 6/190 25491
/proc/meminfo: memFree=20612844/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=337960 CPUtime=1.22 cores=1,3,5,7
/proc/25486/stat : 25486 (python) R 25484 25486 25339 0 -1 4202496 30751 932 1 0 109 13 0 0 16 0 1 0 538343852 346071040 21864 33554432000 4194304 5683644 140733809416048 18446744073709551615 47502568425037 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25486/statm: 84490 21864 1815 364 0 20414 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 337960

[startup+3.10013 s]
/proc/loadavg: 5.54 1.96 0.71 7/190 25492
/proc/meminfo: memFree=20577504/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=337960 CPUtime=2.82 cores=1,3,5,7
/proc/25486/stat : 25486 (python) R 25484 25486 25339 0 -1 4202496 30763 932 1 0 269 13 0 0 18 0 1 0 538343852 346071040 21875 33554432000 4194304 5683644 140733809416048 18446744073709551615 5003956 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25486/statm: 84490 21875 1826 364 0 20414 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 337960

[startup+6.30056 s]
/proc/loadavg: 5.54 1.96 0.71 6/190 25492
/proc/meminfo: memFree=20581896/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=337960 CPUtime=6.02 cores=1,3,5,7
/proc/25486/stat : 25486 (python) R 25484 25486 25339 0 -1 4202496 30764 932 1 0 589 13 0 0 25 0 1 0 538343852 346071040 21876 33554432000 4194304 5683644 140733809416048 18446744073709551615 47502570775214 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25486/statm: 84490 21876 1827 364 0 20414 0
Current children cumulated CPU time (s) 6.02
Current children cumulated vsize (KiB) 337960

[startup+12.7004 s]
/proc/loadavg: 5.46 2.06 0.75 6/190 25492
/proc/meminfo: memFree=20577028/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=337960 CPUtime=12.42 cores=1,3,5,7
/proc/25486/stat : 25486 (python) R 25484 25486 25339 0 -1 4202496 30770 932 1 0 1229 13 0 0 25 0 1 0 538343852 346071040 21882 33554432000 4194304 5683644 140733809416048 18446744073709551615 47502568011916 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25486/statm: 84490 21882 1833 364 0 20414 0
Current children cumulated CPU time (s) 12.42
Current children cumulated vsize (KiB) 337960

[startup+25.5011 s]
/proc/loadavg: 5.63 2.21 0.81 9/202 25504
/proc/meminfo: memFree=20244496/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=374496 CPUtime=20.18 cores=1,3,5,7
/proc/25486/stat : 25486 (python) S 25484 25486 25339 0 -1 4202496 33419 932 1 0 2003 15 0 0 25 0 5 0 538343852 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/25486/statm: 93624 20821 1881 364 0 29533 0
[pid=25493] ppid=25486 vsize=333484 CPUtime=0 cores=1,3,5,7
/proc/25493/stat : 25493 (python) S 25486 25486 25339 0 -1 4202560 975 0 0 0 0 0 0 0 18 0 1 0 538345890 341487616 19305 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899727 0 0 16781312 514 4419341306849886472 0 0 17 5 0 0 0
/proc/25493/statm: 83371 19305 381 364 0 19289 0
[pid=25495] ppid=25493 vsize=21704 CPUtime=5.07 cores=1,3,5,7
/proc/25495/stat : 25495 (SApperloT-base) R 25493 25495 25495 0 -1 4202496 6124 0 0 0 507 0 0 0 25 0 1 0 538345891 22224896 4796 33554432000 134512640 135674940 4291759424 18446744073709551615 134564250 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/25495/statm: 5426 4796 99 284 0 5140 0
[pid=25496] ppid=25486 vsize=343740 CPUtime=0 cores=1,3,5,7
/proc/25496/stat : 25496 (python) S 25486 25486 25339 0 -1 4202560 922 0 0 0 0 0 0 0 18 0 1 0 538345893 351989760 19298 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 4419337458559189256 0 0 17 3 0 0 0
/proc/25496/statm: 85935 19298 370 364 0 21850 0
[pid=25498] ppid=25496 vsize=35296 CPUtime=5.08 cores=1,3,5,7
/proc/25498/stat : 25498 (lingeling) R 25496 25498 25498 0 -1 4202496 16033 0 0 0 506 2 0 0 25 0 1 0 538345893 36143104 7992 33554432000 4194304 4352236 140736277686080 18446744073709551615 4309132 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/25498/statm: 8824 7992 127 39 0 7904 0
[pid=25499] ppid=25486 vsize=353996 CPUtime=0 cores=1,3,5,7
/proc/25499/stat : 25499 (python) S 25486 25486 25339 0 -1 4202560 920 0 0 0 0 0 0 0 18 0 1 0 538345895 362491904 19302 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 11087835898602029320 0 0 17 5 0 0 0
/proc/25499/statm: 88499 19302 370 364 0 24411 0
[pid=25501] ppid=25499 vsize=37296 CPUtime=5.04 cores=1,3,5,7
/proc/25501/stat : 25501 (lingeling) R 25499 25501 25501 0 -1 4202496 15835 0 0 0 502 2 0 0 25 0 1 0 538345896 38191104 7981 33554432000 4194304 4352236 140737212020000 18446744073709551615 4228384 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/25501/statm: 9324 7981 127 39 0 8404 0
[pid=25502] ppid=25486 vsize=364252 CPUtime=0 cores=1,3,5,7
/proc/25502/stat : 25502 (python) S 25486 25486 25339 0 -1 4202560 938 0 0 0 0 0 0 0 18 0 1 0 538345898 372994048 19306 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 4540556141620363263 0 0 17 3 0 0 0
/proc/25502/statm: 91063 19306 370 364 0 26972 0
[pid=25504] ppid=25502 vsize=352592 CPUtime=5.01 cores=1,3,5,7
/proc/25504/stat : 25504 (cryptominisat-2) R 25502 25504 25504 0 -1 4202496 64231 0 0 0 493 8 0 0 25 0 1 0 538345898 361054208 61758 33554432000 4194304 4677096 140734854711296 18446744073709551615 4318902 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25504/statm: 88148 61758 361 118 0 83107 0
[pid=25486/tid=25494] ppid=25484 vsize=374496 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25494/stat : 25494 (python) S 25484 25486 25339 0 -1 4202560 22 932 0 0 0 0 0 0 25 0 5 0 538345891 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 7 0 0 0
[pid=25486/tid=25497] ppid=25484 vsize=374496 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25497/stat : 25497 (python) S 25484 25486 25339 0 -1 4202560 23 932 0 0 0 0 0 0 25 0 5 0 538345893 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 1 0 0 0
[pid=25486/tid=25500] ppid=25484 vsize=374496 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25500/stat : 25500 (python) S 25484 25486 25339 0 -1 4202560 22 932 0 0 0 0 0 0 25 0 5 0 538345895 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25503] ppid=25484 vsize=374496 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25503/stat : 25503 (python) S 25484 25486 25339 0 -1 4202560 26 932 0 0 0 0 0 0 25 0 5 0 538345898 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40.38
Current children cumulated vsize (KiB) 2216856

[startup+51.1006 s]
/proc/loadavg: 6.44 2.67 1.00 9/206 25509
/proc/meminfo: memFree=19643912/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=374496 CPUtime=20.18 cores=1,3,5,7
/proc/25486/stat : 25486 (python) S 25484 25486 25339 0 -1 4202496 33419 932 1 0 2003 15 0 0 25 0 5 0 538343852 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/25486/statm: 93624 20821 1881 364 0 29533 0
[pid=25493] ppid=25486 vsize=333484 CPUtime=0.03 cores=1,3,5,7
/proc/25493/stat : 25493 (python) S 25486 25486 25339 0 -1 4202560 988 0 0 0 1 2 0 0 18 0 1 0 538345890 341487616 19305 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899727 0 0 16781312 514 767793367722459400 0 0 17 5 0 0 0
/proc/25493/statm: 83371 19305 381 364 0 19289 0
[pid=25495] ppid=25493 vsize=50132 CPUtime=30.54 cores=1,3,5,7
/proc/25495/stat : 25495 (SApperloT-base) R 25493 25495 25495 0 -1 4202496 13201 0 0 0 3051 3 0 0 25 0 1 0 538345891 51335168 11873 33554432000 134512640 135674940 4291759424 18446744073709551615 134551360 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/25495/statm: 12533 11873 99 284 0 12247 0
[pid=25496] ppid=25486 vsize=343740 CPUtime=0.04 cores=1,3,5,7
/proc/25496/stat : 25496 (python) S 25486 25486 25339 0 -1 4202560 934 0 0 0 2 2 0 0 18 0 1 0 538345893 351989760 19298 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 767793367722459400 0 0 17 3 0 0 0
/proc/25496/statm: 85935 19298 370 364 0 21850 0
[pid=25498] ppid=25496 vsize=27852 CPUtime=30.68 cores=1,3,5,7
/proc/25498/stat : 25498 (lingeling) R 25496 25498 25498 0 -1 4202496 16291 0 0 0 3066 2 0 0 25 0 1 0 538345893 28520448 6133 33554432000 4194304 4352236 140736277686080 18446744073709551615 4281230 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/25498/statm: 6963 6133 129 39 0 6043 0
[pid=25499] ppid=25486 vsize=353996 CPUtime=0.03 cores=1,3,5,7
/proc/25499/stat : 25499 (python) S 25486 25486 25339 0 -1 4202560 932 0 0 0 1 2 0 0 18 0 1 0 538345895 362491904 19302 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 767793367722459400 0 0 17 5 0 0 0
/proc/25499/statm: 88499 19302 370 364 0 24411 0
[pid=25501] ppid=25499 vsize=28864 CPUtime=30.57 cores=1,3,5,7
/proc/25501/stat : 25501 (lingeling) R 25499 25501 25501 0 -1 4202496 15837 0 0 0 3055 2 0 0 25 0 1 0 538345896 29556736 5875 33554432000 4194304 4352236 140737212020000 18446744073709551615 4280960 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/25501/statm: 7216 5875 129 39 0 6296 0
[pid=25502] ppid=25486 vsize=364252 CPUtime=0.04 cores=1,3,5,7
/proc/25502/stat : 25502 (python) S 25486 25486 25339 0 -1 4202560 952 0 0 0 2 2 0 0 15 0 1 0 538345898 372994048 19306 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 767793367722459400 0 0 17 3 0 0 0
/proc/25502/statm: 91063 19306 370 364 0 26972 0
[pid=25504] ppid=25502 vsize=1026088 CPUtime=30.55 cores=1,3,5,7
/proc/25504/stat : 25504 (cryptominisat-2) R 25502 25504 25504 0 -1 4202496 203699 0 0 0 3026 29 0 0 25 0 1 0 538345898 1050714112 199614 33554432000 4194304 4677096 140734854711296 18446744073709551615 4319643 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25504/statm: 256522 199614 391 118 0 251481 0
[pid=25486/tid=25494] ppid=25484 vsize=374496 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25494/stat : 25494 (python) S 25484 25486 25339 0 -1 4202560 22 932 0 0 0 0 0 0 25 0 5 0 538345891 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 7 0 0 0
[pid=25486/tid=25497] ppid=25484 vsize=374496 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25497/stat : 25497 (python) S 25484 25486 25339 0 -1 4202560 23 932 0 0 0 0 0 0 25 0 5 0 538345893 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 1 0 0 0
[pid=25486/tid=25500] ppid=25484 vsize=374496 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25500/stat : 25500 (python) S 25484 25486 25339 0 -1 4202560 22 932 0 0 0 0 0 0 25 0 5 0 538345895 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25503] ppid=25484 vsize=374496 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25503/stat : 25503 (python) S 25484 25486 25339 0 -1 4202560 26 932 0 0 0 0 0 0 25 0 5 0 538345898 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 142.66
Current children cumulated vsize (KiB) 2902904

[startup+102.307 s]
/proc/loadavg: 7.41 3.58 1.41 9/206 25510
/proc/meminfo: memFree=19400960/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=374496 CPUtime=20.18 cores=1,3,5,7
/proc/25486/stat : 25486 (python) S 25484 25486 25339 0 -1 4202496 33419 932 1 0 2003 15 0 0 25 0 5 0 538343852 383483904 20821 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/25486/statm: 93624 20821 1881 364 0 29533 0
[pid=25493] ppid=25486 vsize=333484 CPUtime=0.1 cores=1,3,5,7
/proc/25493/stat : 25493 (python) S 25486 25486 25339 0 -1 4202560 1005 0 0 0 5 5 0 0 18 0 1 0 538345890 341487616 19305 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899727 0 0 16781312 514 767793367722459400 0 0 17 5 0 0 0
/proc/25493/statm: 83371 19305 381 364 0 19289 0
[pid=25495] ppid=25493 vsize=105632 CPUtime=81.46 cores=1,3,5,7
/proc/25495/stat : 25495 (SApperloT-base) R 25493 25495 25495 0 -1 4202496 27049 0 0 0 8140 6 0 0 25 0 1 0 538345891 108167168 25721 33554432000 134512640 135674940 4291759424 18446744073709551615 134564017 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/25495/statm: 26408 25721 100 284 0 26122 0
[pid=25496] ppid=25486 vsize=343740 CPUtime=0.11 cores=1,3,5,7
/proc/25496/stat : 25496 (python) S 25486 25486 25339 0 -1 4202560 952 0 0 0 6 5 0 0 18 0 1 0 538345893 351989760 19298 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 767793367722459400 0 0 17 3 0 0 0
/proc/25496/statm: 85935 19298 370 364 0 21850 0
[pid=25498] ppid=25496 vsize=30912 CPUtime=81.88 cores=1,3,5,7
/proc/25498/stat : 25498 (lingeling) R 25496 25498 25498 0 -1 4202496 17059 0 0 0 8186 2 0 0 25 0 1 0 538345893 31653888 6898 33554432000 4194304 4352236 140736277686080 18446744073709551615 4328423 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/25498/statm: 7728 6898 129 39 0 6808 0

################
# More data... #
################

[pid=25514] ppid=25486 vsize=374508 CPUtime=0.68 cores=1,3,5,7
/proc/25514/stat : 25514 (python) S 25486 25486 25339 0 -1 4202560 1178 0 0 0 36 32 0 0 18 0 2 0 538355905 383496192 19340 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/25514/statm: 93627 19340 399 364 0 29533 0
[pid=25516] ppid=25514 vsize=168780 CPUtime=510 cores=1,3,5,7
/proc/25516/stat : 25516 (precosat) R 25514 25516 25516 0 -1 4202496 60741 0 0 0 50987 13 0 0 25 0 1 0 538355906 172830720 40811 33554432000 4194304 4890832 140736448321872 18446744073709551615 4235076 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/25516/statm: 42195 40811 86 171 0 42022 0
[pid=25514/tid=25535] ppid=25486 vsize=374508 CPUtime=0 cores=1,3,5,7
/proc/25514/task/25535/stat : 25535 (python) S 25486 25486 25339 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538395253 383496192 19340 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 514 18446604467251478848 0 0 -1 3 0 0 0
[pid=25532] ppid=25486 vsize=384764 CPUtime=0.26 cores=1,3,5,7
/proc/25532/stat : 25532 (python) S 25486 25486 25339 0 -1 4202560 1169 0 0 0 13 13 0 0 18 0 2 0 538394911 393998336 19344 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/25532/statm: 96191 19344 399 364 0 32094 0
[pid=25534] ppid=25532 vsize=37656 CPUtime=194.4 cores=1,3,5,7
/proc/25534/stat : 25534 (lingeling) T 25532 25534 25534 0 -1 4202496 20472 0 0 0 19438 2 0 0 25 0 1 0 538394911 38559744 8584 33554432000 4194304 4352236 140734073221824 18446744073709551615 4207874 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/25534/statm: 9414 8584 129 39 0 8494 0
[pid=25532/tid=25540] ppid=25486 vsize=384764 CPUtime=0 cores=1,3,5,7
/proc/25532/task/25540/stat : 25540 (python) S 25486 25486 25339 0 -1 4202560 51 0 0 0 0 0 0 0 18 0 2 0 538404924 393998336 19344 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 514 18446604471125407040 0 0 -1 3 0 0 0
[pid=25543] ppid=25486 vsize=395020 CPUtime=0.79 cores=1,3,5,7
/proc/25543/stat : 25543 (python) S 25486 25486 25339 0 -1 4202560 1038 0 0 0 43 36 0 0 15 0 1 0 538414439 404500480 19318 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 767793367722459398 0 0 17 3 0 0 0
/proc/25543/statm: 98755 19318 370 364 0 34655 0
[pid=25545] ppid=25543 vsize=1267980 CPUtime=506.51 cores=1,3,5,7
/proc/25545/stat : 25545 (cryptominisat-2) R 25543 25545 25545 0 -1 4202496 353235 0 0 0 50578 73 0 0 25 0 1 0 538414440 1298411520 251444 33554432000 4194304 4677096 140735315659200 18446744073709551615 4321144 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/25545/statm: 316995 251444 391 118 0 311954 0
[pid=25555] ppid=25486 vsize=405276 CPUtime=0.27 cores=1,3,5,7
/proc/25555/stat : 25555 (python) S 25486 25486 25339 0 -1 4202560 1213 0 0 0 14 13 0 0 18 0 2 0 538433815 415002624 19358 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/25555/statm: 101319 19358 405 364 0 37216 0
[pid=25557] ppid=25555 vsize=33928 CPUtime=199.34 cores=1,3,5,7
/proc/25557/stat : 25557 (lingeling) T 25555 25557 25557 0 -1 4202496 19422 0 0 0 19931 3 0 0 25 0 1 0 538433816 34742272 7140 33554432000 4194304 4352236 140733487981008 18446744073709551615 4241523 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/25557/statm: 8482 7140 129 39 0 7562 0
[pid=25555/tid=25562] ppid=25486 vsize=405276 CPUtime=0 cores=1,3,5,7
/proc/25555/task/25562/stat : 25562 (python) S 25486 25486 25339 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 538443728 415002624 19358 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 514 18446604471151490048 0 0 -1 3 0 0 0
[pid=25651] ppid=25486 vsize=415532 CPUtime=0.04 cores=1,3,5,7
/proc/25651/stat : 25651 (python) S 25486 25486 25339 0 -1 4202560 967 0 0 0 2 2 0 0 18 0 1 0 538462837 425504768 19326 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 767793367722459397 0 0 17 3 0 0 0
/proc/25651/statm: 103883 19326 370 364 0 39777 0
[pid=25653] ppid=25651 vsize=128884 CPUtime=28.2 cores=1,3,5,7
/proc/25653/stat : 25653 (precosat) R 25651 25653 25653 0 -1 4202496 32630 0 0 0 2816 4 0 0 25 0 1 0 538462838 131977216 30818 33554432000 4194304 4890832 140734316366192 18446744073709551615 4236058 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/25653/statm: 32221 30818 86 171 0 32048 0
[pid=25486/tid=25494] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25494/stat : 25494 (python) S 25484 25486 25339 0 -1 4202560 22 932 0 0 0 0 0 0 25 0 10 0 538345891 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 7 0 0 0
[pid=25486/tid=25497] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25497/stat : 25497 (python) S 25484 25486 25339 0 -1 4202560 28 932 0 0 0 0 0 0 18 0 10 0 538345893 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 1 0 0 0
[pid=25486/tid=25500] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25500/stat : 25500 (python) S 25484 25486 25339 0 -1 4202560 22 932 0 0 0 0 0 0 25 0 10 0 538345895 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25503] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25503/stat : 25503 (python) S 25484 25486 25339 0 -1 4202560 42 932 0 0 0 0 0 0 18 0 10 0 538345898 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25515] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25515/stat : 25515 (python) S 25484 25486 25339 0 -1 4202560 35 932 0 0 0 0 0 0 18 0 10 0 538355905 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25533] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25533/stat : 25533 (python) S 25484 25486 25339 0 -1 4202560 28 932 0 0 0 0 0 0 18 0 10 0 538394911 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25544] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25544/stat : 25544 (python) S 25484 25486 25339 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 10 0 538414440 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25556] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25556/stat : 25556 (python) S 25484 25486 25339 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 10 0 538433815 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25652] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25652/stat : 25652 (python) S 25484 25486 25339 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 538462837 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 7038140

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1218.1 s]
/proc/loadavg: 6.06 7.38 5.86 6/216 25654
/proc/meminfo: memFree=16217740/32950904 swapFree=67082284/67111528
[pid=25486] ppid=25484 vsize=425776 CPUtime=20.48 cores=1,3,5,7
/proc/25486/stat : 25486 (python) S 25484 25486 25339 0 -1 4202496 38259 932 1 0 2031 17 0 0 18 0 10 0 538343852 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/25486/statm: 106444 20852 1892 364 0 42338 0
[pid=25493] ppid=25486 vsize=343728 CPUtime=0.13 cores=1,3,5,7
/proc/25493/stat : 25493 (python) S 25486 25486 25339 0 -1 4202560 1172 0 0 0 7 6 0 0 19 0 2 0 538345890 351977472 19343 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/25493/statm: 85932 19343 414 364 0 21850 0
[pid=25495] ppid=25493 vsize=106204 CPUtime=99.56 cores=1,3,5,7
/proc/25495/stat : 25495 (SApperloT-base) T 25493 25495 25495 0 -1 4202496 27166 0 0 0 9950 6 0 0 25 0 1 0 538345891 108752896 25838 33554432000 134512640 135674940 4291759424 18446744073709551615 134564620 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/25495/statm: 26551 25838 100 284 0 26265 0
[pid=25493/tid=25513] ppid=25486 vsize=343728 CPUtime=0 cores=1,3,5,7
/proc/25493/task/25513/stat : 25513 (python) S 25486 25486 25339 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538355903 351977472 19343 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 514 18446604471121520512 0 0 -1 5 0 0 0
[pid=25496] ppid=25486 vsize=343740 CPUtime=1.17 cores=1,3,5,7
/proc/25496/stat : 25496 (python) S 25486 25486 25339 0 -1 4202560 1144 0 0 0 64 53 0 0 18 0 2 0 538345893 351989760 19328 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/25496/statm: 85935 19328 399 364 0 21850 0
[pid=25498] ppid=25496 vsize=53948 CPUtime=878.84 cores=1,3,5,7
/proc/25498/stat : 25498 (lingeling) T 25496 25498 25498 0 -1 4202496 26915 0 0 0 87879 5 0 0 25 0 1 0 538345893 55242752 12657 33554432000 4194304 4352236 140736277686080 18446744073709551615 4281248 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/25498/statm: 13487 12657 129 39 0 12567 0
[pid=25496/tid=25512] ppid=25486 vsize=343740 CPUtime=0 cores=1,3,5,7
/proc/25496/task/25512/stat : 25512 (python) S 25486 25486 25339 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 538355806 351989760 19328 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 514 18446604471121519616 0 0 -1 1 0 0 0
[pid=25499] ppid=25486 vsize=353996 CPUtime=1.57 cores=1,3,5,7
/proc/25499/stat : 25499 (python) S 25486 25486 25339 0 -1 4202560 1147 0 0 0 86 71 0 0 19 0 2 0 538345895 362491904 19332 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/25499/statm: 88499 19332 399 364 0 24411 0
[pid=25501] ppid=25499 vsize=91280 CPUtime=1167.7 cores=1,3,5,7
/proc/25501/stat : 25501 (lingeling) T 25499 25501 25501 0 -1 4202496 36060 0 0 0 116766 4 0 0 25 0 1 0 538345896 93470720 21990 33554432000 4194304 4352236 140737212020000 18446744073709551615 4233979 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/25501/statm: 22820 21990 129 39 0 21900 0
[pid=25499/tid=25650] ppid=25486 vsize=353996 CPUtime=0 cores=1,3,5,7
/proc/25499/task/25650/stat : 25650 (python) S 25486 25486 25339 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538462835 362491904 19332 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 514 18446604464084215808 0 0 -1 5 0 0 0
[pid=25502] ppid=25486 vsize=364252 CPUtime=1.83 cores=1,3,5,7
/proc/25502/stat : 25502 (python) S 25486 25486 25339 0 -1 4202560 1221 0 0 0 100 83 0 0 15 0 2 0 538345898 372994048 19337 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/25502/statm: 91063 19337 400 364 0 26972 0
[pid=25504] ppid=25502 vsize=1342888 CPUtime=1188.42 cores=1,3,5,7
/proc/25504/stat : 25504 (cryptominisat-2) R 25502 25504 25504 0 -1 4202496 528932 0 0 0 118709 133 0 0 25 0 1 0 538345898 1375117312 273307 33554432000 4194304 4677096 140734854711296 18446744073709551615 4320199 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/25504/statm: 335722 273307 425 118 0 330681 0
[pid=25502/tid=25531] ppid=25486 vsize=364252 CPUtime=0 cores=1,3,5,7
/proc/25502/task/25531/stat : 25531 (python) S 25486 25486 25339 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 538394908 372994048 19337 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 514 18446604471149743040 0 0 -1 3 0 0 0
[pid=25514] ppid=25486 vsize=374508 CPUtime=0.68 cores=1,3,5,7
/proc/25514/stat : 25514 (python) S 25486 25486 25339 0 -1 4202560 1178 0 0 0 36 32 0 0 18 0 2 0 538355905 383496192 19340 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/25514/statm: 93627 19340 399 364 0 29533 0
[pid=25516] ppid=25514 vsize=168780 CPUtime=510 cores=1,3,5,7
/proc/25516/stat : 25516 (precosat) R 25514 25516 25516 0 -1 4202496 60741 0 0 0 50987 13 0 0 25 0 1 0 538355906 172830720 40811 33554432000 4194304 4890832 140736448321872 18446744073709551615 4235076 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/25516/statm: 42195 40811 86 171 0 42022 0
[pid=25514/tid=25535] ppid=25486 vsize=374508 CPUtime=0 cores=1,3,5,7
/proc/25514/task/25535/stat : 25535 (python) S 25486 25486 25339 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538395253 383496192 19340 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 514 18446604467251478848 0 0 -1 3 0 0 0
[pid=25532] ppid=25486 vsize=384764 CPUtime=0.26 cores=1,3,5,7
/proc/25532/stat : 25532 (python) S 25486 25486 25339 0 -1 4202560 1169 0 0 0 13 13 0 0 18 0 2 0 538394911 393998336 19344 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/25532/statm: 96191 19344 399 364 0 32094 0
[pid=25534] ppid=25532 vsize=37656 CPUtime=194.4 cores=1,3,5,7
/proc/25534/stat : 25534 (lingeling) T 25532 25534 25534 0 -1 4202496 20472 0 0 0 19438 2 0 0 25 0 1 0 538394911 38559744 8584 33554432000 4194304 4352236 140734073221824 18446744073709551615 4207874 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/25534/statm: 9414 8584 129 39 0 8494 0
[pid=25532/tid=25540] ppid=25486 vsize=384764 CPUtime=0 cores=1,3,5,7
/proc/25532/task/25540/stat : 25540 (python) S 25486 25486 25339 0 -1 4202560 51 0 0 0 0 0 0 0 18 0 2 0 538404924 393998336 19344 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 514 18446604471125407040 0 0 -1 3 0 0 0
[pid=25543] ppid=25486 vsize=395020 CPUtime=0.79 cores=1,3,5,7
/proc/25543/stat : 25543 (python) S 25486 25486 25339 0 -1 4202560 1038 0 0 0 43 36 0 0 15 0 1 0 538414439 404500480 19318 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 767793367722459398 0 0 17 3 0 0 0
/proc/25543/statm: 98755 19318 370 364 0 34655 0
[pid=25545] ppid=25543 vsize=1267980 CPUtime=506.51 cores=1,3,5,7
/proc/25545/stat : 25545 (cryptominisat-2) R 25543 25545 25545 0 -1 4202496 353235 0 0 0 50578 73 0 0 25 0 1 0 538414440 1298411520 251444 33554432000 4194304 4677096 140735315659200 18446744073709551615 4321144 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/25545/statm: 316995 251444 391 118 0 311954 0
[pid=25555] ppid=25486 vsize=405276 CPUtime=0.27 cores=1,3,5,7
/proc/25555/stat : 25555 (python) S 25486 25486 25339 0 -1 4202560 1213 0 0 0 14 13 0 0 18 0 2 0 538433815 415002624 19358 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290706379 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/25555/statm: 101319 19358 405 364 0 37216 0
[pid=25557] ppid=25555 vsize=33928 CPUtime=199.34 cores=1,3,5,7
/proc/25557/stat : 25557 (lingeling) T 25555 25557 25557 0 -1 4202496 19422 0 0 0 19931 3 0 0 25 0 1 0 538433816 34742272 7140 33554432000 4194304 4352236 140733487981008 18446744073709551615 4241523 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/25557/statm: 8482 7140 129 39 0 7562 0
[pid=25555/tid=25562] ppid=25486 vsize=405276 CPUtime=0 cores=1,3,5,7
/proc/25555/task/25562/stat : 25562 (python) S 25486 25486 25339 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 538443728 415002624 19358 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 514 18446604471151490048 0 0 -1 3 0 0 0
[pid=25651] ppid=25486 vsize=415532 CPUtime=0.04 cores=1,3,5,7
/proc/25651/stat : 25651 (python) S 25486 25486 25339 0 -1 4202560 967 0 0 0 2 2 0 0 18 0 1 0 538462837 425504768 19326 33554432000 4194304 5683644 140733809416048 18446744073709551615 237278899782 0 0 16781312 514 767793367722459397 0 0 17 3 0 0 0
/proc/25651/statm: 103883 19326 370 364 0 39777 0
[pid=25653] ppid=25651 vsize=128884 CPUtime=28.2 cores=1,3,5,7
/proc/25653/stat : 25653 (precosat) R 25651 25653 25653 0 -1 4202496 32630 0 0 0 2816 4 0 0 25 0 1 0 538462838 131977216 30818 33554432000 4194304 4890832 140734316366192 18446744073709551615 4236058 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/25653/statm: 32221 30818 86 171 0 32048 0
[pid=25486/tid=25494] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25494/stat : 25494 (python) S 25484 25486 25339 0 -1 4202560 22 932 0 0 0 0 0 0 25 0 10 0 538345891 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 7 0 0 0
[pid=25486/tid=25497] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25497/stat : 25497 (python) S 25484 25486 25339 0 -1 4202560 28 932 0 0 0 0 0 0 18 0 10 0 538345893 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 1 0 0 0
[pid=25486/tid=25500] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25500/stat : 25500 (python) S 25484 25486 25339 0 -1 4202560 22 932 0 0 0 0 0 0 25 0 10 0 538345895 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25503] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25503/stat : 25503 (python) S 25484 25486 25339 0 -1 4202560 42 932 0 0 0 0 0 0 18 0 10 0 538345898 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25515] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25515/stat : 25515 (python) S 25484 25486 25339 0 -1 4202560 35 932 0 0 0 0 0 0 18 0 10 0 538355905 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25533] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25533/stat : 25533 (python) S 25484 25486 25339 0 -1 4202560 28 932 0 0 0 0 0 0 18 0 10 0 538394911 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25544] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25544/stat : 25544 (python) S 25484 25486 25339 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 10 0 538414440 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25556] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25556/stat : 25556 (python) S 25484 25486 25339 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 10 0 538433815 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
[pid=25486/tid=25652] ppid=25484 vsize=425776 CPUtime=0 cores=1,3,5,7
/proc/25486/task/25652/stat : 25652 (python) S 25484 25486 25339 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 538462837 435994624 20852 33554432000 4194304 5683644 140733809416048 18446744073709551615 237290703281 0 0 16781312 2 18446604471148531968 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 7038140

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25486 and gives
#  childrusage.ru_utime.tv_sec=20
#  childrusage.ru_utime.tv_usec=315911
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=180972
# CPU time returned by wait4() is 20.4969
# while last known CPU time is 4800.19
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1218.17
CPU time (s): 4800.19
CPU user time (s): 4794.5
CPU system time (s): 5.69
CPU usage (%): 394.05
Max. virtual memory (cumulated for all children) (KiB): 7111060

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20.3159
system time used= 0.180972
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 39196
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2927
involuntary context switches= 77

runsolver used 3.50247 second user time and 7.2169 second system time

The end

Launcher Data 

Begin job on node121 at 2011-05-01 18:30:41
IDJOB=3317883
IDBENCH=70799
IDSOLVER=1706
FILE ID=node121/3317883-1304267441
RUNJOBID= node121-1304267283-25358
PBS_JOBID= 13173958
Free space on /tmp= 73584 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT09/APPLICATIONS/bitverif/countbitswegner/countbitswegner128.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317883-1304267441/watcher-3317883-1304267441 -o /tmp/evaluation-result-3317883-1304267441/solver-3317883-1304267441 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317883-1304267441.cnf -seed 867666104 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4b75ef7fb46928f50793af1d74c176e2
RANDOM SEED=867666104

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      20662732 kB
Buffers:       2190708 kB
Cached:        9448872 kB
SwapCached:       2776 kB
Active:        8775484 kB
Inactive:      2993232 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      20662732 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:           37676 kB
Writeback:           0 kB
AnonPages:      126892 kB
Mapped:          20200 kB
Slab:           452008 kB
PageTables:       7988 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   504308 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73380 MiB
End job on node121 at 2011-05-01 18:51:01