Trace number 3498355

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed)? (MO) 3700.98 3695.76

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf
MD5SUMc4319228342e10028de028a9b67c3404
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables133566
Number of clauses676901
Sum of the clauses size1609791
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2668220
Number of clauses of size 32100
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 56370

Solver Data 

0.38/0.65	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.38/0.65	c INFO: solving HOME/instance-3498355-1307953196.cnf
0.38/0.65	c INFO: computing task features
2.36/2.66	c INFO: computed variable-clause graph statistics
2.46/2.74	c INFO: computed clause balance statistics
12.06/12.30	c INFO: computed variable balance statistics
18.66/18.92	c INFO: computed small-clause counts
18.76/19.04	c INFO: computed Horn-clause counts
39.66/39.97	c INFO: computed variable graph statistics
39.66/39.97	c INFO: collected features for HOME/instance-3498355-1307953196.cnf in 39.25 s
39.74/40.01	c INFO: running lingeling-276@0 for 97 with 4960 remaining (b = 0.23)
139.92/140.16	c INFO: running cryptominisat-2.9.0@0 for 485 with 4860 remaining (b = 0.20)
641.70/640.85	c INFO: running lingeling-276@100 for 388 with 4372 remaining (b = 0.19)
1027.58/1026.28	c INFO: running SApperloT@0 for 97 with 3987 remaining (b = 0.09)
1127.90/1126.44	c INFO: running lingeling-276@0 for 97 with 3887 remaining (b = 0.10)
1228.10/1226.58	c INFO: running cryptominisat-2.9.0@488 for 97 with 3787 remaining (b = 0.04)
1324.54/1322.86	c INFO: running lingeling-276@100 for 388 with 3690 remaining (b = 0.13)
1710.41/1708.30	c INFO: running precosat-570@0 for 194 with 3305 remaining (b = 0.12)
1906.93/1904.56	c INFO: running lingeling-276@0 for 97 with 3109 remaining (b = 0.05)
2006.26/2003.72	c INFO: running precosat-570@196 for 97 with 3010 remaining (b = 0.03)
2102.49/2099.87	c INFO: running cryptominisat-2.9.0@584 for 1358 with 2914 remaining (b = 0.35)
3466.40/3461.73	c INFO: running lingeling-276@485 for 97 with 1554 remaining (b = 0.03)
3563.58/3558.87	c INFO: running cryptominisat-2.9.0@0 for 1457 with 1457 remaining (b = 0.31)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /var/tmp/evaluation-result-3498355-1307953196/watcher-3498355-1307953196 -o /var/tmp/evaluation-result-3498355-1307953196/solver-3498355-1307953196 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498355-1307953196.cnf -seed 1042763137 -budget 5000 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.22 0.35 0.12 2/180 18869
/proc/meminfo: memFree=3329888/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=15184 CPUtime=0 cores=0,2,4,6
/proc/18869/stat : 18869 (python) S 18867 18869 18768 0 -1 4202496 728 0 0 0 0 0 0 0 17 0 1 0 906920145 15548416 616 33554432000 4194304 5683644 140736226032432 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/18869/statm: 3796 616 322 364 0 283 0

[startup+0.012022 s]
/proc/loadavg: 1.22 0.35 0.12 2/180 18869
/proc/meminfo: memFree=3329888/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=15776 CPUtime=0 cores=0,2,4,6
/proc/18869/stat : 18869 (python) S 18867 18869 18768 0 -1 4202496 896 0 0 0 0 0 0 0 17 0 1 0 906920145 16154624 776 33554432000 4194304 5683644 140736226032432 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/18869/statm: 3944 776 343 364 0 431 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15776

[startup+0.10106 s]
/proc/loadavg: 1.22 0.35 0.12 2/180 18869
/proc/meminfo: memFree=3329888/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=91832 CPUtime=0.06 cores=0,2,4,6
/proc/18869/stat : 18869 (python) S 18867 18869 18768 0 -1 4202496 2680 0 0 0 5 1 0 0 17 0 1 0 906920145 94035968 2394 33554432000 4194304 5683644 140736226032432 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/18869/statm: 22958 2394 755 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 91832

[startup+0.300971 s]
/proc/loadavg: 1.22 0.35 0.12 2/180 18869
/proc/meminfo: memFree=3329888/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=135752 CPUtime=0.2 cores=0,2,4,6
/proc/18869/stat : 18869 (python) S 18867 18869 18768 0 -1 4202496 5971 931 1 0 15 5 0 0 17 0 1 0 906920145 139010048 4150 33554432000 4194304 5683644 140736226032432 18446744073709551615 230809161733 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/18869/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 135752

[startup+0.704953 s]
/proc/loadavg: 1.22 0.35 0.12 2/180 18869
/proc/meminfo: memFree=3329888/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=293004 CPUtime=0.47 cores=0,2,4,6
/proc/18869/stat : 18869 (python) R 18867 18869 18768 0 -1 4202496 12889 931 1 0 37 10 0 0 16 0 1 0 906920145 300036096 10560 33554432000 4194304 5683644 140736226032432 18446744073709551615 47214998674184 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18869/statm: 73251 10560 1761 364 0 9175 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 293004

[startup+1.50075 s]
/proc/loadavg: 1.22 0.35 0.12 3/181 18874
/proc/meminfo: memFree=3271776/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=349900 CPUtime=1.26 cores=0,2,4,6
/proc/18869/stat : 18869 (python) R 18867 18869 18768 0 -1 4202496 26613 931 1 0 114 12 0 0 17 0 1 0 906920145 358297600 24284 33554432000 4194304 5683644 140736226032432 18446744073709551615 230808826565 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18869/statm: 87475 24285 1761 364 0 23399 0
Current children cumulated CPU time (s) 1.26
Current children cumulated vsize (KiB) 349900

[startup+3.10049 s]
/proc/loadavg: 1.22 0.35 0.12 3/181 18874
/proc/meminfo: memFree=3203992/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=416356 CPUtime=2.86 cores=0,2,4,6
/proc/18869/stat : 18869 (python) R 18867 18869 18768 0 -1 4202496 59260 931 1 0 270 16 0 0 19 0 1 0 906920145 426348544 41473 33554432000 4194304 5683644 140736226032432 18446744073709551615 230808833036 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18869/statm: 104089 41473 1826 364 0 40013 0
Current children cumulated CPU time (s) 2.86
Current children cumulated vsize (KiB) 416356

[startup+6.30091 s]
/proc/loadavg: 1.28 0.38 0.13 3/181 18874
/proc/meminfo: memFree=3170388/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=416356 CPUtime=6.06 cores=0,2,4,6
/proc/18869/stat : 18869 (python) R 18867 18869 18768 0 -1 4202496 59260 931 1 0 590 16 0 0 25 0 1 0 906920145 426348544 41473 33554432000 4194304 5683644 140736226032432 18446744073709551615 47214827750456 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18869/statm: 104089 41473 1826 364 0 40013 0
Current children cumulated CPU time (s) 6.06
Current children cumulated vsize (KiB) 416356

[startup+12.7007 s]
/proc/loadavg: 1.34 0.40 0.14 3/181 18874
/proc/meminfo: memFree=3171924/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=416356 CPUtime=12.46 cores=0,2,4,6
/proc/18869/stat : 18869 (python) R 18867 18869 18768 0 -1 4202496 59261 931 1 0 1230 16 0 0 25 0 1 0 906920145 426348544 41474 33554432000 4194304 5683644 140736226032432 18446744073709551615 4603440 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18869/statm: 104089 41474 1827 364 0 40013 0
Current children cumulated CPU time (s) 12.46
Current children cumulated vsize (KiB) 416356

[startup+25.5004 s]
/proc/loadavg: 1.55 0.50 0.17 3/181 18874
/proc/meminfo: memFree=3168588/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=416356 CPUtime=25.26 cores=0,2,4,6
/proc/18869/stat : 18869 (python) R 18867 18869 18768 0 -1 4202496 59267 931 1 0 2510 16 0 0 25 0 1 0 906920145 426348544 41480 33554432000 4194304 5683644 140736226032432 18446744073709551615 47214827813004 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18869/statm: 104089 41480 1833 364 0 40013 0
Current children cumulated CPU time (s) 25.26
Current children cumulated vsize (KiB) 416356

[startup+51.1007 s]
/proc/loadavg: 1.70 0.62 0.22 3/184 18878
/proc/meminfo: memFree=3149844/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=416108 CPUtime=39.76 cores=0,2,4,6
/proc/18869/stat : 18869 (python) S 18867 18869 18768 0 -1 4202496 59634 931 1 0 3959 17 0 0 25 0 2 0 906920145 426094592 38897 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18869/statm: 104027 38897 1875 364 0 39945 0
[pid=18876] ppid=18869 vsize=405864 CPUtime=0 cores=0,2,4,6
/proc/18876/stat : 18876 (python) S 18869 18869 18768 0 -1 4202560 973 0 0 0 0 0 0 0 18 0 1 0 906924146 415604736 37399 33554432000 4194304 5683644 140736226032432 18446744073709551615 230809185807 0 0 16781312 514 864902234687635716 0 0 17 6 0 0 0
/proc/18876/statm: 101466 37399 381 364 0 37384 0
[pid=18878] ppid=18876 vsize=29964 CPUtime=11.06 cores=0,2,4,6
/proc/18878/stat : 18878 (lingeling) R 18876 18878 18878 0 -1 4202496 14447 0 0 0 1104 2 0 0 25 0 1 0 906924147 30683136 6661 33554432000 4194304 4352236 140737326748800 18446744073709551615 4207627 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/18878/statm: 7491 6661 129 39 0 6571 0
[pid=18869/tid=18877] ppid=18867 vsize=416108 CPUtime=0 cores=0,2,4,6
/proc/18869/task/18877/stat : 18877 (python) S 18867 18869 18768 0 -1 4202560 29 931 0 0 0 0 0 0 25 0 2 0 906924147 426094592 38897 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.82
Current children cumulated vsize (KiB) 851936

[startup+102.306 s]
/proc/loadavg: 1.87 0.83 0.31 3/188 18883
/proc/meminfo: memFree=2892400/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=416108 CPUtime=39.76 cores=0,2,4,6
/proc/18869/stat : 18869 (python) S 18867 18869 18768 0 -1 4202496 59634 931 1 0 3959 17 0 0 25 0 2 0 906920145 426094592 38897 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18869/statm: 104027 38897 1875 364 0 39945 0
[pid=18876] ppid=18869 vsize=405864 CPUtime=0.07 cores=0,2,4,6
/proc/18876/stat : 18876 (python) S 18869 18869 18768 0 -1 4202560 995 0 0 0 4 3 0 0 18 0 1 0 906924146 415604736 37399 33554432000 4194304 5683644 140736226032432 18446744073709551615 230809185807 0 0 16781312 514 864902234687635716 0 0 17 6 0 0 0
/proc/18876/statm: 101466 37399 381 364 0 37384 0
[pid=18878] ppid=18876 vsize=55536 CPUtime=62.26 cores=0,2,4,6
/proc/18878/stat : 18878 (lingeling) R 18876 18878 18878 0 -1 4202496 21153 0 0 0 6223 3 0 0 25 0 1 0 906924147 56868864 13054 33554432000 4194304 4352236 140737326748800 18446744073709551615 4233893 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/18878/statm: 13884 13054 129 39 0 12964 0
[pid=18869/tid=18877] ppid=18867 vsize=416108 CPUtime=0 cores=0,2,4,6
/proc/18869/task/18877/stat : 18877 (python) S 18867 18869 18768 0 -1 4202560 29 931 0 0 0 0 0 0 25 0 2 0 906924147 426094592 38897 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 102.09
Current children cumulated vsize (KiB) 877508

[startup+162.3 s]
/proc/loadavg: 2.10 1.07 0.42 3/185 18932
/proc/meminfo: memFree=2534180/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=426364 CPUtime=39.79 cores=0,2,4,6
/proc/18869/stat : 18869 (python) S 18867 18869 18768 0 -1 4202496 60420 931 1 0 3962 17 0 0 20 0 3 0 906920145 436596736 38904 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18869/statm: 106591 38904 1878 364 0 42506 0
[pid=18876] ppid=18869 vsize=416108 CPUtime=0.11 cores=0,2,4,6
/proc/18876/stat : 18876 (python) S 18869 18869 18768 0 -1 4202560 1167 0 0 0 7 4 0 0 19 0 2 0 906924146 426094592 37437 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18876/statm: 104027 37437 414 364 0 39945 0
[pid=18878] ppid=18876 vsize=63716 CPUtime=100.09 cores=0,2,4,6
/proc/18878/stat : 18878 (lingeling) T 18876 18878 18878 0 -1 4202496 23201 0 0 0 10006 3 0 0 25 0 1 0 906924147 65245184 15099 33554432000 4194304 4352236 140737326748800 18446744073709551615 4328026 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/18878/statm: 15929 15099 129 39 0 15009 0
[pid=18876/tid=18885] ppid=18869 vsize=416108 CPUtime=0 cores=0,2,4,6
/proc/18876/task/18885/stat : 18885 (python) S 18869 18869 18768 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 906934159 426094592 37437 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604451642431296 0 0 -1 6 0 0 0
[pid=18886] ppid=18869 vsize=416120 CPUtime=0.02 cores=0,2,4,6
/proc/18886/stat : 18886 (python) S 18869 18869 18768 0 -1 4202560 918 0 0 0 1 1 0 0 16 0 1 0 906934161 426106880 37392 33554432000 4194304 5683644 140736226032432 18446744073709551615 230809185862 0 0 16781312 514 864902234687635716 0 0 17 6 0 0 0
/proc/18886/statm: 104030 37392 370 364 0 39945 0
[pid=18888] ppid=18886 vsize=753304 CPUtime=22.11 cores=0,2,4,6
/proc/18888/stat : 18888 (cryptominisat-2) R 18886 18888 18888 0 -1 4202496 147123 0 0 0 2195 16 0 0 25 0 1 0 906934162 771383296 142540 33554432000 4194304 4677096 140736192203712 18446744073709551615 4336322 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/18888/statm: 188326 142540 387 118 0 183285 0
[pid=18869/tid=18877] ppid=18867 vsize=426364 CPUtime=0 cores=0,2,4,6
/proc/18869/task/18877/stat : 18877 (python) S 18867 18869 18768 0 -1 4202560 29 931 0 0 0 0 0 0 25 0 3 0 906924147 436596736 38904 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=18887] ppid=18867 vsize=426364 CPUtime=0 cores=0,2,4,6
/proc/18869/task/18887/stat : 18887 (python) S 18867 18869 18768 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 3 0 906934162 436596736 38904 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 162.12
Current children cumulated vsize (KiB) 2075612

[startup+222.3 s]
/proc/loadavg: 2.11 1.25 0.52 3/185 18979
/proc/meminfo: memFree=2059208/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=426364 CPUtime=39.79 cores=0,2,4,6
/proc/18869/stat : 18869 (python) S 18867 18869 18768 0 -1 4202496 60420 931 1 0 3962 17 0 0 20 0 3 0 906920145 436596736 38904 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18869/statm: 106591 38904 1878 364 0 42506 0
[pid=18876] ppid=18869 vsize=416108 CPUtime=0.11 cores=0,2,4,6
/proc/18876/stat : 18876 (python) S 18869 18869 18768 0 -1 4202560 1167 0 0 0 7 4 0 0 19 0 2 0 906924146 426094592 37437 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18876/statm: 104027 37437 414 364 0 39945 0
[pid=18878] ppid=18876 vsize=63716 CPUtime=100.09 cores=0,2,4,6
/proc/18878/stat : 18878 (lingeling) T 18876 18878 18878 0 -1 4202496 23201 0 0 0 10006 3 0 0 25 0 1 0 906924147 65245184 15099 33554432000 4194304 4352236 140737326748800 18446744073709551615 4328026 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/18878/statm: 15929 15099 129 39 0 15009 0
[pid=18876/tid=18885] ppid=18869 vsize=416108 CPUtime=0 cores=0,2,4,6
/proc/18876/task/18885/stat : 18885 (python) S 18869 18869 18768 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 906934159 426094592 37437 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604451642431296 0 0 -1 6 0 0 0
[pid=18886] ppid=18869 vsize=416120 CPUtime=0.11 cores=0,2,4,6
/proc/18886/stat : 18886 (python) S 18869 18869 18768 0 -1 4202560 1017 0 0 0 6 5 0 0 15 0 1 0 906934161 426106880 37393 33554432000 4194304 5683644 140736226032432 18446744073709551615 230809185862 0 0 16781312 514 4186333352447410436 0 0 17 6 0 0 0
/proc/18886/statm: 104030 37393 371 364 0 39945 0
[pid=18888] ppid=18886 vsize=993224 CPUtime=82.11 cores=0,2,4,6
/proc/18888/stat : 18888 (cryptominisat-2) R 18886 18888 18888 0 -1 4202496 391265 0 0 0 8167 44 0 0 25 0 1 0 906934162 1017061376 188310 33554432000 4194304 4677096 140736192203712 18446744073709551615 4564058 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/18888/statm: 248306 188310 390 118 0 243265 0
[pid=18869/tid=18877] ppid=18867 vsize=426364 CPUtime=0 cores=0,2,4,6
/proc/18869/task/18877/stat : 18877 (python) S 18867 18869 18768 0 -1 4202560 29 931 0 0 0 0 0 0 25 0 3 0 906924147 436596736 38904 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=18887] ppid=18867 vsize=426364 CPUtime=0 cores=0,2,4,6
/proc/18869/task/18887/stat : 18887 (python) S 18867 18869 18768 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 3 0 906934162 436596736 38904 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 2315532

[startup+282.301 s]
/proc/loadavg: 2.04 1.39 0.61 3/185 18981
/proc/meminfo: memFree=94452/32951124 swapFree=67053020/67111528

################
# More data... #
################

/proc/meminfo: memFree=96392/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=477644 CPUtime=40.01 cores=0,2,4,6
/proc/18869/stat : 18869 (python) S 18867 18869 18768 0 -1 4202496 64733 931 1 0 3981 20 0 0 20 0 8 0 906920145 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18869/statm: 119411 38934 1888 364 0 55311 0
[pid=18876] ppid=18869 vsize=416108 CPUtime=0.73 cores=0,2,4,6
/proc/18876/stat : 18876 (python) S 18869 18869 18768 0 -1 4202560 1204 0 0 0 42 31 0 0 18 0 2 0 906924146 426094592 37438 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18876/statm: 104027 37438 415 364 0 39945 0
[pid=18878] ppid=18876 vsize=182364 CPUtime=582.56 cores=0,2,4,6
/proc/18878/stat : 18878 (lingeling) T 18876 18878 18878 0 -1 4202496 86963 0 0 0 58242 14 0 0 25 0 1 0 906924147 186740736 44761 33554432000 4194304 4352236 140737326748800 18446744073709551615 4238648 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/18878/statm: 45591 44761 129 39 0 44671 0
[pid=18876/tid=18885] ppid=18869 vsize=416108 CPUtime=0 cores=0,2,4,6
/proc/18876/task/18885/stat : 18885 (python) S 18869 18869 18768 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 906934159 426094592 37438 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604451642431296 0 0 -1 6 0 0 0
[pid=18886] ppid=18869 vsize=416120 CPUtime=3.24 cores=0,2,4,6
/proc/18886/stat : 18886 (python) S 18869 18869 18768 0 -1 4202560 2493 0 0 0 200 124 0 0 15 0 2 0 906934161 426106880 37423 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/18886/statm: 104030 37423 400 364 0 39945 0
[pid=18888] ppid=18886 vsize=8249492 CPUtime=1958.8 cores=0,2,4,6
/proc/18888/stat : 18888 (cryptominisat-2) T 18886 18888 18888 0 -1 4202496 10197217 0 0 0 194394 1486 0 0 25 0 1 0 906934162 8447479808 1791044 33554432000 4194304 4677096 140736192203712 18446744073709551615 4335680 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/18888/statm: 2062373 1791044 393 118 0 2057332 0
[pid=18886/tid=19041] ppid=18869 vsize=416120 CPUtime=0 cores=0,2,4,6
/proc/18886/task/19041/stat : 19041 (python) S 18869 18869 18768 0 -1 4202560 43 0 0 0 0 0 0 0 15 0 2 0 906984228 426106880 37423 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604453878166528 0 0 -1 2 0 0 0
[pid=19148] ppid=18869 vsize=426376 CPUtime=0.13 cores=0,2,4,6
/proc/19148/stat : 19148 (python) S 18869 18869 18768 0 -1 4202560 1092 0 0 0 7 6 0 0 19 0 2 0 907022774 436609024 37426 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/19148/statm: 106594 37426 399 364 0 42506 0
[pid=19150] ppid=19148 vsize=106208 CPUtime=100.11 cores=0,2,4,6
/proc/19150/stat : 19150 (SApperloT-base) T 19148 19150 19150 0 -1 4202496 26932 0 0 0 10007 4 0 0 25 0 1 0 907022774 108756992 24644 33554432000 134512640 135674940 4292945152 18446744073709551615 134551922 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/19150/statm: 26552 24644 99 284 0 26266 0
[pid=19148/tid=19154] ppid=18869 vsize=426376 CPUtime=0 cores=0,2,4,6
/proc/19148/task/19154/stat : 19154 (python) S 18869 18869 18768 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 907032787 436609024 37426 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604453985331008 0 0 -1 0 0 0 0
[pid=19155] ppid=18869 vsize=436632 CPUtime=0.61 cores=0,2,4,6
/proc/19155/stat : 19155 (python) S 18869 18869 18768 0 -1 4202560 1149 0 0 0 35 26 0 0 18 0 2 0 907032789 447111168 37430 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19155/statm: 109158 37430 399 364 0 45067 0
[pid=19157] ppid=19155 vsize=125300 CPUtime=485.5 cores=0,2,4,6
/proc/19157/stat : 19157 (lingeling) T 19155 19157 19157 0 -1 4202496 56302 0 0 0 48543 7 0 0 25 0 1 0 907032790 128307200 30496 33554432000 4194304 4352236 140733930131104 18446744073709551615 4327867 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/19157/statm: 31325 30496 129 39 0 30405 0
[pid=19155/tid=19160] ppid=18869 vsize=436632 CPUtime=0 cores=0,2,4,6
/proc/19155/task/19160/stat : 19160 (python) S 18869 18869 18768 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 907042801 447111168 37430 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604453860494144 0 0 -1 6 0 0 0
[pid=19228] ppid=18869 vsize=446888 CPUtime=0.39 cores=0,2,4,6
/proc/19228/stat : 19228 (python) S 18869 18869 18768 0 -1 4202560 1152 0 0 0 21 18 0 0 18 0 2 0 907090975 457613312 37434 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/19228/statm: 111722 37434 399 364 0 47628 0
[pid=19230] ppid=19228 vsize=211812 CPUtime=292.33 cores=0,2,4,6
/proc/19230/stat : 19230 (precosat) T 19228 19230 19230 0 -1 4202496 96816 0 0 0 29218 15 0 0 25 0 1 0 907090976 216895488 51004 33554432000 4194304 4890832 140736543840224 18446744073709551615 4238246 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/19230/statm: 52953 51004 86 171 0 52780 0
[pid=19228/tid=19236] ppid=18869 vsize=446888 CPUtime=0 cores=0,2,4,6
/proc/19228/task/19236/stat : 19236 (python) S 18869 18869 18768 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 907110600 457613312 37434 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604453891446912 0 0 -1 6 0 0 0
[pid=19237] ppid=18869 vsize=457144 CPUtime=0.13 cores=0,2,4,6
/proc/19237/stat : 19237 (python) S 18869 18869 18768 0 -1 4202560 1118 0 0 0 7 6 0 0 19 0 2 0 907110602 468115456 37438 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/19237/statm: 114286 37438 399 364 0 50189 0
[pid=19239] ppid=19237 vsize=47512 CPUtime=99.11 cores=0,2,4,6
/proc/19239/stat : 19239 (lingeling) T 19237 19239 19239 0 -1 4202496 19148 0 0 0 9908 3 0 0 25 0 1 0 907110603 48652288 11048 33554432000 4194304 4352236 140737145478368 18446744073709551615 4278712 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/19239/statm: 11878 11048 129 39 0 10958 0
[pid=19237/tid=19243] ppid=18869 vsize=457144 CPUtime=0 cores=0,2,4,6
/proc/19237/task/19243/stat : 19243 (python) S 18869 18869 18768 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 907120515 468115456 37438 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604453888391936 0 0 -1 6 0 0 0
[pid=19305] ppid=18869 vsize=467400 CPUtime=0.51 cores=0,2,4,6
/proc/19305/stat : 19305 (python) S 18869 18869 18768 0 -1 4202560 1534 0 0 0 37 14 0 0 15 0 1 0 907276032 478617600 37413 33554432000 4194304 5683644 140736226032432 18446744073709551615 230809185862 0 0 16781312 514 13973213894630408451 0 0 17 0 0 0 0
/proc/19305/statm: 116850 37413 371 364 0 52750 0
[pid=19307] ppid=19305 vsize=3415848 CPUtime=136.82 cores=0,2,4,6
/proc/19307/stat : 19307 (cryptominisat-2) R 19305 19307 19307 0 -1 4202496 5274597 0 0 0 12965 717 0 0 25 0 1 0 907276033 3497828352 805662 33554432000 4194304 4677096 140734904176016 18446744073709551615 4293843 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/19307/statm: 853962 805662 390 118 0 848921 0
[pid=18869/tid=18877] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/18877/stat : 18877 (python) S 18867 18869 18768 0 -1 4202560 36 931 0 0 0 0 0 0 18 0 8 0 906924147 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=18887] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/18887/stat : 18887 (python) S 18867 18869 18768 0 -1 4202560 36 931 0 0 0 0 0 0 18 0 8 0 906934162 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=19149] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/19149/stat : 19149 (python) S 18867 18869 18768 0 -1 4202560 24 931 0 0 0 0 0 0 20 0 8 0 907022774 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=19156] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/19156/stat : 19156 (python) S 18867 18869 18768 0 -1 4202560 32 931 0 0 0 0 0 0 18 0 8 0 907032789 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=19229] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/19229/stat : 19229 (python) S 18867 18869 18768 0 -1 4202560 33 931 0 0 0 0 0 0 18 0 8 0 907090976 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=19238] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/19238/stat : 19238 (python) S 18867 18869 18768 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 8 0 907110602 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 0 0 0 0
[pid=18869/tid=19306] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/19306/stat : 19306 (python) S 18867 18869 18768 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 8 0 907276033 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3700.98
Current children cumulated vsize (KiB) 15882848

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+3695.7 s]
/proc/loadavg: 2.00 2.00 1.93 3/224 19311
/proc/meminfo: memFree=96392/32951124 swapFree=67053020/67111528
[pid=18869] ppid=18867 vsize=477644 CPUtime=40.01 cores=0,2,4,6
/proc/18869/stat : 18869 (python) S 18867 18869 18768 0 -1 4202496 64733 931 1 0 3981 20 0 0 20 0 8 0 906920145 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/18869/statm: 119411 38934 1888 364 0 55311 0
[pid=18876] ppid=18869 vsize=416108 CPUtime=0.73 cores=0,2,4,6
/proc/18876/stat : 18876 (python) S 18869 18869 18768 0 -1 4202560 1204 0 0 0 42 31 0 0 18 0 2 0 906924146 426094592 37438 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18876/statm: 104027 37438 415 364 0 39945 0
[pid=18878] ppid=18876 vsize=182364 CPUtime=582.56 cores=0,2,4,6
/proc/18878/stat : 18878 (lingeling) T 18876 18878 18878 0 -1 4202496 86963 0 0 0 58242 14 0 0 25 0 1 0 906924147 186740736 44761 33554432000 4194304 4352236 140737326748800 18446744073709551615 4238648 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/18878/statm: 45591 44761 129 39 0 44671 0
[pid=18876/tid=18885] ppid=18869 vsize=416108 CPUtime=0 cores=0,2,4,6
/proc/18876/task/18885/stat : 18885 (python) S 18869 18869 18768 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 906934159 426094592 37438 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604451642431296 0 0 -1 6 0 0 0
[pid=18886] ppid=18869 vsize=416120 CPUtime=3.24 cores=0,2,4,6
/proc/18886/stat : 18886 (python) S 18869 18869 18768 0 -1 4202560 2493 0 0 0 200 124 0 0 15 0 2 0 906934161 426106880 37423 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/18886/statm: 104030 37423 400 364 0 39945 0
[pid=18888] ppid=18886 vsize=8249492 CPUtime=1958.8 cores=0,2,4,6
/proc/18888/stat : 18888 (cryptominisat-2) T 18886 18888 18888 0 -1 4202496 10197217 0 0 0 194394 1486 0 0 25 0 1 0 906934162 8447479808 1791044 33554432000 4194304 4677096 140736192203712 18446744073709551615 4335680 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/18888/statm: 2062373 1791044 393 118 0 2057332 0
[pid=18886/tid=19041] ppid=18869 vsize=416120 CPUtime=0 cores=0,2,4,6
/proc/18886/task/19041/stat : 19041 (python) S 18869 18869 18768 0 -1 4202560 43 0 0 0 0 0 0 0 15 0 2 0 906984228 426106880 37423 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604453878166528 0 0 -1 2 0 0 0
[pid=19148] ppid=18869 vsize=426376 CPUtime=0.13 cores=0,2,4,6
/proc/19148/stat : 19148 (python) S 18869 18869 18768 0 -1 4202560 1092 0 0 0 7 6 0 0 19 0 2 0 907022774 436609024 37426 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/19148/statm: 106594 37426 399 364 0 42506 0
[pid=19150] ppid=19148 vsize=106208 CPUtime=100.11 cores=0,2,4,6
/proc/19150/stat : 19150 (SApperloT-base) T 19148 19150 19150 0 -1 4202496 26932 0 0 0 10007 4 0 0 25 0 1 0 907022774 108756992 24644 33554432000 134512640 135674940 4292945152 18446744073709551615 134551922 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/19150/statm: 26552 24644 99 284 0 26266 0
[pid=19148/tid=19154] ppid=18869 vsize=426376 CPUtime=0 cores=0,2,4,6
/proc/19148/task/19154/stat : 19154 (python) S 18869 18869 18768 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 907032787 436609024 37426 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604453985331008 0 0 -1 0 0 0 0
[pid=19155] ppid=18869 vsize=436632 CPUtime=0.61 cores=0,2,4,6
/proc/19155/stat : 19155 (python) S 18869 18869 18768 0 -1 4202560 1149 0 0 0 35 26 0 0 18 0 2 0 907032789 447111168 37430 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19155/statm: 109158 37430 399 364 0 45067 0
[pid=19157] ppid=19155 vsize=125300 CPUtime=485.5 cores=0,2,4,6
/proc/19157/stat : 19157 (lingeling) T 19155 19157 19157 0 -1 4202496 56302 0 0 0 48543 7 0 0 25 0 1 0 907032790 128307200 30496 33554432000 4194304 4352236 140733930131104 18446744073709551615 4327867 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/19157/statm: 31325 30496 129 39 0 30405 0
[pid=19155/tid=19160] ppid=18869 vsize=436632 CPUtime=0 cores=0,2,4,6
/proc/19155/task/19160/stat : 19160 (python) S 18869 18869 18768 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 907042801 447111168 37430 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604453860494144 0 0 -1 6 0 0 0
[pid=19228] ppid=18869 vsize=446888 CPUtime=0.39 cores=0,2,4,6
/proc/19228/stat : 19228 (python) S 18869 18869 18768 0 -1 4202560 1152 0 0 0 21 18 0 0 18 0 2 0 907090975 457613312 37434 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/19228/statm: 111722 37434 399 364 0 47628 0
[pid=19230] ppid=19228 vsize=211812 CPUtime=292.33 cores=0,2,4,6
/proc/19230/stat : 19230 (precosat) T 19228 19230 19230 0 -1 4202496 96816 0 0 0 29218 15 0 0 25 0 1 0 907090976 216895488 51004 33554432000 4194304 4890832 140736543840224 18446744073709551615 4238246 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/19230/statm: 52953 51004 86 171 0 52780 0
[pid=19228/tid=19236] ppid=18869 vsize=446888 CPUtime=0 cores=0,2,4,6
/proc/19228/task/19236/stat : 19236 (python) S 18869 18869 18768 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 907110600 457613312 37434 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604453891446912 0 0 -1 6 0 0 0
[pid=19237] ppid=18869 vsize=457144 CPUtime=0.13 cores=0,2,4,6
/proc/19237/stat : 19237 (python) S 18869 18869 18768 0 -1 4202560 1118 0 0 0 7 6 0 0 19 0 2 0 907110602 468115456 37438 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/19237/statm: 114286 37438 399 364 0 50189 0
[pid=19239] ppid=19237 vsize=47512 CPUtime=99.11 cores=0,2,4,6
/proc/19239/stat : 19239 (lingeling) T 19237 19239 19239 0 -1 4202496 19148 0 0 0 9908 3 0 0 25 0 1 0 907110603 48652288 11048 33554432000 4194304 4352236 140737145478368 18446744073709551615 4278712 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/19239/statm: 11878 11048 129 39 0 10958 0
[pid=19237/tid=19243] ppid=18869 vsize=457144 CPUtime=0 cores=0,2,4,6
/proc/19237/task/19243/stat : 19243 (python) S 18869 18869 18768 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 907120515 468115456 37438 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 514 18446604453888391936 0 0 -1 6 0 0 0
[pid=19305] ppid=18869 vsize=467400 CPUtime=0.51 cores=0,2,4,6
/proc/19305/stat : 19305 (python) S 18869 18869 18768 0 -1 4202560 1534 0 0 0 37 14 0 0 15 0 1 0 907276032 478617600 37413 33554432000 4194304 5683644 140736226032432 18446744073709551615 230809185862 0 0 16781312 514 13973213894630408451 0 0 17 0 0 0 0
/proc/19305/statm: 116850 37413 371 364 0 52750 0
[pid=19307] ppid=19305 vsize=3415848 CPUtime=136.82 cores=0,2,4,6
/proc/19307/stat : 19307 (cryptominisat-2) R 19305 19307 19307 0 -1 4202496 5274597 0 0 0 12965 717 0 0 25 0 1 0 907276033 3497828352 805662 33554432000 4194304 4677096 140734904176016 18446744073709551615 4293843 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/19307/statm: 853962 805662 390 118 0 848921 0
[pid=18869/tid=18877] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/18877/stat : 18877 (python) S 18867 18869 18768 0 -1 4202560 36 931 0 0 0 0 0 0 18 0 8 0 906924147 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=18887] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/18887/stat : 18887 (python) S 18867 18869 18768 0 -1 4202560 36 931 0 0 0 0 0 0 18 0 8 0 906934162 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=19149] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/19149/stat : 19149 (python) S 18867 18869 18768 0 -1 4202560 24 931 0 0 0 0 0 0 20 0 8 0 907022774 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=19156] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/19156/stat : 19156 (python) S 18867 18869 18768 0 -1 4202560 32 931 0 0 0 0 0 0 18 0 8 0 907032789 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=19229] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/19229/stat : 19229 (python) S 18867 18869 18768 0 -1 4202560 33 931 0 0 0 0 0 0 18 0 8 0 907090976 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 4 0 0 0
[pid=18869/tid=19238] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/19238/stat : 19238 (python) S 18867 18869 18768 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 8 0 907110602 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 0 0 0 0
[pid=18869/tid=19306] ppid=18867 vsize=477644 CPUtime=0 cores=0,2,4,6
/proc/18869/task/19306/stat : 19306 (python) S 18867 18869 18768 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 8 0 907276033 489107456 38934 33554432000 4194304 5683644 140736226032432 18446744073709551615 230820989361 0 0 16781312 2 18446604453888453568 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3700.98
Current children cumulated vsize (KiB) 15882848

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18869 and gives
#  childrusage.ru_utime.tv_sec=39
#  childrusage.ru_utime.tv_usec=821946
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=214967
# CPU time returned by wait4() is 40.0369
# while last known CPU time is 3700.98
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3695.76
CPU time (s): 3700.98
CPU user time (s): 3676.07
CPU system time (s): 24.91
CPU usage (%): 100.141
Max. virtual memory (cumulated for all children) (KiB): 15882848

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39.8219
system time used= 0.214967
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 65669
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2693
involuntary context switches= 97

runsolver used 7.8938 second user time and 14.3558 second system time

The end

Launcher Data 

Begin job on node104 at 2011-06-13 10:19:57
IDJOB=3498355
IDBENCH=82372
IDSOLVER=1991
FILE ID=node104/3498355-1307953196
RUNJOBID= node104-1307953128-18786
PBS_JOBID= 13559724
Free space on /var/tmp= 2832 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /var/tmp/evaluation-result-3498355-1307953196/watcher-3498355-1307953196 -o /var/tmp/evaluation-result-3498355-1307953196/solver-3498355-1307953196 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498355-1307953196.cnf -seed 1042763137 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c4319228342e10028de028a9b67c3404
RANDOM SEED=1042763137

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       3330192 kB
Buffers:        102964 kB
Cached:       28373772 kB
SwapCached:      11468 kB
Active:       13574968 kB
Inactive:     15133968 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       3330192 kB
SwapTotal:    67111528 kB
SwapFree:     67053020 kB
Dirty:           57724 kB
Writeback:           0 kB
AnonPages:      229660 kB
Mapped:          14720 kB
Slab:           845236 kB
PageTables:       6328 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   606400 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /var/tmp at the end= 2816 MiB
End job on node104 at 2011-06-13 11:21:35