Trace number 3498539

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed)? (TO) 5000.1 4994.39

General information on the benchmark

NameSAT-Race-2010-CNF/hardware-verification/
velev/11pipe_11_ooo.cnf
MD5SUMf603f11fbfe855df381282b7bce010ea
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2200.85
Satisfiable
(Un)Satisfiability was proved
Number of variables88289
Number of clauses4187694
Sum of the clauses size12410354
Maximum clause length341
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 23770000
Number of clauses of size 3347602
Number of clauses of size 41622
Number of clauses of size 51351
Number of clauses of size over 567118

Solver Data 

0.40/0.76	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.40/0.76	c INFO: solving HOME/instance-3498539-1307958134.cnf
0.40/0.76	c INFO: computing task features
14.68/15.08	c INFO: computed variable-clause graph statistics
15.18/15.58	c INFO: computed clause balance statistics
77.48/77.86	c INFO: computed variable balance statistics
119.28/119.67	c INFO: computed small-clause counts
119.89/120.28	c INFO: computed Horn-clause counts
135.28/135.66	c INFO: computed variable graph statistics
135.28/135.68	c INFO: collected features for HOME/instance-3498539-1307958134.cnf in 134.30 s
135.37/135.71	c INFO: running lingeling-276@0 for 97 with 4865 remaining (b = 0.54)
235.58/235.86	c INFO: running SApperloT@0 for 97 with 4765 remaining (b = 0.08)
335.87/336.03	c INFO: running cryptominisat-2.9.0@0 for 485 with 4665 remaining (b = 0.33)
823.08/822.65	c INFO: running lingeling-276@99 for 388 with 4180 remaining (b = 0.29)
1214.96/1214.06	c INFO: running lingeling-276@0 for 97 with 3788 remaining (b = 0.42)
1315.23/1314.22	c INFO: running lingeling-276@99 for 388 with 3689 remaining (b = 0.22)
1704.11/1702.64	c INFO: running lingeling-276@0 for 97 with 3300 remaining (b = 0.37)
1804.30/1802.79	c INFO: running precosat-570@0 for 97 with 3200 remaining (b = 0.11)
1904.61/1902.95	c INFO: running precosat-570@99 for 97 with 3101 remaining (b = 0.04)
1999.83/1998.07	c INFO: running precosat-570@194 for 97 with 3005 remaining (b = 0.05)
2101.04/2099.19	c INFO: running precosat-570@0 for 97 with 2904 remaining (b = 0.08)
2201.34/2199.36	c INFO: running precosat-570@296 for 97 with 2805 remaining (b = 0.03)
2298.59/2296.49	c INFO: running precosat-570@99 for 97 with 2707 remaining (b = 0.03)
2395.93/2393.62	c INFO: running lingeling-276@491 for 776 with 2610 remaining (b = 0.19)
3172.64/3169.42	c INFO: running cryptominisat-2.9.0@0 for 1649 with 1835 remaining (b = 0.37)
4829.00/4823.41	c INFO: running precosat-570@0 for 183 with 183 remaining (b = 0.05)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3498539-1307958134/watcher-3498539-1307958134 -o /tmp/evaluation-result-3498539-1307958134/solver-3498539-1307958134 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498539-1307958134.cnf -seed 1292154303 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.02 1.97 2/209 10634
/proc/meminfo: memFree=3226928/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=15080 CPUtime=0 cores=1,3,5,7
/proc/10634/stat : 10634 (python) S 10632 10634 10287 0 -1 4202496 650 0 0 0 0 0 0 0 22 0 1 0 986044582 15441920 544 33554432000 4194304 5683644 140735825592160 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/10634/statm: 3804 547 312 364 0 291 0

[startup+0.0147879 s]
/proc/loadavg: 2.00 2.02 1.97 2/209 10634
/proc/meminfo: memFree=3226928/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=15772 CPUtime=0 cores=1,3,5,7
/proc/10634/stat : 10634 (python) R 10632 10634 10287 0 -1 4202496 903 0 0 0 0 0 0 0 17 0 1 0 986044582 16150528 782 33554432000 4194304 5683644 140735825592160 18446744073709551615 4426576 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10634/statm: 3943 782 345 364 0 430 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15772

[startup+0.100813 s]
/proc/loadavg: 2.00 2.02 1.97 2/209 10634
/proc/meminfo: memFree=3226928/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=52408 CPUtime=0.06 cores=1,3,5,7
/proc/10634/stat : 10634 (python) R 10632 10634 10287 0 -1 4202496 2011 0 0 0 4 2 0 0 17 0 1 0 986044582 53665792 1769 33554432000 4194304 5683644 140735825592160 18446744073709551615 224280002663 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10634/statm: 13102 1772 482 364 0 1283 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 52408

[startup+0.300713 s]
/proc/loadavg: 2.00 2.02 1.97 2/209 10634
/proc/meminfo: memFree=3226928/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=135748 CPUtime=0.18 cores=1,3,5,7
/proc/10634/stat : 10634 (python) S 10632 10634 10287 0 -1 4202496 5971 931 1 0 13 5 0 0 17 0 1 0 986044582 139005952 4148 33554432000 4194304 5683644 140735825592160 18446744073709551615 224284921861 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/10634/statm: 33937 4148 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.702442 s]
/proc/loadavg: 2.00 2.02 1.97 2/209 10634
/proc/meminfo: memFree=3226928/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=256996 CPUtime=0.4 cores=1,3,5,7
/proc/10634/stat : 10634 (python) S 10632 10634 10287 0 -1 4202496 8544 931 1 0 28 12 0 0 15 0 1 0 986044582 263163904 6397 33554432000 4194304 5683644 140735825592160 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/10634/statm: 64249 6397 1648 364 0 5128 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 256996

[startup+1.50056 s]
/proc/loadavg: 2.08 2.04 1.97 3/210 10639
/proc/meminfo: memFree=3112368/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=407228 CPUtime=1.18 cores=1,3,5,7
/proc/10634/stat : 10634 (python) R 10632 10634 10287 0 -1 4202496 40994 931 1 0 100 18 0 0 16 0 1 0 986044582 417001472 38664 33554432000 4194304 5683644 140735825592160 18446744073709551615 224284586693 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/10634/statm: 101807 38664 1761 364 0 37731 0
Current children cumulated CPU time (s) 1.18
Current children cumulated vsize (KiB) 407228

[startup+3.10028 s]
/proc/loadavg: 2.08 2.04 1.97 3/210 10639
/proc/meminfo: memFree=3041680/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=506916 CPUtime=2.78 cores=1,3,5,7
/proc/10634/stat : 10634 (python) R 10632 10634 10287 0 -1 4202496 66228 931 1 0 256 22 0 0 18 0 1 0 986044582 519081984 63898 33554432000 4194304 5683644 140735825592160 18446744073709551615 4418224 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/10634/statm: 126729 63898 1761 364 0 62653 0
Current children cumulated CPU time (s) 2.78
Current children cumulated vsize (KiB) 506916

[startup+6.30074 s]
/proc/loadavg: 2.00 2.02 1.97 2/172 10664
/proc/meminfo: memFree=7251988/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=725204 CPUtime=5.98 cores=1,3,5,7
/proc/10634/stat : 10634 (python) R 10632 10634 10287 0 -1 4202496 118322 931 1 0 568 30 0 0 25 0 1 0 986044582 742608896 115992 33554432000 4194304 5683644 140735825592160 18446744073709551615 224284586693 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/10634/statm: 181301 115992 1761 364 0 117225 0
Current children cumulated CPU time (s) 5.98
Current children cumulated vsize (KiB) 725204

[startup+12.7007 s]
/proc/loadavg: 1.92 2.00 1.96 2/172 10664
/proc/meminfo: memFree=6844748/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=1118028 CPUtime=12.38 cores=1,3,5,7
/proc/10634/stat : 10634 (python) R 10632 10634 10287 0 -1 4202496 214519 931 1 0 1195 43 0 0 25 0 1 0 986044582 1144860672 212189 33554432000 4194304 5683644 140735825592160 18446744073709551615 4458890 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/10634/statm: 279507 212190 1761 364 0 215431 0
Current children cumulated CPU time (s) 12.38
Current children cumulated vsize (KiB) 1118028

[startup+25.5005 s]
/proc/loadavg: 1.77 1.97 1.95 2/172 10664
/proc/meminfo: memFree=6805244/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=1104444 CPUtime=25.18 cores=1,3,5,7
/proc/10634/stat : 10634 (python) R 10632 10634 10287 0 -1 4202496 426343 931 1 0 2448 70 0 0 25 0 1 0 986044582 1130950656 213528 33554432000 4194304 5683644 140735825592160 18446744073709551615 47397148329678 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/10634/statm: 276111 213528 1826 364 0 212035 0
Current children cumulated CPU time (s) 25.18
Current children cumulated vsize (KiB) 1104444

[startup+51.1003 s]
/proc/loadavg: 1.47 1.88 1.92 2/172 10664
/proc/meminfo: memFree=6805788/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=1104444 CPUtime=50.78 cores=1,3,5,7
/proc/10634/stat : 10634 (python) R 10632 10634 10287 0 -1 4202496 426343 931 1 0 5008 70 0 0 25 0 1 0 986044582 1130950656 213528 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296763063 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/10634/statm: 276111 213528 1826 364 0 212035 0
Current children cumulated CPU time (s) 50.78
Current children cumulated vsize (KiB) 1104444

[startup+102.306 s]
/proc/loadavg: 1.20 1.74 1.87 2/172 10666
/proc/meminfo: memFree=6805980/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=1104444 CPUtime=101.99 cores=1,3,5,7
/proc/10634/stat : 10634 (python) R 10632 10634 10287 0 -1 4202496 426344 931 1 0 10129 70 0 0 25 0 1 0 986044582 1130950656 213529 33554432000 4194304 5683644 140735825592160 18446744073709551615 4941989 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/10634/statm: 276111 213529 1827 364 0 212035 0
Current children cumulated CPU time (s) 101.99
Current children cumulated vsize (KiB) 1104444

[startup+162.301 s]
/proc/loadavg: 1.07 1.60 1.81 2/175 10671
/proc/meminfo: memFree=6979784/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=746880 CPUtime=135.4 cores=1,3,5,7
/proc/10634/stat : 10634 (python) S 10632 10634 10287 0 -1 4202496 475695 931 1 0 13461 79 0 0 19 0 2 0 986044582 764805120 121623 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/10634/statm: 186720 121623 1875 364 0 122638 0
[pid=10669] ppid=10634 vsize=736636 CPUtime=0.03 cores=1,3,5,7
/proc/10669/stat : 10669 (python) S 10634 10634 10287 0 -1 4202560 982 0 0 0 1 2 0 0 18 0 1 0 986058154 754315264 120125 33554432000 4194304 5683644 140735825592160 18446744073709551615 224284945935 0 0 16781312 514 9150399649142505736 0 0 17 3 0 0 0
/proc/10669/statm: 184159 120125 381 364 0 120077 0
[pid=10671] ppid=10669 vsize=194780 CPUtime=26.55 cores=1,3,5,7
/proc/10671/stat : 10671 (lingeling) R 10669 10671 10671 0 -1 4202496 91240 0 0 0 2638 17 0 0 25 0 1 0 986058155 199454720 47865 33554432000 4194304 4352236 140733520449248 18446744073709551615 4207615 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/10671/statm: 48695 47865 129 39 0 47775 0
[pid=10634/tid=10670] ppid=10632 vsize=746880 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10670/stat : 10670 (python) S 10632 10634 10287 0 -1 4202560 31 931 0 0 0 0 0 0 19 0 2 0 986058155 764805120 121623 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 161.98
Current children cumulated vsize (KiB) 1678296

[startup+222.301 s]
/proc/loadavg: 1.02 1.49 1.76 2/175 10673
/proc/meminfo: memFree=6960612/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=746880 CPUtime=135.4 cores=1,3,5,7
/proc/10634/stat : 10634 (python) S 10632 10634 10287 0 -1 4202496 475695 931 1 0 13461 79 0 0 19 0 2 0 986044582 764805120 121623 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/10634/statm: 186720 121623 1875 364 0 122638 0
[pid=10669] ppid=10634 vsize=736636 CPUtime=0.1 cores=1,3,5,7
/proc/10669/stat : 10669 (python) S 10634 10634 10287 0 -1 4202560 1001 0 0 0 5 5 0 0 18 0 1 0 986058154 754315264 120125 33554432000 4194304 5683644 140735825592160 18446744073709551615 224284945935 0 0 16781312 514 9150399649142505736 0 0 17 3 0 0 0
/proc/10669/statm: 184159 120125 381 364 0 120077 0
[pid=10671] ppid=10669 vsize=212880 CPUtime=86.56 cores=1,3,5,7
/proc/10671/stat : 10671 (lingeling) R 10669 10671 10671 0 -1 4202496 132586 0 0 0 8634 22 0 0 25 0 1 0 986058155 217989120 52390 33554432000 4194304 4352236 140733520449248 18446744073709551615 4257313 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/10671/statm: 53220 52390 129 39 0 52300 0
[pid=10634/tid=10670] ppid=10632 vsize=746880 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10670/stat : 10670 (python) S 10632 10634 10287 0 -1 4202560 31 931 0 0 0 0 0 0 19 0 2 0 986058155 764805120 121623 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 222.06
Current children cumulated vsize (KiB) 1696396

[startup+282.301 s]
/proc/loadavg: 1.01 1.40 1.71 2/179 10679
/proc/meminfo: memFree=6744948/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=757136 CPUtime=135.44 cores=1,3,5,7
/proc/10634/stat : 10634 (python) S 10632 10634 10287 0 -1 4202496 476468 931 1 0 13464 80 0 0 20 0 3 0 986044582 775307264 121630 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/10634/statm: 189284 121630 1878 364 0 125199 0
[pid=10669] ppid=10634 vsize=746880 CPUtime=0.12 cores=1,3,5,7
/proc/10669/stat : 10669 (python) S 10634 10634 10287 0 -1 4202560 1164 0 0 0 6 6 0 0 19 0 2 0 986058154 764805120 120163 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10669/statm: 186720 120163 414 364 0 122638 0
[pid=10671] ppid=10669 vsize=246404 CPUtime=100.1 cores=1,3,5,7
/proc/10671/stat : 10671 (lingeling) T 10669 10671 10671 0 -1 4202496 140967 0 0 0 9987 23 0 0 25 0 1 0 986058155 252317696 60771 33554432000 4194304 4352236 140733520449248 18446744073709551615 4307912 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/10671/statm: 61601 60771 129 39 0 60681 0
[pid=10669/tid=10674] ppid=10634 vsize=746880 CPUtime=0 cores=1,3,5,7
/proc/10669/task/10674/stat : 10674 (python) S 10634 10634 10287 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 986068167 764805120 120163 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471127925888 0 0 -1 5 0 0 0
[pid=10675] ppid=10634 vsize=746892 CPUtime=0.06 cores=1,3,5,7
/proc/10675/stat : 10675 (python) S 10634 10634 10287 0 -1 4202560 920 0 0 0 2 4 0 0 18 0 1 0 986068169 764817408 120118 33554432000 4194304 5683644 140735825592160 18446744073709551615 224284945990 0 0 16781312 514 9150399649142505736 0 0 17 5 0 0 0
/proc/10675/statm: 186723 120118 370 364 0 122638 0
[pid=10677] ppid=10675 vsize=201220 CPUtime=46.4 cores=1,3,5,7
/proc/10677/stat : 10677 (SApperloT-base) R 10675 10677 10677 0 -1 4202496 45147 0 0 0 4630 10 0 0 25 0 1 0 986068171 206049280 44687 33554432000 134512640 135674940 4294279728 18446744073709551615 134564152 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10677/statm: 50305 44687 100 284 0 50019 0
[pid=10634/tid=10670] ppid=10632 vsize=757136 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10670/stat : 10670 (python) S 10632 10634 10287 0 -1 4202560 31 931 0 0 0 0 0 0 19 0 3 0 986058155 775307264 121630 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 7 0 0 0
[pid=10634/tid=10676] ppid=10632 vsize=757136 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10676/stat : 10676 (python) S 10632 10634 10287 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 3 0 986068171 775307264 121630 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 282.12
Current children cumulated vsize (KiB) 2698532

[startup+342.301 s]
/proc/loadavg: 1.00 1.32 1.66 2/183 10683
/proc/meminfo: memFree=6306124/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=767392 CPUtime=135.47 cores=1,3,5,7
/proc/10634/stat : 10634 (python) S 10632 10634 10287 0 -1 4202496 477291 931 1 0 13466 81 0 0 19 0 4 0 986044582 785809408 121636 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/10634/statm: 191848 121636 1880 364 0 127760 0
[pid=10669] ppid=10634 vsize=746880 CPUtime=0.12 cores=1,3,5,7
/proc/10669/stat : 10669 (python) S 10634 10634 10287 0 -1 4202560 1164 0 0 0 6 6 0 0 19 0 2 0 986058154 764805120 120163 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10669/statm: 186720 120163 414 364 0 122638 0
[pid=10671] ppid=10669 vsize=246404 CPUtime=100.1 cores=1,3,5,7
/proc/10671/stat : 10671 (lingeling) T 10669 10671 10671 0 -1 4202496 140967 0 0 0 9987 23 0 0 25 0 1 0 986058155 252317696 60771 33554432000 4194304 4352236 140733520449248 18446744073709551615 4307912 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/10671/statm: 61601 60771 129 39 0 60681 0

################
# More data... #
################

/proc/10736/stat : 10736 (lingeling) T 10734 10736 10736 0 -1 4202496 157672 0 0 0 9987 23 0 0 25 0 1 0 986214848 218574848 52533 33554432000 4194304 4352236 140734589911696 18446744073709551615 4328063 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/10736/statm: 53363 52533 129 39 0 52443 0
[pid=10734/tid=10741] ppid=10634 vsize=777660 CPUtime=0 cores=1,3,5,7
/proc/10734/task/10741/stat : 10741 (python) S 10634 10634 10287 0 -1 4202560 54 0 0 0 0 0 0 0 19 0 2 0 986224860 796323840 120160 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604460387209600 0 0 -1 3 0 0 0
[pid=10742] ppid=10634 vsize=787916 CPUtime=0.49 cores=1,3,5,7
/proc/10742/stat : 10742 (python) S 10634 10634 10287 0 -1 4202560 1151 0 0 0 23 26 0 0 18 0 2 0 986224862 806825984 120164 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10742/statm: 196979 120164 399 364 0 132882 0
[pid=10744] ppid=10742 vsize=560448 CPUtime=393.42 cores=1,3,5,7
/proc/10744/stat : 10744 (precosat) T 10742 10744 10744 0 -1 4202496 138974 0 0 0 39317 25 0 0 25 0 1 0 986224864 573898752 137127 33554432000 4194304 4890832 140737162659264 18446744073709551615 4295352 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/10744/statm: 140112 137127 86 171 0 139939 0
[pid=10742/tid=10747] ppid=10634 vsize=787916 CPUtime=0 cores=1,3,5,7
/proc/10742/task/10747/stat : 10747 (python) S 10634 10634 10287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 986234876 806825984 120164 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471124579328 0 0 -1 5 0 0 0
[pid=10754] ppid=10634 vsize=798172 CPUtime=0.26 cores=1,3,5,7
/proc/10754/stat : 10754 (python) S 10634 10634 10287 0 -1 4202560 1142 0 0 0 14 12 0 0 18 0 2 0 986254502 817328128 120168 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10754/statm: 199543 120168 399 364 0 135443 0
[pid=10756] ppid=10754 vsize=560436 CPUtime=197.23 cores=1,3,5,7
/proc/10756/stat : 10756 (precosat) T 10754 10756 10756 0 -1 4202496 140326 0 0 0 19691 32 0 0 25 0 1 0 986254503 573886464 137825 33554432000 4194304 4890832 140735579201408 18446744073709551615 4458879 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/10756/statm: 140109 137825 86 171 0 139936 0
[pid=10754/tid=10759] ppid=10634 vsize=798172 CPUtime=0 cores=1,3,5,7
/proc/10754/task/10759/stat : 10759 (python) S 10634 10634 10287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 986264517 817328128 120168 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471134875904 0 0 -1 5 0 0 0
[pid=10786] ppid=10634 vsize=808428 CPUtime=2.36 cores=1,3,5,7
/proc/10786/stat : 10786 (python) S 10634 10634 10287 0 -1 4202560 1239 0 0 0 122 114 0 0 17 0 2 0 986361525 827830272 120178 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10786/statm: 202107 120178 405 364 0 138004 0
[pid=10788] ppid=10786 vsize=2577248 CPUtime=1653.97 cores=1,3,5,7
/proc/10788/stat : 10788 (cryptominisat-2) T 10786 10788 10788 0 -1 4202496 1001350 0 0 0 165188 209 0 0 25 0 1 0 986361526 2639101952 509471 33554432000 4194304 4677096 140737308250096 18446744073709551615 4320155 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/10788/statm: 644312 509471 394 118 0 639271 0
[pid=10786/tid=10845] ppid=10634 vsize=808428 CPUtime=0 cores=1,3,5,7
/proc/10786/task/10845/stat : 10845 (python) S 10634 10634 10287 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 986526923 827830272 120178 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471130089280 0 0 -1 3 0 0 0
[pid=10846] ppid=10634 vsize=818684 CPUtime=0.23 cores=1,3,5,7
/proc/10846/stat : 10846 (python) S 10634 10634 10287 0 -1 4202560 969 0 0 0 11 12 0 0 18 0 1 0 986526924 838332416 120146 33554432000 4194304 5683644 140735825592160 18446744073709551615 224284945990 0 0 16781312 514 9150399649142505732 0 0 17 7 0 0 0
/proc/10846/statm: 204671 120146 370 364 0 140565 0
[pid=10848] ppid=10846 vsize=560436 CPUtime=170.85 cores=1,3,5,7
/proc/10848/stat : 10848 (precosat) R 10846 10848 10848 0 -1 4202496 139224 0 0 0 17056 29 0 0 25 0 1 0 986526925 573886464 137408 33554432000 4194304 4890832 140734115959392 18446744073709551615 4246687 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/10848/statm: 140109 137408 86 171 0 139936 0
[pid=10634/tid=10670] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10670/stat : 10670 (python) S 10632 10634 10287 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 10 0 986058155 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 7 0 0 0
[pid=10634/tid=10676] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10676/stat : 10676 (python) S 10632 10634 10287 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 10 0 986068171 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 3 0 0 0
[pid=10634/tid=10682] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10682/stat : 10682 (python) S 10632 10634 10287 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 10 0 986078187 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 3 0 0 0
[pid=10634/tid=10719] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10719/stat : 10719 (python) S 10632 10634 10287 0 -1 4202560 28 931 0 0 0 0 0 0 18 0 10 0 986165991 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 5 0 0 0
[pid=10634/tid=10735] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10735/stat : 10735 (python) S 10632 10634 10287 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 10 0 986214848 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 5 0 0 0
[pid=10634/tid=10743] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10743/stat : 10743 (python) S 10632 10634 10287 0 -1 4202560 32 931 0 0 0 0 0 0 18 0 10 0 986224864 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 5 0 0 0
[pid=10634/tid=10755] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10755/stat : 10755 (python) S 10632 10634 10287 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 10 0 986254503 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 3 0 0 0
[pid=10634/tid=10787] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10787/stat : 10787 (python) S 10632 10634 10287 0 -1 4202560 35 931 0 0 0 0 0 0 20 0 10 0 986361526 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 3 0 0 0
[pid=10634/tid=10847] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10847/stat : 10847 (python) S 10632 10634 10287 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 10 0 986526925 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5000.1
Current children cumulated vsize (KiB) 15314500

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4994.3 s]
/proc/loadavg: 1.05 1.03 1.01 2/207 10852
/proc/meminfo: memFree=626736/32951124 swapFree=67049472/67111528
[pid=10634] ppid=10632 vsize=828928 CPUtime=135.77 cores=1,3,5,7
/proc/10634/stat : 10634 (python) S 10632 10634 10287 0 -1 4202496 482529 931 1 0 13488 89 0 0 20 0 10 0 986044582 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/10634/statm: 207232 121672 1892 364 0 143126 0
[pid=10669] ppid=10634 vsize=746880 CPUtime=1.49 cores=1,3,5,7
/proc/10669/stat : 10669 (python) S 10634 10634 10287 0 -1 4202560 1208 0 0 0 77 72 0 0 18 0 2 0 986058154 764805120 120164 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10669/statm: 186720 120164 415 364 0 122638 0
[pid=10671] ppid=10669 vsize=231656 CPUtime=1267.29 cores=1,3,5,7
/proc/10671/stat : 10671 (lingeling) T 10669 10671 10671 0 -1 4202496 506922 0 0 0 126655 74 0 0 25 0 1 0 986058155 237215744 57114 33554432000 4194304 4352236 140733520449248 18446744073709551615 4276521 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/10671/statm: 57914 57114 129 39 0 56994 0
[pid=10669/tid=10674] ppid=10634 vsize=746880 CPUtime=0 cores=1,3,5,7
/proc/10669/task/10674/stat : 10674 (python) S 10634 10634 10287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 986068167 764805120 120164 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471127925888 0 0 -1 5 0 0 0
[pid=10675] ppid=10634 vsize=746892 CPUtime=0.12 cores=1,3,5,7
/proc/10675/stat : 10675 (python) S 10634 10634 10287 0 -1 4202560 1090 0 0 0 5 7 0 0 19 0 2 0 986068169 764817408 120148 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10675/statm: 186723 120148 399 364 0 122638 0
[pid=10677] ppid=10675 vsize=296152 CPUtime=100.1 cores=1,3,5,7
/proc/10677/stat : 10677 (SApperloT-base) T 10675 10677 10677 0 -1 4202496 68711 0 0 0 9997 13 0 0 25 0 1 0 986068171 303259648 68122 33554432000 134512640 135674940 4294279728 18446744073709551615 134564250 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/10677/statm: 74038 68122 100 284 0 73752 0
[pid=10675/tid=10680] ppid=10634 vsize=746892 CPUtime=0 cores=1,3,5,7
/proc/10675/task/10680/stat : 10680 (python) S 10634 10634 10287 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 986078183 764817408 120148 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471110663104 0 0 -1 5 0 0 0
[pid=10681] ppid=10634 vsize=757148 CPUtime=0.64 cores=1,3,5,7
/proc/10681/stat : 10681 (python) S 10634 10634 10287 0 -1 4202560 1159 0 0 0 33 31 0 0 16 0 2 0 986078186 775319552 120152 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10681/statm: 189287 120152 399 364 0 125199 0
[pid=10683] ppid=10681 vsize=2256664 CPUtime=486.57 cores=1,3,5,7
/proc/10683/stat : 10683 (cryptominisat-2) T 10681 10683 10683 0 -1 4202496 635801 0 0 0 48559 98 0 0 25 0 1 0 986078187 2310823936 467329 33554432000 4194304 4677096 140735017321600 18446744073709551615 4319802 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/10683/statm: 564166 467329 391 118 0 559125 0
[pid=10681/tid=10698] ppid=10634 vsize=757148 CPUtime=0 cores=1,3,5,7
/proc/10681/task/10698/stat : 10698 (python) S 10634 10634 10287 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 986126845 775319552 120152 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471098952512 0 0 -1 3 0 0 0
[pid=10718] ppid=10634 vsize=767404 CPUtime=0.58 cores=1,3,5,7
/proc/10718/stat : 10718 (python) S 10634 10634 10287 0 -1 4202560 1153 0 0 0 30 28 0 0 18 0 2 0 986165989 785821696 120156 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10718/statm: 191851 120156 399 364 0 127760 0
[pid=10720] ppid=10718 vsize=219896 CPUtime=488.5 cores=1,3,5,7
/proc/10720/stat : 10720 (lingeling) T 10718 10720 10720 0 -1 4202496 314964 0 0 0 48808 42 0 0 25 0 1 0 986165991 225173504 54144 33554432000 4194304 4352236 140737473438528 18446744073709551615 4328013 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/10720/statm: 54974 54144 129 39 0 54054 0
[pid=10718/tid=10723] ppid=10634 vsize=767404 CPUtime=0 cores=1,3,5,7
/proc/10718/task/10723/stat : 10723 (python) S 10634 10634 10287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 986176003 785821696 120156 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471134876800 0 0 -1 7 0 0 0
[pid=10734] ppid=10634 vsize=777660 CPUtime=0.13 cores=1,3,5,7
/proc/10734/stat : 10734 (python) S 10634 10634 10287 0 -1 4202560 1110 0 0 0 6 7 0 0 19 0 2 0 986214847 796323840 120160 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10734/statm: 194415 120160 399 364 0 130321 0
[pid=10736] ppid=10734 vsize=213452 CPUtime=100.1 cores=1,3,5,7
/proc/10736/stat : 10736 (lingeling) T 10734 10736 10736 0 -1 4202496 157672 0 0 0 9987 23 0 0 25 0 1 0 986214848 218574848 52533 33554432000 4194304 4352236 140734589911696 18446744073709551615 4328063 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/10736/statm: 53363 52533 129 39 0 52443 0
[pid=10734/tid=10741] ppid=10634 vsize=777660 CPUtime=0 cores=1,3,5,7
/proc/10734/task/10741/stat : 10741 (python) S 10634 10634 10287 0 -1 4202560 54 0 0 0 0 0 0 0 19 0 2 0 986224860 796323840 120160 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604460387209600 0 0 -1 3 0 0 0
[pid=10742] ppid=10634 vsize=787916 CPUtime=0.49 cores=1,3,5,7
/proc/10742/stat : 10742 (python) S 10634 10634 10287 0 -1 4202560 1151 0 0 0 23 26 0 0 18 0 2 0 986224862 806825984 120164 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10742/statm: 196979 120164 399 364 0 132882 0
[pid=10744] ppid=10742 vsize=560448 CPUtime=393.42 cores=1,3,5,7
/proc/10744/stat : 10744 (precosat) T 10742 10744 10744 0 -1 4202496 138974 0 0 0 39317 25 0 0 25 0 1 0 986224864 573898752 137127 33554432000 4194304 4890832 140737162659264 18446744073709551615 4295352 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/10744/statm: 140112 137127 86 171 0 139939 0
[pid=10742/tid=10747] ppid=10634 vsize=787916 CPUtime=0 cores=1,3,5,7
/proc/10742/task/10747/stat : 10747 (python) S 10634 10634 10287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 986234876 806825984 120164 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471124579328 0 0 -1 5 0 0 0
[pid=10754] ppid=10634 vsize=798172 CPUtime=0.26 cores=1,3,5,7
/proc/10754/stat : 10754 (python) S 10634 10634 10287 0 -1 4202560 1142 0 0 0 14 12 0 0 18 0 2 0 986254502 817328128 120168 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10754/statm: 199543 120168 399 364 0 135443 0
[pid=10756] ppid=10754 vsize=560436 CPUtime=197.23 cores=1,3,5,7
/proc/10756/stat : 10756 (precosat) T 10754 10756 10756 0 -1 4202496 140326 0 0 0 19691 32 0 0 25 0 1 0 986254503 573886464 137825 33554432000 4194304 4890832 140735579201408 18446744073709551615 4458879 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/10756/statm: 140109 137825 86 171 0 139936 0
[pid=10754/tid=10759] ppid=10634 vsize=798172 CPUtime=0 cores=1,3,5,7
/proc/10754/task/10759/stat : 10759 (python) S 10634 10634 10287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 986264517 817328128 120168 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471134875904 0 0 -1 5 0 0 0
[pid=10786] ppid=10634 vsize=808428 CPUtime=2.36 cores=1,3,5,7
/proc/10786/stat : 10786 (python) S 10634 10634 10287 0 -1 4202560 1239 0 0 0 122 114 0 0 17 0 2 0 986361525 827830272 120178 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10786/statm: 202107 120178 405 364 0 138004 0
[pid=10788] ppid=10786 vsize=2577248 CPUtime=1653.97 cores=1,3,5,7
/proc/10788/stat : 10788 (cryptominisat-2) T 10786 10788 10788 0 -1 4202496 1001350 0 0 0 165188 209 0 0 25 0 1 0 986361526 2639101952 509471 33554432000 4194304 4677096 140737308250096 18446744073709551615 4320155 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/10788/statm: 644312 509471 394 118 0 639271 0
[pid=10786/tid=10845] ppid=10634 vsize=808428 CPUtime=0 cores=1,3,5,7
/proc/10786/task/10845/stat : 10845 (python) S 10634 10634 10287 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 986526923 827830272 120178 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 514 18446604471130089280 0 0 -1 3 0 0 0
[pid=10846] ppid=10634 vsize=818684 CPUtime=0.23 cores=1,3,5,7
/proc/10846/stat : 10846 (python) S 10634 10634 10287 0 -1 4202560 969 0 0 0 11 12 0 0 18 0 1 0 986526924 838332416 120146 33554432000 4194304 5683644 140735825592160 18446744073709551615 224284945990 0 0 16781312 514 9150399649142505732 0 0 17 7 0 0 0
/proc/10846/statm: 204671 120146 370 364 0 140565 0
[pid=10848] ppid=10846 vsize=560436 CPUtime=170.85 cores=1,3,5,7
/proc/10848/stat : 10848 (precosat) R 10846 10848 10848 0 -1 4202496 139224 0 0 0 17056 29 0 0 25 0 1 0 986526925 573886464 137408 33554432000 4194304 4890832 140734115959392 18446744073709551615 4246687 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/10848/statm: 140109 137408 86 171 0 139936 0
[pid=10634/tid=10670] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10670/stat : 10670 (python) S 10632 10634 10287 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 10 0 986058155 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 7 0 0 0
[pid=10634/tid=10676] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10676/stat : 10676 (python) S 10632 10634 10287 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 10 0 986068171 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 3 0 0 0
[pid=10634/tid=10682] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10682/stat : 10682 (python) S 10632 10634 10287 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 10 0 986078187 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 3 0 0 0
[pid=10634/tid=10719] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10719/stat : 10719 (python) S 10632 10634 10287 0 -1 4202560 28 931 0 0 0 0 0 0 18 0 10 0 986165991 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 5 0 0 0
[pid=10634/tid=10735] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10735/stat : 10735 (python) S 10632 10634 10287 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 10 0 986214848 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 5 0 0 0
[pid=10634/tid=10743] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10743/stat : 10743 (python) S 10632 10634 10287 0 -1 4202560 32 931 0 0 0 0 0 0 18 0 10 0 986224864 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 5 0 0 0
[pid=10634/tid=10755] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10755/stat : 10755 (python) S 10632 10634 10287 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 10 0 986254503 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 3 0 0 0
[pid=10634/tid=10787] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10787/stat : 10787 (python) S 10632 10634 10287 0 -1 4202560 35 931 0 0 0 0 0 0 20 0 10 0 986361526 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 3 0 0 0
[pid=10634/tid=10847] ppid=10632 vsize=828928 CPUtime=0 cores=1,3,5,7
/proc/10634/task/10847/stat : 10847 (python) S 10632 10634 10287 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 10 0 986526925 848822272 121672 33554432000 4194304 5683644 140735825592160 18446744073709551615 224296749489 0 0 16781312 2 18446604471124581120 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5000.1
Current children cumulated vsize (KiB) 15314500

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10634 and gives
#  childrusage.ru_utime.tv_sec=134
#  childrusage.ru_utime.tv_usec=885494
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=916860
# CPU time returned by wait4() is 135.802
# while last known CPU time is 5000.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4994.39
CPU time (s): 5000.1
CPU user time (s): 4990.67
CPU system time (s): 9.43
CPU usage (%): 100.114
Max. virtual memory (cumulated for all children) (KiB): 15314500

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 134.885
system time used= 0.91686
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 483467
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2913
involuntary context switches= 366

runsolver used 15.2697 second user time and 37.9162 second system time

The end

Launcher Data 

Begin job on node118 at 2011-06-13 11:42:17
IDJOB=3498539
IDBENCH=88163
IDSOLVER=1991
FILE ID=node118/3498539-1307958134
RUNJOBID= node118-1307953121-10306
PBS_JOBID= 13559710
Free space on /tmp= 18084 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed)
BENCH NAME= SAT-Race-2010-CNF/hardware-verification/velev/11pipe_11_ooo.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3498539-1307958134/watcher-3498539-1307958134 -o /tmp/evaluation-result-3498539-1307958134/solver-3498539-1307958134 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498539-1307958134.cnf -seed 1292154303 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f603f11fbfe855df381282b7bce010ea
RANDOM SEED=1292154303

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       3227604 kB
Buffers:        138500 kB
Cached:       24370932 kB
SwapCached:      14336 kB
Active:       13418544 kB
Inactive:     15462908 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       3227604 kB
SwapTotal:    67111528 kB
SwapFree:     67049472 kB
Dirty:          113376 kB
Writeback:           0 kB
AnonPages:     4370600 kB
Mapped:          15680 kB
Slab:           759892 kB
PageTables:      22660 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  7295440 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 18104 MiB
End job on node118 at 2011-06-13 13:05:36