Trace number 3498343

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed)? (TO) 5000.11 4994.07

General information on the benchmark

Nameapplication/fuhs/
AProVE11/AProVE11-06.cnf
MD5SUM6fd7d026c372988cefc364000243d13f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1455.4
Satisfiable
(Un)Satisfiability was proved
Number of variables302076
Number of clauses1039056
Sum of the clauses size2729970
Maximum clause length978
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2420562
Number of clauses of size 3588399
Number of clauses of size 429561
Number of clauses of size 569
Number of clauses of size over 5464

Solver Data 

0.38/0.80	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.38/0.80	c INFO: solving HOME/instance-3498343-1307953147.cnf
0.38/0.80	c INFO: computing task features
4.38/4.83	c INFO: computed variable-clause graph statistics
4.48/4.96	c INFO: computed clause balance statistics
22.38/22.83	c INFO: computed variable balance statistics
35.98/36.42	c INFO: computed small-clause counts
36.28/36.79	c INFO: computed Horn-clause counts
151.38/151.86	c INFO: computed variable graph statistics
151.38/151.86	c INFO: collected features for HOME/instance-3498343-1307953147.cnf in 150.95 s
151.38/151.88	c INFO: running lingeling-276@0 for 97 with 4849 remaining (b = 0.54)
251.68/252.03	c INFO: running cryptominisat-2.9.0@0 for 485 with 4748 remaining (b = 0.34)
739.60/739.32	c INFO: running lingeling-276@100 for 388 with 4262 remaining (b = 0.31)
1125.46/1124.74	c INFO: running lingeling-276@0 for 97 with 3876 remaining (b = 0.46)
1224.76/1223.90	c INFO: running cryptominisat-2.9.0@486 for 97 with 3777 remaining (b = 0.10)
1324.40/1323.41	c INFO: running lingeling-276@99 for 194 with 3678 remaining (b = 0.16)
1516.85/1515.65	c INFO: running precosat-570@0 for 291 with 3486 remaining (b = 0.47)
1809.62/1808.04	c INFO: running lingeling-276@0 for 97 with 3193 remaining (b = 0.31)
1909.94/1908.20	c INFO: running cryptominisat-2.9.0@0 for 485 with 3093 remaining (b = 0.19)
2397.16/2394.72	c INFO: running lingeling-276@100 for 97 with 2607 remaining (b = 0.04)
2493.40/2490.86	c INFO: running precosat-570@0 for 97 with 2511 remaining (b = 0.17)
2593.70/2591.02	c INFO: running precosat-570@292 for 97 with 2411 remaining (b = 0.04)
2690.94/2688.15	c INFO: running cryptominisat-2.9.0@586 for 776 with 2314 remaining (b = 0.26)
3469.56/3465.67	c INFO: running cryptominisat-2.9.0@486 for 97 with 1537 remaining (b = 0.05)
3567.52/3563.48	c INFO: running cryptominisat-2.9.0@1363 for 97 with 1439 remaining (b = 0.05)
3660.85/3656.69	c INFO: running lingeling-276@196 for 97 with 1346 remaining (b = 0.04)
3761.21/3756.84	c INFO: running precosat-570@99 for 97 with 1245 remaining (b = 0.04)
3858.46/3853.97	c INFO: running lingeling-276@0 for 97 with 1148 remaining (b = 0.15)
3957.75/3953.14	c INFO: running cryptominisat-2.9.0@1456 for 485 with 1049 remaining (b = 0.19)
4442.53/4437.24	c INFO: running cryptominisat-2.9.0@583 for 565 with 565 remaining (b = 0.15)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3498343-1307953147/watcher-3498343-1307953147 -o /tmp/evaluation-result-3498343-1307953147/solver-3498343-1307953147 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498343-1307953147.cnf -seed 1292154303 -budget 5000 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.48 0.11 0.04 2/180 10386
/proc/meminfo: memFree=7654700/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=15080 CPUtime=0 cores=0,2,4,6
/proc/10386/stat : 10386 (python) S 10384 10386 10287 0 -1 4202496 618 0 0 0 0 0 0 0 21 0 1 0 985545439 15441920 513 33554432000 4194304 5683644 140733629634064 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/10386/statm: 3770 513 300 364 0 257 0

[startup+0.076337 s]
/proc/loadavg: 0.48 0.11 0.04 2/180 10386
/proc/meminfo: memFree=7654700/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=23188 CPUtime=0.02 cores=0,2,4,6
/proc/10386/stat : 10386 (python) S 10384 10386 10287 0 -1 4202496 1326 0 0 0 2 0 0 0 17 0 1 0 985545439 23744512 1173 33554432000 4194304 5683644 140733629634064 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/10386/statm: 5797 1173 432 364 0 724 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 23188

[startup+0.10033 s]
/proc/loadavg: 0.48 0.11 0.04 2/180 10386
/proc/meminfo: memFree=7654700/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=36512 CPUtime=0.03 cores=0,2,4,6
/proc/10386/stat : 10386 (python) R 10384 10386 10287 0 -1 4202496 1565 0 0 0 3 0 0 0 17 0 1 0 985545439 37388288 1398 33554432000 4194304 5683644 140733629634064 18446744073709551615 4438840 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/10386/statm: 9128 1398 452 364 0 945 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 36512

[startup+0.300264 s]
/proc/loadavg: 0.48 0.11 0.04 2/180 10386
/proc/meminfo: memFree=7654700/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=104220 CPUtime=0.06 cores=0,2,4,6
/proc/10386/stat : 10386 (python) S 10384 10386 10287 0 -1 4202496 3038 0 0 0 5 1 0 0 17 0 1 0 985545439 106721280 2725 33554432000 4194304 5683644 140733629634064 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 10
/proc/10386/statm: 26055 2725 847 364 0 1803 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104220

[startup+0.700231 s]
/proc/loadavg: 0.48 0.11 0.04 2/180 10386
/proc/meminfo: memFree=7654700/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=236856 CPUtime=0.3 cores=0,2,4,6
/proc/10386/stat : 10386 (python) R 10384 10386 10287 0 -1 4202496 7896 934 1 0 23 7 0 0 16 0 1 0 985545439 242540544 5790 33554432000 4194304 5683644 140733629634064 18446744073709551615 224280002570 0 0 16781312 2 0 0 0 17 0 0 0 10
/proc/10386/statm: 59757 5793 1597 364 0 4415 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 236856

[startup+1.50111 s]
/proc/loadavg: 0.48 0.11 0.04 3/181 10391
/proc/meminfo: memFree=7601768/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=341844 CPUtime=1.08 cores=0,2,4,6
/proc/10386/stat : 10386 (python) R 10384 10386 10287 0 -1 4202496 24873 934 1 0 98 10 0 0 17 0 1 0 985545439 350048256 22541 33554432000 4194304 5683644 140733629634064 18446744073709551615 4539735 0 0 16781312 2 0 0 0 17 0 0 0 10
/proc/10386/statm: 85461 22541 1761 364 0 21385 0
Current children cumulated CPU time (s) 1.08
Current children cumulated vsize (KiB) 341844

[startup+3.10087 s]
/proc/loadavg: 0.48 0.11 0.04 3/181 10391
/proc/meminfo: memFree=7535924/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=439916 CPUtime=2.68 cores=0,2,4,6
/proc/10386/stat : 10386 (python) R 10384 10386 10287 0 -1 4202496 49056 934 1 0 254 14 0 0 19 0 1 0 985545439 450473984 46724 33554432000 4194304 5683644 140733629634064 18446744073709551615 224284586693 0 0 16781312 2 0 0 0 17 0 0 0 10
/proc/10386/statm: 109979 46724 1761 364 0 45903 0
Current children cumulated CPU time (s) 2.68
Current children cumulated vsize (KiB) 439916

[startup+6.30034 s]
/proc/loadavg: 0.60 0.14 0.05 3/181 10391
/proc/meminfo: memFree=7407124/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=505748 CPUtime=5.88 cores=0,2,4,6
/proc/10386/stat : 10386 (python) R 10384 10386 10287 0 -1 4202496 92126 934 1 0 569 19 0 0 25 0 1 0 985545439 517885952 63821 33554432000 4194304 5683644 140733629634064 18446744073709551615 4662462 0 0 16781312 2 0 0 0 17 0 0 0 10
/proc/10386/statm: 126437 63821 1826 364 0 62361 0
Current children cumulated CPU time (s) 5.88
Current children cumulated vsize (KiB) 505748

[startup+12.7003 s]
/proc/loadavg: 0.71 0.17 0.06 3/181 10391
/proc/meminfo: memFree=7407284/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=505748 CPUtime=12.28 cores=0,2,4,6
/proc/10386/stat : 10386 (python) R 10384 10386 10287 0 -1 4202496 92126 934 1 0 1209 19 0 0 25 0 1 0 985545439 517885952 63821 33554432000 4194304 5683644 140733629634064 18446744073709551615 224284585194 0 0 16781312 2 0 0 0 17 0 0 0 10
/proc/10386/statm: 126437 63821 1826 364 0 62361 0
Current children cumulated CPU time (s) 12.28
Current children cumulated vsize (KiB) 505748

[startup+25.5011 s]
/proc/loadavg: 1.00 0.26 0.09 3/181 10393
/proc/meminfo: memFree=7406484/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=505748 CPUtime=25.08 cores=0,2,4,6
/proc/10386/stat : 10386 (python) R 10384 10386 10287 0 -1 4202496 92127 934 1 0 2489 19 0 0 25 0 1 0 985545439 517885952 63822 33554432000 4194304 5683644 140733629634064 18446744073709551615 4523414 0 0 16781312 2 0 0 0 17 0 0 0 10
/proc/10386/statm: 126437 63822 1827 364 0 62361 0
Current children cumulated CPU time (s) 25.08
Current children cumulated vsize (KiB) 505748

[startup+51.1008 s]
/proc/loadavg: 1.34 0.40 0.14 3/181 10393
/proc/meminfo: memFree=7407632/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=505748 CPUtime=50.68 cores=0,2,4,6
/proc/10386/stat : 10386 (python) R 10384 10386 10287 0 -1 4202496 92133 934 1 0 5049 19 0 0 25 0 1 0 985545439 517885952 63828 33554432000 4194304 5683644 140733629634064 18446744073709551615 47515864873100 0 0 16781312 2 0 0 0 17 0 0 0 10
/proc/10386/statm: 126437 63828 1833 364 0 62361 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 505748

[startup+102.306 s]
/proc/loadavg: 1.71 0.65 0.23 3/185 10399
/proc/meminfo: memFree=7344268/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=505748 CPUtime=101.88 cores=0,2,4,6
/proc/10386/stat : 10386 (python) R 10384 10386 10287 0 -1 4202496 92133 934 1 0 10169 19 0 0 25 0 1 0 985545439 517885952 63828 33554432000 4194304 5683644 140733629634064 18446744073709551615 47515864873100 0 0 16781312 2 0 0 0 17 0 0 0 10
/proc/10386/statm: 126437 63828 1833 364 0 62361 0
Current children cumulated CPU time (s) 101.88
Current children cumulated vsize (KiB) 505748

[startup+162.301 s]
/proc/loadavg: 1.89 0.89 0.34 3/188 10402
/proc/meminfo: memFree=7197400/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=498624 CPUtime=151.47 cores=0,2,4,6
/proc/10386/stat : 10386 (python) S 10384 10386 10287 0 -1 4202496 92500 934 1 0 15127 20 0 0 25 0 2 0 985545439 510590976 59526 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 10
/proc/10386/statm: 124656 59526 1875 364 0 60574 0
[pid=10400] ppid=10386 vsize=488380 CPUtime=0.01 cores=0,2,4,6
/proc/10400/stat : 10400 (python) S 10386 10386 10287 0 -1 4202560 973 0 0 0 0 1 0 0 18 0 1 0 985560627 500101120 58028 33554432000 4194304 5683644 140733629634064 18446744073709551615 224284945935 0 0 16781312 514 2537145071325643012 0 0 17 6 0 0 0
/proc/10400/statm: 122095 58028 381 364 0 58013 0
[pid=10402] ppid=10400 vsize=138872 CPUtime=10.39 cores=0,2,4,6
/proc/10402/stat : 10402 (lingeling) R 10400 10402 10402 0 -1 4202496 49125 0 0 0 1033 6 0 0 25 0 1 0 985560628 142204928 33886 33554432000 4194304 4352236 140733510803328 18446744073709551615 4214078 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/10402/statm: 34718 33886 126 39 0 33798 0
[pid=10386/tid=10401] ppid=10384 vsize=498624 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10401/stat : 10401 (python) S 10384 10386 10287 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 2 0 985560628 510590976 59526 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 161.87
Current children cumulated vsize (KiB) 1125876

[startup+222.301 s]
/proc/loadavg: 1.96 1.09 0.44 3/188 10404
/proc/meminfo: memFree=7162616/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=498624 CPUtime=151.47 cores=0,2,4,6
/proc/10386/stat : 10386 (python) S 10384 10386 10287 0 -1 4202496 92500 934 1 0 15127 20 0 0 25 0 2 0 985545439 510590976 59526 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 10
/proc/10386/statm: 124656 59526 1875 364 0 60574 0
[pid=10400] ppid=10386 vsize=488380 CPUtime=0.08 cores=0,2,4,6
/proc/10400/stat : 10400 (python) S 10386 10386 10287 0 -1 4202560 998 0 0 0 4 4 0 0 18 0 1 0 985560627 500101120 58028 33554432000 4194304 5683644 140733629634064 18446744073709551615 224284945935 0 0 16781312 514 2537145071325643012 0 0 17 6 0 0 0
/proc/10400/statm: 122095 58028 381 364 0 58013 0
[pid=10402] ppid=10400 vsize=147264 CPUtime=70.4 cores=0,2,4,6
/proc/10402/stat : 10402 (lingeling) R 10400 10402 10402 0 -1 4202496 52428 0 0 0 7033 7 0 0 25 0 1 0 985560628 150798336 35987 33554432000 4194304 4352236 140733510803328 18446744073709551615 4267918 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/10402/statm: 36816 35987 129 39 0 35896 0
[pid=10386/tid=10401] ppid=10384 vsize=498624 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10401/stat : 10401 (python) S 10384 10386 10287 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 2 0 985560628 510590976 59526 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 221.95
Current children cumulated vsize (KiB) 1134268

[startup+282.301 s]
/proc/loadavg: 1.98 1.25 0.54 3/192 10410
/proc/meminfo: memFree=6577864/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=508880 CPUtime=151.5 cores=0,2,4,6
/proc/10386/stat : 10386 (python) S 10384 10386 10287 0 -1 4202496 93268 934 1 0 15129 21 0 0 20 0 3 0 985545439 521093120 59533 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 10
/proc/10386/statm: 127220 59533 1878 364 0 63135 0
[pid=10400] ppid=10386 vsize=498624 CPUtime=0.11 cores=0,2,4,6
/proc/10400/stat : 10400 (python) S 10386 10386 10287 0 -1 4202560 1168 0 0 0 5 6 0 0 19 0 2 0 985560627 510590976 58066 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10400/statm: 124656 58066 414 364 0 60574 0
[pid=10402] ppid=10400 vsize=141668 CPUtime=100.11 cores=0,2,4,6
/proc/10402/stat : 10402 (lingeling) T 10400 10402 10402 0 -1 4202496 52428 0 0 0 10004 7 0 0 25 0 1 0 985560628 145068032 34588 33554432000 4194304 4352236 140733510803328 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/10402/statm: 35417 34588 129 39 0 34497 0
[pid=10400/tid=10407] ppid=10386 vsize=498624 CPUtime=0 cores=0,2,4,6
/proc/10400/task/10407/stat : 10407 (python) S 10386 10386 10287 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 985570640 510590976 58066 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453895263360 0 0 -1 6 0 0 0
[pid=10408] ppid=10386 vsize=498636 CPUtime=0.04 cores=0,2,4,6
/proc/10408/stat : 10408 (python) S 10386 10386 10287 0 -1 4202560 916 0 0 0 2 2 0 0 15 0 1 0 985570642 510603264 58021 33554432000 4194304 5683644 140733629634064 18446744073709551615 224284945990 0 0 16781312 514 4567995828681015556 0 0 17 4 0 0 0
/proc/10408/statm: 124659 58021 370 364 0 60574 0
[pid=10410] ppid=10408 vsize=685764 CPUtime=30.24 cores=0,2,4,6
/proc/10410/stat : 10410 (cryptominisat-2) R 10408 10410 10410 0 -1 4202496 166636 0 0 0 3002 22 0 0 25 0 1 0 985570643 702222336 143787 33554432000 4194304 4677096 140734752773728 18446744073709551615 224284623852 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/10410/statm: 171441 143787 393 118 0 166400 0
[pid=10386/tid=10401] ppid=10384 vsize=508880 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10401/stat : 10401 (python) S 10384 10386 10287 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 3 0 985560628 521093120 59533 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10409] ppid=10384 vsize=508880 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10409/stat : 10409 (python) S 10384 10386 10287 0 -1 4202560 23 934 0 0 0 0 0 0 20 0 3 0 985570643 521093120 59533 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 282
Current children cumulated vsize (KiB) 2333572

[startup+342.301 s]
/proc/loadavg: 1.99 1.39 0.62 3/192 10412
/proc/meminfo: memFree=6189188/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=508880 CPUtime=151.5 cores=0,2,4,6
/proc/10386/stat : 10386 (python) S 10384 10386 10287 0 -1 4202496 93268 934 1 0 15129 21 0 0 20 0 3 0 985545439 521093120 59533 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 10
/proc/10386/statm: 127220 59533 1878 364 0 63135 0
[pid=10400] ppid=10386 vsize=498624 CPUtime=0.11 cores=0,2,4,6
/proc/10400/stat : 10400 (python) S 10386 10386 10287 0 -1 4202560 1168 0 0 0 5 6 0 0 19 0 2 0 985560627 510590976 58066 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10400/statm: 124656 58066 414 364 0 60574 0
[pid=10402] ppid=10400 vsize=141668 CPUtime=100.11 cores=0,2,4,6
/proc/10402/stat : 10402 (lingeling) T 10400 10402 10402 0 -1 4202496 52428 0 0 0 10004 7 0 0 25 0 1 0 985560628 145068032 34588 33554432000 4194304 4352236 140733510803328 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/10402/statm: 35417 34588 129 39 0 34497 0

################
# More data... #
################

[pid=10460] ppid=10386 vsize=519148 CPUtime=0.53 cores=0,2,4,6
/proc/10460/stat : 10460 (python) S 10386 10386 10287 0 -1 4202560 1157 0 0 0 32 21 0 0 18 0 2 0 985697004 531607552 58059 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/10460/statm: 129787 58059 399 364 0 65696 0
[pid=10462] ppid=10460 vsize=357728 CPUtime=389.46 cores=0,2,4,6
/proc/10462/stat : 10462 (precosat) T 10460 10462 10462 0 -1 4202496 89417 0 0 0 38934 12 0 0 25 0 1 0 985697005 366313472 84361 33554432000 4194304 4890832 140734903571968 18446744073709551615 4232286 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/10462/statm: 89432 84361 86 171 0 89259 0
[pid=10460/tid=10474] ppid=10386 vsize=519148 CPUtime=0 cores=0,2,4,6
/proc/10460/task/10474/stat : 10474 (python) S 10386 10386 10287 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 985726241 531607552 58059 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453891859520 0 0 -1 2 0 0 0
[pid=10475] ppid=10386 vsize=529404 CPUtime=0.41 cores=0,2,4,6
/proc/10475/stat : 10475 (python) S 10386 10386 10287 0 -1 4202560 1164 0 0 0 23 18 0 0 18 0 2 0 985726243 542109696 58063 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10475/statm: 132351 58063 399 364 0 68257 0
[pid=10477] ppid=10475 vsize=146216 CPUtime=296.38 cores=0,2,4,6
/proc/10477/stat : 10477 (lingeling) T 10475 10477 10477 0 -1 4202496 54892 0 0 0 29632 6 0 0 25 0 1 0 985726244 149725184 35723 33554432000 4194304 4352236 140736777462416 18446744073709551615 4328304 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/10477/statm: 36554 35723 129 39 0 35634 0
[pid=10475/tid=10486] ppid=10386 vsize=529404 CPUtime=0 cores=0,2,4,6
/proc/10475/task/10486/stat : 10486 (python) S 10386 10386 10287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 985736257 542109696 58063 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453891326080 0 0 -1 6 0 0 0
[pid=10487] ppid=10386 vsize=539660 CPUtime=1.62 cores=0,2,4,6
/proc/10487/stat : 10487 (python) S 10386 10386 10287 0 -1 4202560 1178 0 0 0 94 68 0 0 15 0 2 0 985736259 552611840 58068 33554432000 4194304 5683644 140733629634064 18446744073709551615 224284945990 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/10487/statm: 134915 58068 400 364 0 70818 0
[pid=10489] ppid=10487 vsize=1696548 CPUtime=1109.32 cores=0,2,4,6
/proc/10489/stat : 10489 (cryptominisat-2) R 10487 10489 10489 0 -1 4202496 387200 0 0 0 110877 55 0 0 25 0 1 0 985736260 1737265152 355039 33554432000 4194304 4677096 140736498994800 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/10489/statm: 424137 355039 393 118 0 419096 0
[pid=10487/tid=10503] ppid=10386 vsize=539660 CPUtime=0 cores=0,2,4,6
/proc/10487/task/10503/stat : 10503 (python) S 10386 10386 10287 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 985784909 552611840 58068 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453894104256 0 0 -1 2 0 0 0
[pid=10506] ppid=10386 vsize=549916 CPUtime=0.27 cores=0,2,4,6
/proc/10506/stat : 10506 (python) S 10386 10386 10287 0 -1 4202560 1144 0 0 0 13 14 0 0 18 0 2 0 985794525 563113984 58071 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/10506/statm: 137479 58071 399 364 0 73379 0
[pid=10508] ppid=10506 vsize=359072 CPUtime=197.23 cores=0,2,4,6
/proc/10508/stat : 10508 (precosat) T 10506 10508 10508 0 -1 4202496 89762 0 0 0 19709 14 0 0 25 0 1 0 985794526 367689728 84707 33554432000 4194304 4890832 140733536362176 18446744073709551615 4238599 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/10508/statm: 89768 84707 86 171 0 89595 0
[pid=10506/tid=10522] ppid=10386 vsize=549916 CPUtime=0 cores=0,2,4,6
/proc/10506/task/10522/stat : 10522 (python) S 10386 10386 10287 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 985804539 563113984 58071 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453880899520 0 0 -1 4 0 0 0
[pid=10560] ppid=10386 vsize=560172 CPUtime=0.14 cores=0,2,4,6
/proc/10560/stat : 10560 (python) S 10386 10386 10287 0 -1 4202560 1165 0 0 0 8 6 0 0 19 0 2 0 985930837 573616128 58081 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10560/statm: 140043 58081 405 364 0 75940 0
[pid=10562] ppid=10560 vsize=141068 CPUtime=99.12 cores=0,2,4,6
/proc/10562/stat : 10562 (lingeling) T 10560 10562 10562 0 -1 4202496 52272 0 0 0 9904 8 0 0 25 0 1 0 985930838 144453632 34437 33554432000 4194304 4352236 140734032607632 18446744073709551615 4276395 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/10562/statm: 35267 34437 129 39 0 34347 0
[pid=10560/tid=10565] ppid=10386 vsize=560172 CPUtime=0 cores=0,2,4,6
/proc/10560/task/10565/stat : 10565 (python) S 10386 10386 10287 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 985940752 573616128 58081 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453876434176 0 0 -1 6 0 0 0
[pid=10386/tid=10401] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10401/stat : 10401 (python) S 10384 10386 10287 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 9 0 985560628 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10409] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10409/stat : 10409 (python) S 10384 10386 10287 0 -1 4202560 36 934 0 0 0 0 0 0 18 0 9 0 985570643 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10440] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10440/stat : 10440 (python) S 10384 10386 10287 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 9 0 985657914 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10461] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10461/stat : 10461 (python) S 10384 10386 10287 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 9 0 985697005 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10476] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10476/stat : 10476 (python) S 10384 10386 10287 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 9 0 985726244 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10488] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10488/stat : 10488 (python) S 10384 10386 10287 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 9 0 985736260 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10507] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10507/stat : 10507 (python) S 10384 10386 10287 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 9 0 985794526 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 4 0 0 0
[pid=10386/tid=10561] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10561/stat : 10561 (python) S 10384 10386 10287 0 -1 4202560 33 934 0 0 0 0 0 0 20 0 9 0 985930837 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4968.34
Current children cumulated vsize (KiB) 9432636



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4994.01 s]
/proc/loadavg: 2.08 2.04 1.97 3/210 10639
/proc/meminfo: memFree=3011796/32951124 swapFree=67049472/67111528
[pid=10386] ppid=10384 vsize=570416 CPUtime=151.82 cores=0,2,4,6
/proc/10386/stat : 10386 (python) S 10384 10386 10287 0 -1 4202496 99032 934 1 0 15156 26 0 0 18 0 9 0 985545439 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 10
/proc/10386/statm: 142604 59569 1890 364 0 78501 0
[pid=10400] ppid=10386 vsize=498624 CPUtime=0.57 cores=0,2,4,6
/proc/10400/stat : 10400 (python) S 10386 10386 10287 0 -1 4202560 1210 0 0 0 33 24 0 0 18 0 2 0 985560627 510590976 58067 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10400/statm: 124656 58067 415 364 0 60574 0
[pid=10402] ppid=10400 vsize=141348 CPUtime=485.5 cores=0,2,4,6
/proc/10402/stat : 10402 (lingeling) T 10400 10402 10402 0 -1 4202496 54943 0 0 0 48543 7 0 0 25 0 1 0 985560628 144740352 34508 33554432000 4194304 4352236 140733510803328 18446744073709551615 4234392 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/10402/statm: 35337 34508 129 39 0 34417 0
[pid=10400/tid=10407] ppid=10386 vsize=498624 CPUtime=0 cores=0,2,4,6
/proc/10400/task/10407/stat : 10407 (python) S 10386 10386 10287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 985570640 510590976 58067 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453895263360 0 0 -1 6 0 0 0
[pid=10408] ppid=10386 vsize=498636 CPUtime=2.7 cores=0,2,4,6
/proc/10408/stat : 10408 (python) S 10386 10386 10287 0 -1 4202560 1175 0 0 0 154 116 0 0 15 0 2 0 985570642 510603264 58052 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/10408/statm: 124659 58052 400 364 0 60574 0
[pid=10410] ppid=10408 vsize=1674816 CPUtime=1941.55 cores=0,2,4,6
/proc/10410/stat : 10410 (cryptominisat-2) T 10408 10410 10410 0 -1 4202496 454708 0 0 0 194073 82 0 0 25 0 1 0 985570643 1715011584 359631 33554432000 4194304 4677096 140734752773728 18446744073709551615 4320976 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/10410/statm: 418704 359631 393 118 0 413663 0
[pid=10408/tid=10427] ppid=10386 vsize=498636 CPUtime=0 cores=0,2,4,6
/proc/10408/task/10427/stat : 10427 (python) S 10386 10386 10287 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 985619369 510603264 58052 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453881438336 0 0 -1 4 0 0 0
[pid=10439] ppid=10386 vsize=508892 CPUtime=0.38 cores=0,2,4,6
/proc/10439/stat : 10439 (python) S 10386 10386 10287 0 -1 4202560 1146 0 0 0 21 17 0 0 18 0 2 0 985657914 521105408 58055 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10439/statm: 127223 58055 399 364 0 63135 0
[pid=10441] ppid=10439 vsize=140972 CPUtime=291.34 cores=0,2,4,6
/proc/10441/stat : 10441 (lingeling) T 10439 10441 10441 0 -1 4202496 54789 0 0 0 29129 5 0 0 25 0 1 0 985657915 144355328 34413 33554432000 4194304 4352236 140736599055360 18446744073709551615 4327922 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/10441/statm: 35243 34413 129 39 0 34323 0
[pid=10439/tid=10452] ppid=10386 vsize=508892 CPUtime=0 cores=0,2,4,6
/proc/10439/task/10452/stat : 10452 (python) S 10386 10386 10287 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 985667827 521105408 58055 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604440278876544 0 0 -1 6 0 0 0
[pid=10460] ppid=10386 vsize=519148 CPUtime=0.53 cores=0,2,4,6
/proc/10460/stat : 10460 (python) S 10386 10386 10287 0 -1 4202560 1157 0 0 0 32 21 0 0 18 0 2 0 985697004 531607552 58059 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/10460/statm: 129787 58059 399 364 0 65696 0
[pid=10462] ppid=10460 vsize=357728 CPUtime=389.46 cores=0,2,4,6
/proc/10462/stat : 10462 (precosat) T 10460 10462 10462 0 -1 4202496 89417 0 0 0 38934 12 0 0 25 0 1 0 985697005 366313472 84361 33554432000 4194304 4890832 140734903571968 18446744073709551615 4232286 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/10462/statm: 89432 84361 86 171 0 89259 0
[pid=10460/tid=10474] ppid=10386 vsize=519148 CPUtime=0 cores=0,2,4,6
/proc/10460/task/10474/stat : 10474 (python) S 10386 10386 10287 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 985726241 531607552 58059 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453891859520 0 0 -1 2 0 0 0
[pid=10475] ppid=10386 vsize=529404 CPUtime=0.41 cores=0,2,4,6
/proc/10475/stat : 10475 (python) S 10386 10386 10287 0 -1 4202560 1164 0 0 0 23 18 0 0 18 0 2 0 985726243 542109696 58063 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10475/statm: 132351 58063 399 364 0 68257 0
[pid=10477] ppid=10475 vsize=146216 CPUtime=296.38 cores=0,2,4,6
/proc/10477/stat : 10477 (lingeling) T 10475 10477 10477 0 -1 4202496 54892 0 0 0 29632 6 0 0 25 0 1 0 985726244 149725184 35723 33554432000 4194304 4352236 140736777462416 18446744073709551615 4328304 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/10477/statm: 36554 35723 129 39 0 35634 0
[pid=10475/tid=10486] ppid=10386 vsize=529404 CPUtime=0 cores=0,2,4,6
/proc/10475/task/10486/stat : 10486 (python) S 10386 10386 10287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 985736257 542109696 58063 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453891326080 0 0 -1 6 0 0 0
[pid=10487] ppid=10386 vsize=539660 CPUtime=1.68 cores=0,2,4,6
/proc/10487/stat : 10487 (python) S 10386 10386 10287 0 -1 4202560 1178 0 0 0 97 71 0 0 15 0 2 0 985736259 552611840 58068 33554432000 4194304 5683644 140733629634064 18446744073709551615 224284945990 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/10487/statm: 134915 58068 400 364 0 70818 0
[pid=10489] ppid=10487 vsize=1696548 CPUtime=1141.03 cores=0,2,4,6
/proc/10489/stat : 10489 (cryptominisat-2) R 10487 10489 10489 0 -1 4202496 387586 0 0 0 114048 55 0 0 25 0 1 0 985736260 1737265152 355425 33554432000 4194304 4677096 140736498994800 18446744073709551615 4320251 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/10489/statm: 424137 355425 393 118 0 419096 0
[pid=10487/tid=10503] ppid=10386 vsize=539660 CPUtime=0 cores=0,2,4,6
/proc/10487/task/10503/stat : 10503 (python) S 10386 10386 10287 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 985784909 552611840 58068 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453894104256 0 0 -1 2 0 0 0
[pid=10506] ppid=10386 vsize=549916 CPUtime=0.27 cores=0,2,4,6
/proc/10506/stat : 10506 (python) S 10386 10386 10287 0 -1 4202560 1144 0 0 0 13 14 0 0 18 0 2 0 985794525 563113984 58071 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/10506/statm: 137479 58071 399 364 0 73379 0
[pid=10508] ppid=10506 vsize=359072 CPUtime=197.23 cores=0,2,4,6
/proc/10508/stat : 10508 (precosat) T 10506 10508 10508 0 -1 4202496 89762 0 0 0 19709 14 0 0 25 0 1 0 985794526 367689728 84707 33554432000 4194304 4890832 140733536362176 18446744073709551615 4238599 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/10508/statm: 89768 84707 86 171 0 89595 0
[pid=10506/tid=10522] ppid=10386 vsize=549916 CPUtime=0 cores=0,2,4,6
/proc/10506/task/10522/stat : 10522 (python) S 10386 10386 10287 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 985804539 563113984 58071 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453880899520 0 0 -1 4 0 0 0
[pid=10560] ppid=10386 vsize=560172 CPUtime=0.14 cores=0,2,4,6
/proc/10560/stat : 10560 (python) S 10386 10386 10287 0 -1 4202560 1165 0 0 0 8 6 0 0 19 0 2 0 985930837 573616128 58081 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/10560/statm: 140043 58081 405 364 0 75940 0
[pid=10562] ppid=10560 vsize=141068 CPUtime=99.12 cores=0,2,4,6
/proc/10562/stat : 10562 (lingeling) T 10560 10562 10562 0 -1 4202496 52272 0 0 0 9904 8 0 0 25 0 1 0 985930838 144453632 34437 33554432000 4194304 4352236 140734032607632 18446744073709551615 4276395 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/10562/statm: 35267 34437 129 39 0 34347 0
[pid=10560/tid=10565] ppid=10386 vsize=560172 CPUtime=0 cores=0,2,4,6
/proc/10560/task/10565/stat : 10565 (python) S 10386 10386 10287 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 985940752 573616128 58081 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 514 18446604453876434176 0 0 -1 6 0 0 0
[pid=10386/tid=10401] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10401/stat : 10401 (python) S 10384 10386 10287 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 9 0 985560628 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10409] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10409/stat : 10409 (python) S 10384 10386 10287 0 -1 4202560 36 934 0 0 0 0 0 0 18 0 9 0 985570643 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10440] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10440/stat : 10440 (python) S 10384 10386 10287 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 9 0 985657914 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10461] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10461/stat : 10461 (python) S 10384 10386 10287 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 9 0 985697005 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10476] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10476/stat : 10476 (python) S 10384 10386 10287 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 9 0 985726244 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10488] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10488/stat : 10488 (python) S 10384 10386 10287 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 9 0 985736260 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
[pid=10386/tid=10507] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10507/stat : 10507 (python) S 10384 10386 10287 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 9 0 985794526 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 4 0 0 0
[pid=10386/tid=10561] ppid=10384 vsize=570416 CPUtime=0 cores=0,2,4,6
/proc/10386/task/10561/stat : 10561 (python) S 10384 10386 10287 0 -1 4202560 33 934 0 0 0 0 0 0 20 0 9 0 985930837 584105984 59569 33554432000 4194304 5683644 140733629634064 18446744073709551615 224296749489 0 0 16781312 2 18446604453862696192 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5000.11
Current children cumulated vsize (KiB) 9432636

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10386 and gives
#  childrusage.ru_utime.tv_sec=151
#  childrusage.ru_utime.tv_usec=567958
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=283956
# CPU time returned by wait4() is 151.852
# while last known CPU time is 5000.11
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4994.07
CPU time (s): 5000.11
CPU user time (s): 4995.09
CPU system time (s): 5.02
CPU usage (%): 100.121
Max. virtual memory (cumulated for all children) (KiB): 9471820

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 151.568
system time used= 0.283956
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 99970
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1060
involuntary context switches= 337

runsolver used 17.8533 second user time and 34.8367 second system time

The end

Launcher Data 

Begin job on node118 at 2011-06-13 10:19:07
IDJOB=3498343
IDBENCH=82354
IDSOLVER=1991
FILE ID=node118/3498343-1307953147
RUNJOBID= node118-1307953121-10305
PBS_JOBID= 13559710
Free space on /tmp= 18164 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed)
BENCH NAME= SAT11/application/fuhs/AProVE11/AProVE11-06.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3498343-1307953147/watcher-3498343-1307953147 -o /tmp/evaluation-result-3498343-1307953147/solver-3498343-1307953147 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498343-1307953147.cnf -seed 1292154303 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6fd7d026c372988cefc364000243d13f
RANDOM SEED=1292154303

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       7655260 kB
Buffers:        133480 kB
Cached:       24280056 kB
SwapCached:      14336 kB
Active:        9025152 kB
Inactive:     15448128 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       7655260 kB
SwapTotal:    67111528 kB
SwapFree:     67049472 kB
Dirty:           86544 kB
Writeback:           0 kB
AnonPages:       58352 kB
Mapped:          14740 kB
Slab:           756556 kB
PageTables:       5776 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   296896 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 18056 MiB
End job on node118 at 2011-06-13 11:42:24