Trace number 3317732

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 3175.83 1149.31

General information on the benchmark

NameSAT-Race-2010-CNF/hardware-verification/
velev/11pipe_k.cnf
MD5SUM932387240a0c17f4c88af52c4ca151c6
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark325.87
Satisfiable
(Un)Satisfiability was proved
Number of variables89315
Number of clauses5584003
Sum of the clauses size16593705
Maximum clause length295
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 25473787
Number of clauses of size 337063
Number of clauses of size 4514
Number of clauses of size 5453
Number of clauses of size over 572185

Solver Data 

0.39/0.70	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.39/0.70	c INFO: solving HOME/instance-3317732-1304271200.cnf
0.39/0.70	c INFO: computing task features
19.09/19.47	c INFO: computed variable-clause graph statistics
19.79/20.11	c INFO: computed clause balance statistics
106.29/106.68	c INFO: computed variable balance statistics
163.10/163.42	c INFO: computed small-clause counts
163.89/164.26	c INFO: computed Horn-clause counts
182.20/182.59	c INFO: computed variable graph statistics
182.29/182.61	c INFO: collected features for HOME/instance-3317732-1304271200.cnf in 181.00 s
182.29/182.63	c INFO: running lingeling-276@0 for 97 with 4618 remaining (b = 0.59)
182.29/182.67	c INFO: running precosat-570@0 for 97 with 4618 remaining (b = 0.25)
182.39/182.70	c INFO: running cryptominisat-2.9.0@0 for 485 with 4618 remaining (b = 0.27)
182.39/182.74	c INFO: running SApperloT@0 for 97 with 4617 remaining (b = 0.04)
512.35/282.88	c INFO: running lingeling-276@0 for 485 with 4517 remaining (b = 0.23)
592.90/305.98	c INFO: running lingeling-276@0 for 97 with 4494 remaining (b = 0.25)
668.32/331.18	c INFO: running precosat-570@0 for 97 with 4469 remaining (b = 0.06)
1013.15/446.44	c INFO: running precosat-570@93 for 97 with 4354 remaining (b = 0.06)
1180.64/502.46	c INFO: running lingeling-276@97 for 1261 with 4298 remaining (b = 0.33)
1315.87/547.65	c INFO: running lingeling-276@0 for 97 with 4253 remaining (b = 0.24)
1663.28/660.03	c INFO: running precosat-570@192 for 194 with 4140 remaining (b = 0.08)
1885.23/734.29	c INFO: running precosat-570@0 for 97 with 4066 remaining (b = 0.11)
2220.15/846.60	c INFO: running cryptominisat-2.9.0@0 for 388 with 3954 remaining (b = 0.12)
2439.53/913.06	c INFO: running cryptominisat-2.9.0@0 for 582 with 3887 remaining (b = 0.18)
2567.04/949.62	c INFO: running cryptominisat-2.9.0@0 for 1649 with 3851 remaining (b = 0.36)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317732-1304271200/watcher-3317732-1304271200 -o /tmp/evaluation-result-3317732-1304271200/solver-3317732-1304271200 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317732-1304271200.cnf -seed 928521394 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.20 7.50 8.31 3/264 12666
/proc/meminfo: memFree=22046440/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/12666/stat : 12666 (python) R 12664 12666 10986 0 -1 4202496 895 0 0 0 0 0 0 0 19 0 1 0 617350743 16154624 776 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735178384 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/12666/statm: 3944 776 343 364 0 431 0

[startup+0.0888151 s]
/proc/loadavg: 5.20 7.50 8.31 3/264 12666
/proc/meminfo: memFree=22046440/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=93964 CPUtime=0.06 cores=1,3,5,7
/proc/12666/stat : 12666 (python) D 12664 12666 10986 0 -1 4202496 2693 0 0 0 4 2 0 0 17 0 1 0 617350743 96219136 2407 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735176704 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/12666/statm: 23491 2407 764 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 93964

[startup+0.100684 s]
/proc/loadavg: 5.20 7.50 8.31 3/264 12666
/proc/meminfo: memFree=22046440/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=101880 CPUtime=0.07 cores=1,3,5,7
/proc/12666/stat : 12666 (python) S 12664 12666 10986 0 -1 4202496 2961 0 0 0 5 2 0 0 17 0 1 0 617350743 104325120 2654 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735176704 0 2147483391 16781312 2 18446744071699945619 0 0 17 7 0 0 0
/proc/12666/statm: 25470 2654 841 364 0 1770 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 101880

[startup+0.300507 s]
/proc/loadavg: 5.20 7.50 8.31 3/264 12666
/proc/meminfo: memFree=22046440/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=135752 CPUtime=0.18 cores=1,3,5,7
/proc/12666/stat : 12666 (python) S 12664 12666 10986 0 -1 4202496 5964 932 1 0 13 5 0 0 17 0 1 0 617350743 139010048 4150 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735174661 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/12666/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.700448 s]
/proc/loadavg: 5.20 7.50 8.31 3/264 12666
/proc/meminfo: memFree=22046440/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=268640 CPUtime=0.39 cores=1,3,5,7
/proc/12666/stat : 12666 (python) S 12664 12666 10986 0 -1 4202496 8858 932 1 0 27 12 0 0 15 0 1 0 617350743 275087360 6622 33554432000 4194304 5683644 140737069202272 18446744073709551615 216730254983 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/12666/statm: 67160 6622 1705 364 0 5291 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 268640

[startup+1.50029 s]
/proc/loadavg: 5.20 7.50 8.31 3/264 12666
/proc/meminfo: memFree=22046440/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=427772 CPUtime=1.19 cores=1,3,5,7
/proc/12666/stat : 12666 (python) R 12664 12666 10986 0 -1 4202496 46299 932 1 0 100 19 0 0 16 0 1 0 617350743 438038528 43980 33554432000 4194304 5683644 140737069202272 18446744073709551615 216734839493 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/12666/statm: 106943 43980 1761 364 0 42867 0
Current children cumulated CPU time (s) 1.19
Current children cumulated vsize (KiB) 427772

[startup+3.10103 s]
/proc/loadavg: 5.20 7.50 8.31 4/265 12675
/proc/meminfo: memFree=21556796/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=530616 CPUtime=2.79 cores=1,3,5,7
/proc/12666/stat : 12666 (python) R 12664 12666 10986 0 -1 4202496 71134 932 1 0 256 23 0 0 18 0 1 0 617350743 543350784 68815 33554432000 4194304 5683644 140737069202272 18446744073709551615 4571087 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/12666/statm: 132654 68816 1761 364 0 68578 0
Current children cumulated CPU time (s) 2.79
Current children cumulated vsize (KiB) 530616

[startup+6.30045 s]
/proc/loadavg: 5.26 7.47 8.30 4/265 12675
/proc/meminfo: memFree=21142364/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=728352 CPUtime=5.99 cores=1,3,5,7
/proc/12666/stat : 12666 (python) R 12664 12666 10986 0 -1 4202496 119697 932 1 0 569 30 0 0 25 0 1 0 617350743 745832448 117378 33554432000 4194304 5683644 140737069202272 18446744073709551615 216734839493 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/12666/statm: 182088 117378 1761 364 0 118012 0
Current children cumulated CPU time (s) 5.99
Current children cumulated vsize (KiB) 728352

[startup+12.7093 s]
/proc/loadavg: 5.08 7.40 8.27 4/265 12676
/proc/meminfo: memFree=20330180/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=1170256 CPUtime=12.4 cores=1,3,5,7
/proc/12666/stat : 12666 (python) R 12664 12666 10986 0 -1 4202496 223980 932 1 0 1193 47 0 0 25 0 1 0 617350743 1198342144 221661 33554432000 4194304 5683644 140737069202272 18446744073709551615 47991512487293 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/12666/statm: 292564 221662 1761 364 0 228488 0
Current children cumulated CPU time (s) 12.4
Current children cumulated vsize (KiB) 1170256

[startup+25.5001 s]
/proc/loadavg: 4.62 7.18 8.19 4/265 12676
/proc/meminfo: memFree=20229860/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=1257916 CPUtime=25.19 cores=1,3,5,7
/proc/12666/stat : 12666 (python) R 12664 12666 10986 0 -1 4202496 588556 932 1 0 2428 91 0 0 25 0 1 0 617350743 1288105984 251863 33554432000 4194304 5683644 140737069202272 18446744073709551615 4643424 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/12666/statm: 314479 251863 1826 364 0 250403 0
Current children cumulated CPU time (s) 25.19
Current children cumulated vsize (KiB) 1257916

[startup+51.1006 s]
/proc/loadavg: 4.07 6.84 8.05 4/265 12677
/proc/meminfo: memFree=20225776/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=1257916 CPUtime=50.8 cores=1,3,5,7
/proc/12666/stat : 12666 (python) R 12664 12666 10986 0 -1 4202496 588556 932 1 0 4989 91 0 0 25 0 1 0 617350743 1288105984 251863 33554432000 4194304 5683644 140737069202272 18446744073709551615 216734837145 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/12666/statm: 314479 251863 1826 364 0 250403 0
Current children cumulated CPU time (s) 50.8
Current children cumulated vsize (KiB) 1257916

[startup+102.301 s]
/proc/loadavg: 3.46 6.25 7.78 4/265 12678
/proc/meminfo: memFree=20218900/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=1257916 CPUtime=101.99 cores=1,3,5,7
/proc/12666/stat : 12666 (python) R 12664 12666 10986 0 -1 4202496 588556 932 1 0 10108 91 0 0 25 0 1 0 617350743 1288105984 251863 33554432000 4194304 5683644 140737069202272 18446744073709551615 216734833660 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/12666/statm: 314479 251863 1826 364 0 250403 0
Current children cumulated CPU time (s) 101.99
Current children cumulated vsize (KiB) 1257916

[startup+162.309 s]
/proc/loadavg: 3.17 5.66 7.48 4/265 12680
/proc/meminfo: memFree=20210004/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=1257916 CPUtime=162 cores=1,3,5,7
/proc/12666/stat : 12666 (python) R 12664 12666 10986 0 -1 4202496 588557 932 1 0 16109 91 0 0 25 0 1 0 617350743 1288105984 251864 33554432000 4194304 5683644 140737069202272 18446744073709551615 47991341715040 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/12666/statm: 314479 251864 1827 364 0 250403 0
Current children cumulated CPU time (s) 162
Current children cumulated vsize (KiB) 1257916

[startup+222.301 s]
/proc/loadavg: 5.62 5.80 7.41 10/289 12705
/proc/meminfo: memFree=17555332/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=807188 CPUtime=182.43 cores=1,3,5,7
/proc/12666/stat : 12666 (python) S 12664 12666 10986 0 -1 4202496 689431 932 1 0 18135 108 0 0 21 0 5 0 617350743 826560512 128993 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/12666/statm: 201797 128993 1881 364 0 137706 0
[pid=12681] ppid=12666 vsize=766176 CPUtime=0.08 cores=1,3,5,7
/proc/12681/stat : 12681 (python) S 12666 12666 10986 0 -1 4202560 1003 0 0 0 4 4 0 0 18 0 1 0 617369007 784564224 127477 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198735 0 0 16781312 514 15552442441310109959 0 0 17 5 0 0 0
/proc/12681/statm: 191544 127477 381 364 0 127462 0
[pid=12683] ppid=12681 vsize=177252 CPUtime=39.62 cores=1,3,5,7
/proc/12683/stat : 12683 (lingeling) R 12681 12683 12683 0 -1 4202496 109685 0 0 0 3945 17 0 0 25 0 1 0 617369009 181506048 43483 33554432000 4194304 4352236 140733914978928 18446744073709551615 4207780 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/12683/statm: 44313 43483 129 39 0 43393 0
[pid=12684] ppid=12666 vsize=776432 CPUtime=0.08 cores=1,3,5,7
/proc/12684/stat : 12684 (python) S 12666 12666 10986 0 -1 4202560 924 0 0 0 4 4 0 0 18 0 1 0 617369010 795066368 127470 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 15552442441310109960 0 0 17 7 0 0 0
/proc/12684/statm: 194108 127470 370 364 0 130023 0
[pid=12686] ppid=12684 vsize=658712 CPUtime=19.95 cores=1,3,5,7
/proc/12686/stat : 12686 (precosat) R 12684 12686 12686 0 -1 4202496 164464 0 0 0 1964 31 0 0 25 0 1 0 617369012 674521088 159303 33554432000 4194304 4890832 140733920600016 18446744073709551615 4246759 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/12686/statm: 164678 159303 80 171 0 164505 0
[pid=12687] ppid=12666 vsize=786688 CPUtime=0.09 cores=1,3,5,7
/proc/12687/stat : 12687 (python) S 12666 12666 10986 0 -1 4202560 936 0 0 0 4 5 0 0 15 0 1 0 617369014 805568512 127474 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 15552442441310109960 0 0 17 5 0 0 0
/proc/12687/statm: 196672 127474 370 364 0 132584 0
[pid=12691] ppid=12687 vsize=777456 CPUtime=39.29 cores=1,3,5,7
/proc/12691/stat : 12691 (cryptominisat-2) R 12687 12691 12691 0 -1 4202496 172051 0 0 0 3905 24 0 0 25 0 1 0 617369018 796114944 169580 33554432000 4194304 4677096 140735890560032 18446744073709551615 4454532 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/12691/statm: 194364 169580 378 118 0 189323 0
[pid=12689] ppid=12666 vsize=796944 CPUtime=0.06 cores=1,3,5,7
/proc/12689/stat : 12689 (python) S 12666 12666 10986 0 -1 4202560 953 0 0 0 3 3 0 0 18 0 1 0 617369017 816070656 127478 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 15552442441310109956 0 0 17 5 0 0 0
/proc/12689/statm: 199236 127478 370 364 0 135145 0
[pid=12692] ppid=12689 vsize=215712 CPUtime=19.55 cores=1,3,5,7
/proc/12692/stat : 12692 (SApperloT-base) R 12689 12692 12692 0 -1 4202496 47603 0 0 0 1940 15 0 0 25 0 1 0 617369020 220889088 44961 33554432000 134512640 135674940 4292791840 18446744073709551615 134571255 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12692/statm: 53928 44961 99 284 0 53642 0
[pid=12666/tid=12682] ppid=12664 vsize=807188 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12682/stat : 12682 (python) S 12664 12666 10986 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 5 0 617369008 826560512 128993 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12685] ppid=12664 vsize=807188 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12685/stat : 12685 (python) S 12664 12666 10986 0 -1 4202560 21 932 0 0 0 0 0 0 22 0 5 0 617369012 826560512 128993 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 7 0 0 0
[pid=12666/tid=12688] ppid=12664 vsize=807188 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12688/stat : 12688 (python) S 12664 12666 10986 0 -1 4202560 40 932 0 0 0 0 0 0 20 0 5 0 617369015 826560512 128993 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12690] ppid=12664 vsize=807188 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12690/stat : 12690 (python) S 12664 12666 10986 0 -1 4202560 19 932 0 0 0 0 0 0 22 0 5 0 617369018 826560512 128993 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 301.15
Current children cumulated vsize (KiB) 5762560

[startup+282.301 s]
/proc/loadavg: 7.88 6.41 7.51 10/289 12707
/proc/meminfo: memFree=16771168/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=807188 CPUtime=182.43 cores=1,3,5,7
/proc/12666/stat : 12666 (python) S 12664 12666 10986 0 -1 4202496 689431 932 1 0 18135 108 0 0 21 0 5 0 617350743 826560512 128993 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/12666/statm: 201797 128993 1881 364 0 137706 0
[pid=12681] ppid=12666 vsize=766176 CPUtime=0.19 cores=1,3,5,7
/proc/12681/stat : 12681 (python) S 12666 12666 10986 0 -1 4202560 1025 0 0 0 9 10 0 0 18 0 1 0 617369007 784564224 127477 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198735 0 0 16781312 514 15552442441310109959 0 0 17 5 0 0 0
/proc/12681/statm: 191544 127477 381 364 0 127462 0
[pid=12683] ppid=12681 vsize=180916 CPUtime=99.62 cores=1,3,5,7
/proc/12683/stat : 12683 (lingeling) R 12681 12683 12683 0 -1 4202496 165229 0 0 0 9937 25 0 0 25 0 1 0 617369009 185257984 44399 33554432000 4194304 4352236 140733914978928 18446744073709551615 4207874 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/12683/statm: 45229 44399 129 39 0 44309 0
[pid=12684] ppid=12666 vsize=776432 CPUtime=0.21 cores=1,3,5,7
/proc/12684/stat : 12684 (python) S 12666 12666 10986 0 -1 4202560 946 0 0 0 11 10 0 0 18 0 1 0 617369010 795066368 127470 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 15552442441310109960 0 0 17 7 0 0 0
/proc/12684/statm: 194108 127470 370 364 0 130023 0
[pid=12686] ppid=12684 vsize=724888 CPUtime=79.26 cores=1,3,5,7
/proc/12686/stat : 12686 (precosat) R 12684 12686 12686 0 -1 4202496 183369 0 0 0 7891 35 0 0 25 0 1 0 617369012 742285312 178208 33554432000 4194304 4890832 140733920600016 18446744073709551615 4238946 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/12686/statm: 181222 178208 86 171 0 181049 0
[pid=12687] ppid=12666 vsize=786688 CPUtime=0.21 cores=1,3,5,7
/proc/12687/stat : 12687 (python) S 12666 12666 10986 0 -1 4202560 952 0 0 0 10 11 0 0 15 0 1 0 617369014 805568512 127474 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 15552442441310109960 0 0 17 5 0 0 0
/proc/12687/statm: 196672 127474 370 364 0 132584 0
[pid=12691] ppid=12687 vsize=814108 CPUtime=98.94 cores=1,3,5,7
/proc/12691/stat : 12691 (cryptominisat-2) R 12687 12691 12691 0 -1 4202496 183046 0 0 0 9867 27 0 0 25 0 1 0 617369018 833646592 180575 33554432000 4194304 4677096 140735890560032 18446744073709551615 4459142 0 0 16781312 2 0 0 0 17 5 0 0 0

################
# More data... #
################

/proc/12718/stat : 12718 (lingeling) R 12716 12718 12718 0 -1 4202496 385142 0 0 0 56420 58 0 0 25 0 1 0 617381343 198656000 47670 33554432000 4194304 4352236 140733897902816 18446744073709551615 4328351 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/12718/statm: 48500 47670 129 39 0 47580 0
[pid=12716/tid=12737] ppid=12666 vsize=807200 CPUtime=0 cores=1,3,5,7
/proc/12716/task/12737/stat : 12737 (python) S 12666 12666 10986 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 617400988 826572800 127512 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 514 18446604468379337792 0 0 -1 5 0 0 0
[pid=12739] ppid=12666 vsize=817456 CPUtime=0.24 cores=1,3,5,7
/proc/12739/stat : 12739 (python) S 12666 12666 10986 0 -1 4202560 1137 0 0 0 11 13 0 0 19 0 2 0 617405509 837074944 127516 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/12739/statm: 204364 127516 399 364 0 140267 0
[pid=12741] ppid=12739 vsize=183808 CPUtime=100.44 cores=1,3,5,7
/proc/12741/stat : 12741 (lingeling) T 12739 12741 12741 0 -1 4202496 165905 0 0 0 10016 28 0 0 25 0 1 0 617405510 188219392 45122 33554432000 4194304 4352236 140736599370288 18446744073709551615 4331567 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/12741/statm: 45952 45122 129 39 0 45032 0
[pid=12739/tid=12745] ppid=12666 vsize=817456 CPUtime=0 cores=1,3,5,7
/proc/12739/task/12745/stat : 12745 (python) S 12666 12666 10986 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 617416744 837074944 127516 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 514 18446604463215219840 0 0 -1 5 0 0 0
[pid=12750] ppid=12666 vsize=827712 CPUtime=0.23 cores=1,3,5,7
/proc/12750/stat : 12750 (python) S 12666 12666 10986 0 -1 4202560 1126 0 0 0 10 13 0 0 19 0 2 0 617424172 847577088 127520 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/12750/statm: 206928 127520 399 364 0 142828 0
[pid=12752] ppid=12750 vsize=724884 CPUtime=101.87 cores=1,3,5,7
/proc/12752/stat : 12752 (precosat) T 12750 12752 12752 0 -1 4202496 184767 0 0 0 10147 40 0 0 25 0 1 0 617424174 742281216 179559 33554432000 4194304 4890832 140733228354848 18446744073709551615 4246516 0 0 16781312 17442 18446744071562691360 0 0 17 5 0 0 0
/proc/12752/statm: 181221 179559 86 171 0 181048 0
[pid=12750/tid=12774] ppid=12666 vsize=827712 CPUtime=0 cores=1,3,5,7
/proc/12750/task/12774/stat : 12774 (python) S 12666 12666 10986 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 617435401 847577088 127520 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 514 18446604458000826816 0 0 -1 5 0 0 0
[pid=12777] ppid=12666 vsize=837968 CPUtime=0.45 cores=1,3,5,7
/proc/12777/stat : 12777 (python) S 12666 12666 10986 0 -1 4202560 1058 0 0 0 23 22 0 0 15 0 1 0 617442049 858079232 127500 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 48325739358945544 0 0 17 7 0 0 0
/proc/12777/statm: 209492 127500 376 364 0 145389 0
[pid=12779] ppid=12777 vsize=1834752 CPUtime=200.8 cores=1,3,5,7
/proc/12779/stat : 12779 (cryptominisat-2) R 12777 12779 12779 0 -1 4202496 401802 0 0 0 20015 65 0 0 25 0 1 0 617442051 1878786048 375350 33554432000 4194304 4677096 140735202565488 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/12779/statm: 458688 375350 391 118 0 453647 0
[pid=12780] ppid=12666 vsize=848224 CPUtime=0.36 cores=1,3,5,7
/proc/12780/stat : 12780 (python) S 12666 12666 10986 0 -1 4202560 999 0 0 0 18 18 0 0 15 0 1 0 617445706 868581376 127498 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 15552442441310109960 0 0 17 5 0 0 0
/proc/12780/statm: 212056 127498 370 364 0 147950 0
[pid=12782] ppid=12780 vsize=777460 CPUtime=86.09 cores=1,3,5,7
/proc/12782/stat : 12782 (cryptominisat-2) R 12780 12782 12782 0 -1 4202496 172054 0 0 0 8578 31 0 0 25 0 1 0 617445707 796119040 169580 33554432000 4194304 4677096 140736790410656 18446744073709551615 4454468 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/12782/statm: 194365 169580 378 118 0 189324 0
[pid=12666/tid=12682] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12682/stat : 12682 (python) S 12664 12666 10986 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 10 0 617369008 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12685] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12685/stat : 12685 (python) S 12664 12666 10986 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 10 0 617369012 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 7 0 0 0
[pid=12666/tid=12688] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12688/stat : 12688 (python) S 12664 12666 10986 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 10 0 617369015 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12690] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12690/stat : 12690 (python) S 12664 12666 10986 0 -1 4202560 19 932 0 0 0 0 0 0 22 0 10 0 617369018 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12717] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12717/stat : 12717 (python) S 12664 12666 10986 0 -1 4202560 33 932 0 0 0 0 0 0 18 0 10 0 617381343 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 3 0 0 0
[pid=12666/tid=12740] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12740/stat : 12740 (python) S 12664 12666 10986 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 617405510 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12751] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12751/stat : 12751 (python) S 12664 12666 10986 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 10 0 617424174 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12778] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12778/stat : 12778 (python) S 12664 12666 10986 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 10 0 617442051 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12781] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12781/stat : 12781 (python) S 12664 12666 10986 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 10 0 617445707 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3082.74
Current children cumulated vsize (KiB) 15525248



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1149.2 s]
/proc/loadavg: 5.04 6.09 7.15 6/296 12788
/proc/meminfo: memFree=10892416/32951124 swapFree=67102140/67111528
[pid=12666] ppid=12664 vsize=858468 CPUtime=182.76 cores=1,3,5,7
/proc/12666/stat : 12666 (python) S 12664 12666 10986 0 -1 4202496 693757 932 1 0 18160 116 0 0 20 0 10 0 617350743 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747005387 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/12666/statm: 214617 129024 1892 364 0 150511 0
[pid=12681] ppid=12666 vsize=776420 CPUtime=1.46 cores=1,3,5,7
/proc/12681/stat : 12681 (python) S 12666 12666 10986 0 -1 4202560 1215 0 0 0 71 75 0 0 18 0 2 0 617369007 795054080 127516 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/12681/statm: 194105 127516 415 364 0 130023 0
[pid=12683] ppid=12681 vsize=189588 CPUtime=587.86 cores=1,3,5,7
/proc/12683/stat : 12683 (lingeling) T 12681 12683 12683 0 -1 4202496 380650 0 0 0 58734 52 0 0 25 0 1 0 617369009 194138112 46567 33554432000 4194304 4352236 140733914978928 18446744073709551615 4207831 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/12683/statm: 47397 46567 129 39 0 46477 0
[pid=12681/tid=12708] ppid=12666 vsize=776420 CPUtime=0 cores=1,3,5,7
/proc/12681/task/12708/stat : 12708 (python) S 12666 12666 10986 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 617379029 795054080 127516 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 514 18446604471121204160 0 0 -1 1 0 0 0
[pid=12684] ppid=12666 vsize=776432 CPUtime=1.32 cores=1,3,5,7
/proc/12684/stat : 12684 (python) S 12666 12666 10986 0 -1 4202560 1154 0 0 0 66 66 0 0 18 0 2 0 617369010 795066368 127500 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12684/statm: 194108 127500 399 364 0 130023 0
[pid=12686] ppid=12684 vsize=724888 CPUtime=485.53 cores=1,3,5,7
/proc/12686/stat : 12686 (precosat) T 12684 12686 12686 0 -1 4202496 185391 0 0 0 48517 36 0 0 25 0 1 0 617369012 742285312 180230 33554432000 4194304 4890832 140733920600016 18446744073709551615 4293445 0 0 16781312 17442 18446744071562691360 0 0 17 5 0 0 0
/proc/12686/statm: 181222 180230 86 171 0 181049 0
[pid=12684/tid=12715] ppid=12666 vsize=776432 CPUtime=0 cores=1,3,5,7
/proc/12684/task/12715/stat : 12715 (python) S 12666 12666 10986 0 -1 4202560 50 0 0 0 0 0 0 0 18 0 2 0 617381340 795066368 127500 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 514 18446604454223470656 0 0 -1 7 0 0 0
[pid=12687] ppid=12666 vsize=786688 CPUtime=1.85 cores=1,3,5,7
/proc/12687/stat : 12687 (python) S 12666 12666 10986 0 -1 4202560 1168 0 0 0 92 93 0 0 15 0 2 0 617369014 805568512 127504 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/12687/statm: 196672 127504 399 364 0 132584 0
[pid=12691] ppid=12687 vsize=2647624 CPUtime=690.64 cores=1,3,5,7
/proc/12691/stat : 12691 (cryptominisat-2) R 12687 12691 12691 0 -1 4202496 649244 0 0 0 68947 117 0 0 25 0 1 0 617369018 2711166976 526514 33554432000 4194304 4677096 140735890560032 18446744073709551615 4336148 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/12691/statm: 661906 526514 391 118 0 656865 0
[pid=12687/tid=12749] ppid=12666 vsize=786688 CPUtime=0 cores=1,3,5,7
/proc/12687/task/12749/stat : 12749 (python) S 12666 12666 10986 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 617424170 805568512 127504 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 514 18446604468835271680 0 0 -1 3 0 0 0
[pid=12689] ppid=12666 vsize=796944 CPUtime=0.3 cores=1,3,5,7
/proc/12689/stat : 12689 (python) S 12666 12666 10986 0 -1 4202560 1146 0 0 0 15 15 0 0 19 0 2 0 617369017 816070656 127508 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/12689/statm: 199236 127508 399 364 0 135145 0
[pid=12692] ppid=12689 vsize=228820 CPUtime=98.11 cores=1,3,5,7
/proc/12692/stat : 12692 (SApperloT-base) T 12689 12692 12692 0 -1 4202496 50549 0 0 0 9795 16 0 0 25 0 1 0 617369020 234311680 47907 33554432000 134512640 135674940 4292791840 18446744073709551615 134564250 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12692/statm: 57205 47907 100 284 0 56919 0
[pid=12689/tid=12722] ppid=12666 vsize=796944 CPUtime=0 cores=1,3,5,7
/proc/12689/task/12722/stat : 12722 (python) S 12666 12666 10986 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 617383859 816070656 127508 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 514 18446604468835272576 0 0 -1 5 0 0 0
[pid=12716] ppid=12666 vsize=807200 CPUtime=1.7 cores=1,3,5,7
/proc/12716/stat : 12716 (python) S 12666 12666 10986 0 -1 4202560 1171 0 0 0 85 85 0 0 18 0 2 0 617381342 826572800 127512 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/12716/statm: 201800 127512 399 364 0 137706 0
[pid=12718] ppid=12716 vsize=194000 CPUtime=591.69 cores=1,3,5,7
/proc/12718/stat : 12718 (lingeling) R 12716 12718 12718 0 -1 4202496 385142 0 0 0 59111 58 0 0 25 0 1 0 617381343 198656000 47670 33554432000 4194304 4352236 140733897902816 18446744073709551615 4231098 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/12718/statm: 48500 47670 129 39 0 47580 0
[pid=12716/tid=12737] ppid=12666 vsize=807200 CPUtime=0 cores=1,3,5,7
/proc/12716/task/12737/stat : 12737 (python) S 12666 12666 10986 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 617400988 826572800 127512 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 514 18446604468379337792 0 0 -1 5 0 0 0
[pid=12739] ppid=12666 vsize=817456 CPUtime=0.24 cores=1,3,5,7
/proc/12739/stat : 12739 (python) S 12666 12666 10986 0 -1 4202560 1137 0 0 0 11 13 0 0 19 0 2 0 617405509 837074944 127516 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/12739/statm: 204364 127516 399 364 0 140267 0
[pid=12741] ppid=12739 vsize=183808 CPUtime=100.44 cores=1,3,5,7
/proc/12741/stat : 12741 (lingeling) T 12739 12741 12741 0 -1 4202496 165905 0 0 0 10016 28 0 0 25 0 1 0 617405510 188219392 45122 33554432000 4194304 4352236 140736599370288 18446744073709551615 4331567 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/12741/statm: 45952 45122 129 39 0 45032 0
[pid=12739/tid=12745] ppid=12666 vsize=817456 CPUtime=0 cores=1,3,5,7
/proc/12739/task/12745/stat : 12745 (python) S 12666 12666 10986 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 617416744 837074944 127516 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 514 18446604463215219840 0 0 -1 5 0 0 0
[pid=12750] ppid=12666 vsize=827712 CPUtime=0.23 cores=1,3,5,7
/proc/12750/stat : 12750 (python) S 12666 12666 10986 0 -1 4202560 1126 0 0 0 10 13 0 0 19 0 2 0 617424172 847577088 127520 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747005387 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/12750/statm: 206928 127520 399 364 0 142828 0
[pid=12752] ppid=12750 vsize=724884 CPUtime=101.87 cores=1,3,5,7
/proc/12752/stat : 12752 (precosat) T 12750 12752 12752 0 -1 4202496 184767 0 0 0 10147 40 0 0 25 0 1 0 617424174 742281216 179559 33554432000 4194304 4890832 140733228354848 18446744073709551615 4246516 0 0 16781312 17442 18446744071562691360 0 0 17 5 0 0 0
/proc/12752/statm: 181221 179559 86 171 0 181048 0
[pid=12750/tid=12774] ppid=12666 vsize=827712 CPUtime=0 cores=1,3,5,7
/proc/12750/task/12774/stat : 12774 (python) S 12666 12666 10986 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 617435401 847577088 127520 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 514 18446604458000826816 0 0 -1 5 0 0 0
[pid=12777] ppid=12666 vsize=837968 CPUtime=0.5 cores=1,3,5,7
/proc/12777/stat : 12777 (python) S 12666 12666 10986 0 -1 4202560 1061 0 0 0 25 25 0 0 15 0 1 0 617442049 858079232 127500 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 48325739358945544 0 0 17 7 0 0 0
/proc/12777/statm: 209492 127500 376 364 0 145389 0
[pid=12779] ppid=12777 vsize=2039808 CPUtime=227.14 cores=1,3,5,7
/proc/12779/stat : 12779 (cryptominisat-2) R 12777 12779 12779 0 -1 4202496 446552 0 0 0 22640 74 0 0 25 0 1 0 617442051 2088763392 409424 33554432000 4194304 4677096 140735202565488 18446744073709551615 4499792 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/12779/statm: 509952 409424 391 118 0 504911 0
[pid=12780] ppid=12666 vsize=848224 CPUtime=0.41 cores=1,3,5,7
/proc/12780/stat : 12780 (python) S 12666 12666 10986 0 -1 4202560 1006 0 0 0 20 21 0 0 15 0 1 0 617445706 868581376 127498 33554432000 4194304 5683644 140737069202272 18446744073709551615 216735198790 0 0 16781312 514 15552442441310109960 0 0 17 5 0 0 0
/proc/12780/statm: 212056 127498 370 364 0 147950 0
[pid=12782] ppid=12780 vsize=805940 CPUtime=101.78 cores=1,3,5,7
/proc/12782/stat : 12782 (cryptominisat-2) R 12780 12782 12782 0 -1 4202496 181062 0 0 0 10146 32 0 0 25 0 1 0 617445707 825282560 178588 33554432000 4194304 4677096 140736790410656 18446744073709551615 4454506 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/12782/statm: 201485 178588 378 118 0 196444 0
[pid=12666/tid=12682] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12682/stat : 12682 (python) S 12664 12666 10986 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 10 0 617369008 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12685] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12685/stat : 12685 (python) S 12664 12666 10986 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 10 0 617369012 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 7 0 0 0
[pid=12666/tid=12688] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12688/stat : 12688 (python) S 12664 12666 10986 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 10 0 617369015 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12690] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12690/stat : 12690 (python) S 12664 12666 10986 0 -1 4202560 19 932 0 0 0 0 0 0 22 0 10 0 617369018 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12717] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12717/stat : 12717 (python) S 12664 12666 10986 0 -1 4202560 33 932 0 0 0 0 0 0 18 0 10 0 617381343 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 3 0 0 0
[pid=12666/tid=12740] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12740/stat : 12740 (python) S 12664 12666 10986 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 10 0 617405510 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12751] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12751/stat : 12751 (python) S 12664 12666 10986 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 10 0 617424174 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12778] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12778/stat : 12778 (python) S 12664 12666 10986 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 10 0 617442051 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
[pid=12666/tid=12781] ppid=12664 vsize=858468 CPUtime=0 cores=1,3,5,7
/proc/12666/task/12781/stat : 12781 (python) S 12664 12666 10986 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 10 0 617445707 879071232 129024 33554432000 4194304 5683644 140737069202272 18446744073709551615 216747002289 0 0 16781312 2 18446604469359542336 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3175.83
Current children cumulated vsize (KiB) 15872872

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 12666 and gives
#  childrusage.ru_utime.tv_sec=181
#  childrusage.ru_utime.tv_usec=607391
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=203816
# CPU time returned by wait4() is 182.811
# while last known CPU time is 3175.83
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1149.31
CPU time (s): 3175.83
CPU user time (s): 3166.08
CPU system time (s): 9.75
CPU usage (%): 276.326
Max. virtual memory (cumulated for all children) (KiB): 15872872

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 181.607
system time used= 1.20382
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 694696
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9614
involuntary context switches= 1725

runsolver used 4.15837 second user time and 9.77951 second system time

The end

Launcher Data 

Begin job on node119 at 2011-05-01 19:33:21
IDJOB=3317732
IDBENCH=88167
IDSOLVER=1706
FILE ID=node119/3317732-1304271200
RUNJOBID= node119-1304271200-12649
PBS_JOBID= 13173960
Free space on /tmp= 72804 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT-Race-2010-CNF/hardware-verification/velev/11pipe_k.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317732-1304271200/watcher-3317732-1304271200 -o /tmp/evaluation-result-3317732-1304271200/solver-3317732-1304271200 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317732-1304271200.cnf -seed 928521394 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 932387240a0c17f4c88af52c4ca151c6
RANDOM SEED=928521394

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22046728 kB
Buffers:       1971404 kB
Cached:        7331660 kB
SwapCached:       3688 kB
Active:        2049588 kB
Inactive:      8255016 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22046728 kB
SwapTotal:    67111528 kB
SwapFree:     67102140 kB
Dirty:          259600 kB
Writeback:           0 kB
AnonPages:     1000604 kB
Mapped:          23812 kB
Slab:           523856 kB
PageTables:      16660 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 47364536 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72860 MiB
End job on node119 at 2011-05-01 19:52:32