Trace number 3317877

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4800.21 1222.26

General information on the benchmark

Nameindustrial/fuhs/hard/
AProVE07-01.cnf
MD5SUMd2f77e32530988f77dca5112174eee00
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables7502
Number of clauses28770
Sum of the clauses size76290
Maximum clause length847
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 215814
Number of clauses of size 311119
Number of clauses of size 4733
Number of clauses of size 5172
Number of clauses of size over 5931

Solver Data 

0.58/18.49	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.58/18.49	c INFO: solving HOME/instance-3317877-1304267283.cnf
0.58/18.49	c INFO: computing task features
0.59/18.58	c INFO: computed variable-clause graph statistics
0.59/18.58	c INFO: computed clause balance statistics
1.09/19.04	c INFO: computed variable balance statistics
1.39/19.37	c INFO: computed small-clause counts
1.39/19.37	c INFO: computed Horn-clause counts
1.49/19.48	c INFO: computed variable graph statistics
1.49/19.48	c INFO: collected features for HOME/instance-3317877-1304267283.cnf in 0.98 s
1.59/19.51	c INFO: running lingeling-276@0 for 97 with 4799 remaining (b = 0.29)
1.59/19.53	c INFO: running cryptominisat-2.9.0@0 for 485 with 4798 remaining (b = 0.35)
1.59/19.55	c INFO: running lingeling-276@0 for 582 with 4798 remaining (b = 0.39)
1.59/19.58	c INFO: running lingeling-276@0 for 1261 with 4798 remaining (b = 0.44)
401.19/119.66	c INFO: running SApperloT@0 for 97 with 4698 remaining (b = 0.03)
801.33/219.81	c INFO: running precosat-570@0 for 291 with 4598 remaining (b = 0.16)
1964.69/511.16	c INFO: running cryptominisat-2.9.0@0 for 388 with 4307 remaining (b = 0.20)
1988.66/517.19	c INFO: running cryptominisat-2.9.0@0 for 388 with 4301 remaining (b = 0.16)
2356.79/609.33	c INFO: running lingeling-276@0 for 582 with 4209 remaining (b = 0.20)
3510.20/898.46	c INFO: running cryptominisat-2.9.0@296 for 194 with 3920 remaining (b = 0.13)
3560.83/911.13	c INFO: running lingeling-276@0 for 97 with 3907 remaining (b = 0.06)
3960.01/1011.30	c INFO: running cryptominisat-2.9.0@584 for 1067 with 3807 remaining (b = 0.34)
4292.65/1094.89	c INFO: running precosat-570@490 for 291 with 3723 remaining (b = 0.14)
4684.27/1193.16	c INFO: running cryptominisat-2.9.0@0 for 485 with 3625 remaining (b = 0.18)
4800.21/1222.25	c INFO: running precosat-570@0 for 388 with 3596 remaining (b = 0.12)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317877-1304267283/watcher-3317877-1304267283 -o /tmp/evaluation-result-3317877-1304267283/solver-3317877-1304267283 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317877-1304267283.cnf -seed 638206346 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/176 4533
/proc/meminfo: memFree=27569980/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=11800 CPUtime=0 cores=1,3,5,7
/proc/4531/stat : 4531 (runsolver) S 4529 4531 4496 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 1 0 538328224 12083200 54 33554432000 4194304 5434984 140736207079968 18446744073709551615 5055495 0 2147483391 4096 24578 18446744071699207358 0 0 17 5 0 0 0
/proc/4531/statm: 2950 54 34 303 0 2644 0

[startup+0.014701 s]
/proc/loadavg: 0.00 0.00 0.00 2/176 4533
/proc/meminfo: memFree=27569980/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=11800 CPUtime=0 cores=1,3,5,7
/proc/4531/stat : 4531 (runsolver) S 4529 4531 4496 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 1 0 538328224 12083200 54 33554432000 4194304 5434984 140736207079968 18446744073709551615 5055495 0 2147483391 4096 24578 18446744071699207358 0 0 17 5 0 0 0
/proc/4531/statm: 2950 54 34 303 0 2644 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 11800

[startup+0.100683 s]
/proc/loadavg: 0.00 0.00 0.00 2/176 4533
/proc/meminfo: memFree=27569980/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=15080 CPUtime=0 cores=1,3,5,7
/proc/4531/stat : 4531 (python) S 4529 4531 4496 0 -1 4202496 611 0 6 0 0 0 0 0 17 0 1 0 538328224 15441920 513 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 2
/proc/4531/statm: 3770 513 300 364 0 257 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15080

[startup+0.300673 s]
/proc/loadavg: 0.00 0.00 0.00 2/176 4533
/proc/meminfo: memFree=27569980/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/4531/stat : 4531 (python) S 4529 4531 4496 0 -1 4202496 728 0 6 0 0 0 0 0 16 0 1 0 538328224 15548416 622 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080228197 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 3
/proc/4531/statm: 3796 622 322 364 0 283 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15184

[startup+0.70057 s]
/proc/loadavg: 0.00 0.00 0.00 2/176 4533
/proc/meminfo: memFree=27569980/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/4531/stat : 4531 (python) S 4529 4531 4496 0 -1 4202496 922 0 6 0 0 0 0 0 16 0 1 0 538328224 16154624 807 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 4
/proc/4531/statm: 3944 807 356 364 0 431 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15776

[startup+1.50041 s]
/proc/loadavg: 0.00 0.00 0.00 2/178 4535
/proc/meminfo: memFree=27560160/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=16396 CPUtime=0.01 cores=1,3,5,7
/proc/4531/stat : 4531 (python) S 4529 4531 4496 0 -1 4202496 1112 0 6 0 1 0 0 0 16 0 1 0 538328224 16789504 985 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080228197 0 2147483391 16781312 2 18446744071699207358 0 0 17 1 0 0 9
/proc/4531/statm: 4099 985 409 364 0 586 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16396

[startup+3.10011 s]
/proc/loadavg: 0.16 0.03 0.01 2/178 4535
/proc/meminfo: memFree=27559884/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=18884 CPUtime=0.02 cores=1,3,5,7
/proc/4531/stat : 4531 (python) S 4529 4531 4496 0 -1 4202496 1232 0 7 0 1 1 0 0 16 0 1 0 538328224 19337216 1094 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 1 0 0 16
/proc/4531/statm: 4721 1094 421 364 0 690 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18884
heavy processes:

[startup+6.3005 s]
/proc/loadavg: 0.16 0.03 0.01 2/178 4535
/proc/meminfo: memFree=27556580/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=93960 CPUtime=0.11 cores=1,3,5,7
/proc/4531/stat : 4531 (python) D 4529 4531 4496 0 -1 4202496 2669 0 24 0 5 6 0 0 16 0 1 0 538328224 96215040 2407 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080228197 0 0 16781312 2 0 0 0 17 7 0 0 29
/proc/4531/statm: 23490 2407 764 364 0 1622 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 93960
heavy processes:

[startup+12.7003 s]
/proc/loadavg: 0.21 0.05 0.02 2/178 4543
/proc/meminfo: memFree=27524220/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=135748 CPUtime=0.34 cores=1,3,5,7
/proc/4531/stat : 4531 (python) S 4529 4531 4496 0 -1 4202496 5961 924 44 9 16 18 0 0 15 0 1 0 538328224 139005952 4169 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 7 0 0 66
/proc/4531/statm: 33937 4169 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 135748
heavy processes:

[startup+25.5008 s]
/proc/loadavg: 0.89 0.19 0.06 10/202 4567
/proc/meminfo: memFree=27379172/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=322464 CPUtime=1.67 cores=1,3,5,7
/proc/4531/stat : 4531 (python) S 4529 4531 4496 0 -1 4202496 14166 924 118 9 136 31 0 0 25 0 5 0 538328224 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 139
/proc/4531/statm: 80616 7813 1881 364 0 16525 0
[pid=4556] ppid=4531 vsize=281452 CPUtime=0 cores=1,3,5,7
/proc/4556/stat : 4556 (python) S 4531 4531 4496 0 -1 4202560 982 0 0 0 0 0 0 0 18 0 1 0 538330175 288206848 6297 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252431 0 0 16781312 514 188614077214327048 0 0 17 7 0 0 0
/proc/4556/statm: 70363 6297 381 364 0 6281 0
[pid=4558] ppid=4556 vsize=9760 CPUtime=5.98 cores=1,3,5,7
/proc/4558/stat : 4558 (lingeling) R 4556 4558 4558 0 -1 4202496 2499 0 0 0 598 0 0 0 25 0 1 0 538330176 9994240 1610 33554432000 4194304 4352236 140733223589344 18446744073709551615 4328109 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/4558/statm: 2440 1610 129 39 0 1520 0
[pid=4559] ppid=4531 vsize=291708 CPUtime=0 cores=1,3,5,7
/proc/4559/stat : 4559 (python) S 4531 4531 4496 0 -1 4202560 904 0 0 0 0 0 0 0 15 0 1 0 538330178 298708992 6291 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 2063167603118932232 0 0 17 5 0 0 0
/proc/4559/statm: 72927 6291 371 364 0 8842 0
[pid=4561] ppid=4559 vsize=44436 CPUtime=5.94 cores=1,3,5,7
/proc/4561/stat : 4561 (cryptominisat-2) R 4559 4561 4561 0 -1 4202496 7630 0 0 0 594 0 0 0 25 0 1 0 538330178 45502464 4092 33554432000 4194304 4677096 140736007702752 18446744073709551615 4465841 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/4561/statm: 11109 4092 393 118 0 6068 0
[pid=4562] ppid=4531 vsize=301964 CPUtime=0 cores=1,3,5,7
/proc/4562/stat : 4562 (python) S 4531 4531 4496 0 -1 4202560 903 0 0 0 0 0 0 0 18 0 1 0 538330180 309211136 6295 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 4520190987250663688 0 0 17 7 0 0 0
/proc/4562/statm: 75491 6295 371 364 0 11403 0
[pid=4564] ppid=4562 vsize=10936 CPUtime=5.87 cores=1,3,5,7
/proc/4564/stat : 4564 (lingeling) R 4562 4564 4564 0 -1 4202496 2667 0 0 0 587 0 0 0 25 0 1 0 538330180 11198464 1904 33554432000 4194304 4352236 140736054638832 18446744073709551615 4328390 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/4564/statm: 2734 1904 129 39 0 1814 0
[pid=4565] ppid=4531 vsize=312220 CPUtime=0 cores=1,3,5,7
/proc/4565/stat : 4565 (python) S 4531 4531 4496 0 -1 4202560 931 0 0 0 0 0 0 0 18 0 1 0 538330182 319713280 6299 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 13100711560693645576 0 0 17 3 0 0 0
/proc/4565/statm: 78055 6299 371 364 0 13964 0
[pid=4567] ppid=4565 vsize=9684 CPUtime=5.89 cores=1,3,5,7
/proc/4567/stat : 4567 (lingeling) R 4565 4567 4567 0 -1 4202496 2096 0 0 0 589 0 0 0 25 0 1 0 538330183 9916416 1591 33554432000 4194304 4352236 140735827137680 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/4567/statm: 2421 1591 129 39 0 1501 0
[pid=4531/tid=4557] ppid=4529 vsize=322464 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4557/stat : 4557 (python) S 4529 4531 4496 0 -1 4202560 24 924 0 9 0 0 0 0 19 0 5 0 538330176 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 7 0 0 0
[pid=4531/tid=4560] ppid=4529 vsize=322464 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4560/stat : 4560 (python) S 4529 4531 4496 0 -1 4202560 19 924 0 9 0 0 0 0 21 0 5 0 538330178 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 5 0 0 0
[pid=4531/tid=4563] ppid=4529 vsize=322464 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4563/stat : 4563 (python) S 4529 4531 4496 0 -1 4202560 26 924 0 9 0 0 0 0 23 0 5 0 538330180 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 7 0 0 0
[pid=4531/tid=4566] ppid=4529 vsize=322464 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4566/stat : 4566 (python) S 4529 4531 4496 0 -1 4202560 28 924 0 9 0 0 0 0 25 0 5 0 538330183 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.35
Current children cumulated vsize (KiB) 1584624

[startup+51.101 s]
/proc/loadavg: 3.31 0.82 0.27 11/202 4568
/proc/meminfo: memFree=27302036/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=322464 CPUtime=1.67 cores=1,3,5,7
/proc/4531/stat : 4531 (python) S 4529 4531 4496 0 -1 4202496 14166 924 118 9 136 31 0 0 25 0 5 0 538328224 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 139
/proc/4531/statm: 80616 7813 1881 364 0 16525 0
[pid=4556] ppid=4531 vsize=281452 CPUtime=0.03 cores=1,3,5,7
/proc/4556/stat : 4556 (python) S 4531 4531 4496 0 -1 4202560 995 0 0 0 1 2 0 0 18 0 1 0 538330175 288206848 6298 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252431 0 0 16781312 514 12312753420300681480 0 0 17 7 0 0 0
/proc/4556/statm: 70363 6298 382 364 0 6281 0
[pid=4558] ppid=4556 vsize=11388 CPUtime=31.56 cores=1,3,5,7
/proc/4558/stat : 4558 (lingeling) R 4556 4558 4558 0 -1 4202496 6330 0 0 0 3156 0 0 0 25 0 1 0 538330176 11661312 2017 33554432000 4194304 4352236 140733223589344 18446744073709551615 4283151 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/4558/statm: 2847 2017 129 39 0 1927 0
[pid=4559] ppid=4531 vsize=291708 CPUtime=0.04 cores=1,3,5,7
/proc/4559/stat : 4559 (python) S 4531 4531 4496 0 -1 4202560 919 0 0 0 2 2 0 0 15 0 1 0 538330178 298708992 6291 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 12312753420300681480 0 0 17 5 0 0 0
/proc/4559/statm: 72927 6291 371 364 0 8842 0
[pid=4561] ppid=4559 vsize=68984 CPUtime=31.5 cores=1,3,5,7
/proc/4561/stat : 4561 (cryptominisat-2) R 4559 4561 4561 0 -1 4202496 23882 0 0 0 3147 3 0 0 25 0 1 0 538330178 70639616 10360 33554432000 4194304 4677096 140736007702752 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/4561/statm: 17246 10360 393 118 0 12205 0
[pid=4562] ppid=4531 vsize=301964 CPUtime=0.03 cores=1,3,5,7
/proc/4562/stat : 4562 (python) S 4531 4531 4496 0 -1 4202560 915 0 0 0 2 1 0 0 18 0 1 0 538330180 309211136 6295 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 12312753420300681480 0 0 17 7 0 0 0
/proc/4562/statm: 75491 6295 371 364 0 11403 0
[pid=4564] ppid=4562 vsize=14532 CPUtime=31.25 cores=1,3,5,7
/proc/4564/stat : 4564 (lingeling) R 4562 4564 4564 0 -1 4202496 6146 0 0 0 3125 0 0 0 25 0 1 0 538330180 14880768 2823 33554432000 4194304 4352236 140736054638832 18446744073709551615 4277773 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/4564/statm: 3633 2823 129 39 0 2713 0
[pid=4565] ppid=4531 vsize=312220 CPUtime=0.03 cores=1,3,5,7
/proc/4565/stat : 4565 (python) S 4531 4531 4496 0 -1 4202560 942 0 0 0 1 2 0 0 18 0 1 0 538330182 319713280 6299 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 12312753420300681480 0 0 17 3 0 0 0
/proc/4565/statm: 78055 6299 371 364 0 13964 0
[pid=4567] ppid=4565 vsize=16540 CPUtime=31.47 cores=1,3,5,7
/proc/4567/stat : 4567 (lingeling) R 4565 4567 4567 0 -1 4202496 6550 0 0 0 3146 1 0 0 25 0 1 0 538330183 16936960 3325 33554432000 4194304 4352236 140735827137680 18446744073709551615 4276757 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/4567/statm: 4135 3325 129 39 0 3215 0
[pid=4531/tid=4557] ppid=4529 vsize=322464 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4557/stat : 4557 (python) S 4529 4531 4496 0 -1 4202560 24 924 0 9 0 0 0 0 19 0 5 0 538330176 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 7 0 0 0
[pid=4531/tid=4560] ppid=4529 vsize=322464 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4560/stat : 4560 (python) S 4529 4531 4496 0 -1 4202560 19 924 0 9 0 0 0 0 21 0 5 0 538330178 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 5 0 0 0
[pid=4531/tid=4563] ppid=4529 vsize=322464 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4563/stat : 4563 (python) S 4529 4531 4496 0 -1 4202560 26 924 0 9 0 0 0 0 23 0 5 0 538330180 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 7 0 0 0
[pid=4531/tid=4566] ppid=4529 vsize=322464 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4566/stat : 4566 (python) S 4529 4531 4496 0 -1 4202560 28 924 0 9 0 0 0 0 25 0 5 0 538330183 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 127.58
Current children cumulated vsize (KiB) 1621252

[startup+102.307 s]
/proc/loadavg: 6.13 2.03 0.71 10/202 4569
/proc/meminfo: memFree=27280556/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=322464 CPUtime=1.67 cores=1,3,5,7
/proc/4531/stat : 4531 (python) S 4529 4531 4496 0 -1 4202496 14166 924 118 9 136 31 0 0 25 0 5 0 538328224 330203136 7813 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 139
/proc/4531/statm: 80616 7813 1881 364 0 16525 0
[pid=4556] ppid=4531 vsize=281452 CPUtime=0.11 cores=1,3,5,7
/proc/4556/stat : 4556 (python) S 4531 4531 4496 0 -1 4202560 1021 0 0 0 6 5 0 0 18 0 1 0 538330175 288206848 6298 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252431 0 0 16781312 514 12312753420300681480 0 0 17 7 0 0 0
/proc/4556/statm: 70363 6298 382 364 0 6281 0
[pid=4558] ppid=4556 vsize=13948 CPUtime=82.76 cores=1,3,5,7
/proc/4558/stat : 4558 (lingeling) R 4556 4558 4558 0 -1 4202496 12026 0 0 0 8275 1 0 0 25 0 1 0 538330176 14282752 2689 33554432000 4194304 4352236 140733223589344 18446744073709551615 4328423 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/4558/statm: 3487 2689 129 39 0 2567 0
[pid=4559] ppid=4531 vsize=291708 CPUtime=0.12 cores=1,3,5,7
/proc/4559/stat : 4559 (python) S 4531 4531 4496 0 -1 4202560 939 0 0 0 7 5 0 0 15 0 1 0 538330178 298708992 6291 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 12312753420300681480 0 0 17 5 0 0 0
/proc/4559/statm: 72927 6291 371 364 0 8842 0

################
# More data... #
################

/proc/4567/stat : 4567 (lingeling) R 4565 4567 4567 0 -1 4202496 99482 0 0 0 116101 13 0 0 25 0 1 0 538330183 40386560 9062 33554432000 4194304 4352236 140735827137680 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/4567/statm: 9860 9062 129 39 0 8940 0
[pid=4576] ppid=4531 vsize=322476 CPUtime=0.13 cores=1,3,5,7
/proc/4576/stat : 4576 (python) S 4531 4531 4496 0 -1 4202560 1116 0 0 0 6 7 0 0 19 0 2 0 538340191 330215424 6333 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/4576/statm: 80619 6333 400 364 0 16525 0
[pid=4578] ppid=4576 vsize=13864 CPUtime=99.84 cores=1,3,5,7
/proc/4578/stat : 4578 (SApperloT-base) T 4576 4578 4578 0 -1 4202496 3371 0 0 0 9984 0 0 0 25 0 1 0 538340191 14196736 3073 33554432000 134512640 135674940 4293219872 18446744073709551615 134563449 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/4578/statm: 3466 3073 100 284 0 3180 0
[pid=4576/tid=4582] ppid=4531 vsize=322476 CPUtime=0 cores=1,3,5,7
/proc/4576/task/4582/stat : 4582 (python) S 4531 4531 4496 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538350203 330215424 6333 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604471135180800 0 0 -1 3 0 0 0
[pid=4583] ppid=4531 vsize=332732 CPUtime=0.53 cores=1,3,5,7
/proc/4583/stat : 4583 (python) S 4531 4531 4496 0 -1 4202560 1165 0 0 0 26 27 0 0 18 0 2 0 538350205 340717568 6337 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/4583/statm: 83183 6337 400 364 0 19086 0
[pid=4585] ppid=4583 vsize=35464 CPUtime=383.97 cores=1,3,5,7
/proc/4585/stat : 4585 (precosat) R 4583 4585 4585 0 -1 4202496 9467 0 0 0 38394 3 0 0 25 0 1 0 538350206 36315136 8673 33554432000 4194304 4890832 140736151376480 18446744073709551615 4238627 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/4585/statm: 8866 8673 86 171 0 8693 0
[pid=4583/tid=4595] ppid=4531 vsize=332732 CPUtime=0 cores=1,3,5,7
/proc/4583/task/4595/stat : 4595 (python) S 4531 4531 4496 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538379942 340717568 6337 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604468847843136 0 0 -1 3 0 0 0
[pid=4596] ppid=4531 vsize=342988 CPUtime=0.83 cores=1,3,5,7
/proc/4596/stat : 4596 (python) S 4531 4531 4496 0 -1 4202560 1180 0 0 0 40 43 0 0 15 0 2 0 538379944 351219712 6341 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/4596/statm: 85747 6341 400 364 0 21647 0
[pid=4598] ppid=4596 vsize=181520 CPUtime=558.03 cores=1,3,5,7
/proc/4598/stat : 4598 (cryptominisat-2) R 4596 4598 4598 0 -1 4202496 142918 0 0 0 55742 61 0 0 25 0 1 0 538379944 185876480 27009 33554432000 4194304 4677096 140734874455744 18446744073709551615 4454526 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/4598/statm: 45380 27009 398 118 0 40339 0
[pid=4596/tid=4623] ppid=4531 vsize=342988 CPUtime=0 cores=1,3,5,7
/proc/4596/task/4623/stat : 4623 (python) S 4531 4531 4496 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 538419336 351219712 6341 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604471139877248 0 0 -1 3 0 0 0
[pid=4624] ppid=4531 vsize=353244 CPUtime=0.14 cores=1,3,5,7
/proc/4624/stat : 4624 (python) S 4531 4531 4496 0 -1 4202560 1182 0 0 0 10 4 0 0 19 0 2 0 538419338 361721856 6351 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/4624/statm: 88311 6351 406 364 0 24208 0
[pid=4626] ppid=4624 vsize=16560 CPUtime=99.83 cores=1,3,5,7
/proc/4626/stat : 4626 (lingeling) T 4624 4626 4626 0 -1 4202496 14083 0 0 0 9981 2 0 0 25 0 1 0 538419338 16957440 3330 33554432000 4194304 4352236 140737456052512 18446744073709551615 4276717 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/4626/statm: 4140 3330 129 39 0 3220 0
[pid=4624/tid=4631] ppid=4531 vsize=353244 CPUtime=0 cores=1,3,5,7
/proc/4624/task/4631/stat : 4631 (python) S 4531 4531 4496 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538429352 361721856 6351 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604454223004928 0 0 -1 3 0 0 0
[pid=4531/tid=4557] ppid=4529 vsize=363488 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4557/stat : 4557 (python) S 4529 4531 4496 0 -1 4202560 28 924 0 9 0 0 0 0 18 0 9 0 538330176 372211712 7838 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 7 0 0 0
[pid=4531/tid=4560] ppid=4529 vsize=363488 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4560/stat : 4560 (python) S 4529 4531 4496 0 -1 4202560 31 924 0 9 0 0 0 0 18 0 9 0 538330178 372211712 7838 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 5 0 0 0
[pid=4531/tid=4563] ppid=4529 vsize=363488 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4563/stat : 4563 (python) S 4529 4531 4496 0 -1 4202560 26 924 0 9 0 0 0 0 23 0 9 0 538330180 372211712 7838 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 7 0 0 0
[pid=4531/tid=4566] ppid=4529 vsize=363488 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4566/stat : 4566 (python) S 4529 4531 4496 0 -1 4202560 28 924 0 9 0 0 0 0 25 0 9 0 538330183 372211712 7838 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
[pid=4531/tid=4577] ppid=4529 vsize=363488 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4577/stat : 4577 (python) S 4529 4531 4496 0 -1 4202560 28 924 0 9 0 0 0 0 20 0 9 0 538340191 372211712 7838 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
[pid=4531/tid=4584] ppid=4529 vsize=363488 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4584/stat : 4584 (python) S 4529 4531 4496 0 -1 4202560 33 924 0 9 0 0 0 0 18 0 9 0 538350206 372211712 7838 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
[pid=4531/tid=4597] ppid=4529 vsize=363488 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4597/stat : 4597 (python) S 4529 4531 4496 0 -1 4202560 31 924 0 9 0 0 0 0 18 0 9 0 538379944 372211712 7838 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
[pid=4531/tid=4625] ppid=4529 vsize=363488 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4625/stat : 4625 (python) S 4529 4531 4496 0 -1 4202560 31 924 0 9 0 0 0 0 20 0 9 0 538419338 372211712 7838 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4641.24
Current children cumulated vsize (KiB) 3408800



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1222.2 s]
/proc/loadavg: 6.73 7.67 5.79 6/212 4671
/proc/meminfo: memFree=26727900/32950928 swapFree=67111356/67111528
[pid=4531] ppid=4529 vsize=373744 CPUtime=1.91 cores=1,3,5,7
/proc/4531/stat : 4531 (python) S 4529 4531 4496 0 -1 4202496 18456 924 118 9 159 32 0 0 20 0 10 0 538328224 382713856 7844 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 139
/proc/4531/statm: 93436 7844 1892 364 0 29330 0
[pid=4556] ppid=4531 vsize=291696 CPUtime=0.93 cores=1,3,5,7
/proc/4556/stat : 4556 (python) S 4531 4531 4496 0 -1 4202560 1212 0 0 0 46 47 0 0 18 0 2 0 538330175 298696704 6337 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/4556/statm: 72924 6337 416 364 0 8842 0
[pid=4558] ppid=4556 vsize=28044 CPUtime=683.94 cores=1,3,5,7
/proc/4558/stat : 4558 (lingeling) T 4556 4558 4558 0 -1 4202496 60990 0 0 0 68385 9 0 0 25 0 1 0 538330176 28717056 6213 33554432000 4194304 4352236 140733223589344 18446744073709551615 4328055 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/4558/statm: 7011 6213 129 39 0 6091 0
[pid=4556/tid=4575] ppid=4531 vsize=291696 CPUtime=0 cores=1,3,5,7
/proc/4556/task/4575/stat : 4575 (python) S 4531 4531 4496 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538340188 298696704 6337 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604470136477568 0 0 -1 7 0 0 0
[pid=4559] ppid=4531 vsize=291708 CPUtime=1.53 cores=1,3,5,7
/proc/4559/stat : 4559 (python) S 4531 4531 4496 0 -1 4202560 1169 0 0 0 79 74 0 0 15 0 2 0 538330178 298708992 6322 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/4559/statm: 72927 6322 401 364 0 8842 0
[pid=4561] ppid=4559 vsize=155324 CPUtime=1072 cores=1,3,5,7
/proc/4561/stat : 4561 (cryptominisat-2) T 4559 4561 4561 0 -1 4202496 231522 0 0 0 107110 90 0 0 25 0 1 0 538330178 159051776 29965 33554432000 4194304 4677096 140736007702752 18446744073709551615 4319581 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/4561/statm: 38831 29965 393 118 0 33790 0
[pid=4559/tid=4593] ppid=4531 vsize=291708 CPUtime=0 cores=1,3,5,7
/proc/4559/task/4593/stat : 4593 (python) S 4531 4531 4496 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 538379338 298708992 6322 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604468847844032 0 0 -1 5 0 0 0
[pid=4562] ppid=4531 vsize=301964 CPUtime=0.79 cores=1,3,5,7
/proc/4562/stat : 4562 (python) S 4531 4531 4496 0 -1 4202560 1128 0 0 0 41 38 0 0 19 0 2 0 538330180 309211136 6325 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/4562/statm: 75491 6325 400 364 0 11403 0
[pid=4564] ppid=4562 vsize=28884 CPUtime=585.01 cores=1,3,5,7
/proc/4564/stat : 4564 (lingeling) T 4562 4564 4564 0 -1 4202496 54822 0 0 0 58493 8 0 0 25 0 1 0 538330180 29577216 6411 33554432000 4194304 4352236 140736054638832 18446744073709551615 4328345 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/4564/statm: 7221 6411 129 39 0 6301 0
[pid=4562/tid=4606] ppid=4531 vsize=301964 CPUtime=0 cores=1,3,5,7
/proc/4562/task/4606/stat : 4606 (python) S 4531 4531 4496 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 538389155 309211136 6325 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604471145001408 0 0 -1 7 0 0 0
[pid=4565] ppid=4531 vsize=312220 CPUtime=1.64 cores=1,3,5,7
/proc/4565/stat : 4565 (python) S 4531 4531 4496 0 -1 4202560 1002 0 0 0 82 82 0 0 18 0 1 0 538330182 319713280 6299 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 12312753420300681480 0 0 17 3 0 0 0
/proc/4565/statm: 78055 6299 371 364 0 13964 0
[pid=4567] ppid=4565 vsize=38416 CPUtime=1200.98 cores=1,3,5,7
/proc/4567/stat : 4567 (lingeling) R 4565 4567 4567 0 -1 4202496 101402 0 0 0 120084 14 0 0 25 0 1 0 538330183 39337984 8806 33554432000 4194304 4352236 140735827137680 18446744073709551615 4328100 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/4567/statm: 9604 8806 129 39 0 8684 0
[pid=4576] ppid=4531 vsize=322476 CPUtime=0.13 cores=1,3,5,7
/proc/4576/stat : 4576 (python) S 4531 4531 4496 0 -1 4202560 1116 0 0 0 6 7 0 0 19 0 2 0 538340191 330215424 6333 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/4576/statm: 80619 6333 400 364 0 16525 0
[pid=4578] ppid=4576 vsize=13864 CPUtime=99.84 cores=1,3,5,7
/proc/4578/stat : 4578 (SApperloT-base) T 4576 4578 4578 0 -1 4202496 3371 0 0 0 9984 0 0 0 25 0 1 0 538340191 14196736 3073 33554432000 134512640 135674940 4293219872 18446744073709551615 134563449 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/4578/statm: 3466 3073 100 284 0 3180 0
[pid=4576/tid=4582] ppid=4531 vsize=322476 CPUtime=0 cores=1,3,5,7
/proc/4576/task/4582/stat : 4582 (python) S 4531 4531 4496 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538350203 330215424 6333 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604471135180800 0 0 -1 3 0 0 0
[pid=4583] ppid=4531 vsize=332732 CPUtime=0.59 cores=1,3,5,7
/proc/4583/stat : 4583 (python) S 4531 4531 4496 0 -1 4202560 1165 0 0 0 29 30 0 0 18 0 2 0 538350205 340717568 6337 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/4583/statm: 83183 6337 400 364 0 19086 0
[pid=4585] ppid=4583 vsize=36380 CPUtime=423.88 cores=1,3,5,7
/proc/4585/stat : 4585 (precosat) R 4583 4585 4585 0 -1 4202496 9714 0 0 0 42385 3 0 0 25 0 1 0 538350206 37253120 8920 33554432000 4194304 4890832 140736151376480 18446744073709551615 4237511 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/4585/statm: 9095 8920 86 171 0 8922 0
[pid=4583/tid=4595] ppid=4531 vsize=332732 CPUtime=0 cores=1,3,5,7
/proc/4583/task/4595/stat : 4595 (python) S 4531 4531 4496 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538379942 340717568 6337 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604468847843136 0 0 -1 3 0 0 0
[pid=4596] ppid=4531 vsize=342988 CPUtime=0.89 cores=1,3,5,7
/proc/4596/stat : 4596 (python) S 4531 4531 4496 0 -1 4202560 1180 0 0 0 44 45 0 0 15 0 2 0 538379944 351219712 6341 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/4596/statm: 85747 6341 400 364 0 21647 0
[pid=4598] ppid=4596 vsize=133036 CPUtime=597.28 cores=1,3,5,7
/proc/4598/stat : 4598 (cryptominisat-2) R 4596 4598 4598 0 -1 4202496 149774 0 0 0 59664 64 0 0 25 0 1 0 538379944 136228864 25788 33554432000 4194304 4677096 140734874455744 18446744073709551615 4335943 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/4598/statm: 33259 25788 393 118 0 28218 0
[pid=4596/tid=4623] ppid=4531 vsize=342988 CPUtime=0 cores=1,3,5,7
/proc/4596/task/4623/stat : 4623 (python) S 4531 4531 4496 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 538419336 351219712 6341 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604471139877248 0 0 -1 3 0 0 0
[pid=4624] ppid=4531 vsize=353244 CPUtime=0.14 cores=1,3,5,7
/proc/4624/stat : 4624 (python) S 4531 4531 4496 0 -1 4202560 1182 0 0 0 10 4 0 0 19 0 2 0 538419338 361721856 6351 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/4624/statm: 88311 6351 406 364 0 24208 0
[pid=4626] ppid=4624 vsize=16560 CPUtime=99.83 cores=1,3,5,7
/proc/4626/stat : 4626 (lingeling) T 4624 4626 4626 0 -1 4202496 14083 0 0 0 9981 2 0 0 25 0 1 0 538419338 16957440 3330 33554432000 4194304 4352236 140737456052512 18446744073709551615 4276717 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/4626/statm: 4140 3330 129 39 0 3220 0
[pid=4624/tid=4631] ppid=4531 vsize=353244 CPUtime=0 cores=1,3,5,7
/proc/4624/task/4631/stat : 4631 (python) S 4531 4531 4496 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538429352 361721856 6351 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 514 18446604454223004928 0 0 -1 3 0 0 0
[pid=4669] ppid=4531 vsize=363500 CPUtime=0.04 cores=1,3,5,7
/proc/4669/stat : 4669 (python) S 4531 4531 4496 0 -1 4202560 963 0 0 0 2 2 0 0 15 0 1 0 538447541 372224000 6319 33554432000 4194304 5683644 140735074375344 18446744073709551615 208080252486 0 0 16781312 514 7719693133142786310 0 0 17 3 0 0 0
/proc/4669/statm: 90875 6319 371 364 0 26769 0
[pid=4671] ppid=4669 vsize=63884 CPUtime=28.86 cores=1,3,5,7
/proc/4671/stat : 4671 (cryptominisat-2) R 4669 4671 4671 0 -1 4202496 20098 0 0 0 2881 5 0 0 25 0 1 0 538447541 65417216 9494 33554432000 4194304 4677096 140734583856080 18446744073709551615 4462636 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/4671/statm: 15971 9494 393 118 0 10930 0
[pid=4531/tid=4557] ppid=4529 vsize=373744 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4557/stat : 4557 (python) S 4529 4531 4496 0 -1 4202560 28 924 0 9 0 0 0 0 18 0 10 0 538330176 382713856 7844 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 7 0 0 0
[pid=4531/tid=4560] ppid=4529 vsize=373744 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4560/stat : 4560 (python) S 4529 4531 4496 0 -1 4202560 31 924 0 9 0 0 0 0 18 0 10 0 538330178 382713856 7844 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 5 0 0 0
[pid=4531/tid=4563] ppid=4529 vsize=373744 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4563/stat : 4563 (python) S 4529 4531 4496 0 -1 4202560 26 924 0 9 0 0 0 0 23 0 10 0 538330180 382713856 7844 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 7 0 0 0
[pid=4531/tid=4566] ppid=4529 vsize=373744 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4566/stat : 4566 (python) S 4529 4531 4496 0 -1 4202560 28 924 0 9 0 0 0 0 25 0 10 0 538330183 382713856 7844 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
[pid=4531/tid=4577] ppid=4529 vsize=373744 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4577/stat : 4577 (python) S 4529 4531 4496 0 -1 4202560 28 924 0 9 0 0 0 0 20 0 10 0 538340191 382713856 7844 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
[pid=4531/tid=4584] ppid=4529 vsize=373744 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4584/stat : 4584 (python) S 4529 4531 4496 0 -1 4202560 33 924 0 9 0 0 0 0 18 0 10 0 538350206 382713856 7844 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
[pid=4531/tid=4597] ppid=4529 vsize=373744 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4597/stat : 4597 (python) S 4529 4531 4496 0 -1 4202560 31 924 0 9 0 0 0 0 18 0 10 0 538379944 382713856 7844 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
[pid=4531/tid=4625] ppid=4529 vsize=373744 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4625/stat : 4625 (python) S 4529 4531 4496 0 -1 4202560 31 924 0 9 0 0 0 0 20 0 10 0 538419338 382713856 7844 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
[pid=4531/tid=4670] ppid=4529 vsize=373744 CPUtime=0 cores=1,3,5,7
/proc/4531/task/4670/stat : 4670 (python) S 4529 4531 4496 0 -1 4202560 29 924 0 9 0 0 0 0 20 0 10 0 538447541 382713856 7844 33554432000 4194304 5683644 140735074375344 18446744073709551615 208092055985 0 0 16781312 2 18446604454223006720 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 3800664

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4531 and gives
#  childrusage.ru_utime.tv_sec=1629
#  childrusage.ru_utime.tv_usec=778236
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=844415
# CPU time returned by wait4() is 1633.62
# while last known CPU time is 4800.21
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1222.26
CPU time (s): 4800.21
CPU user time (s): 4794.65
CPU system time (s): 5.56
CPU usage (%): 392.732
Max. virtual memory (cumulated for all children) (KiB): 3842372

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1629.78
system time used= 3.84441
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 141209
page faults= 127
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 28136
involuntary context switches= 6119

runsolver used 4.19636 second user time and 7.95179 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-01 18:28:04
IDJOB=3317877
IDBENCH=20399
IDSOLVER=1706
FILE ID=node127/3317877-1304267283
RUNJOBID= node127-1304267282-4515
PBS_JOBID= 13173952
Free space on /tmp= 72840 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT07/industrial/fuhs/hard/AProVE07-01.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317877-1304267283/watcher-3317877-1304267283 -o /tmp/evaluation-result-3317877-1304267283/solver-3317877-1304267283 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317877-1304267283.cnf -seed 638206346 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d2f77e32530988f77dca5112174eee00
RANDOM SEED=638206346

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      27570664 kB
Buffers:       1327768 kB
Cached:        3522868 kB
SwapCached:          8 kB
Active:         406644 kB
Inactive:      4507420 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      27570664 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           64284 kB
Writeback:           0 kB
AnonPages:       63568 kB
Mapped:          14540 kB
Slab:           402436 kB
PageTables:       4656 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   187128 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72752 MiB
End job on node127 at 2011-05-01 18:48:30