Trace number 3317913

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4800.16 1237.1

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
MD5SUMa0ec1baa890da62d0c6df7f1e62c6af3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3057.55
Satisfiable
(Un)Satisfiability was proved
Number of variables163622
Number of clauses488120
Sum of the clauses size1138944
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2325412
Number of clauses of size 3162706
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.31/0.48	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.31/0.48	c INFO: solving HOME/instance-3317913-1304269553.cnf
0.31/0.48	c INFO: computing task features
1.79/1.95	c INFO: computed variable-clause graph statistics
1.90/2.01	c INFO: computed clause balance statistics
9.40/9.54	c INFO: computed variable balance statistics
14.90/15.09	c INFO: computed small-clause counts
15.00/15.19	c INFO: computed Horn-clause counts
45.90/46.06	c INFO: computed variable graph statistics
45.90/46.06	c INFO: collected features for HOME/instance-3317913-1304269553.cnf in 45.54 s
45.90/46.08	c INFO: running lingeling-276@0 for 97 with 4754 remaining (b = 0.51)
46.00/46.11	c INFO: running lingeling-276@0 for 1261 with 4754 remaining (b = 0.54)
46.00/46.13	c INFO: running cryptominisat-2.9.0@0 for 485 with 4754 remaining (b = 0.39)
46.00/46.16	c INFO: running SApperloT@0 for 97 with 4754 remaining (b = 0.03)
445.75/146.23	c INFO: running lingeling-276@0 for 776 with 4654 remaining (b = 0.35)
446.15/146.33	c INFO: running cryptominisat-2.9.0@0 for 679 with 4654 remaining (b = 0.45)
2003.94/536.31	c INFO: running precosat-570@0 for 485 with 4264 remaining (b = 0.36)
3167.69/827.71	c INFO: running lingeling-276@0 for 194 with 3972 remaining (b = 0.21)
3560.61/926.16	c INFO: running cryptominisat-2.9.0@489 for 97 with 3874 remaining (b = 0.08)
3947.11/1022.99	c INFO: running precosat-570@0 for 97 with 3777 remaining (b = 0.07)
3963.02/1026.91	c INFO: running lingeling-276@99 for 97 with 3773 remaining (b = 0.05)
3963.02/1026.99	c INFO: running precosat-570@679 for 97 with 3773 remaining (b = 0.06)
4342.35/1122.12	c INFO: running cryptominisat-2.9.0@0 for 388 with 3678 remaining (b = 0.16)
4342.35/1122.16	c INFO: running cryptominisat-2.9.0@683 for 97 with 3678 remaining (b = 0.06)
4349.91/1124.06	c INFO: running lingeling-276@778 for 97 with 3676 remaining (b = 0.04)
4727.66/1218.88	c INFO: running precosat-570@774 for 97 with 3581 remaining (b = 0.06)
4757.14/1226.25	c INFO: running cryptominisat-2.9.0@0 for 485 with 3574 remaining (b = 0.20)
4800.16/1237.05	c INFO: running lingeling-276@200 for 97 with 3563 remaining (b = 0.05)
4800.16/1237.05	Traceback (most recent call last):
4800.16/1237.05	  File "HOME/solve", line 33, in <module>
4800.16/1237.05	    plac.call(main)
4800.16/1237.05	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317913-1304269553/watcher-3317913-1304269553 -o /tmp/evaluation-result-3317913-1304269553/solver-3317913-1304269553 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317913-1304269553.cnf -seed 1321080376 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.95 3.88 4.69 2/183 11717
/proc/meminfo: memFree=28648200/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=15380 CPUtime=0 cores=1,3,5,7
/proc/11717/stat : 11717 (python) R 11715 11717 11084 0 -1 4202496 808 0 0 0 0 0 0 0 25 0 1 0 538553329 15749120 693 33554432000 4194304 5683644 140735741353440 18446744073709551615 4363648 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11717/statm: 3845 693 332 364 0 332 0

[startup+0.086157 s]
/proc/loadavg: 3.95 3.88 4.69 2/183 11717
/proc/meminfo: memFree=28648200/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=93956 CPUtime=0.06 cores=1,3,5,7
/proc/11717/stat : 11717 (python) R 11715 11717 11084 0 -1 4202496 2692 0 0 0 4 2 0 0 17 0 1 0 538553329 96210944 2406 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122712064 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11717/statm: 23489 2406 764 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 93956

[startup+0.101131 s]
/proc/loadavg: 3.95 3.88 4.69 2/183 11717
/proc/meminfo: memFree=28648200/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=104216 CPUtime=0.07 cores=1,3,5,7
/proc/11717/stat : 11717 (python) S 11715 11717 11084 0 -1 4202496 3040 0 0 0 5 2 0 0 17 0 1 0 538553329 106717184 2727 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122712064 0 2147483391 16781312 2 18446744071699207358 0 0 17 3 0 0 0
/proc/11717/statm: 26054 2727 847 364 0 1802 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104216

[startup+0.301135 s]
/proc/loadavg: 3.95 3.88 4.69 2/183 11717
/proc/meminfo: memFree=28648200/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=157384 CPUtime=0.24 cores=1,3,5,7
/proc/11717/stat : 11717 (python) R 11715 11717 11084 0 -1 4202496 6590 934 1 0 17 7 0 0 17 0 1 0 538553329 161161216 4696 33554432000 4194304 5683644 140735741353440 18446744073709551615 4570870 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11717/statm: 39346 4696 1257 364 0 3454 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 157384

[startup+0.701038 s]
/proc/loadavg: 3.95 3.88 4.69 2/183 11717
/proc/meminfo: memFree=28648200/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=301132 CPUtime=0.6 cores=1,3,5,7
/proc/11717/stat : 11717 (python) R 11715 11717 11084 0 -1 4202496 14952 934 1 0 50 10 0 0 17 0 1 0 538553329 308359168 12524 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122374853 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11717/statm: 75283 12524 1761 364 0 11207 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 301132

[startup+1.5009 s]
/proc/loadavg: 3.95 3.88 4.69 3/184 11722
/proc/meminfo: memFree=28582876/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=357536 CPUtime=1.4 cores=1,3,5,7
/proc/11717/stat : 11717 (python) R 11715 11717 11084 0 -1 4202496 27244 934 1 0 130 10 0 0 18 0 1 0 538553329 366116864 24816 33554432000 4194304 5683644 140735741353440 18446744073709551615 47298751994565 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11717/statm: 89384 24818 1761 364 0 25308 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 357536

[startup+3.1006 s]
/proc/loadavg: 3.95 3.88 4.69 3/184 11722
/proc/meminfo: memFree=28534020/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=369900 CPUtime=3 cores=1,3,5,7
/proc/11717/stat : 11717 (python) R 11715 11717 11084 0 -1 4202496 48032 934 1 0 287 13 0 0 21 0 1 0 538553329 378777600 29860 33554432000 4194304 5683644 140735741353440 18446744073709551615 47298752062912 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11717/statm: 92475 29860 1826 364 0 28399 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 369900

[startup+6.30101 s]
/proc/loadavg: 3.88 3.86 4.68 3/184 11722
/proc/meminfo: memFree=28534692/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=369900 CPUtime=6.2 cores=1,3,5,7
/proc/11717/stat : 11717 (python) R 11715 11717 11084 0 -1 4202496 48032 934 1 0 607 13 0 0 25 0 1 0 538553329 378777600 29860 33554432000 4194304 5683644 140735741353440 18446744073709551615 47298759225547 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11717/statm: 92475 29860 1826 364 0 28399 0
Current children cumulated CPU time (s) 6.2
Current children cumulated vsize (KiB) 369900

[startup+12.7008 s]
/proc/loadavg: 3.73 3.83 4.66 3/184 11722
/proc/meminfo: memFree=28534708/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=369900 CPUtime=12.6 cores=1,3,5,7
/proc/11717/stat : 11717 (python) R 11715 11717 11084 0 -1 4202496 48033 934 1 0 1247 13 0 0 25 0 1 0 538553329 378777600 29861 33554432000 4194304 5683644 140735741353440 18446744073709551615 4603226 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11717/statm: 92475 29861 1827 364 0 28399 0
Current children cumulated CPU time (s) 12.6
Current children cumulated vsize (KiB) 369900

[startup+25.5005 s]
/proc/loadavg: 3.34 3.74 4.62 3/184 11723
/proc/meminfo: memFree=28531560/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=373712 CPUtime=25.4 cores=1,3,5,7
/proc/11717/stat : 11717 (python) R 11715 11717 11084 0 -1 4202496 48992 934 1 0 2527 13 0 0 25 0 1 0 538553329 382681088 30820 33554432000 4194304 5683644 140735741353440 18446744073709551615 47298751813772 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11717/statm: 93428 30820 1833 364 0 29352 0
Current children cumulated CPU time (s) 25.4
Current children cumulated vsize (KiB) 373712

[startup+51.1008 s]
/proc/loadavg: 3.12 3.65 4.57 6/196 11735
/proc/meminfo: memFree=28148768/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=407272 CPUtime=46.06 cores=1,3,5,7
/proc/11717/stat : 11717 (python) S 11715 11717 11084 0 -1 4202496 51695 934 1 0 4592 14 0 0 22 0 5 0 538553329 417046528 29015 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/11717/statm: 101818 29015 1881 364 0 37727 0
[pid=11724] ppid=11717 vsize=366260 CPUtime=0 cores=1,3,5,7
/proc/11724/stat : 11724 (python) S 11717 11717 11084 0 -1 4202560 980 0 0 0 0 0 0 0 18 0 1 0 538557937 375050240 27499 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734095 0 0 16781312 514 17727615094927360264 0 0 17 5 0 0 0
/proc/11724/statm: 91565 27499 381 364 0 27483 0
[pid=11726] ppid=11724 vsize=53204 CPUtime=4.99 cores=1,3,5,7
/proc/11726/stat : 11726 (lingeling) R 11724 11726 11726 0 -1 4202496 18500 0 0 0 497 2 0 0 25 0 1 0 538557938 54480896 12469 33554432000 4194304 4352236 140736455373296 18446744073709551615 4228691 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/11726/statm: 13301 12469 127 39 0 12381 0
[pid=11727] ppid=11717 vsize=376516 CPUtime=0 cores=1,3,5,7
/proc/11727/stat : 11727 (python) S 11717 11717 11084 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 538557940 385552384 27492 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 17727618943218057480 0 0 17 3 0 0 0
/proc/11727/statm: 94129 27492 370 364 0 30044 0
[pid=11729] ppid=11727 vsize=50160 CPUtime=4.94 cores=1,3,5,7
/proc/11729/stat : 11729 (lingeling) R 11727 11729 11729 0 -1 4202496 17756 0 0 0 492 2 0 0 25 0 1 0 538557941 51363840 11708 33554432000 4194304 4352236 140736193416832 18446744073709551615 4228427 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/11729/statm: 12540 11708 127 39 0 11620 0
[pid=11730] ppid=11717 vsize=386772 CPUtime=0 cores=1,3,5,7
/proc/11730/stat : 11730 (python) S 11717 11717 11084 0 -1 4202560 902 0 0 0 0 0 0 0 15 0 1 0 538557943 396054528 27496 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 12213721511793492232 0 0 17 7 0 0 0
/proc/11730/statm: 96693 27496 370 364 0 32605 0
[pid=11732] ppid=11730 vsize=319068 CPUtime=4.94 cores=1,3,5,7
/proc/11732/stat : 11732 (cryptominisat-2) R 11730 11732 11732 0 -1 4202496 73632 0 0 0 483 11 0 0 25 0 1 0 538557943 326725632 68981 33554432000 4194304 4677096 140735363416480 18446744073709551615 4319643 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/11732/statm: 79767 68981 362 118 0 74726 0
[pid=11733] ppid=11717 vsize=397028 CPUtime=0.01 cores=1,3,5,7
/proc/11733/stat : 11733 (python) S 11717 11717 11084 0 -1 4202560 930 0 0 0 0 1 0 0 18 0 1 0 538557945 406556672 27499 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 4320825614756970760 0 0 17 3 0 0 0
/proc/11733/statm: 99257 27499 369 364 0 35166 0
[pid=11735] ppid=11733 vsize=27408 CPUtime=4.9 cores=1,3,5,7
/proc/11735/stat : 11735 (SApperloT-base) R 11733 11735 11735 0 -1 4202496 6545 0 0 0 489 1 0 0 25 0 1 0 538557946 28065792 6056 33554432000 134512640 135674940 4287360592 18446744073709551615 134564017 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/11735/statm: 6852 6056 99 284 0 6566 0
[pid=11717/tid=11725] ppid=11715 vsize=407272 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11725/stat : 11725 (python) S 11715 11717 11084 0 -1 4202560 24 934 0 0 0 0 0 0 19 0 5 0 538557938 417046528 29015 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 5 0 0 0
[pid=11717/tid=11728] ppid=11715 vsize=407272 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11728/stat : 11728 (python) S 11715 11717 11084 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 5 0 538557940 417046528 29015 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 1 0 0 0
[pid=11717/tid=11731] ppid=11715 vsize=407272 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11731/stat : 11731 (python) S 11715 11717 11084 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 5 0 538557943 417046528 29015 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11734] ppid=11715 vsize=407272 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11734/stat : 11734 (python) S 11715 11717 11084 0 -1 4202560 31 934 0 0 0 0 0 0 22 0 5 0 538557946 417046528 29015 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 65.84
Current children cumulated vsize (KiB) 2383688

[startup+102.308 s]
/proc/loadavg: 4.22 3.87 4.59 6/196 11737
/proc/meminfo: memFree=27980236/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=407272 CPUtime=46.06 cores=1,3,5,7
/proc/11717/stat : 11717 (python) S 11715 11717 11084 0 -1 4202496 51695 934 1 0 4592 14 0 0 22 0 5 0 538553329 417046528 29015 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/11717/statm: 101818 29015 1881 364 0 37727 0
[pid=11724] ppid=11717 vsize=366260 CPUtime=0.06 cores=1,3,5,7
/proc/11724/stat : 11724 (python) S 11717 11717 11084 0 -1 4202560 1006 0 0 0 4 2 0 0 18 0 1 0 538557937 375050240 27499 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734095 0 0 16781312 514 10827603482245038344 0 0 17 5 0 0 0
/proc/11724/statm: 91565 27499 381 364 0 27483 0
[pid=11726] ppid=11724 vsize=30340 CPUtime=56.13 cores=1,3,5,7
/proc/11726/stat : 11726 (lingeling) R 11724 11726 11726 0 -1 4202496 27030 0 0 0 5610 3 0 0 25 0 1 0 538557938 31068160 6755 33554432000 4194304 4352236 140736455373296 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/11726/statm: 7585 6755 129 39 0 6665 0
[pid=11727] ppid=11717 vsize=376516 CPUtime=0.06 cores=1,3,5,7
/proc/11727/stat : 11727 (python) S 11717 11717 11084 0 -1 4202560 926 0 0 0 3 3 0 0 18 0 1 0 538557940 385552384 27492 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 10827603482245038344 0 0 17 3 0 0 0
/proc/11727/statm: 94129 27492 370 364 0 30044 0
[pid=11729] ppid=11727 vsize=31352 CPUtime=55.81 cores=1,3,5,7
/proc/11729/stat : 11729 (lingeling) R 11727 11729 11729 0 -1 4202496 26862 0 0 0 5578 3 0 0 25 0 1 0 538557941 32104448 7008 33554432000 4194304 4352236 140736193416832 18446744073709551615 4207744 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/11729/statm: 7838 7008 129 39 0 6918 0
[pid=11730] ppid=11717 vsize=386772 CPUtime=0.08 cores=1,3,5,7
/proc/11730/stat : 11730 (python) S 11717 11717 11084 0 -1 4202560 929 0 0 0 5 3 0 0 15 0 1 0 538557943 396054528 27496 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 9947118973063495944 0 0 17 1 0 0 0
/proc/11730/statm: 96693 27496 370 364 0 32605 0
[pid=11732] ppid=11730 vsize=519616 CPUtime=56.13 cores=1,3,5,7
/proc/11732/stat : 11732 (cryptominisat-2) R 11730 11732 11732 0 -1 4202496 127481 0 0 0 5594 19 0 0 25 0 1 0 538557943 532086784 113846 33554432000 4194304 4677096 140735363416480 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/11732/statm: 129904 113846 393 118 0 124863 0
[pid=11733] ppid=11717 vsize=397028 CPUtime=0.07 cores=1,3,5,7
/proc/11733/stat : 11733 (python) S 11717 11717 11084 0 -1 4202560 952 0 0 0 4 3 0 0 18 0 1 0 538557945 406556672 27500 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 10827603482245038344 0 0 17 3 0 0 0
/proc/11733/statm: 99257 27500 370 364 0 35166 0
[pid=11735] ppid=11733 vsize=37760 CPUtime=55.98 cores=1,3,5,7
/proc/11735/stat : 11735 (SApperloT-base) R 11733 11735 11735 0 -1 4202496 9105 0 0 0 5595 3 0 0 25 0 1 0 538557946 38666240 8616 33554432000 134512640 135674940 4287360592 18446744073709551615 134564250 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/11735/statm: 9440 8616 100 284 0 9154 0
[pid=11717/tid=11725] ppid=11715 vsize=407272 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11725/stat : 11725 (python) S 11715 11717 11084 0 -1 4202560 24 934 0 0 0 0 0 0 19 0 5 0 538557938 417046528 29015 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 5 0 0 0
[pid=11717/tid=11728] ppid=11715 vsize=407272 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11728/stat : 11728 (python) S 11715 11717 11084 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 5 0 538557940 417046528 29015 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 1 0 0 0
[pid=11717/tid=11731] ppid=11715 vsize=407272 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11731/stat : 11731 (python) S 11715 11717 11084 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 5 0 538557943 417046528 29015 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11734] ppid=11715 vsize=407272 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11734/stat : 11734 (python) S 11715 11717 11084 0 -1 4202560 31 934 0 0 0 0 0 0 22 0 5 0 538557946 417046528 29015 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 270.38
Current children cumulated vsize (KiB) 2552916

[startup+162.302 s]
/proc/loadavg: 4.71 4.07 4.61 6/201 11743
/proc/meminfo: memFree=27580356/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=417528 CPUtime=46.11 cores=1,3,5,7
/proc/11717/stat : 11717 (python) S 11715 11717 11084 0 -1 4202496 52530 934 1 0 4596 15 0 0 19 0 6 0 538553329 427548672 29022 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/11717/statm: 104382 29022 1884 364 0 40288 0
[pid=11724] ppid=11717 vsize=376504 CPUtime=0.15 cores=1,3,5,7
/proc/11724/stat : 11724 (python) S 11717 11717 11084 0 -1 4202560 1184 0 0 0 9 6 0 0 18 0 2 0 538557937 385540096 27538 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/11724/statm: 94126 27538 415 364 0 30044 0

################
# More data... #
################

[pid=11733/tid=11740] ppid=11717 vsize=397028 CPUtime=0 cores=1,3,5,7
/proc/11733/task/11740/stat : 11740 (python) S 11717 11717 11084 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538567960 406556672 27530 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604471098583040 0 0 -1 5 0 0 0
[pid=11741] ppid=11717 vsize=407284 CPUtime=1.23 cores=1,3,5,7
/proc/11741/stat : 11741 (python) S 11717 11717 11084 0 -1 4202560 1188 0 0 0 65 58 0 0 15 0 2 0 538567962 417058816 27535 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/11741/statm: 101821 27535 400 364 0 37727 0
[pid=11743] ppid=11741 vsize=569364 CPUtime=841.03 cores=1,3,5,7
/proc/11743/stat : 11743 (cryptominisat-2) R 11741 11743 11743 0 -1 4202496 234088 0 0 0 84047 56 0 0 25 0 1 0 538567963 583028736 130606 33554432000 4194304 4677096 140735827119632 18446744073709551615 4321066 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11743/statm: 142341 130606 393 118 0 137300 0
[pid=11741/tid=11814] ppid=11717 vsize=407284 CPUtime=0 cores=1,3,5,7
/proc/11741/task/11814/stat : 11814 (python) S 11717 11717 11084 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 538636098 417058816 27535 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604467228374848 0 0 -1 3 0 0 0
[pid=11799] ppid=11717 vsize=417540 CPUtime=0.79 cores=1,3,5,7
/proc/11799/stat : 11799 (python) S 11717 11717 11084 0 -1 4202560 1158 0 0 0 37 42 0 0 18 0 2 0 538606960 427560960 27538 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/11799/statm: 104385 27538 399 364 0 40288 0
[pid=11801] ppid=11799 vsize=161860 CPUtime=583.83 cores=1,3,5,7
/proc/11801/stat : 11801 (precosat) T 11799 11801 11801 0 -1 4202496 41302 0 0 0 58378 5 0 0 25 0 1 0 538606960 165744640 38476 33554432000 4194304 4890832 140733652792016 18446744073709551615 4239021 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/11801/statm: 40465 38476 86 171 0 40292 0
[pid=11799/tid=11828] ppid=11717 vsize=417540 CPUtime=0 cores=1,3,5,7
/proc/11799/task/11828/stat : 11828 (python) S 11717 11717 11084 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538656018 427560960 27538 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604471120933248 0 0 -1 5 0 0 0
[pid=11815] ppid=11717 vsize=427796 CPUtime=0.35 cores=1,3,5,7
/proc/11815/stat : 11815 (python) S 11717 11717 11084 0 -1 4202560 1159 0 0 0 17 18 0 0 18 0 2 0 538636101 438063104 27542 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/11815/statm: 106949 27542 399 364 0 42849 0
[pid=11817] ppid=11815 vsize=43732 CPUtime=252.86 cores=1,3,5,7
/proc/11817/stat : 11817 (lingeling) R 11815 11817 11817 0 -1 4202496 35112 0 0 0 25281 5 0 0 25 0 1 0 538636101 44781568 10103 33554432000 4194304 4352236 140733690358832 18446744073709551615 4329189 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/11817/statm: 10933 10103 129 39 0 10013 0
[pid=11815/tid=11824] ppid=11717 vsize=427796 CPUtime=0 cores=1,3,5,7
/proc/11815/task/11824/stat : 11824 (python) S 11717 11717 11084 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538655625 438063104 27542 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604464346354688 0 0 -1 3 0 0 0
[pid=11825] ppid=11717 vsize=438052 CPUtime=0.13 cores=1,3,5,7
/proc/11825/stat : 11825 (python) S 11717 11717 11084 0 -1 4202560 1157 0 0 0 6 7 0 0 19 0 2 0 538655628 448565248 27552 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/11825/statm: 109513 27552 405 364 0 45410 0
[pid=11827] ppid=11825 vsize=161836 CPUtime=99.11 cores=1,3,5,7
/proc/11827/stat : 11827 (precosat) T 11825 11827 11827 0 -1 4202496 41299 0 0 0 9906 5 0 0 25 0 1 0 538655628 165720064 38468 33554432000 4194304 4890832 140734977595200 18446744073709551615 4238692 0 0 16781312 17442 18446744071562691360 0 0 17 1 0 0 0
/proc/11827/statm: 40459 38468 86 171 0 40286 0
[pid=11825/tid=11832] ppid=11717 vsize=438052 CPUtime=0 cores=1,3,5,7
/proc/11825/task/11832/stat : 11832 (python) S 11717 11717 11084 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538665542 448565248 27552 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604467228373952 0 0 -1 3 0 0 0
[pid=11717/tid=11725] ppid=11715 vsize=448296 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11725/stat : 11725 (python) S 11715 11717 11084 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 9 0 538557938 459055104 29040 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 5 0 0 0
[pid=11717/tid=11728] ppid=11715 vsize=448296 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11728/stat : 11728 (python) S 11715 11717 11084 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 9 0 538557940 459055104 29040 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 1 0 0 0
[pid=11717/tid=11731] ppid=11715 vsize=448296 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11731/stat : 11731 (python) S 11715 11717 11084 0 -1 4202560 23 934 0 0 0 0 0 0 18 0 9 0 538557943 459055104 29040 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11734] ppid=11715 vsize=448296 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11734/stat : 11734 (python) S 11715 11717 11084 0 -1 4202560 31 934 0 0 0 0 0 0 22 0 9 0 538557946 459055104 29040 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11742] ppid=11715 vsize=448296 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11742/stat : 11742 (python) S 11715 11717 11084 0 -1 4202560 39 934 0 0 0 0 0 0 18 0 9 0 538567963 459055104 29040 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11800] ppid=11715 vsize=448296 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11800/stat : 11800 (python) S 11715 11717 11084 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 9 0 538606960 459055104 29040 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11816] ppid=11715 vsize=448296 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11816/stat : 11816 (python) S 11715 11717 11084 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 9 0 538636101 459055104 29040 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11826] ppid=11715 vsize=448296 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11826/stat : 11826 (python) S 11715 11717 11084 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 9 0 538655628 459055104 29040 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4582.22
Current children cumulated vsize (KiB) 5379656



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1237 s]
/proc/loadavg: 8.05 7.83 6.62 9/238 11841
/proc/meminfo: memFree=27381384/32951124 swapFree=67111444/67111528
[pid=11717] ppid=11715 vsize=458552 CPUtime=46.37 cores=1,3,5,7
/proc/11717/stat : 11717 (python) S 11715 11717 11084 0 -1 4202496 55954 934 1 0 4619 18 0 0 19 0 10 0 538553329 469557248 29046 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/11717/statm: 114638 29046 1892 364 0 50532 0
[pid=11724] ppid=11717 vsize=376504 CPUtime=1.31 cores=1,3,5,7
/proc/11724/stat : 11724 (python) S 11717 11717 11084 0 -1 4202560 1212 0 0 0 70 61 0 0 18 0 2 0 538557937 385540096 27538 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/11724/statm: 94126 27538 415 364 0 30044 0
[pid=11726] ppid=11724 vsize=67016 CPUtime=975.67 cores=1,3,5,7
/proc/11726/stat : 11726 (lingeling) T 11724 11726 11726 0 -1 4202496 48118 0 0 0 97560 7 0 0 25 0 1 0 538557938 68624384 15924 33554432000 4194304 4352236 140736455373296 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/11726/statm: 16754 15924 129 39 0 15834 0
[pid=11724/tid=11739] ppid=11717 vsize=376504 CPUtime=0 cores=1,3,5,7
/proc/11724/task/11739/stat : 11739 (python) S 11717 11717 11084 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538567950 385540096 27538 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604469925127168 0 0 -1 5 0 0 0
[pid=11727] ppid=11717 vsize=376516 CPUtime=1.63 cores=1,3,5,7
/proc/11727/stat : 11727 (python) S 11717 11717 11084 0 -1 4202560 974 0 0 0 83 80 0 0 18 0 1 0 538557940 385552384 27492 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 10827603482245038344 0 0 17 5 0 0 0
/proc/11727/statm: 94129 27492 370 364 0 30044 0
[pid=11729] ppid=11727 vsize=80084 CPUtime=1181.52 cores=1,3,5,7
/proc/11729/stat : 11729 (lingeling) R 11727 11729 11729 0 -1 4202496 55152 0 0 0 118144 8 0 0 25 0 1 0 538557941 82006016 19191 33554432000 4194304 4352236 140736193416832 18446744073709551615 4328986 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/11729/statm: 20021 19191 129 39 0 19101 0
[pid=11730] ppid=11717 vsize=386772 CPUtime=0.89 cores=1,3,5,7
/proc/11730/stat : 11730 (python) S 11717 11717 11084 0 -1 4202560 1191 0 0 0 51 38 0 0 15 0 2 0 538557943 396054528 27527 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/11730/statm: 96693 27527 400 364 0 32605 0
[pid=11732] ppid=11730 vsize=573984 CPUtime=604.18 cores=1,3,5,7
/proc/11732/stat : 11732 (cryptominisat-2) R 11730 11732 11732 0 -1 4202496 202941 0 0 0 60371 47 0 0 25 0 1 0 538557943 587759616 131097 33554432000 4194304 4677096 140735363416480 18446744073709551615 4319815 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/11732/statm: 143496 131097 393 118 0 138455 0
[pid=11730/tid=11798] ppid=11717 vsize=386772 CPUtime=0 cores=1,3,5,7
/proc/11730/task/11798/stat : 11798 (python) S 11717 11717 11084 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 538606957 396054528 27527 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604464346356480 0 0 -1 1 0 0 0
[pid=11733] ppid=11717 vsize=397028 CPUtime=0.13 cores=1,3,5,7
/proc/11733/stat : 11733 (python) S 11717 11717 11084 0 -1 4202560 1124 0 0 0 7 6 0 0 19 0 2 0 538557945 406556672 27530 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/11733/statm: 99257 27530 399 364 0 35166 0
[pid=11735] ppid=11733 vsize=50472 CPUtime=99.88 cores=1,3,5,7
/proc/11735/stat : 11735 (SApperloT-base) T 11733 11735 11735 0 -1 4202496 12239 0 0 0 9984 4 0 0 25 0 1 0 538557946 51683328 11750 33554432000 134512640 135674940 4287360592 18446744073709551615 134565290 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/11735/statm: 12618 11750 100 284 0 12332 0
[pid=11733/tid=11740] ppid=11717 vsize=397028 CPUtime=0 cores=1,3,5,7
/proc/11733/task/11740/stat : 11740 (python) S 11717 11717 11084 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538567960 406556672 27530 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604471098583040 0 0 -1 5 0 0 0
[pid=11741] ppid=11717 vsize=407284 CPUtime=1.3 cores=1,3,5,7
/proc/11741/stat : 11741 (python) S 11717 11717 11084 0 -1 4202560 1188 0 0 0 68 62 0 0 15 0 2 0 538567962 417058816 27535 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/11741/statm: 101821 27535 400 364 0 37727 0
[pid=11743] ppid=11741 vsize=589364 CPUtime=877.47 cores=1,3,5,7
/proc/11743/stat : 11743 (cryptominisat-2) T 11741 11743 11743 0 -1 4202496 244648 0 0 0 87688 59 0 0 25 0 1 0 538567963 603508736 134508 33554432000 4194304 4677096 140735827119632 18446744073709551615 4334772 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/11743/statm: 147341 134508 393 118 0 142300 0
[pid=11741/tid=11814] ppid=11717 vsize=407284 CPUtime=0 cores=1,3,5,7
/proc/11741/task/11814/stat : 11814 (python) S 11717 11717 11084 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 538636098 417058816 27535 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604467228374848 0 0 -1 3 0 0 0
[pid=11799] ppid=11717 vsize=417540 CPUtime=0.81 cores=1,3,5,7
/proc/11799/stat : 11799 (python) S 11717 11717 11084 0 -1 4202560 1158 0 0 0 38 43 0 0 18 0 2 0 538606960 427560960 27538 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/11799/statm: 104385 27538 399 364 0 40288 0
[pid=11801] ppid=11799 vsize=161860 CPUtime=601.92 cores=1,3,5,7
/proc/11801/stat : 11801 (precosat) R 11799 11801 11801 0 -1 4202496 41302 0 0 0 60187 5 0 0 25 0 1 0 538606960 165744640 38476 33554432000 4194304 4890832 140733652792016 18446744073709551615 4291474 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/11801/statm: 40465 38476 86 171 0 40292 0
[pid=11799/tid=11828] ppid=11717 vsize=417540 CPUtime=0 cores=1,3,5,7
/proc/11799/task/11828/stat : 11828 (python) S 11717 11717 11084 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538656018 427560960 27538 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604471120933248 0 0 -1 5 0 0 0
[pid=11815] ppid=11717 vsize=427796 CPUtime=0.42 cores=1,3,5,7
/proc/11815/stat : 11815 (python) S 11717 11717 11084 0 -1 4202560 1159 0 0 0 20 22 0 0 18 0 2 0 538636101 438063104 27542 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/11815/statm: 106949 27542 399 364 0 42849 0
[pid=11817] ppid=11815 vsize=51892 CPUtime=296.7 cores=1,3,5,7
/proc/11817/stat : 11817 (lingeling) T 11815 11817 11817 0 -1 4202496 39208 0 0 0 29665 5 0 0 25 0 1 0 538636101 53137408 12143 33554432000 4194304 4352236 140733690358832 18446744073709551615 4328047 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/11817/statm: 12973 12143 129 39 0 12053 0
[pid=11815/tid=11824] ppid=11717 vsize=427796 CPUtime=0 cores=1,3,5,7
/proc/11815/task/11824/stat : 11824 (python) S 11717 11717 11084 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 538655625 438063104 27542 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604464346354688 0 0 -1 3 0 0 0
[pid=11825] ppid=11717 vsize=438052 CPUtime=0.13 cores=1,3,5,7
/proc/11825/stat : 11825 (python) S 11717 11717 11084 0 -1 4202560 1157 0 0 0 6 7 0 0 19 0 2 0 538655628 448565248 27552 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134540747 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/11825/statm: 109513 27552 405 364 0 45410 0
[pid=11827] ppid=11825 vsize=161836 CPUtime=99.11 cores=1,3,5,7
/proc/11827/stat : 11827 (precosat) T 11825 11827 11827 0 -1 4202496 41299 0 0 0 9906 5 0 0 25 0 1 0 538655628 165720064 38468 33554432000 4194304 4890832 140734977595200 18446744073709551615 4238692 0 0 16781312 17442 18446744071562691360 0 0 17 1 0 0 0
/proc/11827/statm: 40459 38468 86 171 0 40286 0
[pid=11825/tid=11832] ppid=11717 vsize=438052 CPUtime=0 cores=1,3,5,7
/proc/11825/task/11832/stat : 11832 (python) S 11717 11717 11084 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538665542 448565248 27552 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 514 18446604467228373952 0 0 -1 3 0 0 0
[pid=11839] ppid=11717 vsize=448308 CPUtime=0.02 cores=1,3,5,7
/proc/11839/stat : 11839 (python) S 11717 11717 11084 0 -1 4202560 959 0 0 0 1 1 0 0 15 0 1 0 538675954 459067392 27520 33554432000 4194304 5683644 140735741353440 18446744073709551615 228122734150 0 0 16781312 514 5601800392473018631 0 0 17 3 0 0 0
/proc/11839/statm: 112077 27520 370 364 0 47971 0
[pid=11841] ppid=11839 vsize=419328 CPUtime=10.7 cores=1,3,5,7
/proc/11841/stat : 11841 (cryptominisat-2) R 11839 11841 11841 0 -1 4202496 90690 0 0 0 1056 14 0 0 25 0 1 0 538675955 429391872 86015 33554432000 4194304 4677096 140735403942480 18446744073709551615 4346658 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/11841/statm: 104832 86015 387 118 0 99791 0
[pid=11717/tid=11725] ppid=11715 vsize=458552 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11725/stat : 11725 (python) S 11715 11717 11084 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 10 0 538557938 469557248 29046 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 5 0 0 0
[pid=11717/tid=11728] ppid=11715 vsize=458552 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11728/stat : 11728 (python) S 11715 11717 11084 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 10 0 538557940 469557248 29046 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 1 0 0 0
[pid=11717/tid=11731] ppid=11715 vsize=458552 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11731/stat : 11731 (python) S 11715 11717 11084 0 -1 4202560 23 934 0 0 0 0 0 0 18 0 10 0 538557943 469557248 29046 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11734] ppid=11715 vsize=458552 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11734/stat : 11734 (python) S 11715 11717 11084 0 -1 4202560 31 934 0 0 0 0 0 0 22 0 10 0 538557946 469557248 29046 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11742] ppid=11715 vsize=458552 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11742/stat : 11742 (python) S 11715 11717 11084 0 -1 4202560 39 934 0 0 0 0 0 0 18 0 10 0 538567963 469557248 29046 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11800] ppid=11715 vsize=458552 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11800/stat : 11800 (python) S 11715 11717 11084 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 10 0 538606960 469557248 29046 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11816] ppid=11715 vsize=458552 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11816/stat : 11816 (python) S 11715 11717 11084 0 -1 4202560 32 934 0 0 0 0 0 0 18 0 10 0 538636101 469557248 29046 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11826] ppid=11715 vsize=458552 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11826/stat : 11826 (python) S 11715 11717 11084 0 -1 4202560 30 934 0 0 0 0 0 0 20 0 10 0 538655628 469557248 29046 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
[pid=11717/tid=11840] ppid=11715 vsize=458552 CPUtime=0 cores=1,3,5,7
/proc/11717/task/11840/stat : 11840 (python) S 11715 11717 11084 0 -1 4202560 33 934 0 0 0 0 0 0 20 0 10 0 538675955 469557248 29046 33554432000 4194304 5683644 140735741353440 18446744073709551615 228134537649 0 0 16781312 2 18446604471098582144 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 6290188

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11717 and gives
#  childrusage.ru_utime.tv_sec=46
#  childrusage.ru_utime.tv_usec=930865
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=807877
# CPU time returned by wait4() is 47.7387
# while last known CPU time is 4800.16
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1237.1
CPU time (s): 4800.16
CPU user time (s): 4795.24
CPU system time (s): 4.92
CPU usage (%): 388.018
Max. virtual memory (cumulated for all children) (KiB): 6290188

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 46.9309
system time used= 0.807877
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 58687
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2178
involuntary context switches= 104

runsolver used 2.85357 second user time and 6.69298 second system time

The end

Launcher Data 

Begin job on node138 at 2011-05-01 19:05:53
IDJOB=3317913
IDBENCH=82468
IDSOLVER=1706
FILE ID=node138/3317913-1304269553
RUNJOBID= node138-1304267281-11103
PBS_JOBID= 13173941
Free space on /tmp= 72256 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-pdtvisns3p02-tseitin.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317913-1304269553/watcher-3317913-1304269553 -o /tmp/evaluation-result-3317913-1304269553/solver-3317913-1304269553 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317913-1304269553.cnf -seed 1321080376 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a0ec1baa890da62d0c6df7f1e62c6af3
RANDOM SEED=1321080376

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28648604 kB
Buffers:        700368 kB
Cached:        1365436 kB
SwapCached:         84 kB
Active:        2289032 kB
Inactive:      1608308 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28648604 kB
SwapTotal:    67111528 kB
SwapFree:     67111444 kB
Dirty:           40708 kB
Writeback:           0 kB
AnonPages:     1831052 kB
Mapped:          22320 kB
Slab:           336844 kB
PageTables:       9100 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1992380 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72388 MiB
End job on node138 at 2011-05-01 19:26:33