Trace number 3321587

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 1847.14 285.607

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf
MD5SUM4ab53801f3b1a3f7169c9fb38cba4184
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables171676
Number of clauses870241
Sum of the clauses size2069671
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2859140
Number of clauses of size 32700
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58190

Solver Data 

0.37/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.37/0.67	c INFO: solving HOME/instance-3321587-1304347631.cnf
0.37/0.67	c INFO: computing task features
3.05/3.33	c INFO: computed variable-clause graph statistics
3.15/3.43	c INFO: computed clause balance statistics
15.15/15.48	c INFO: computed variable balance statistics
23.74/24.01	c INFO: computed small-clause counts
23.84/24.18	c INFO: computed Horn-clause counts
61.24/61.57	c INFO: computed variable graph statistics
61.24/61.57	c INFO: collected features for HOME/instance-3321587-1304347631.cnf in 60.83 s
61.24/61.60	c INFO: running lingeling-276@0 for 97 with 39939 remaining (b = 0.21)
61.34/61.64	c INFO: running cryptominisat-2.9.0@0 for 485 with 39939 remaining (b = 0.19)
61.34/61.67	c INFO: running lingeling-276@0 for 1261 with 39939 remaining (b = 0.32)
61.44/61.71	c INFO: running cryptominisat-2.9.0@0 for 485 with 39938 remaining (b = 0.13)
61.44/61.74	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39938 remaining (b = 0.40)
61.44/61.78	c INFO: running lingeling-276@0 for 1261 with 39938 remaining (b = 0.25)
61.53/61.81	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39938 remaining (b = 0.30)
61.53/61.85	c INFO: running SApperloT@0 for 97 with 39938 remaining (b = 0.02)
860.91/161.84	c INFO: running precosat-570@0 for 388 with 39838 remaining (b = 0.08)
862.28/162.08	c INFO: running lingeling-276@0 for 1164 with 39838 remaining (b = 0.17)
1847.14/285.57	c INFO: running lingeling-276@0 for 97 with 39715 remaining (b = 0.06)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321587-1304347631/watcher-3321587-1304347631 -o /tmp/evaluation-result-3321587-1304347631/solver-3321587-1304347631 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321587-1304347631.cnf -seed 542497367 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.80 7.78 7.91 2/251 27590
/proc/meminfo: memFree=22547600/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=15388 CPUtime=0 cores=0-7
/proc/27590/stat : 27590 (python) R 27588 27590 27564 0 -1 4202496 814 0 0 0 0 0 0 0 17 0 1 0 546360891 15757312 699 33554432000 4194304 5683644 140733508788688 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27590/statm: 3847 699 334 364 0 334 0

[startup+0.106231 s]
/proc/loadavg: 6.80 7.78 7.91 2/251 27590
/proc/meminfo: memFree=22547600/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=94176 CPUtime=0.07 cores=0-7
/proc/27590/stat : 27590 (python) R 27588 27590 27564 0 -1 4202496 2761 0 0 0 5 2 0 0 17 0 1 0 546360891 96436224 2471 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687336133 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27590/statm: 23543 2474 764 364 0 1675 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 94176

[startup+0.201198 s]
/proc/loadavg: 6.80 7.78 7.91 2/251 27590
/proc/meminfo: memFree=22547600/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=124232 CPUtime=0.12 cores=0-7
/proc/27590/stat : 27590 (python) S 27588 27590 27564 0 -1 4202496 4273 0 1 0 9 3 0 0 17 0 1 0 546360891 127213568 3879 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687673344 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/27590/statm: 31058 3879 996 364 0 2869 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 124232

[startup+0.301185 s]
/proc/loadavg: 6.80 7.78 7.91 2/251 27590
/proc/meminfo: memFree=22547600/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=135748 CPUtime=0.19 cores=0-7
/proc/27590/stat : 27590 (python) R 27588 27590 27564 0 -1 4202496 5963 932 1 0 14 5 0 0 17 0 1 0 546360891 139005952 4150 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687671301 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27590/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.701124 s]
/proc/loadavg: 6.80 7.78 7.91 2/251 27590
/proc/meminfo: memFree=22547600/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=295204 CPUtime=0.44 cores=0-7
/proc/27590/stat : 27590 (python) R 27588 27590 27564 0 -1 4202496 13440 932 1 0 32 12 0 0 16 0 1 0 546360891 302288896 11120 33554432000 4194304 5683644 140733508788688 18446744073709551615 4570188 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27590/statm: 73801 11121 1761 364 0 9725 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 295204

[startup+1.50092 s]
/proc/loadavg: 6.80 7.78 7.91 2/252 27595
/proc/meminfo: memFree=22482864/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=349700 CPUtime=1.24 cores=0-7
/proc/27590/stat : 27590 (python) R 27588 27590 27564 0 -1 4202496 26825 932 1 0 110 14 0 0 17 0 1 0 546360891 358092800 24505 33554432000 4194304 5683644 140733508788688 18446744073709551615 47763903058158 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27590/statm: 87425 24507 1761 364 0 23349 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 349700

[startup+3.10063 s]
/proc/loadavg: 6.80 7.78 7.91 2/252 27595
/proc/meminfo: memFree=22408712/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=455916 CPUtime=2.84 cores=0-7
/proc/27590/stat : 27590 (python) R 27588 27590 27564 0 -1 4202496 73630 932 1 0 265 19 0 0 19 0 1 0 546360891 466857984 51352 33554432000 4194304 5683644 140733508788688 18446744073709551615 47763732579917 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27590/statm: 113979 51352 1814 364 0 49903 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 455916

[startup+6.30104 s]
/proc/loadavg: 6.34 7.67 7.88 2/252 27595
/proc/meminfo: memFree=22348996/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=455916 CPUtime=6.04 cores=0-7
/proc/27590/stat : 27590 (python) R 27588 27590 27564 0 -1 4202496 73644 932 1 0 585 19 0 0 25 0 1 0 546360891 466857984 51364 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687342602 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27590/statm: 113979 51364 1826 364 0 49903 0
Current children cumulated CPU time (s) 6.04
Current children cumulated vsize (KiB) 455916

[startup+12.7009 s]
/proc/loadavg: 5.91 7.56 7.84 2/252 27596
/proc/meminfo: memFree=22349568/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=455916 CPUtime=12.44 cores=0-7
/proc/27590/stat : 27590 (python) R 27588 27590 27564 0 -1 4202496 73644 932 1 0 1225 19 0 0 25 0 1 0 546360891 466857984 51364 33554432000 4194304 5683644 140733508788688 18446744073709551615 47763732278210 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27590/statm: 113979 51364 1826 364 0 49903 0
Current children cumulated CPU time (s) 12.44
Current children cumulated vsize (KiB) 455916

[startup+25.5006 s]
/proc/loadavg: 4.89 7.25 7.73 2/252 27596
/proc/meminfo: memFree=22351064/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=455916 CPUtime=25.24 cores=0-7
/proc/27590/stat : 27590 (python) R 27588 27590 27564 0 -1 4202496 73651 932 1 0 2505 19 0 0 25 0 1 0 546360891 466857984 51371 33554432000 4194304 5683644 140733508788688 18446744073709551615 47763732166784 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27590/statm: 113979 51371 1833 364 0 49903 0
Current children cumulated CPU time (s) 25.24
Current children cumulated vsize (KiB) 455916

[startup+51.1009 s]
/proc/loadavg: 3.56 6.75 7.55 2/252 27597
/proc/meminfo: memFree=22350812/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=455916 CPUtime=50.84 cores=0-7
/proc/27590/stat : 27590 (python) R 27588 27590 27564 0 -1 4202496 73651 932 1 0 5065 19 0 0 25 0 1 0 546360891 466857984 51371 33554432000 4194304 5683644 140733508788688 18446744073709551615 47763732166796 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/27590/statm: 113979 51371 1833 364 0 49903 0
Current children cumulated CPU time (s) 50.84
Current children cumulated vsize (KiB) 455916

[startup+102.302 s]
/proc/loadavg: 5.52 6.74 7.50 9/276 27622
/proc/meminfo: memFree=19728980/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=590000 CPUtime=61.6 cores=0-7
/proc/27590/stat : 27590 (python) S 27588 27590 27564 0 -1 4202496 79172 932 1 0 6135 25 0 0 19 0 9 0 546360891 604160000 48264 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27590/statm: 147500 48264 1889 364 0 83397 0
[pid=27598] ppid=27590 vsize=442428 CPUtime=0.08 cores=0-7
/proc/27598/stat : 27598 (python) S 27590 27590 27564 0 -1 4202560 932 0 0 0 4 4 0 0 18 0 1 0 546367052 453046272 46536 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695375 0 0 16781312 514 15654653042228166913 0 0 17 7 0 0 0
/proc/27598/statm: 110607 46536 376 364 0 46525 0
[pid=27600] ppid=27598 vsize=64660 CPUtime=40.28 cores=0-7
/proc/27600/stat : 27600 (lingeling) R 27598 27600 27600 0 -1 4202496 23822 0 0 0 4025 3 0 0 25 0 1 0 546367052 66211840 15334 33554432000 4194304 4352236 140737108411104 18446744073709551615 4278746 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/27600/statm: 16165 15334 129 39 0 15245 0
[pid=27601] ppid=27590 vsize=452684 CPUtime=0.07 cores=0-7
/proc/27601/stat : 27601 (python) S 27590 27590 27564 0 -1 4202560 942 0 0 0 3 4 0 0 15 0 1 0 546367055 463548416 46534 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166914 0 0 17 2 0 0 0
/proc/27601/statm: 113171 46534 370 364 0 49086 0
[pid=27603] ppid=27601 vsize=831924 CPUtime=40.56 cores=0-7
/proc/27603/stat : 27603 (cryptominisat-2) R 27601 27603 27603 0 -1 4202496 154596 0 0 0 4037 19 0 0 25 0 1 0 546367056 851890176 149941 33554432000 4194304 4677096 140736364762208 18446744073709551615 4336461 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/27603/statm: 207981 149941 387 118 0 202940 0
[pid=27604] ppid=27590 vsize=462940 CPUtime=0.07 cores=0-7
/proc/27604/stat : 27604 (python) S 27590 27590 27564 0 -1 4202560 917 0 0 0 3 4 0 0 18 0 1 0 546367058 474050560 46538 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166916 0 0 17 1 0 0 0
/proc/27604/statm: 115735 46538 370 364 0 51647 0
[pid=27606] ppid=27604 vsize=62560 CPUtime=40.61 cores=0-7
/proc/27606/stat : 27606 (lingeling) R 27604 27606 27606 0 -1 4202496 22272 0 0 0 4058 3 0 0 25 0 1 0 546367059 64061440 13787 33554432000 4194304 4352236 140734721534896 18446744073709551615 4233914 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/27606/statm: 15640 13787 129 39 0 14720 0
[pid=27607] ppid=27590 vsize=473196 CPUtime=0.08 cores=0-7
/proc/27607/stat : 27607 (python) S 27590 27590 27564 0 -1 4202560 932 0 0 0 3 5 0 0 15 0 1 0 546367062 484552704 46542 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 13990005636209803524 0 0 17 5 0 0 0
/proc/27607/statm: 118299 46542 370 364 0 54208 0
[pid=27609] ppid=27607 vsize=811440 CPUtime=40.52 cores=0-7
/proc/27609/stat : 27609 (cryptominisat-2) R 27607 27609 27609 0 -1 4202496 160775 0 0 0 4031 21 0 0 25 0 1 0 546367063 830914560 149188 33554432000 4194304 4677096 140734871430256 18446744073709551615 4336232 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/27609/statm: 202860 149188 387 118 0 197819 0
[pid=27610] ppid=27590 vsize=548988 CPUtime=0.07 cores=0-7
/proc/27610/stat : 27610 (python) S 27590 27590 27564 0 -1 4202560 803 0 0 0 4 3 0 0 15 0 1 0 546367065 562163712 46664 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166913 0 0 17 1 0 0 0
/proc/27610/statm: 137247 46664 371 364 0 73153 0
[pid=27612] ppid=27610 vsize=809704 CPUtime=40.54 cores=0-7
/proc/27612/stat : 27612 (cryptominisat-2) R 27610 27612 27612 0 -1 4202496 159564 0 0 0 4034 20 0 0 25 0 1 0 546367066 829136896 148608 33554432000 4194304 4677096 140734243953984 18446744073709551615 4335860 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/27612/statm: 202426 148608 387 118 0 197385 0
[pid=27613] ppid=27590 vsize=559244 CPUtime=0.08 cores=0-7
/proc/27613/stat : 27613 (python) S 27590 27590 27564 0 -1 4202560 808 0 0 0 4 4 0 0 18 0 1 0 546367069 572665856 46653 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166914 0 0 17 1 0 0 0
/proc/27613/statm: 139811 46653 371 364 0 75714 0
[pid=27615] ppid=27613 vsize=61748 CPUtime=40.04 cores=0-7
/proc/27615/stat : 27615 (lingeling) R 27613 27615 27615 0 -1 4202496 22064 0 0 0 4000 4 0 0 25 0 1 0 546367070 63229952 13584 33554432000 4194304 4352236 140734018601776 18446744073709551615 4281293 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/27615/statm: 15437 13584 129 39 0 14517 0
[pid=27616] ppid=27590 vsize=569500 CPUtime=0.07 cores=0-7
/proc/27616/stat : 27616 (python) S 27590 27590 27564 0 -1 4202560 828 0 0 0 3 4 0 0 15 0 1 0 546367072 583168000 46726 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166916 0 0 17 1 0 0 0
/proc/27616/statm: 142375 46726 371 364 0 78275 0
[pid=27618] ppid=27616 vsize=800828 CPUtime=40.45 cores=0-7
/proc/27618/stat : 27618 (cryptominisat-2) R 27616 27618 27618 0 -1 4202496 155174 0 0 0 4024 21 0 0 25 0 1 0 546367075 820047872 146986 33554432000 4194304 4677096 140733720751568 18446744073709551615 4336222 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27618/statm: 200207 146986 387 118 0 195166 0
[pid=27619] ppid=27590 vsize=579756 CPUtime=0.07 cores=0-7
/proc/27619/stat : 27619 (python) S 27590 27590 27564 0 -1 4202560 864 0 0 0 3 4 0 0 18 0 1 0 546367076 593670144 46748 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166915 0 0 17 1 0 0 0
/proc/27619/statm: 144939 46748 377 364 0 80836 0
[pid=27621] ppid=27619 vsize=58460 CPUtime=40.44 cores=0-7
/proc/27621/stat : 27621 (SApperloT-base) R 27619 27621 27621 0 -1 4202496 13949 0 0 0 4041 3 0 0 25 0 1 0 546367077 59863040 13382 33554432000 134512640 135674940 4294855136 18446744073709551615 134551968 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/27621/statm: 14615 13382 99 284 0 14329 0
[pid=27590/tid=27599] ppid=27588 vsize=590000 CPUtime=0 cores=0-7
/proc/27590/task/27599/stat : 27599 (python) S 27588 27590 27564 0 -1 4202560 27 932 0 0 0 0 0 0 25 0 9 0 546367052 604160000 48264 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27602] ppid=27588 vsize=590000 CPUtime=0 cores=0-7
/proc/27590/task/27602/stat : 27602 (python) S 27588 27590 27564 0 -1 4202560 21 932 0 0 0 0 0 0 20 0 9 0 546367056 604160000 48264 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27605] ppid=27588 vsize=590000 CPUtime=0 cores=0-7
/proc/27590/task/27605/stat : 27605 (python) S 27588 27590 27564 0 -1 4202560 22 932 0 0 0 0 0 0 19 0 9 0 546367059 604160000 48264 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27608] ppid=27588 vsize=590000 CPUtime=0 cores=0-7
/proc/27590/task/27608/stat : 27608 (python) S 27588 27590 27564 0 -1 4202560 20 932 0 0 0 0 0 0 18 0 9 0 546367062 604160000 48264 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 5 0 0 0
[pid=27590/tid=27611] ppid=27588 vsize=590000 CPUtime=0 cores=0-7
/proc/27590/task/27611/stat : 27611 (python) S 27588 27590 27564 0 -1 4202560 78 932 0 0 0 0 0 0 19 0 9 0 546367066 604160000 48264 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27614] ppid=27588 vsize=590000 CPUtime=0 cores=0-7
/proc/27590/task/27614/stat : 27614 (python) S 27588 27590 27564 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 9 0 546367069 604160000 48264 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 7 0 0 0
[pid=27590/tid=27617] ppid=27588 vsize=590000 CPUtime=0 cores=0-7
/proc/27590/task/27617/stat : 27617 (python) S 27588 27590 27564 0 -1 4202560 32 932 0 0 0 0 0 0 19 0 9 0 546367073 604160000 48264 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 6 0 0 0
[pid=27590/tid=27620] ppid=27588 vsize=590000 CPUtime=0 cores=0-7
/proc/27590/task/27620/stat : 27620 (python) S 27588 27590 27564 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 9 0 546367076 604160000 48264 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 385.63
Current children cumulated vsize (KiB) 8180060

[startup+162.302 s]
/proc/loadavg: 7.09 6.96 7.53 9/276 27624
/proc/meminfo: memFree=12156164/32951124 swapFree=67111524/67111528
[pid=27590] ppid=27588 vsize=600256 CPUtime=61.68 cores=0-7
/proc/27590/stat : 27590 (python) S 27588 27590 27564 0 -1 4202496 80305 932 1 0 6142 26 0 0 18 0 10 0 546360891 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27590/statm: 150064 48217 1892 364 0 85958 0
[pid=27598] ppid=27590 vsize=452672 CPUtime=0.2 cores=0-7
/proc/27598/stat : 27598 (python) S 27590 27590 27564 0 -1 4202560 1110 0 0 0 10 10 0 0 18 0 2 0 546367052 463536128 46575 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/27598/statm: 113168 46575 410 364 0 49086 0

################
# More data... #
################

/proc/27604/statm: 115735 46538 370 364 0 51647 0
[pid=27606] ppid=27604 vsize=82492 CPUtime=220.6 cores=0-7
/proc/27606/stat : 27606 (lingeling) R 27604 27606 27606 0 -1 4202496 28723 0 0 0 22056 4 0 0 25 0 1 0 546367059 84471808 19793 33554432000 4194304 4352236 140734721534896 18446744073709551615 4234404 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/27606/statm: 20623 19793 129 39 0 19703 0
[pid=27607] ppid=27590 vsize=473196 CPUtime=1.36 cores=0-7
/proc/27607/stat : 27607 (python) S 27590 27590 27564 0 -1 4202560 1857 0 0 0 92 44 0 0 15 0 1 0 546367062 484552704 46543 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166916 0 0 17 5 0 0 0
/proc/27607/statm: 118299 46543 371 364 0 54208 0
[pid=27609] ppid=27607 vsize=6914916 CPUtime=219.12 cores=0-7
/proc/27609/stat : 27609 (cryptominisat-2) R 27607 27609 27609 0 -1 4202496 7588932 0 0 0 20842 1070 0 0 25 0 1 0 546367063 7080873984 1620979 33554432000 4194304 4677096 140734871430256 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27609/statm: 1728729 1620979 393 118 0 1723688 0
[pid=27610] ppid=27590 vsize=548988 CPUtime=1.17 cores=0-7
/proc/27610/stat : 27610 (python) S 27590 27590 27564 0 -1 4202560 1198 0 0 0 85 32 0 0 15 0 1 0 546367065 562163712 46972 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 7998019108551491841 0 0 17 0 0 0 0
/proc/27610/statm: 137247 46972 372 364 0 73153 0
[pid=27612] ppid=27610 vsize=6147764 CPUtime=219.56 cores=0-7
/proc/27612/stat : 27612 (cryptominisat-2) R 27610 27612 27612 0 -1 4202496 7566165 0 0 0 20688 1268 0 0 25 0 1 0 546367066 6295310336 1478118 33554432000 4194304 4677096 140734243953984 18446744073709551615 4319643 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/27612/statm: 1536941 1478118 393 118 0 1531900 0
[pid=27613] ppid=27590 vsize=559244 CPUtime=0.43 cores=0-7
/proc/27613/stat : 27613 (python) S 27590 27590 27564 0 -1 4202560 808 0 0 0 23 20 0 0 18 0 1 0 546367069 572665856 46653 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166914 0 0 17 1 0 0 0
/proc/27613/statm: 139811 46653 371 364 0 75714 0
[pid=27615] ppid=27613 vsize=91920 CPUtime=219.15 cores=0-7
/proc/27615/stat : 27615 (lingeling) R 27613 27615 27615 0 -1 4202496 31075 0 0 0 21910 5 0 0 25 0 1 0 546367070 94126080 22150 33554432000 4194304 4352236 140734018601776 18446744073709551615 4278683 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/27615/statm: 22980 22150 129 39 0 22060 0
[pid=27616] ppid=27590 vsize=569500 CPUtime=1.25 cores=0-7
/proc/27616/stat : 27616 (python) S 27590 27590 27564 0 -1 4202560 1614 0 0 0 89 36 0 0 15 0 1 0 546367072 583168000 47036 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 4584734793702277380 0 0 17 7 0 0 0
/proc/27616/statm: 142375 47036 372 364 0 78275 0
[pid=27618] ppid=27616 vsize=6476760 CPUtime=216.98 cores=0-7
/proc/27618/stat : 27618 (cryptominisat-2) R 27616 27618 27618 0 -1 4202496 7027495 0 0 0 20697 1001 0 0 25 0 1 0 546367075 6632202240 1540709 33554432000 4194304 4677096 140733720751568 18446744073709551615 4586861 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/27618/statm: 1619190 1540709 393 118 0 1614149 0
[pid=27619] ppid=27590 vsize=579756 CPUtime=0.2 cores=0-7
/proc/27619/stat : 27619 (python) S 27590 27590 27564 0 -1 4202560 1054 0 0 0 9 11 0 0 19 0 2 0 546367076 593670144 46777 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/27619/statm: 144939 46777 405 364 0 80836 0
[pid=27621] ppid=27619 vsize=102056 CPUtime=100.18 cores=0-7
/proc/27621/stat : 27621 (SApperloT-base) T 27619 27621 27621 0 -1 4202496 25365 0 0 0 10013 5 0 0 25 0 1 0 546367077 104505344 24028 33554432000 134512640 135674940 4294855136 18446744073709551615 134552028 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/27621/statm: 25514 24028 99 284 0 25228 0
[pid=27619/tid=27629] ppid=27590 vsize=579756 CPUtime=0 cores=0-7
/proc/27619/task/27629/stat : 27629 (python) S 27590 27590 27564 0 -1 4202560 78 0 0 0 0 0 0 0 19 0 2 0 546377096 593670144 46777 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 514 18446604444163212352 0 0 -1 1 0 0 0
[pid=27626] ppid=27590 vsize=590012 CPUtime=0.24 cores=0-7
/proc/27626/stat : 27626 (python) S 27590 27590 27564 0 -1 4202560 840 0 0 0 11 13 0 0 18 0 1 0 546377075 604172288 46692 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166915 0 0 17 6 0 0 0
/proc/27626/statm: 147503 46692 371 364 0 83397 0
[pid=27628] ppid=27626 vsize=195876 CPUtime=119.39 cores=0-7
/proc/27628/stat : 27628 (precosat) R 27626 27628 27628 0 -1 4202496 49985 0 0 0 11930 9 0 0 25 0 1 0 546377076 200577024 47035 33554432000 4194304 4890832 140733310396160 18446744073709551615 4238265 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/27628/statm: 48969 47035 86 171 0 48796 0
[pid=27590/tid=27599] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27599/stat : 27599 (python) S 27588 27590 27564 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 10 0 546367052 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27602] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27602/stat : 27602 (python) S 27588 27590 27564 0 -1 4202560 21 932 0 0 0 0 0 0 20 0 10 0 546367056 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27605] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27605/stat : 27605 (python) S 27588 27590 27564 0 -1 4202560 22 932 0 0 0 0 0 0 19 0 10 0 546367059 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27608] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27608/stat : 27608 (python) S 27588 27590 27564 0 -1 4202560 20 932 0 0 0 0 0 0 18 0 10 0 546367062 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 5 0 0 0
[pid=27590/tid=27611] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27611/stat : 27611 (python) S 27588 27590 27564 0 -1 4202560 78 932 0 0 0 0 0 0 19 0 10 0 546367066 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27614] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27614/stat : 27614 (python) S 27588 27590 27564 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 10 0 546367069 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 7 0 0 0
[pid=27590/tid=27617] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27617/stat : 27617 (python) S 27588 27590 27564 0 -1 4202560 32 932 0 0 0 0 0 0 19 0 10 0 546367073 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 6 0 0 0
[pid=27590/tid=27620] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27620/stat : 27620 (python) S 27588 27590 27564 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 10 0 546367076 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 1 0 0 0
[pid=27590/tid=27627] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27627/stat : 27627 (python) S 27588 27590 27564 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 10 0 546377076 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1821.8
Current children cumulated vsize (KiB) 31490428



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+285.501 s]
/proc/loadavg: 8.26 7.44 7.63 10/281 27632
/proc/meminfo: memFree=95740/32951124 swapFree=67111464/67111528
[pid=27590] ppid=27588 vsize=600256 CPUtime=61.68 cores=0-7
/proc/27590/stat : 27590 (python) S 27588 27590 27564 0 -1 4202496 80305 932 1 0 6142 26 0 0 18 0 10 0 546360891 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27590/statm: 150064 48217 1892 364 0 85958 0
[pid=27598] ppid=27590 vsize=452672 CPUtime=0.44 cores=0-7
/proc/27598/stat : 27598 (python) S 27590 27590 27564 0 -1 4202560 1138 0 0 0 23 21 0 0 18 0 2 0 546367052 463536128 46575 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/27598/statm: 113168 46575 410 364 0 49086 0
[pid=27600] ppid=27598 vsize=85056 CPUtime=222.19 cores=0-7
/proc/27600/stat : 27600 (lingeling) R 27598 27600 27600 0 -1 4202496 29347 0 0 0 22214 5 0 0 25 0 1 0 546367052 87097344 20433 33554432000 4194304 4352236 140737108411104 18446744073709551615 4208067 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/27600/statm: 21264 20433 129 39 0 20344 0
[pid=27598/tid=27625] ppid=27590 vsize=452672 CPUtime=0 cores=0-7
/proc/27598/task/27625/stat : 27625 (python) S 27590 27590 27564 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 546377071 463536128 46575 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 514 18446604453903499520 0 0 -1 7 0 0 0
[pid=27601] ppid=27590 vsize=452684 CPUtime=1.22 cores=0-7
/proc/27601/stat : 27601 (python) S 27590 27590 27564 0 -1 4202560 1893 0 0 0 87 35 0 0 15 0 1 0 546367055 463548416 46535 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 5602131646120689922 0 0 17 2 0 0 0
/proc/27601/statm: 113171 46535 371 364 0 49086 0
[pid=27603] ppid=27601 vsize=6177312 CPUtime=222.64 cores=0-7
/proc/27603/stat : 27603 (cryptominisat-2) R 27601 27603 27603 0 -1 4202496 7416359 0 0 0 21031 1233 0 0 25 0 1 0 546367056 6325567488 1481128 33554432000 4194304 4677096 140736364762208 18446744073709551615 4336232 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/27603/statm: 1544328 1481128 390 118 0 1539287 0
[pid=27604] ppid=27590 vsize=462940 CPUtime=0.43 cores=0-7
/proc/27604/stat : 27604 (python) S 27590 27590 27564 0 -1 4202560 965 0 0 0 21 22 0 0 18 0 1 0 546367058 474050560 46538 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166916 0 0 17 1 0 0 0
/proc/27604/statm: 115735 46538 370 364 0 51647 0
[pid=27606] ppid=27604 vsize=82492 CPUtime=223.81 cores=0-7
/proc/27606/stat : 27606 (lingeling) R 27604 27606 27606 0 -1 4202496 28723 0 0 0 22377 4 0 0 25 0 1 0 546367059 84471808 19793 33554432000 4194304 4352236 140734721534896 18446744073709551615 4234038 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/27606/statm: 20623 19793 129 39 0 19703 0
[pid=27607] ppid=27590 vsize=473196 CPUtime=1.36 cores=0-7
/proc/27607/stat : 27607 (python) S 27590 27590 27564 0 -1 4202560 1857 0 0 0 92 44 0 0 15 0 1 0 546367062 484552704 46543 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166916 0 0 17 5 0 0 0
/proc/27607/statm: 118299 46543 371 364 0 54208 0
[pid=27609] ppid=27607 vsize=6964160 CPUtime=222.23 cores=0-7
/proc/27609/stat : 27609 (cryptominisat-2) R 27607 27609 27609 0 -1 4202496 7598386 0 0 0 21151 1072 0 0 25 0 1 0 546367063 7131299840 1630433 33554432000 4194304 4677096 140734871430256 18446744073709551615 4586909 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27609/statm: 1741040 1630433 393 118 0 1735999 0
[pid=27610] ppid=27590 vsize=548988 CPUtime=1.18 cores=0-7
/proc/27610/stat : 27610 (python) S 27590 27590 27564 0 -1 4202560 1198 0 0 0 85 33 0 0 15 0 1 0 546367065 562163712 46972 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166913 0 0 17 0 0 0 0
/proc/27610/statm: 137247 46972 372 364 0 73153 0
[pid=27612] ppid=27610 vsize=6252804 CPUtime=222.76 cores=0-7
/proc/27612/stat : 27612 (cryptominisat-2) R 27610 27612 27612 0 -1 4202496 7585372 0 0 0 21005 1271 0 0 25 0 1 0 546367066 6402871296 1497325 33554432000 4194304 4677096 140734243953984 18446744073709551615 4318786 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/27612/statm: 1563201 1497325 393 118 0 1558160 0
[pid=27613] ppid=27590 vsize=559244 CPUtime=0.43 cores=0-7
/proc/27613/stat : 27613 (python) S 27590 27590 27564 0 -1 4202560 808 0 0 0 23 20 0 0 18 0 1 0 546367069 572665856 46653 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166914 0 0 17 1 0 0 0
/proc/27613/statm: 139811 46653 371 364 0 75714 0
[pid=27615] ppid=27613 vsize=91920 CPUtime=222.36 cores=0-7
/proc/27615/stat : 27615 (lingeling) R 27613 27615 27615 0 -1 4202496 31075 0 0 0 22231 5 0 0 25 0 1 0 546367070 94126080 22150 33554432000 4194304 4352236 140734018601776 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/27615/statm: 22980 22150 129 39 0 22060 0
[pid=27616] ppid=27590 vsize=569500 CPUtime=1.27 cores=0-7
/proc/27616/stat : 27616 (python) S 27590 27590 27564 0 -1 4202560 1614 0 0 0 90 37 0 0 15 0 1 0 546367072 583168000 47036 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 4584734793702277380 0 0 17 7 0 0 0
/proc/27616/statm: 142375 47036 372 364 0 78275 0
[pid=27618] ppid=27616 vsize=6506660 CPUtime=220.11 cores=0-7
/proc/27618/stat : 27618 (cryptominisat-2) R 27616 27618 27618 0 -1 4202496 7035004 0 0 0 21009 1002 0 0 25 0 1 0 546367075 6662819840 1548218 33554432000 4194304 4677096 140733720751568 18446744073709551615 4462632 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/27618/statm: 1626665 1548218 393 118 0 1621624 0
[pid=27619] ppid=27590 vsize=579756 CPUtime=0.2 cores=0-7
/proc/27619/stat : 27619 (python) S 27590 27590 27564 0 -1 4202560 1054 0 0 0 9 11 0 0 19 0 2 0 546367076 593670144 46777 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/27619/statm: 144939 46777 405 364 0 80836 0
[pid=27621] ppid=27619 vsize=102056 CPUtime=100.18 cores=0-7
/proc/27621/stat : 27621 (SApperloT-base) T 27619 27621 27621 0 -1 4202496 25365 0 0 0 10013 5 0 0 25 0 1 0 546367077 104505344 24028 33554432000 134512640 135674940 4294855136 18446744073709551615 134552028 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/27621/statm: 25514 24028 99 284 0 25228 0
[pid=27619/tid=27629] ppid=27590 vsize=579756 CPUtime=0 cores=0-7
/proc/27619/task/27629/stat : 27629 (python) S 27590 27590 27564 0 -1 4202560 78 0 0 0 0 0 0 0 19 0 2 0 546377096 593670144 46777 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 514 18446604444163212352 0 0 -1 1 0 0 0
[pid=27626] ppid=27590 vsize=590012 CPUtime=0.24 cores=0-7
/proc/27626/stat : 27626 (python) S 27590 27590 27564 0 -1 4202560 840 0 0 0 11 13 0 0 18 0 1 0 546377075 604172288 46692 33554432000 4194304 5683644 140733508788688 18446744073709551615 212687695430 0 0 16781312 514 15654653042228166915 0 0 17 6 0 0 0
/proc/27626/statm: 147503 46692 371 364 0 83397 0
[pid=27628] ppid=27626 vsize=195876 CPUtime=122.41 cores=0-7
/proc/27628/stat : 27628 (precosat) R 27626 27628 27628 0 -1 4202496 49985 0 0 0 12232 9 0 0 25 0 1 0 546377076 200577024 47035 33554432000 4194304 4890832 140733310396160 18446744073709551615 4232386 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/27628/statm: 48969 47035 86 171 0 48796 0
[pid=27590/tid=27599] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27599/stat : 27599 (python) S 27588 27590 27564 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 10 0 546367052 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27602] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27602/stat : 27602 (python) S 27588 27590 27564 0 -1 4202560 21 932 0 0 0 0 0 0 20 0 10 0 546367056 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27605] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27605/stat : 27605 (python) S 27588 27590 27564 0 -1 4202560 22 932 0 0 0 0 0 0 19 0 10 0 546367059 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27608] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27608/stat : 27608 (python) S 27588 27590 27564 0 -1 4202560 20 932 0 0 0 0 0 0 18 0 10 0 546367062 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 5 0 0 0
[pid=27590/tid=27611] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27611/stat : 27611 (python) S 27588 27590 27564 0 -1 4202560 78 932 0 0 0 0 0 0 19 0 10 0 546367066 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 0 0 0 0
[pid=27590/tid=27614] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27614/stat : 27614 (python) S 27588 27590 27564 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 10 0 546367069 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 7 0 0 0
[pid=27590/tid=27617] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27617/stat : 27617 (python) S 27588 27590 27564 0 -1 4202560 32 932 0 0 0 0 0 0 19 0 10 0 546367073 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 6 0 0 0
[pid=27590/tid=27620] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27620/stat : 27620 (python) S 27588 27590 27564 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 10 0 546367076 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 1 0 0 0
[pid=27590/tid=27627] ppid=27588 vsize=600256 CPUtime=0 cores=0-7
/proc/27590/task/27627/stat : 27627 (python) S 27588 27590 27564 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 10 0 546377076 614662144 48217 33554432000 4194304 5683644 140733508788688 18446744073709551615 212699498929 0 0 16781312 2 18446604466911456320 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1847.14
Current children cumulated vsize (KiB) 31747584

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 27590 and gives
#  childrusage.ru_utime.tv_sec=734
#  childrusage.ru_utime.tv_usec=91401
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=788576
# CPU time returned by wait4() is 736.88
# while last known CPU time is 1847.14
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 285.607
CPU time (s): 1847.14
CPU user time (s): 1798.46
CPU system time (s): 48.68
CPU usage (%): 646.742
Max. virtual memory (cumulated for all children) (KiB): 31747584

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 734.091
system time used= 2.78858
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 181415
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 67229
involuntary context switches= 6674

runsolver used 1.07584 second user time and 2.72959 second system time

The end

Launcher Data 

Begin job on node139 at 2011-05-02 16:47:11
IDJOB=3321587
IDBENCH=82389
IDSOLVER=1710
FILE ID=node139/3321587-1304347631
RUNJOBID= node139-1304347631-27578
PBS_JOBID= 13178658
Free space on /tmp= 73164 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321587-1304347631/watcher-3321587-1304347631 -o /tmp/evaluation-result-3321587-1304347631/solver-3321587-1304347631 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321587-1304347631.cnf -seed 542497367 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4ab53801f3b1a3f7169c9fb38cba4184
RANDOM SEED=542497367

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22547880 kB
Buffers:       2095388 kB
Cached:        6309168 kB
SwapCached:          4 kB
Active:        3086656 kB
Inactive:      6771312 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22547880 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           47484 kB
Writeback:           0 kB
AnonPages:     1453756 kB
Mapped:          21580 kB
Slab:           466272 kB
PageTables:      15284 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 35432684 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73132 MiB
End job on node139 at 2011-05-02 16:51:59