Trace number 3317721

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 2665.69 900.903

General information on the benchmark

Nameindustrial/vliw_unsat_2.0/
9dlx_vliw_at_b_iq7.cnf
MD5SUM0fbc00fde383cec371bb97d621c5e7e5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark485.526
Satisfiable
(Un)Satisfiability was proved
Number of variables306095
Number of clauses6069108
Sum of the clauses size17675754
Maximum clause length163
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 25745111
Number of clauses of size 366910
Number of clauses of size 44878
Number of clauses of size 518476
Number of clauses of size over 5233732

Solver Data 

0.53/10.50	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.53/10.50	c INFO: solving HOME/instance-3317721-1304267293.cnf
0.53/10.51	c INFO: computing task features
23.73/33.79	c INFO: computed variable-clause graph statistics
24.53/34.54	c INFO: computed clause balance statistics
119.63/129.64	c INFO: computed variable balance statistics
183.54/193.59	c INFO: computed small-clause counts
185.64/195.69	c INFO: computed Horn-clause counts
297.34/307.40	c INFO: computed variable graph statistics
297.44/307.41	c INFO: collected features for HOME/instance-3317721-1304267293.cnf in 295.80 s
297.44/307.44	c INFO: running lingeling-276@0 for 97 with 4503 remaining (b = 0.76)
297.44/307.48	c INFO: running precosat-570@0 for 97 with 4503 remaining (b = 0.54)
297.53/307.51	c INFO: running lingeling-276@0 for 97 with 4503 remaining (b = 0.32)
297.53/307.55	c INFO: running cryptominisat-2.9.0@0 for 485 with 4502 remaining (b = 0.31)
697.27/407.63	c INFO: running lingeling-276@0 for 194 with 4402 remaining (b = 0.15)
697.27/407.66	c INFO: running precosat-570@0 for 97 with 4402 remaining (b = 0.22)
697.27/407.70	c INFO: running lingeling-276@0 for 388 with 4402 remaining (b = 0.42)
1101.45/508.80	c INFO: running precosat-570@99 for 97 with 4301 remaining (b = 0.43)
1477.26/602.94	c INFO: running glucosER@0 for 291 with 4207 remaining (b = 0.77)
1484.69/604.88	c INFO: running precosat-570@0 for 97 with 4205 remaining (b = 0.45)
1884.84/705.07	c INFO: running lingeling-276@0 for 97 with 4105 remaining (b = 0.27)
2240.55/794.19	c INFO: running cryptominisat-2.9.0@0 for 1164 with 4016 remaining (b = 0.43)
2247.70/795.99	c INFO: running lingeling-276@98 for 1164 with 4014 remaining (b = 0.35)
2284.78/805.26	c INFO: running lingeling-276@386 for 97 with 4005 remaining (b = 0.13)
2643.78/895.36	c INFO: running glucosER@195 for 97 with 3915 remaining (b = 0.40)
2664.06/900.40	c INFO: running lingeling-276@0 for 97 with 3910 remaining (b = 0.36)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317721-1304267293/watcher-3317721-1304267293 -o /tmp/evaluation-result-3317721-1304267293/solver-3317721-1304267293 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317721-1304267293.cnf -seed 832098950 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.08 0.02 0.01 1/177 20002
/proc/meminfo: memFree=28692512/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=11800 CPUtime=0 cores=1,3,5,7
/proc/20002/stat : 20002 (runsolver) S 20000 20002 19964 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 1 0 616960532 12083200 54 33554432000 4194304 5434984 140735336945936 18446744073709551615 5055495 0 2147483391 4096 24578 18446744071699199166 0 0 17 5 0 0 0
/proc/20002/statm: 2950 54 34 303 0 2644 0

[startup+0.045038 s]
/proc/loadavg: 0.08 0.02 0.01 1/177 20002
/proc/meminfo: memFree=28692512/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/20002/stat : 20002 (python) S 20000 20002 19964 0 -1 4202496 712 0 0 0 0 0 0 0 17 0 1 0 616960532 15548416 603 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/20002/statm: 3796 603 319 364 0 283 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15184

[startup+0.101017 s]
/proc/loadavg: 0.08 0.02 0.01 1/177 20002
/proc/meminfo: memFree=28692512/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=15380 CPUtime=0 cores=1,3,5,7
/proc/20002/stat : 20002 (python) S 20000 20002 19964 0 -1 4202496 811 0 0 0 0 0 0 0 17 0 1 0 616960532 15749120 696 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/20002/statm: 3845 696 334 364 0 332 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15380

[startup+0.30098 s]
/proc/loadavg: 0.08 0.02 0.01 1/177 20002
/proc/meminfo: memFree=28692512/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=16392 CPUtime=0.01 cores=1,3,5,7
/proc/20002/stat : 20002 (python) S 20000 20002 19964 0 -1 4202496 1153 0 0 0 1 0 0 0 15 0 1 0 616960532 16785408 1018 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/20002/statm: 4098 1018 413 364 0 585 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16392

[startup+0.700912 s]
/proc/loadavg: 0.08 0.02 0.01 1/177 20002
/proc/meminfo: memFree=28692512/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=25284 CPUtime=0.03 cores=1,3,5,7
/proc/20002/stat : 20002 (python) D 20000 20002 19964 0 -1 4202496 1343 0 1 0 2 1 0 0 16 0 1 0 616960532 25890816 1190 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367544832 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/20002/statm: 6321 1190 438 364 0 722 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 25284

[startup+1.50076 s]
/proc/loadavg: 0.08 0.02 0.01 1/178 20003
/proc/meminfo: memFree=28687812/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=30112 CPUtime=0.05 cores=1,3,5,7
/proc/20002/stat : 20002 (python) D 20000 20002 19964 0 -1 4202496 1508 0 2 0 3 2 0 0 15 0 1 0 616960532 30834688 1347 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367546624 0 0 16781312 2 18446744071562234166 0 0 17 3 0 0 3
/proc/20002/statm: 7528 1347 443 364 0 898 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 30112

[startup+3.10043 s]
/proc/loadavg: 0.08 0.02 0.01 1/178 20003
/proc/meminfo: memFree=28690680/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=50332 CPUtime=0.07 cores=1,3,5,7
/proc/20002/stat : 20002 (python) D 20000 20002 19964 0 -1 4202496 2002 0 8 0 3 4 0 0 16 0 1 0 616960532 51539968 1769 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367542629 0 0 16781312 2 0 0 0 17 7 0 0 32
/proc/20002/statm: 12583 1769 480 364 0 1283 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 50332
heavy processes:

[startup+6.30086 s]
/proc/loadavg: 0.15 0.03 0.01 1/178 20003
/proc/meminfo: memFree=28675344/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=115432 CPUtime=0.16 cores=1,3,5,7
/proc/20002/stat : 20002 (python) D 20000 20002 19964 0 -1 4202496 3565 0 27 0 8 8 0 0 16 0 1 0 616960532 118202368 3234 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367546624 0 0 16781312 2 18446744071562234166 0 0 17 7 0 0 84
/proc/20002/statm: 28858 3234 889 364 0 2359 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 115432
heavy processes:

[startup+12.7007 s]
/proc/loadavg: 0.22 0.05 0.02 3/178 20012
/proc/meminfo: memFree=28288872/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=547568 CPUtime=2.73 cores=1,3,5,7
/proc/20002/stat : 20002 (python) R 20000 20002 19964 0 -1 4202496 76211 926 101 9 238 35 0 0 18 0 1 0 616960532 560709632 73992 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367207621 0 0 16781312 2 0 0 0 17 1 0 0 215
/proc/20002/statm: 136892 73995 1761 364 0 72816 0
Current children cumulated CPU time (s) 2.73
Current children cumulated vsize (KiB) 547568
heavy processes:

[startup+25.5003 s]
/proc/loadavg: 0.61 0.14 0.05 3/178 20012
/proc/meminfo: memFree=27466608/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=1298572 CPUtime=15.53 cores=1,3,5,7
/proc/20002/stat : 20002 (python) R 20000 20002 19964 0 -1 4202496 260693 926 101 9 1491 62 0 0 25 0 1 0 616960532 1329737728 258474 33554432000 4194304 5683644 140734183632400 18446744073709551615 47692698078544 0 0 16781312 2 0 0 0 17 1 0 0 215
/proc/20002/statm: 324643 258474 1761 364 0 260567 0
Current children cumulated CPU time (s) 15.53
Current children cumulated vsize (KiB) 1298572
heavy processes:

[startup+51.1005 s]
/proc/loadavg: 1.09 0.29 0.10 3/178 20012
/proc/meminfo: memFree=27363272/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=1387708 CPUtime=41.13 cores=1,3,5,7
/proc/20002/stat : 20002 (python) R 20000 20002 19964 0 -1 4202496 723684 926 101 9 3999 114 0 0 25 0 1 0 616960532 1421012992 284312 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367195754 0 0 16781312 2 0 0 0 17 1 0 0 215
/proc/20002/statm: 346927 284312 1826 364 0 282851 0
Current children cumulated CPU time (s) 41.13
Current children cumulated vsize (KiB) 1387708

[startup+102.306 s]
/proc/loadavg: 3.24 0.98 0.34 6/190 20026
/proc/meminfo: memFree=26788884/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=1387708 CPUtime=92.34 cores=1,3,5,7
/proc/20002/stat : 20002 (python) R 20000 20002 19964 0 -1 4202496 723684 926 101 9 9120 114 0 0 25 0 1 0 616960532 1421012992 284312 33554432000 4194304 5683644 140734183632400 18446744073709551615 4523408 0 0 16781312 2 0 0 0 17 1 0 0 215
/proc/20002/statm: 346927 284312 1826 364 0 282851 0
Current children cumulated CPU time (s) 92.34
Current children cumulated vsize (KiB) 1387708

[startup+162.301 s]
/proc/loadavg: 4.40 1.72 0.63 6/190 20028
/proc/meminfo: memFree=26708820/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=1387708 CPUtime=152.33 cores=1,3,5,7
/proc/20002/stat : 20002 (python) R 20000 20002 19964 0 -1 4202496 723685 926 101 9 15119 114 0 0 25 0 1 0 616960532 1421012992 284313 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367204598 0 0 16781312 2 0 0 0 17 1 0 0 215
/proc/20002/statm: 346927 284313 1827 364 0 282851 0
Current children cumulated CPU time (s) 152.33
Current children cumulated vsize (KiB) 1387708

[startup+222.301 s]
/proc/loadavg: 4.82 2.33 0.91 6/195 20034
/proc/meminfo: memFree=26253780/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=1387708 CPUtime=212.34 cores=1,3,5,7
/proc/20002/stat : 20002 (python) R 20000 20002 19964 0 -1 4202496 901501 926 101 9 21100 134 0 0 25 0 1 0 616960532 1421012992 284319 33554432000 4194304 5683644 140734183632400 18446744073709551615 47692697839756 0 0 16781312 2 0 0 0 17 1 0 0 215
/proc/20002/statm: 346927 284319 1833 364 0 282851 0
Current children cumulated CPU time (s) 212.34
Current children cumulated vsize (KiB) 1387708

[startup+282.3 s]
/proc/loadavg: 4.93 2.81 1.16 6/195 20036
/proc/meminfo: memFree=26198196/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=1387708 CPUtime=272.34 cores=1,3,5,7
/proc/20002/stat : 20002 (python) R 20000 20002 19964 0 -1 4202496 901501 926 101 9 27100 134 0 0 25 0 1 0 616960532 1421012992 284319 33554432000 4194304 5683644 140734183632400 18446744073709551615 47692697839744 0 0 16781312 2 0 0 0 17 1 0 0 215
/proc/20002/statm: 346927 284319 1833 364 0 282851 0
Current children cumulated CPU time (s) 272.34
Current children cumulated vsize (KiB) 1387708

[startup+342.301 s]
/proc/loadavg: 6.37 3.56 1.51 9/207 20049
/proc/meminfo: memFree=24766444/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=904444 CPUtime=297.59 cores=1,3,5,7
/proc/20002/stat : 20002 (python) S 20000 20002 19964 0 -1 4202496 904204 926 101 9 29617 142 0 0 20 0 5 0 616960532 926150656 153308 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 215
/proc/20002/statm: 226111 153308 1881 364 0 162020 0
[pid=20037] ppid=20002 vsize=863432 CPUtime=0.05 cores=1,3,5,7
/proc/20037/stat : 20037 (python) S 20002 20002 19964 0 -1 4202560 990 0 0 0 2 3 0 0 18 0 1 0 616991277 884154368 151792 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566863 0 0 16781312 514 5712446691412508936 0 0 17 1 0 0 0
/proc/20037/statm: 215858 151792 381 364 0 151776 0
[pid=20039] ppid=20037 vsize=225336 CPUtime=34.76 cores=1,3,5,7
/proc/20039/stat : 20039 (lingeling) R 20037 20039 20039 0 -1 4202496 92496 0 0 0 3458 18 0 0 25 0 1 0 616991279 230744064 55504 33554432000 4194304 4352236 140736656165824 18446744073709551615 4207640 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/20039/statm: 56334 55504 129 39 0 55414 0
[pid=20040] ppid=20002 vsize=873688 CPUtime=0.05 cores=1,3,5,7
/proc/20040/stat : 20040 (python) S 20002 20002 19964 0 -1 4202560 928 0 0 0 2 3 0 0 18 0 1 0 616991280 894656512 151785 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566918 0 0 16781312 514 5712446691412508933 0 0 17 7 0 0 0
/proc/20040/statm: 218422 151785 370 364 0 154337 0
[pid=20042] ppid=20040 vsize=735204 CPUtime=34.48 cores=1,3,5,7
/proc/20042/stat : 20042 (precosat) R 20040 20042 20042 0 -1 4202496 183561 0 0 0 3412 36 0 0 25 0 1 0 616991282 752848896 176356 33554432000 4194304 4890832 140737031001744 18446744073709551615 4229338 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/20042/statm: 183801 176356 86 171 0 183628 0
[pid=20043] ppid=20002 vsize=883944 CPUtime=0.06 cores=1,3,5,7
/proc/20043/stat : 20043 (python) S 20002 20002 19964 0 -1 4202560 937 0 0 0 2 4 0 0 18 0 1 0 616991284 905158656 151789 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566918 0 0 16781312 514 5712446691412508934 0 0 17 7 0 0 0
/proc/20043/statm: 220986 151789 370 364 0 156898 0
[pid=20045] ppid=20043 vsize=206344 CPUtime=34.69 cores=1,3,5,7
/proc/20045/stat : 20045 (lingeling) R 20043 20045 20045 0 -1 4202496 86729 0 0 0 3453 16 0 0 25 0 1 0 616991285 211296256 49733 33554432000 4194304 4352236 140734462973872 18446744073709551615 4331541 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/20045/statm: 51586 49733 129 39 0 50666 0
[pid=20046] ppid=20002 vsize=894200 CPUtime=0.05 cores=1,3,5,7
/proc/20046/stat : 20046 (python) S 20002 20002 19964 0 -1 4202560 957 0 0 0 2 3 0 0 16 0 1 0 616991287 915660800 151793 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566918 0 0 16781312 514 5712446691412508933 0 0 17 3 0 0 0
/proc/20046/statm: 223550 151793 370 364 0 159459 0
[pid=20048] ppid=20046 vsize=894912 CPUtime=34.71 cores=1,3,5,7
/proc/20048/stat : 20048 (cryptominisat-2) R 20046 20048 20048 0 -1 4202496 204572 0 0 0 3439 32 0 0 25 0 1 0 616991289 916389888 195577 33554432000 4194304 4677096 140736234591792 18446744073709551615 4564230 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20048/statm: 223728 195577 379 118 0 218687 0
[pid=20002/tid=20038] ppid=20000 vsize=904444 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20038/stat : 20038 (python) S 20000 20002 19964 0 -1 4202560 25 926 0 9 0 0 0 0 25 0 5 0 616991278 926150656 153308 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 1 0 0 0
[pid=20002/tid=20041] ppid=20000 vsize=904444 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20041/stat : 20041 (python) S 20000 20002 19964 0 -1 4202560 20 926 0 9 0 0 0 0 25 0 5 0 616991282 926150656 153308 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 7 0 0 0
[pid=20002/tid=20044] ppid=20000 vsize=904444 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20044/stat : 20044 (python) S 20000 20002 19964 0 -1 4202560 23 926 0 9 0 0 0 0 20 0 5 0 616991285 926150656 153308 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 7 0 0 0
[pid=20002/tid=20047] ppid=20000 vsize=904444 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20047/stat : 20047 (python) S 20000 20002 19964 0 -1 4202560 30 926 0 9 0 0 0 0 20 0 5 0 616991289 926150656 153308 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 436.44
Current children cumulated vsize (KiB) 6481504

[startup+402.301 s]

################
# More data... #
################

/proc/20046/statm: 223550 151823 399 364 0 159459 0
[pid=20048] ppid=20046 vsize=3244464 CPUtime=486.72 cores=1,3,5,7
/proc/20048/stat : 20048 (cryptominisat-2) T 20046 20048 20048 0 -1 4202496 752826 0 0 0 48559 113 0 0 25 0 1 0 616991289 3322331136 656346 33554432000 4194304 4677096 140736234591792 18446744073709551615 4334213 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/20048/statm: 811116 656346 393 118 0 806075 0
[pid=20046/tid=20085] ppid=20002 vsize=894200 CPUtime=0 cores=1,3,5,7
/proc/20046/task/20085/stat : 20085 (python) S 20002 20002 19964 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 617040129 915660800 151823 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 514 18446604455566324928 0 0 -1 7 0 0 0
[pid=20064] ppid=20002 vsize=904456 CPUtime=0.38 cores=1,3,5,7
/proc/20064/stat : 20064 (python) S 20002 20002 19964 0 -1 4202560 1009 0 0 0 18 20 0 0 18 0 1 0 617020827 926162944 151797 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566918 0 0 16781312 514 5712446691412508936 0 0 17 3 0 0 0
/proc/20064/statm: 226114 151797 370 364 0 162020 0
[pid=20066] ppid=20064 vsize=426520 CPUtime=278.7 cores=1,3,5,7
/proc/20066/stat : 20066 (glucoser_static) R 20064 20066 20066 0 -1 4202496 102135 0 7 0 27845 25 0 0 25 0 1 0 617020828 436756480 101865 33554432000 134512640 134580299 4289469632 18446744073709551615 134528608 0 0 16781312 8388611 0 0 0 17 5 0 0 18
/proc/20066/statm: 106630 101865 243 17 0 105958 0
[pid=20067] ppid=20002 vsize=914712 CPUtime=0.15 cores=1,3,5,7
/proc/20067/stat : 20067 (python) S 20002 20002 19964 0 -1 4202560 1136 0 0 0 7 8 0 0 19 0 2 0 617021020 936665088 151831 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/20067/statm: 228678 151831 399 364 0 164581 0
[pid=20069] ppid=20067 vsize=739572 CPUtime=100.12 cores=1,3,5,7
/proc/20069/stat : 20069 (precosat) T 20067 20069 20069 0 -1 4202496 185251 0 0 0 9977 35 0 0 25 0 1 0 617021022 757321728 177778 33554432000 4194304 4890832 140735345884432 18446744073709551615 4236504 0 0 16781312 17442 18446744071562691360 0 0 17 5 0 0 0
/proc/20069/statm: 184893 177778 86 171 0 184720 0
[pid=20067/tid=20076] ppid=20002 vsize=914712 CPUtime=0 cores=1,3,5,7
/proc/20067/task/20076/stat : 20076 (python) S 20002 20002 19964 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 617031037 936665088 151831 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 514 18446604463740310784 0 0 -1 3 0 0 0
[pid=20077] ppid=20002 vsize=924968 CPUtime=0.24 cores=1,3,5,7
/proc/20077/stat : 20077 (python) S 20002 20002 19964 0 -1 4202560 1158 0 0 0 10 14 0 0 18 0 2 0 617031039 947167232 151835 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566918 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/20077/statm: 231242 151835 399 364 0 167142 0
[pid=20079] ppid=20077 vsize=222536 CPUtime=176.55 cores=1,3,5,7
/proc/20079/stat : 20079 (lingeling) R 20077 20079 20079 0 -1 4202496 147963 0 0 0 17628 27 0 0 25 0 1 0 617031041 227876864 54002 33554432000 4194304 4352236 140733673468304 18446744073709551615 4256382 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/20079/statm: 55634 54002 129 39 0 54714 0
[pid=20077/tid=20087] ppid=20002 vsize=924968 CPUtime=0 cores=1,3,5,7
/proc/20077/task/20087/stat : 20087 (python) S 20002 20002 19964 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 617041056 947167232 151835 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 514 18446604471161032832 0 0 -1 3 0 0 0
[pid=20082] ppid=20002 vsize=935224 CPUtime=0.14 cores=1,3,5,7
/proc/20082/stat : 20082 (python) S 20002 20002 19964 0 -1 4202560 1014 0 0 0 6 8 0 0 15 0 1 0 617039951 957669376 151815 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566918 0 0 16781312 514 6178666014163566854 0 0 17 3 0 0 0
/proc/20082/statm: 233806 151815 376 364 0 169703 0
[pid=20084] ppid=20082 vsize=1454852 CPUtime=87.91 cores=1,3,5,7
/proc/20084/stat : 20084 (cryptominisat-2) R 20082 20084 20084 0 -1 4202496 322205 0 0 0 8738 53 0 0 25 0 1 0 617039953 1489768448 302360 33554432000 4194304 4677096 140737451225392 18446744073709551615 4462641 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20084/statm: 363713 302360 391 118 0 358672 0
[pid=20002/tid=20038] ppid=20000 vsize=945468 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20038/stat : 20038 (python) S 20000 20002 19964 0 -1 4202560 35 926 0 9 0 0 0 0 18 0 9 0 616991278 968159232 153333 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 1 0 0 0
[pid=20002/tid=20041] ppid=20000 vsize=945468 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20041/stat : 20041 (python) S 20000 20002 19964 0 -1 4202560 26 926 0 9 0 0 0 0 18 0 9 0 616991282 968159232 153333 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 7 0 0 0
[pid=20002/tid=20044] ppid=20000 vsize=945468 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20044/stat : 20044 (python) S 20000 20002 19964 0 -1 4202560 26 926 0 9 0 0 0 0 18 0 9 0 616991285 968159232 153333 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 7 0 0 0
[pid=20002/tid=20047] ppid=20000 vsize=945468 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20047/stat : 20047 (python) S 20000 20002 19964 0 -1 4202560 30 926 0 9 0 0 0 0 20 0 9 0 616991289 968159232 153333 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
[pid=20002/tid=20065] ppid=20000 vsize=945468 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20065/stat : 20065 (python) S 20000 20002 19964 0 -1 4202560 32 926 0 9 0 0 0 0 20 0 9 0 617020828 968159232 153333 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
[pid=20002/tid=20068] ppid=20000 vsize=945468 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20068/stat : 20068 (python) S 20000 20002 19964 0 -1 4202560 26 926 0 9 0 0 0 0 20 0 9 0 617021022 968159232 153333 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
[pid=20002/tid=20078] ppid=20000 vsize=945468 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20078/stat : 20078 (python) S 20000 20002 19964 0 -1 4202560 33 926 0 9 0 0 0 0 18 0 9 0 617031041 968159232 153333 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
[pid=20002/tid=20083] ppid=20000 vsize=945468 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20083/stat : 20083 (python) S 20000 20002 19964 0 -1 4202560 28 926 0 9 0 0 0 0 20 0 9 0 617039953 968159232 153333 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2591.94
Current children cumulated vsize (KiB) 15293524



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+900.801 s]
/proc/loadavg: 8.06 7.42 4.50 9/237 20097
/proc/meminfo: memFree=20026060/32950928 swapFree=67111352/67111528
[pid=20002] ppid=20000 vsize=955724 CPUtime=297.95 cores=1,3,5,7
/proc/20002/stat : 20002 (python) S 20000 20002 19964 0 -1 4202496 908379 926 101 9 29644 151 0 0 19 0 10 0 616960532 978661376 153339 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 215
/proc/20002/statm: 238931 153339 1892 364 0 174825 0
[pid=20037] ppid=20002 vsize=873676 CPUtime=0.54 cores=1,3,5,7
/proc/20037/stat : 20037 (python) S 20002 20002 19964 0 -1 4202560 1214 0 0 0 28 26 0 0 18 0 2 0 616991277 894644224 151831 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566918 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/20037/statm: 218419 151831 415 364 0 154337 0
[pid=20039] ppid=20037 vsize=161236 CPUtime=398.61 cores=1,3,5,7
/proc/20039/stat : 20039 (lingeling) R 20037 20039 20039 0 -1 4202496 193800 0 0 0 39830 31 0 0 25 0 1 0 616991279 165105664 39479 33554432000 4194304 4352236 140736656165824 18446744073709551615 4234669 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/20039/statm: 40309 39479 129 39 0 39389 0
[pid=20037/tid=20052] ppid=20002 vsize=873676 CPUtime=0 cores=1,3,5,7
/proc/20037/task/20052/stat : 20052 (python) S 20002 20002 19964 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 617001293 894644224 151831 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 514 18446604471139924800 0 0 -1 1 0 0 0
[pid=20040] ppid=20002 vsize=873688 CPUtime=0.41 cores=1,3,5,7
/proc/20040/stat : 20040 (python) S 20002 20002 19964 0 -1 4202560 1136 0 0 0 20 21 0 0 18 0 2 0 616991280 894656512 151815 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20040/statm: 218422 151815 399 364 0 154337 0
[pid=20042] ppid=20040 vsize=735204 CPUtime=294.24 cores=1,3,5,7
/proc/20042/stat : 20042 (precosat) T 20040 20042 20042 0 -1 4202496 186686 0 0 0 29387 37 0 0 25 0 1 0 616991282 752848896 179481 33554432000 4194304 4890832 140737031001744 18446744073709551615 4238327 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/20042/statm: 183801 179481 86 171 0 183628 0
[pid=20040/tid=20053] ppid=20002 vsize=873688 CPUtime=0 cores=1,3,5,7
/proc/20040/task/20053/stat : 20053 (python) S 20002 20002 19964 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 617001296 894656512 151815 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 514 18446604455566326720 0 0 -1 7 0 0 0
[pid=20043] ppid=20002 vsize=883944 CPUtime=0.67 cores=1,3,5,7
/proc/20043/stat : 20043 (python) S 20002 20002 19964 0 -1 4202560 1157 0 0 0 33 34 0 0 18 0 2 0 616991284 905158656 151819 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20043/statm: 220986 151819 399 364 0 156898 0
[pid=20045] ppid=20043 vsize=157904 CPUtime=486.19 cores=1,3,5,7
/proc/20045/stat : 20045 (lingeling) T 20043 20045 20045 0 -1 4202496 201841 0 0 0 48589 30 0 0 25 0 1 0 616991285 161693696 38646 33554432000 4194304 4352236 140734462973872 18446744073709551615 4233979 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/20045/statm: 39476 38646 129 39 0 38556 0
[pid=20043/tid=20054] ppid=20002 vsize=883944 CPUtime=0 cores=1,3,5,7
/proc/20043/task/20054/stat : 20054 (python) S 20002 20002 19964 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 617001300 905158656 151819 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 514 18446604455566325824 0 0 -1 7 0 0 0
[pid=20046] ppid=20002 vsize=894200 CPUtime=0.73 cores=1,3,5,7
/proc/20046/stat : 20046 (python) S 20002 20002 19964 0 -1 4202560 1187 0 0 0 37 36 0 0 17 0 2 0 616991287 915660800 151823 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20046/statm: 223550 151823 399 364 0 159459 0
[pid=20048] ppid=20046 vsize=3244464 CPUtime=486.72 cores=1,3,5,7
/proc/20048/stat : 20048 (cryptominisat-2) T 20046 20048 20048 0 -1 4202496 752826 0 0 0 48559 113 0 0 25 0 1 0 616991289 3322331136 656346 33554432000 4194304 4677096 140736234591792 18446744073709551615 4334213 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/20048/statm: 811116 656346 393 118 0 806075 0
[pid=20046/tid=20085] ppid=20002 vsize=894200 CPUtime=0 cores=1,3,5,7
/proc/20046/task/20085/stat : 20085 (python) S 20002 20002 19964 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 617040129 915660800 151823 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 514 18446604455566324928 0 0 -1 7 0 0 0
[pid=20064] ppid=20002 vsize=904456 CPUtime=0.42 cores=1,3,5,7
/proc/20064/stat : 20064 (python) S 20002 20002 19964 0 -1 4202560 1171 0 0 0 20 22 0 0 18 0 2 0 617020827 926162944 151827 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566918 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/20064/statm: 226114 151827 399 364 0 162020 0
[pid=20066] ppid=20064 vsize=427848 CPUtime=297.16 cores=1,3,5,7
/proc/20066/stat : 20066 (glucoser_static) R 20064 20066 20066 0 -1 4202496 102480 0 7 0 29691 25 0 0 25 0 1 0 617020828 438116352 102210 33554432000 134512640 134580299 4289469632 18446744073709551615 134546826 0 0 16781312 8388611 0 0 0 17 5 0 0 18
/proc/20066/statm: 106962 102210 243 17 0 106290 0
[pid=20064/tid=20094] ppid=20002 vsize=904456 CPUtime=0 cores=1,3,5,7
/proc/20064/task/20094/stat : 20094 (python) S 20002 20002 19964 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 617050066 926162944 151827 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 514 18446604463740309888 0 0 -1 5 0 0 0
[pid=20067] ppid=20002 vsize=914712 CPUtime=0.15 cores=1,3,5,7
/proc/20067/stat : 20067 (python) S 20002 20002 19964 0 -1 4202560 1136 0 0 0 7 8 0 0 19 0 2 0 617021020 936665088 151831 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/20067/statm: 228678 151831 399 364 0 164581 0
[pid=20069] ppid=20067 vsize=739572 CPUtime=100.12 cores=1,3,5,7
/proc/20069/stat : 20069 (precosat) T 20067 20069 20069 0 -1 4202496 185251 0 0 0 9977 35 0 0 25 0 1 0 617021022 757321728 177778 33554432000 4194304 4890832 140735345884432 18446744073709551615 4236504 0 0 16781312 17442 18446744071562691360 0 0 17 5 0 0 0
/proc/20069/statm: 184893 177778 86 171 0 184720 0
[pid=20067/tid=20076] ppid=20002 vsize=914712 CPUtime=0 cores=1,3,5,7
/proc/20067/task/20076/stat : 20076 (python) S 20002 20002 19964 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 617031037 936665088 151831 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 514 18446604463740310784 0 0 -1 3 0 0 0
[pid=20077] ppid=20002 vsize=924968 CPUtime=0.28 cores=1,3,5,7
/proc/20077/stat : 20077 (python) S 20002 20002 19964 0 -1 4202560 1164 0 0 0 12 16 0 0 18 0 2 0 617031039 947167232 151835 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/20077/statm: 231242 151835 399 364 0 167142 0
[pid=20079] ppid=20077 vsize=222536 CPUtime=194.55 cores=1,3,5,7
/proc/20079/stat : 20079 (lingeling) T 20077 20079 20079 0 -1 4202496 147963 0 0 0 19428 27 0 0 25 0 1 0 617031041 227876864 54002 33554432000 4194304 4352236 140733673468304 18446744073709551615 4328100 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/20079/statm: 55634 54002 129 39 0 54714 0
[pid=20077/tid=20087] ppid=20002 vsize=924968 CPUtime=0 cores=1,3,5,7
/proc/20077/task/20087/stat : 20087 (python) S 20002 20002 19964 0 -1 4202560 50 0 0 0 0 0 0 0 18 0 2 0 617041056 947167232 151835 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 514 18446604471161032832 0 0 -1 3 0 0 0
[pid=20082] ppid=20002 vsize=935224 CPUtime=0.17 cores=1,3,5,7
/proc/20082/stat : 20082 (python) S 20002 20002 19964 0 -1 4202560 1023 0 0 0 8 9 0 0 15 0 1 0 617039951 957669376 151815 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566918 0 0 16781312 514 6178666014163566854 0 0 17 3 0 0 0
/proc/20082/statm: 233806 151815 376 364 0 169703 0
[pid=20084] ppid=20082 vsize=1483720 CPUtime=106.41 cores=1,3,5,7
/proc/20084/stat : 20084 (cryptominisat-2) R 20082 20084 20084 0 -1 4202496 330169 0 0 0 10586 55 0 0 25 0 1 0 617039953 1519329280 310324 33554432000 4194304 4677096 140737451225392 18446744073709551615 4319643 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20084/statm: 370930 310324 391 118 0 365889 0
[pid=20095] ppid=20002 vsize=945480 CPUtime=0.01 cores=1,3,5,7
/proc/20095/stat : 20095 (python) S 20002 20002 19964 0 -1 4202560 766 0 0 0 0 1 0 0 19 0 1 0 617050573 968171520 151786 33554432000 4194304 5683644 140734183632400 18446744073709551615 251367566918 0 0 16781312 514 6923088712481898495 0 0 17 3 0 0 0
/proc/20095/statm: 236370 151786 343 364 0 172264 0
[pid=20097] ppid=20095 vsize=28476 CPUtime=0.36 cores=1,3,5,7
/proc/20097/stat : 20097 (lingeling) R 20095 20097 20097 0 -1 4202496 6600 0 0 0 34 2 0 0 21 0 1 0 617050575 29159424 6289 33554432000 4194304 4352236 140735583273856 18446744073709551615 251367546624 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/20097/statm: 7119 6289 103 39 0 6199 0
[pid=20002/tid=20038] ppid=20000 vsize=955724 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20038/stat : 20038 (python) S 20000 20002 19964 0 -1 4202560 35 926 0 9 0 0 0 0 18 0 10 0 616991278 978661376 153339 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 1 0 0 0
[pid=20002/tid=20041] ppid=20000 vsize=955724 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20041/stat : 20041 (python) S 20000 20002 19964 0 -1 4202560 26 926 0 9 0 0 0 0 18 0 10 0 616991282 978661376 153339 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 7 0 0 0
[pid=20002/tid=20044] ppid=20000 vsize=955724 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20044/stat : 20044 (python) S 20000 20002 19964 0 -1 4202560 26 926 0 9 0 0 0 0 18 0 10 0 616991285 978661376 153339 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 7 0 0 0
[pid=20002/tid=20047] ppid=20000 vsize=955724 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20047/stat : 20047 (python) S 20000 20002 19964 0 -1 4202560 30 926 0 9 0 0 0 0 20 0 10 0 616991289 978661376 153339 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
[pid=20002/tid=20065] ppid=20000 vsize=955724 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20065/stat : 20065 (python) S 20000 20002 19964 0 -1 4202560 36 926 0 9 0 0 0 0 18 0 10 0 617020828 978661376 153339 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
[pid=20002/tid=20068] ppid=20000 vsize=955724 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20068/stat : 20068 (python) S 20000 20002 19964 0 -1 4202560 26 926 0 9 0 0 0 0 20 0 10 0 617021022 978661376 153339 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
[pid=20002/tid=20078] ppid=20000 vsize=955724 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20078/stat : 20078 (python) S 20000 20002 19964 0 -1 4202560 33 926 0 9 0 0 0 0 18 0 10 0 617031041 978661376 153339 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
[pid=20002/tid=20083] ppid=20000 vsize=955724 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20083/stat : 20083 (python) S 20000 20002 19964 0 -1 4202560 28 926 0 9 0 0 0 0 20 0 10 0 617039953 978661376 153339 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
[pid=20002/tid=20096] ppid=20000 vsize=955724 CPUtime=0 cores=1,3,5,7
/proc/20002/task/20096/stat : 20096 (python) S 20000 20002 19964 0 -1 4202560 30 926 0 9 0 0 0 0 20 0 10 0 617050574 978661376 153339 33554432000 4194304 5683644 140734183632400 18446744073709551615 251379370417 0 0 16781312 2 18446604463114537728 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2665.69
Current children cumulated vsize (KiB) 16307032

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20002 and gives
#  childrusage.ru_utime.tv_sec=296
#  childrusage.ru_utime.tv_usec=453932
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=548764
# CPU time returned by wait4() is 298.003
# while last known CPU time is 2665.69
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.903
CPU time (s): 2665.69
CPU user time (s): 2658.9
CPU system time (s): 6.79
CPU usage (%): 295.891
Max. virtual memory (cumulated for all children) (KiB): 16307032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 296.454
system time used= 1.54876
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 909311
page faults= 110
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17354
involuntary context switches= 595

runsolver used 1.92371 second user time and 4.33934 second system time

The end

Launcher Data 

Begin job on node113 at 2011-05-01 18:28:17
IDJOB=3317721
IDBENCH=20580
IDSOLVER=1706
FILE ID=node113/3317721-1304267293
RUNJOBID= node113-1304267292-19983
PBS_JOBID= 13173966
Free space on /tmp= 72268 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT07/industrial/vliw_unsat_2.0/9dlx_vliw_at_b_iq7.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317721-1304267293/watcher-3317721-1304267293 -o /tmp/evaluation-result-3317721-1304267293/solver-3317721-1304267293 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317721-1304267293.cnf -seed 832098950 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0fbc00fde383cec371bb97d621c5e7e5
RANDOM SEED=832098950

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      28692792 kB
Buffers:        797664 kB
Cached:        2881492 kB
SwapCached:         12 kB
Active:         511916 kB
Inactive:      3234148 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      28692792 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:          211760 kB
Writeback:           0 kB
AnonPages:       67276 kB
Mapped:          16212 kB
Slab:           447552 kB
PageTables:       4704 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   209812 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72236 MiB
End job on node113 at 2011-05-01 18:43:22