Trace number 3321419

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrialUNSAT 1314.64 195.035

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l46_lambda.cnf
MD5SUMeb4d0d02a25a8a84182ddd3b6d1fa8b5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark79.111
Satisfiable
(Un)Satisfiability was proved
Number of variables33090
Number of clauses165828
Sum of the clauses size478271
Maximum clause length9
Minimum clause length1
Number of clauses of size 14268
Number of clauses of size 241089
Number of clauses of size 397665
Number of clauses of size 415752
Number of clauses of size 56916
Number of clauses of size over 5138

Solver Data

0.33/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.33/0.67	c INFO: solving HOME/instance-3321419-1304339564.cnf
0.33/0.67	c INFO: computing task features
0.90/1.22	c INFO: computed variable-clause graph statistics
0.90/1.24	c INFO: computed clause balance statistics
3.81/4.16	c INFO: computed variable balance statistics
6.11/6.45	c INFO: computed small-clause counts
6.11/6.46	c INFO: computed Horn-clause counts
7.51/7.85	c INFO: computed variable graph statistics
7.51/7.85	c INFO: collected features for HOME/instance-3321419-1304339564.cnf in 7.16 s
7.51/7.88	c INFO: running lingeling-276@0 for 97 with 39992 remaining (b = 0.30)
7.61/7.91	c INFO: running cryptominisat-2.9.0@0 for 485 with 39992 remaining (b = 0.30)
7.61/7.94	c INFO: running lingeling-276@0 for 1261 with 39992 remaining (b = 0.45)
7.61/7.97	c INFO: running lingeling-276@0 for 1261 with 39992 remaining (b = 0.38)
7.71/8.01	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39992 remaining (b = 0.47)
7.71/8.04	c INFO: running SApperloT@0 for 97 with 39992 remaining (b = 0.03)
7.71/8.07	c INFO: running precosat-570@0 for 388 with 39992 remaining (b = 0.17)
7.80/8.10	c INFO: running lingeling-276@0 for 1261 with 39992 remaining (b = 0.29)
706.93/108.06	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39892 remaining (b = 0.42)
708.17/108.24	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39892 remaining (b = 0.37)
1314.55/195.00	s UNSATISFIABLE

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321419-1304339564/watcher-3321419-1304339564 -o /tmp/evaluation-result-3321419-1304339564/solver-3321419-1304339564 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321419-1304339564.cnf -seed 3020936 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.19 9.06 8.65 3/208 5084
/proc/meminfo: memFree=27471024/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=15384 CPUtime=0 cores=0-7
/proc/5084/stat : 5084 (python) R 5082 5084 4539 0 -1 4202496 790 0 0 0 0 0 0 0 22 0 1 0 1565848 15753216 678 33554432000 4194304 5683644 140734472918304 18446744073709551615 4567033 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/5084/statm: 3845 677 322 364 0 332 0

[startup+0.0244831 s]
/proc/loadavg: 9.19 9.06 8.65 3/208 5084
/proc/meminfo: memFree=27471024/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=16244 CPUtime=0.01 cores=0-7
/proc/5084/stat : 5084 (python) R 5082 5084 4539 0 -1 4202496 1065 0 0 0 1 0 0 0 22 0 1 0 1565848 16633856 935 33554432000 4194304 5683644 140734472918304 18446744073709551615 4608768 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/5084/statm: 4100 939 382 364 0 587 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16244

[startup+0.100469 s]
/proc/loadavg: 9.19 9.06 8.65 3/208 5084
/proc/meminfo: memFree=27471024/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=87708 CPUtime=0.05 cores=0-7
/proc/5084/stat : 5084 (python) R 5082 5084 4539 0 -1 4202496 2638 0 0 0 4 1 0 0 18 0 1 0 1565848 89812992 2354 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880563200 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/5084/statm: 21927 2354 717 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 87708

[startup+0.300474 s]
/proc/loadavg: 9.19 9.06 8.65 3/208 5084
/proc/meminfo: memFree=27471024/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=135752 CPUtime=0.17 cores=0-7
/proc/5084/stat : 5084 (python) S 5082 5084 4539 0 -1 4202496 5963 931 1 0 13 4 0 0 17 0 1 0 1565848 139010048 4150 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880561157 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/5084/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135752

[startup+0.700363 s]
/proc/loadavg: 9.19 9.06 8.65 3/208 5084
/proc/meminfo: memFree=27471024/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=282640 CPUtime=0.4 cores=0-7
/proc/5084/stat : 5084 (python) R 5082 5084 4539 0 -1 4202496 10305 931 1 0 31 9 0 0 16 0 1 0 1565848 289423360 7985 33554432000 4194304 5683644 140734472918304 18446744073709551615 47801840471769 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/5084/statm: 70660 7985 1761 364 0 6584 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 282640

[startup+1.5002 s]
/proc/loadavg: 9.19 9.06 8.65 3/209 5089
/proc/meminfo: memFree=27426492/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=314632 CPUtime=1.21 cores=0-7
/proc/5084/stat : 5084 (python) R 5082 5084 4539 0 -1 4202496 22707 931 1 0 109 12 0 0 17 0 1 0 1565848 322183168 16042 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880225585 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/5084/statm: 78658 16042 1826 364 0 14582 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 314632

[startup+3.10094 s]
/proc/loadavg: 9.19 9.06 8.65 3/209 5089
/proc/meminfo: memFree=27412748/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=314632 CPUtime=2.81 cores=0-7
/proc/5084/stat : 5084 (python) R 5082 5084 4539 0 -1 4202496 22707 931 1 0 269 12 0 0 19 0 1 0 1565848 322183168 16042 33554432000 4194304 5683644 140734472918304 18446744073709551615 4578842 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/5084/statm: 78658 16042 1826 364 0 14582 0
Current children cumulated CPU time (s) 2.81
Current children cumulated vsize (KiB) 314632

[startup+6.30038 s]
/proc/loadavg: 8.61 8.94 8.62 3/209 5089
/proc/meminfo: memFree=27413408/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=314632 CPUtime=6.01 cores=0-7
/proc/5084/stat : 5084 (python) R 5082 5084 4539 0 -1 4202496 22708 931 1 0 589 12 0 0 25 0 1 0 1565848 322183168 16043 33554432000 4194304 5683644 140734472918304 18446744073709551615 47801672386255 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/5084/statm: 78658 16043 1827 364 0 14582 0
Current children cumulated CPU time (s) 6.01
Current children cumulated vsize (KiB) 314632

[startup+12.7012 s]
/proc/loadavg: 8.64 8.94 8.62 11/233 5114
/proc/meminfo: memFree=27189788/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=393704 CPUtime=7.81 cores=0-7
/proc/5084/stat : 5084 (python) S 5082 5084 4539 0 -1 4202496 28776 931 1 0 767 14 0 0 25 0 9 0 1565848 403152896 15390 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892391883 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5084/statm: 98426 15390 1889 364 0 34323 0
[pid=5091] ppid=5084 vsize=311668 CPUtime=0 cores=0-7
/proc/5091/stat : 5091 (python) S 5084 5084 4539 0 -1 4202560 919 0 0 0 0 0 0 0 18 0 1 0 1566637 319148032 13845 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585231 0 0 16781312 514 4097968076824215811 0 0 17 0 0 0 0
/proc/5091/statm: 77917 13845 376 364 0 13835 0
[pid=5093] ppid=5091 vsize=13640 CPUtime=4.8 cores=0-7
/proc/5093/stat : 5093 (lingeling) R 5091 5093 5093 0 -1 4202496 6141 0 0 0 479 1 0 0 25 0 1 0 1566637 13967360 2579 33554432000 4194304 4352236 140737039626656 18446744073709551615 4208082 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/5093/statm: 3410 2579 129 39 0 2490 0
[pid=5094] ppid=5084 vsize=321924 CPUtime=0 cores=0-7
/proc/5094/stat : 5094 (python) S 5084 5084 4539 0 -1 4202560 904 0 0 0 0 0 0 0 15 0 1 0 1566640 329650176 13843 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 4132518030703821060 0 0 17 1 0 0 0
/proc/5094/statm: 80481 13843 370 364 0 16396 0
[pid=5096] ppid=5094 vsize=75324 CPUtime=2.51 cores=0-7
/proc/5096/stat : 5096 (cryptominisat-2) R 5094 5096 5096 0 -1 4202496 14681 0 0 0 249 2 0 0 25 0 1 0 1566641 77131776 10771 33554432000 4194304 4677096 140736408852352 18446744073709551615 4334785 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/5096/statm: 18831 10771 390 118 0 13790 0
[pid=5097] ppid=5084 vsize=332180 CPUtime=0 cores=0-7
/proc/5097/stat : 5097 (python) S 5084 5084 4539 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 1566643 340152320 13847 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 4132521878994518275 0 0 17 4 0 0 0
/proc/5097/statm: 83045 13847 370 364 0 18957 0
[pid=5099] ppid=5097 vsize=13728 CPUtime=4.73 cores=0-7
/proc/5099/stat : 5099 (lingeling) R 5097 5099 5099 0 -1 4202496 6165 0 0 0 473 0 0 0 25 0 1 0 1566644 14057472 2602 33554432000 4194304 4352236 140733569145536 18446744073709551615 4328392 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/5099/statm: 3432 2602 129 39 0 2512 0
[pid=5100] ppid=5084 vsize=342436 CPUtime=0.01 cores=0-7
/proc/5100/stat : 5100 (python) S 5084 5084 4539 0 -1 4202560 936 0 0 0 0 1 0 0 18 0 1 0 1566646 350654464 13851 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 4085135951494349059 0 0 17 1 0 0 0
/proc/5100/statm: 85609 13851 370 364 0 21518 0
[pid=5102] ppid=5100 vsize=13512 CPUtime=4.67 cores=0-7
/proc/5102/stat : 5102 (lingeling) R 5100 5102 5102 0 -1 4202496 6037 0 0 0 466 1 0 0 25 0 1 0 1566647 13836288 2548 33554432000 4194304 4352236 140734937758320 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/5102/statm: 3378 2548 129 39 0 2458 0
[pid=5103] ppid=5084 vsize=352692 CPUtime=0 cores=0-7
/proc/5103/stat : 5103 (python) S 5084 5084 4539 0 -1 4202560 947 0 0 0 0 0 0 0 15 0 1 0 1566649 361156608 13855 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 14331078541192429828 0 0 17 1 0 0 0
/proc/5103/statm: 88173 13855 370 364 0 24079 0
[pid=5105] ppid=5103 vsize=85404 CPUtime=4.64 cores=0-7
/proc/5105/stat : 5105 (cryptominisat-2) R 5103 5105 5105 0 -1 4202496 18440 0 0 0 462 2 0 0 25 0 1 0 1566650 87453696 13662 33554432000 4194304 4677096 140734430468352 18446744073709551615 4334807 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/5105/statm: 21351 13662 394 118 0 16310 0
[pid=5106] ppid=5084 vsize=362948 CPUtime=0 cores=0-7
/proc/5106/stat : 5106 (python) S 5084 5084 4539 0 -1 4202560 952 0 0 0 0 0 0 0 18 0 1 0 1566653 371658752 13859 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 4482748768034193667 0 0 17 0 0 0 0
/proc/5106/statm: 90737 13859 370 364 0 26640 0
[pid=5108] ppid=5106 vsize=15384 CPUtime=4.6 cores=0-7
/proc/5108/stat : 5108 (SApperloT-base) R 5106 5108 5108 0 -1 4202496 3699 0 0 0 459 1 0 0 25 0 1 0 1566653 15753216 3400 33554432000 134512640 135674940 4292839504 18446744073709551615 134550591 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/5108/statm: 3846 3400 99 284 0 3560 0
[pid=5109] ppid=5084 vsize=373204 CPUtime=0 cores=0-7
/proc/5109/stat : 5109 (python) S 5084 5084 4539 0 -1 4202560 943 0 0 0 0 0 0 0 18 0 1 0 1566656 382160896 13863 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 3307036861284712708 0 0 17 6 0 0 0
/proc/5109/statm: 93301 13863 370 364 0 29201 0
[pid=5111] ppid=5109 vsize=45132 CPUtime=2.25 cores=0-7
/proc/5111/stat : 5111 (precosat) R 5109 5111 5111 0 -1 4202496 11488 0 0 0 223 2 0 0 25 0 1 0 1566658 46215168 10660 33554432000 4194304 4890832 140736952325760 18446744073709551615 4239076 0 0 16781312 17442 0 0 0 17 3 0 0 0
/proc/5111/statm: 11283 10660 86 171 0 11110 0
[pid=5112] ppid=5084 vsize=383460 CPUtime=0 cores=0-7
/proc/5112/stat : 5112 (python) S 5084 5084 4539 0 -1 4202560 1004 0 0 0 0 0 0 0 18 0 1 0 1566659 392663040 13873 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 4265516606467080191 0 0 17 6 0 0 0
/proc/5112/statm: 95865 13873 376 364 0 31762 0
[pid=5114] ppid=5112 vsize=13520 CPUtime=4.56 cores=0-7
/proc/5114/stat : 5114 (lingeling) R 5112 5114 5114 0 -1 4202496 6048 0 0 0 455 1 0 0 25 0 1 0 1566660 13844480 2550 33554432000 4194304 4352236 140734708224944 18446744073709551615 4331541 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/5114/statm: 3380 2550 129 39 0 2460 0
[pid=5084/tid=5092] ppid=5082 vsize=393704 CPUtime=0 cores=0-7
/proc/5084/task/5092/stat : 5092 (python) S 5082 5084 4539 0 -1 4202560 26 931 0 0 0 0 0 0 25 0 9 0 1566637 403152896 15390 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 2 0 0 0
[pid=5084/tid=5095] ppid=5082 vsize=393704 CPUtime=0 cores=0-7
/proc/5084/task/5095/stat : 5095 (python) S 5082 5084 4539 0 -1 4202560 20 931 0 0 0 0 0 0 19 0 9 0 1566640 403152896 15390 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5098] ppid=5082 vsize=393704 CPUtime=0 cores=0-7
/proc/5084/task/5098/stat : 5098 (python) S 5082 5084 4539 0 -1 4202560 24 931 0 0 0 0 0 0 21 0 9 0 1566643 403152896 15390 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 4 0 0 0
[pid=5084/tid=5101] ppid=5082 vsize=393704 CPUtime=0 cores=0-7
/proc/5084/task/5101/stat : 5101 (python) S 5082 5084 4539 0 -1 4202560 21 931 0 0 0 0 0 0 19 0 9 0 1566646 403152896 15390 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5104] ppid=5082 vsize=393704 CPUtime=0 cores=0-7
/proc/5084/task/5104/stat : 5104 (python) S 5082 5084 4539 0 -1 4202560 25 931 0 0 0 0 0 0 21 0 9 0 1566650 403152896 15390 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5107] ppid=5082 vsize=393704 CPUtime=0 cores=0-7
/proc/5084/task/5107/stat : 5107 (python) S 5082 5084 4539 0 -1 4202560 23 931 0 0 0 0 0 0 23 0 9 0 1566653 403152896 15390 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5110] ppid=5082 vsize=393704 CPUtime=0 cores=0-7
/proc/5084/task/5110/stat : 5110 (python) S 5082 5084 4539 0 -1 4202560 26 931 0 0 0 0 0 0 25 0 9 0 1566656 403152896 15390 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5113] ppid=5082 vsize=393704 CPUtime=0 cores=0-7
/proc/5084/task/5113/stat : 5113 (python) S 5082 5084 4539 0 -1 4202560 31 931 0 0 0 0 0 0 25 0 9 0 1566660 403152896 15390 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40.58
Current children cumulated vsize (KiB) 3449860

[startup+25.502 s]
/proc/loadavg: 8.72 8.94 8.62 10/233 5114
/proc/meminfo: memFree=27154100/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=393704 CPUtime=7.81 cores=0-7
/proc/5084/stat : 5084 (python) S 5082 5084 4539 0 -1 4202496 28776 931 1 0 767 14 0 0 25 0 9 0 1565848 403152896 15390 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892391883 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5084/statm: 98426 15390 1889 364 0 34323 0
[pid=5091] ppid=5084 vsize=311668 CPUtime=0.02 cores=0-7
/proc/5091/stat : 5091 (python) S 5084 5084 4539 0 -1 4202560 925 0 0 0 1 1 0 0 18 0 1 0 1566637 319148032 13845 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585231 0 0 16781312 514 12583039766687088899 0 0 17 0 0 0 0
/proc/5091/statm: 77917 13845 376 364 0 13835 0
[pid=5093] ppid=5091 vsize=15900 CPUtime=17.6 cores=0-7
/proc/5093/stat : 5093 (lingeling) R 5091 5093 5093 0 -1 4202496 6782 0 0 0 1759 1 0 0 25 0 1 0 1566637 16281600 3144 33554432000 4194304 4352236 140737039626656 18446744073709551615 4329346 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/5093/statm: 3975 3144 129 39 0 3055 0
[pid=5094] ppid=5084 vsize=321924 CPUtime=0.04 cores=0-7
/proc/5094/stat : 5094 (python) S 5084 5084 4539 0 -1 4202560 919 0 0 0 2 2 0 0 15 0 1 0 1566640 329650176 13843 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 5625783189206171908 0 0 17 1 0 0 0
/proc/5094/statm: 80481 13843 370 364 0 16396 0
[pid=5096] ppid=5094 vsize=88596 CPUtime=8.91 cores=0-7
/proc/5096/stat : 5096 (cryptominisat-2) R 5094 5096 5096 0 -1 4202496 21858 0 0 0 888 3 0 0 25 0 1 0 1566641 90722304 14055 33554432000 4194304 4677096 140736408852352 18446744073709551615 4319998 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/5096/statm: 22149 14055 394 118 0 17108 0
[pid=5097] ppid=5084 vsize=332180 CPUtime=0.02 cores=0-7
/proc/5097/stat : 5097 (python) S 5084 5084 4539 0 -1 4202560 909 0 0 0 1 1 0 0 18 0 1 0 1566643 340152320 13847 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088899 0 0 17 4 0 0 0
/proc/5097/statm: 83045 13847 370 364 0 18957 0
[pid=5099] ppid=5097 vsize=15480 CPUtime=17.51 cores=0-7
/proc/5099/stat : 5099 (lingeling) R 5097 5099 5099 0 -1 4202496 6676 0 0 0 1751 0 0 0 25 0 1 0 1566644 15851520 3040 33554432000 4194304 4352236 140733569145536 18446744073709551615 4328359 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/5099/statm: 3870 3040 129 39 0 2950 0
[pid=5100] ppid=5084 vsize=342436 CPUtime=0.02 cores=0-7
/proc/5100/stat : 5100 (python) S 5084 5084 4539 0 -1 4202560 942 0 0 0 1 1 0 0 18 0 1 0 1566646 350654464 13851 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088899 0 0 17 1 0 0 0
/proc/5100/statm: 85609 13851 370 364 0 21518 0
[pid=5102] ppid=5100 vsize=15744 CPUtime=17.37 cores=0-7
/proc/5102/stat : 5102 (lingeling) R 5100 5102 5102 0 -1 4202496 6672 0 0 0 1736 1 0 0 25 0 1 0 1566647 16121856 3106 33554432000 4194304 4352236 140734937758320 18446744073709551615 4329063 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/5102/statm: 3936 3106 129 39 0 3016 0
[pid=5103] ppid=5084 vsize=352692 CPUtime=0.03 cores=0-7
/proc/5103/stat : 5103 (python) S 5084 5084 4539 0 -1 4202560 964 0 0 0 2 1 0 0 15 0 1 0 1566649 361156608 13855 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 14331078541192429828 0 0 17 1 0 0 0
/proc/5103/statm: 88173 13855 370 364 0 24079 0
[pid=5105] ppid=5103 vsize=96536 CPUtime=17.37 cores=0-7
/proc/5105/stat : 5105 (cryptominisat-2) R 5103 5105 5105 0 -1 4202496 24704 0 0 0 1732 5 0 0 25 0 1 0 1566650 98852864 16327 33554432000 4194304 4677096 140734430468352 18446744073709551615 4358608 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/5105/statm: 24134 16327 394 118 0 19093 0

################
# More data... #
################

/proc/5112/stat : 5112 (python) S 5084 5084 4539 0 -1 4202560 1065 0 0 0 13 14 0 0 18 0 1 0 1566659 392663040 13873 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088899 0 0 17 6 0 0 0
/proc/5112/statm: 95865 13873 376 364 0 31762 0
[pid=5114] ppid=5112 vsize=27120 CPUtime=186.28 cores=0-7
/proc/5114/stat : 5114 (lingeling) R 5112 5114 5114 0 -1 4202496 10873 0 0 0 18627 1 0 0 25 0 1 0 1566660 27770880 5958 33554432000 4194304 4352236 140734708224944 18446744073709551615 4328390 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/5114/statm: 6780 5958 129 39 0 5860 0
[pid=5119] ppid=5084 vsize=393716 CPUtime=0.16 cores=0-7
/proc/5119/stat : 5119 (python) S 5084 5084 4539 0 -1 4202560 1011 0 0 0 8 8 0 0 15 0 1 0 1576655 403165184 13871 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088900 0 0 17 6 0 0 0
/proc/5119/statm: 98429 13871 370 364 0 34323 0
[pid=5121] ppid=5119 vsize=111148 CPUtime=86.63 cores=0-7
/proc/5121/stat : 5121 (cryptominisat-2) R 5119 5121 5121 0 -1 4202496 41714 0 0 0 8655 8 0 0 25 0 1 0 1576655 113815552 18564 33554432000 4194304 4677096 140735967045584 18446744073709551615 4346693 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/5121/statm: 27787 18564 394 118 0 22746 0
[pid=5123] ppid=5084 vsize=403972 CPUtime=0.15 cores=0-7
/proc/5123/stat : 5123 (python) S 5084 5084 4539 0 -1 4202560 1011 0 0 0 8 7 0 0 15 0 1 0 1576673 413667328 13875 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088899 0 0 17 6 0 0 0
/proc/5123/statm: 100993 13875 370 364 0 36884 0
[pid=5125] ppid=5123 vsize=111972 CPUtime=85.85 cores=0-7
/proc/5125/stat : 5125 (cryptominisat-2) R 5123 5125 5125 0 -1 4202496 40605 0 0 0 8577 8 0 0 25 0 1 0 1576674 114659328 18765 33554432000 4194304 4677096 140734243895168 18446744073709551615 4444696 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/5125/statm: 27993 18765 394 118 0 22952 0
[pid=5084/tid=5092] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5092/stat : 5092 (python) S 5082 5084 4539 0 -1 4202560 26 931 0 0 0 0 0 0 25 0 11 0 1566637 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 2 0 0 0
[pid=5084/tid=5095] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5095/stat : 5095 (python) S 5082 5084 4539 0 -1 4202560 20 931 0 0 0 0 0 0 19 0 11 0 1566640 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5098] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5098/stat : 5098 (python) S 5082 5084 4539 0 -1 4202560 24 931 0 0 0 0 0 0 21 0 11 0 1566643 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 4 0 0 0
[pid=5084/tid=5101] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5101/stat : 5101 (python) S 5082 5084 4539 0 -1 4202560 21 931 0 0 0 0 0 0 19 0 11 0 1566646 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5104] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5104/stat : 5104 (python) S 5082 5084 4539 0 -1 4202560 25 931 0 0 0 0 0 0 21 0 11 0 1566650 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5107] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5107/stat : 5107 (python) S 5082 5084 4539 0 -1 4202560 23 931 0 0 0 0 0 0 23 0 11 0 1566653 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5110] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5110/stat : 5110 (python) S 5082 5084 4539 0 -1 4202560 26 931 0 0 0 0 0 0 25 0 11 0 1566656 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5113] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5113/stat : 5113 (python) S 5082 5084 4539 0 -1 4202560 31 931 0 0 0 0 0 0 25 0 11 0 1566660 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5120] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5120/stat : 5120 (python) S 5082 5084 4539 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 11 0 1576655 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5124] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5124/stat : 5124 (python) S 5082 5084 4539 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 11 0 1576673 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1312.39
Current children cumulated vsize (KiB) 4607524

[startup+194.901 s]
/proc/loadavg: 8.98 8.96 8.68 11/241 5127
/proc/meminfo: memFree=26922744/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=414216 CPUtime=7.89 cores=0-7
/proc/5084/stat : 5084 (python) S 5082 5084 4539 0 -1 4202496 30499 931 1 0 774 15 0 0 20 0 11 0 1565848 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892391883 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5084/statm: 103554 15403 1894 364 0 39445 0
[pid=5091] ppid=5084 vsize=321912 CPUtime=0.14 cores=0-7
/proc/5091/stat : 5091 (python) S 5084 5084 4539 0 -1 4202560 1111 0 0 0 7 7 0 0 19 0 2 0 1566637 329637888 13883 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/5091/statm: 80478 13883 409 364 0 16396 0
[pid=5093] ppid=5091 vsize=25832 CPUtime=100.12 cores=0-7
/proc/5093/stat : 5093 (lingeling) T 5091 5093 5093 0 -1 4202496 11442 0 0 0 10010 2 0 0 25 0 1 0 1566637 26451968 5627 33554432000 4194304 4352236 140737039626656 18446744073709551615 4329315 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/5093/statm: 6458 5627 129 39 0 5538 0
[pid=5091/tid=5118] ppid=5084 vsize=321912 CPUtime=0 cores=0-7
/proc/5091/task/5118/stat : 5118 (python) S 5084 5084 4539 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 1576651 329637888 13883 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 514 18446604453866825792 0 0 -1 0 0 0 0
[pid=5094] ppid=5084 vsize=321924 CPUtime=0.34 cores=0-7
/proc/5094/stat : 5094 (python) S 5084 5084 4539 0 -1 4202560 979 0 0 0 18 16 0 0 15 0 1 0 1566640 329650176 13843 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 5625783189206171908 0 0 17 1 0 0 0
/proc/5094/statm: 80481 13843 370 364 0 16396 0
[pid=5096] ppid=5094 vsize=103588 CPUtime=93.59 cores=0-7
/proc/5096/stat : 5096 (cryptominisat-2) R 5094 5096 5096 0 -1 4202496 44894 0 0 0 9347 12 0 0 25 0 1 0 1566641 106074112 18162 33554432000 4194304 4677096 140736408852352 18446744073709551615 4334865 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/5096/statm: 25897 18162 394 118 0 20856 0
[pid=5097] ppid=5084 vsize=332180 CPUtime=1.04 cores=0-7
/proc/5097/stat : 5097 (python) R 5084 5084 4539 0 -1 4202560 972 0 0 0 77 27 0 0 18 0 1 0 1566643 340152320 13847 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892395327 0 0 16781312 514 0 0 0 17 4 0 0 0
/proc/5097/statm: 83045 13847 370 364 0 18957 0
[pid=5099] ppid=5097 vsize=0 CPUtime=185.89 cores=0-7
/proc/5099/stat : 5099 (lingeling) R 5097 5099 5099 0 -1 4202500 10703 0 0 0 18588 1 0 0 25 0 1 0 1566644 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/5099/statm: 0 0 0 0 0 0 0
[pid=5100] ppid=5084 vsize=342436 CPUtime=0.28 cores=0-7
/proc/5100/stat : 5100 (python) S 5084 5084 4539 0 -1 4202560 996 0 0 0 13 15 0 0 18 0 1 0 1566646 350654464 13851 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088899 0 0 17 1 0 0 0
/proc/5100/statm: 85609 13851 370 364 0 21518 0
[pid=5102] ppid=5100 vsize=27220 CPUtime=184.69 cores=0-7
/proc/5102/stat : 5102 (lingeling) R 5100 5102 5102 0 -1 4202496 10817 0 0 0 18468 1 0 0 25 0 1 0 1566647 27873280 5975 33554432000 4194304 4352236 140734937758320 18446744073709551615 4328000 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/5102/statm: 6805 5975 129 39 0 5885 0
[pid=5103] ppid=5084 vsize=352692 CPUtime=0.33 cores=0-7
/proc/5103/stat : 5103 (python) S 5084 5084 4539 0 -1 4202560 1022 0 0 0 18 15 0 0 15 0 1 0 1566649 361156608 13855 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088900 0 0 17 1 0 0 0
/proc/5103/statm: 88173 13855 370 364 0 24079 0
[pid=5105] ppid=5103 vsize=117660 CPUtime=185.9 cores=0-7
/proc/5105/stat : 5105 (cryptominisat-2) R 5103 5105 5105 0 -1 4202496 62570 0 0 0 18567 23 0 0 25 0 1 0 1566650 120483840 21549 33554432000 4194304 4677096 140734430468352 18446744073709551615 4334804 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/5105/statm: 29415 21549 396 118 0 24374 0
[pid=5106] ppid=5084 vsize=362948 CPUtime=0.14 cores=0-7
/proc/5106/stat : 5106 (python) S 5084 5084 4539 0 -1 4202560 1143 0 0 0 7 7 0 0 19 0 2 0 1566653 371658752 13889 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/5106/statm: 90737 13889 399 364 0 26640 0
[pid=5108] ppid=5106 vsize=34672 CPUtime=99.83 cores=0-7
/proc/5108/stat : 5108 (SApperloT-base) T 5106 5108 5108 0 -1 4202496 8182 0 0 0 9980 3 0 0 25 0 1 0 1566653 35504128 7818 33554432000 134512640 135674940 4292839504 18446744073709551615 134564806 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/5108/statm: 8668 7818 100 284 0 8382 0
[pid=5106/tid=5122] ppid=5084 vsize=362948 CPUtime=0 cores=0-7
/proc/5106/task/5122/stat : 5122 (python) S 5084 5084 4539 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 1576669 371658752 13889 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 514 18446604449661447232 0 0 -1 0 0 0 0
[pid=5109] ppid=5084 vsize=373204 CPUtime=0.27 cores=0-7
/proc/5109/stat : 5109 (python) S 5084 5084 4539 0 -1 4202560 1003 0 0 0 15 12 0 0 18 0 1 0 1566656 382160896 13863 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088900 0 0 17 6 0 0 0
/proc/5109/statm: 93301 13863 370 364 0 29201 0
[pid=5111] ppid=5109 vsize=45652 CPUtime=93.37 cores=0-7
/proc/5111/stat : 5111 (precosat) R 5109 5111 5111 0 -1 4202496 11644 0 0 0 9335 2 0 0 25 0 1 0 1566658 46747648 10816 33554432000 4194304 4890832 140736952325760 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 3 0 0 0
/proc/5111/statm: 11413 10816 86 171 0 11240 0
[pid=5112] ppid=5084 vsize=383460 CPUtime=0.27 cores=0-7
/proc/5112/stat : 5112 (python) S 5084 5084 4539 0 -1 4202560 1065 0 0 0 13 14 0 0 18 0 1 0 1566659 392663040 13873 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088899 0 0 17 6 0 0 0
/proc/5112/statm: 95865 13873 376 364 0 31762 0
[pid=5114] ppid=5112 vsize=27120 CPUtime=186.47 cores=0-7
/proc/5114/stat : 5114 (lingeling) R 5112 5114 5114 0 -1 4202496 10873 0 0 0 18646 1 0 0 25 0 1 0 1566660 27770880 5958 33554432000 4194304 4352236 140734708224944 18446744073709551615 4328090 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/5114/statm: 6780 5958 129 39 0 5860 0
[pid=5119] ppid=5084 vsize=393716 CPUtime=0.16 cores=0-7
/proc/5119/stat : 5119 (python) S 5084 5084 4539 0 -1 4202560 1011 0 0 0 8 8 0 0 15 0 1 0 1576655 403165184 13871 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088900 0 0 17 6 0 0 0
/proc/5119/statm: 98429 13871 370 364 0 34323 0
[pid=5121] ppid=5119 vsize=111148 CPUtime=86.82 cores=0-7
/proc/5121/stat : 5121 (cryptominisat-2) R 5119 5121 5121 0 -1 4202496 41743 0 0 0 8674 8 0 0 25 0 1 0 1576655 113815552 18593 33554432000 4194304 4677096 140735967045584 18446744073709551615 4320037 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/5121/statm: 27787 18593 394 118 0 22746 0
[pid=5123] ppid=5084 vsize=403972 CPUtime=0.15 cores=0-7
/proc/5123/stat : 5123 (python) S 5084 5084 4539 0 -1 4202560 1011 0 0 0 8 7 0 0 15 0 1 0 1576673 413667328 13875 33554432000 4194304 5683644 140734472918304 18446744073709551615 218880585286 0 0 16781312 514 12583039766687088899 0 0 17 6 0 0 0
/proc/5123/statm: 100993 13875 370 364 0 36884 0
[pid=5125] ppid=5123 vsize=111972 CPUtime=86.04 cores=0-7
/proc/5125/stat : 5125 (cryptominisat-2) R 5123 5125 5125 0 -1 4202496 40632 0 0 0 8596 8 0 0 25 0 1 0 1576674 114659328 18792 33554432000 4194304 4677096 140734243895168 18446744073709551615 4320052 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/5125/statm: 27993 18792 394 118 0 22952 0
[pid=5084/tid=5092] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5092/stat : 5092 (python) S 5082 5084 4539 0 -1 4202560 26 931 0 0 0 0 0 0 25 0 11 0 1566637 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 2 0 0 0
[pid=5084/tid=5095] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5095/stat : 5095 (python) S 5082 5084 4539 0 -1 4202560 20 931 0 0 0 0 0 0 19 0 11 0 1566640 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5098] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5098/stat : 5098 (python) S 5082 5084 4539 0 -1 4202560 24 931 0 0 0 0 0 0 21 0 11 0 1566643 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 4 0 0 0
[pid=5084/tid=5101] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5101/stat : 5101 (python) S 5082 5084 4539 0 -1 4202560 21 931 0 0 0 0 0 0 19 0 11 0 1566646 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5104] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5104/stat : 5104 (python) S 5082 5084 4539 0 -1 4202560 25 931 0 0 0 0 0 0 21 0 11 0 1566650 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5107] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5107/stat : 5107 (python) S 5082 5084 4539 0 -1 4202560 23 931 0 0 0 0 0 0 23 0 11 0 1566653 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5110] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5110/stat : 5110 (python) S 5082 5084 4539 0 -1 4202560 26 931 0 0 0 0 0 0 25 0 11 0 1566656 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5113] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5113/stat : 5113 (python) S 5082 5084 4539 0 -1 4202560 31 931 0 0 0 0 0 0 25 0 11 0 1566660 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5120] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5120/stat : 5120 (python) S 5082 5084 4539 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 11 0 1576655 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5124] ppid=5082 vsize=414216 CPUtime=0 cores=0-7
/proc/5084/task/5124/stat : 5124 (python) S 5082 5084 4539 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 11 0 1576673 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1313.73
Current children cumulated vsize (KiB) 4607524

[startup+195.001 s]
/proc/loadavg: 8.98 8.96 8.68 11/241 5127
/proc/meminfo: memFree=26922744/32950928 swapFree=67111528/67111528
[pid=5084] ppid=5082 vsize=414216 CPUtime=1033.85 cores=0-7
/proc/5084/stat : 5084 (python) S 5082 5084 4539 0 -1 4202496 30551 240790 1 0 774 15 102437 159 17 0 11 0 1565848 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892395327 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5084/statm: 103554 15403 1894 364 0 39445 0
[pid=5097] ppid=5084 vsize=0 CPUtime=187.01 cores=0-7
/proc/5097/stat : 5097 (python) Z 5084 5084 4539 0 -1 4202588 1201 10703 0 0 84 28 18588 1 19 0 1 0 1566643 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5097/statm: 0 0 0 0 0 0 0
[pid=5109] ppid=5084 vsize=373204 CPUtime=0.27 cores=0-7
/proc/5109/stat : 5109 (python) S 5084 5084 4539 0 -1 4202560 1022 0 0 0 15 12 0 0 15 0 1 0 1566656 382160896 13868 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892395327 0 0 16781824 2 18446744071562232103 0 0 17 6 0 0 0
/proc/5109/statm: 93301 13868 375 364 0 29201 0
[pid=5111] ppid=5109 vsize=0 CPUtime=93.42 cores=0-7
/proc/5111/stat : 5111 (precosat) R 5109 5111 5111 0 -1 4203524 11644 0 0 0 9340 2 0 0 25 0 1 0 1566658 0 0 33554432000 0 0 0 0 0 0 0 16781312 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/5111/statm: 0 0 0 0 0 0 0
[pid=5084/tid=5092] ppid=5082 vsize=414216 CPUtime=1025.96 cores=0-7
/proc/5084/task/5092/stat : 5092 (python) S 5082 5084 4539 0 -1 4202560 26 240790 0 0 0 0 102437 159 25 0 11 0 1566637 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 2 0 0 0
[pid=5084/tid=5095] ppid=5082 vsize=414216 CPUtime=1025.96 cores=0-7
/proc/5084/task/5095/stat : 5095 (python) S 5082 5084 4539 0 -1 4202560 20 240790 0 0 0 0 102437 159 19 0 11 0 1566640 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5098] ppid=5082 vsize=414216 CPUtime=1025.96 cores=0-7
/proc/5084/task/5098/stat : 5098 (python) S 5082 5084 4539 0 -1 4202560 24 240790 0 0 0 0 102437 159 21 0 11 0 1566643 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 4 0 0 0
[pid=5084/tid=5101] ppid=5082 vsize=414216 CPUtime=1025.96 cores=0-7
/proc/5084/task/5101/stat : 5101 (python) S 5082 5084 4539 0 -1 4202560 21 240790 0 0 0 0 102437 159 19 0 11 0 1566646 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5104] ppid=5082 vsize=414216 CPUtime=1025.96 cores=0-7
/proc/5084/task/5104/stat : 5104 (python) S 5082 5084 4539 0 -1 4202560 25 240790 0 0 0 0 102437 159 21 0 11 0 1566650 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5107] ppid=5082 vsize=414216 CPUtime=1025.96 cores=0-7
/proc/5084/task/5107/stat : 5107 (python) S 5082 5084 4539 0 -1 4202560 23 240790 0 0 0 0 102437 159 23 0 11 0 1566653 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 0 0 0 0
[pid=5084/tid=5110] ppid=5082 vsize=414216 CPUtime=1025.96 cores=0-7
/proc/5084/task/5110/stat : 5110 (python) S 5082 5084 4539 0 -1 4202560 26 240790 0 0 0 0 102437 159 25 0 11 0 1566656 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5113] ppid=5082 vsize=414216 CPUtime=1025.96 cores=0-7
/proc/5084/task/5113/stat : 5113 (python) S 5082 5084 4539 0 -1 4202560 31 240790 0 0 0 0 102437 159 25 0 11 0 1566660 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5120] ppid=5082 vsize=414216 CPUtime=1025.96 cores=0-7
/proc/5084/task/5120/stat : 5120 (python) S 5082 5084 4539 0 -1 4202560 28 240790 0 0 0 0 102437 159 20 0 11 0 1576655 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
[pid=5084/tid=5124] ppid=5082 vsize=414216 CPUtime=1025.96 cores=0-7
/proc/5084/task/5124/stat : 5124 (python) S 5082 5084 4539 0 -1 4202560 28 240790 0 0 0 0 102437 159 20 0 11 0 1576673 424157184 15403 33554432000 4194304 5683644 140734472918304 18446744073709551615 218892388785 0 0 16781312 2 18446604453898369728 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1314.55
Current children cumulated vsize (KiB) 787420

Child status: 0
Real time (s): 195.035
CPU time (s): 1314.64
CPU user time (s): 1312.43
CPU system time (s): 2.21666
CPU usage (%): 674.056
Max. virtual memory (cumulated for all children) (KiB): 4644796

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1312.43
system time used= 2.21666
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 303714
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5582
involuntary context switches= 10667

runsolver used 0.700893 second user time and 1.56776 second system time

The end

Launcher Data

Begin job on node112 at 2011-05-02 14:32:44
IDJOB=3321419
IDBENCH=70941
IDSOLVER=1710
FILE ID=node112/3321419-1304339564
RUNJOBID= node112-1304335804-4553
PBS_JOBID= 13178018
Free space on /tmp= 72488 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l46_lambda.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321419-1304339564/watcher-3321419-1304339564 -o /tmp/evaluation-result-3321419-1304339564/solver-3321419-1304339564 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321419-1304339564.cnf -seed 3020936 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= eb4d0d02a25a8a84182ddd3b6d1fa8b5
RANDOM SEED=3020936

node112.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5180.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      27471304 kB
Buffers:         55928 kB
Cached:        1035384 kB
SwapCached:          0 kB
Active:        4502616 kB
Inactive:       855248 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      27471304 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           34972 kB
Writeback:           0 kB
AnonPages:     4266324 kB
Mapped:          14832 kB
Slab:            48196 kB
PageTables:      13404 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  4506008 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72456 MiB
End job on node112 at 2011-05-02 14:36:00