Trace number 3386619

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)SAT 3231.53 3222.75

General information on the benchmark

Namerandom/large/
unif-k7-r85-v150-c12750-S1290198737-013-UNKNOWN.cnf
MD5SUM707c4bcddcda116edc4a57a77dc3ba68
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark64.6052
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses12750
Sum of the clauses size89250
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 512750

Solver Data 

0.37/0.64	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.37/0.64	c INFO: solving HOME/instance-3386619-1305589619.cnf
0.37/0.64	c INFO: computing task features
0.47/0.72	c INFO: computed variable-clause graph statistics
0.47/0.72	c INFO: computed clause balance statistics
0.89/1.17	c INFO: computed variable balance statistics
1.07/1.35	c INFO: computed small-clause counts
1.07/1.35	c INFO: computed Horn-clause counts
1.07/1.36	c INFO: computed variable graph statistics
1.07/1.36	c INFO: collected features for HOME/instance-3386619-1305589619.cnf in 0.72 s
1.17/3.70	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.37)
103.09/105.21	c INFO: running gnovelty+2@0 for 97 with 4897 remaining (b = 0.12)
206.01/207.72	c INFO: running adaptg2wsat2009++@0 for 97 with 4795 remaining (b = 0.08)
306.75/308.15	c INFO: running adaptg2wsat2009++@0 for 97 with 4694 remaining (b = 0.06)
409.68/410.64	c INFO: running adaptg2wsat2009++@0 for 97 with 4592 remaining (b = 0.05)
510.34/511.07	c INFO: running gnovelty+2@0 for 97 with 4492 remaining (b = 0.04)
609.26/609.54	c INFO: running FH@0 for 97 with 4393 remaining (b = 0.03)
710.14/710.00	c INFO: running adaptg2wsat2009++@0 for 97 with 4293 remaining (b = 0.03)
810.82/810.44	c INFO: running adaptg2wsat2009++@0 for 97 with 4192 remaining (b = 0.02)
912.62/912.92	c INFO: running FH@0 for 97 with 4091 remaining (b = 0.02)
1013.34/1013.38	c INFO: running hybridGM3@0 for 194 with 3991 remaining (b = 0.04)
1208.96/1208.25	c INFO: running gnovelty+2@0 for 97 with 3796 remaining (b = 0.02)
1308.81/1307.72	c INFO: running hybridGM3@0 for 194 with 3697 remaining (b = 0.03)
1504.25/1502.58	c INFO: running hybridGM3@0 for 194 with 3502 remaining (b = 0.03)
1701.69/1699.42	c INFO: running TNM@0 for 1552 with 3305 remaining (b = 0.19)
3231.17/3222.72	s SATISFIABLE
3231.17/3222.72	v 1 -2 -3 4 -5 6 -7 -8 -9 10 11 -12 -13 -14 -15 16 -17 18 -19 20 -21 22 23 24 25 -26 -27 -28 -29 -30 31 32 -33 34 35 -36 37 -38 -39 -40 41 -42 43 44 -45 -46 -47 48 -49 50 -51 -52 53 54 -55 56 -57 58 59 60 -61 -62 -63 -64 65 66 -67 68 69 70 -71 -72 -73 -74 -75 -76 77 78 -79 -80 -81 -82 83 84 -85 86 -87 88 89 -90 91 92 93 94 95 -96 97 -98 99 -100 101 -102 103 104 105 -106 107 -108 109 110 -111 -112 -113 -114 115 116 -117 118 119 120 121 -122 123 -124 -125 -126 -127 128 129 130 -131 -132 133 -134 135 -136 137 -138 139 -140 141 142 143 -144 145 -146 147 -148 149 150 0

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386619-1305589619/watcher-3386619-1305589619 -o /tmp/evaluation-result-3386619-1305589619/solver-3386619-1305589619 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386619-1305589619.cnf -seed 2096126216 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.99 4.07 4.02 4/567 20068
/proc/meminfo: memFree=3963920/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=16236 CPUtime=0 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 999 0 0 0 0 0 0 0 20 0 1 0 670560622 16625664 872 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970548224 0 2147483391 16781312 2 18446744071699109054 0 0 17 1 0 0 0
/proc/20068/statm: 4059 872 371 364 0 546 0

[startup+0.0816641 s]
/proc/loadavg: 3.99 4.07 4.02 4/567 20068
/proc/meminfo: memFree=3963920/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=50332 CPUtime=0.04 cores=1,3,5,7
/proc/20068/stat : 20068 (python) R 20066 20068 19558 0 -1 4202496 2002 0 0 0 4 0 0 0 17 0 1 0 670560622 51539968 1762 33554432000 4194304 5683644 140736669196240 18446744073709551615 4870088 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20068/statm: 12583 1763 480 364 0 1283 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 50332

[startup+0.10066 s]
/proc/loadavg: 3.99 4.07 4.02 4/567 20068
/proc/meminfo: memFree=3963920/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=93956 CPUtime=0.06 cores=1,3,5,7
/proc/20068/stat : 20068 (python) R 20066 20068 19558 0 -1 4202496 2691 0 0 0 5 1 0 0 17 0 1 0 670560622 96210944 2406 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970546021 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20068/statm: 23489 2406 764 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 93956

[startup+0.300659 s]
/proc/loadavg: 3.99 4.07 4.02 4/567 20068
/proc/meminfo: memFree=3963920/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=135748 CPUtime=0.18 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 5972 931 1 0 14 4 0 0 17 0 1 0 670560622 139005952 4149 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970546181 0 2147483391 16781312 2 18446744071699109054 0 0 17 1 0 0 0
/proc/20068/statm: 33937 4149 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700584 s]
/proc/loadavg: 3.99 4.07 4.02 4/567 20068
/proc/meminfo: memFree=3963920/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=280868 CPUtime=0.47 cores=1,3,5,7
/proc/20068/stat : 20068 (python) R 20066 20068 19558 0 -1 4202496 9861 931 1 0 36 11 0 0 15 0 1 0 670560622 287608832 7533 33554432000 4194304 5683644 140736669196240 18446744073709551615 242969911044 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/20068/statm: 70217 7535 1761 364 0 6141 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 280868

[startup+1.50042 s]
/proc/loadavg: 3.99 4.07 4.02 5/568 20073
/proc/meminfo: memFree=3937128/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=278624 CPUtime=1.13 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 10745 931 1 0 102 11 0 0 16 0 1 0 670560622 285310976 7082 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970548224 0 2147483391 16781312 2 18446744071699109054 0 0 17 1 0 0 0
/proc/20068/statm: 69656 7082 1835 364 0 5580 0
Current children cumulated CPU time (s) 1.13
Current children cumulated vsize (KiB) 278624

[startup+3.10016 s]
/proc/loadavg: 3.99 4.07 4.02 4/568 20073
/proc/meminfo: memFree=3938724/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=278624 CPUtime=1.15 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 10758 931 1 0 102 13 0 0 15 0 1 0 670560622 285310976 7082 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970548224 0 2147483391 16781312 2 18446744071699109054 0 0 17 1 0 0 0
/proc/20068/statm: 69656 7082 1835 364 0 5580 0
Current children cumulated CPU time (s) 1.15
Current children cumulated vsize (KiB) 278624
heavy processes:

[startup+6.30059 s]
/proc/loadavg: 4.07 4.09 4.02 5/571 20076
/proc/meminfo: memFree=3934640/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=289256 CPUtime=1.18 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 11113 931 1 0 105 13 0 0 16 0 2 0 670560622 296198144 7204 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/20068/statm: 72314 7204 1877 364 0 8232 0
[pid=20074] ppid=20068 vsize=279012 CPUtime=0 cores=1,3,5,7
/proc/20074/stat : 20074 (python) S 20068 20068 19558 0 -1 4202560 738 0 0 0 0 0 0 0 15 0 1 0 670560992 285708288 5677 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970570255 0 0 16781312 514 6077334747669823751 0 0 17 1 0 0 0
/proc/20074/statm: 69753 5677 354 364 0 5671 0
[pid=20076] ppid=20074 vsize=1018364 CPUtime=2.59 cores=1,3,5,7
/proc/20076/stat : 20076 (gnovelty+2) R 20074 20076 20076 0 -1 4202496 668 0 0 0 259 0 0 0 25 0 1 0 670560993 1042804736 408 33554432000 134512640 135663704 4293450528 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/20076/statm: 254591 408 113 282 0 254307 0
[pid=20068/tid=20075] ppid=20066 vsize=289256 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20075/stat : 20075 (python) S 20066 20068 19558 0 -1 4202560 31 931 0 0 0 0 0 0 17 0 2 0 670560993 296198144 7204 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.77
Current children cumulated vsize (KiB) 1586632
heavy processes:

[startup+12.7005 s]
/proc/loadavg: 4.22 4.12 4.03 5/571 20076
/proc/meminfo: memFree=3931312/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=289256 CPUtime=1.18 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 11113 931 1 0 105 13 0 0 16 0 2 0 670560622 296198144 7204 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/20068/statm: 72314 7204 1877 364 0 8232 0
[pid=20074] ppid=20068 vsize=279012 CPUtime=0.02 cores=1,3,5,7
/proc/20074/stat : 20074 (python) S 20068 20068 19558 0 -1 4202560 887 0 0 0 1 1 0 0 15 0 1 0 670560992 285708288 5700 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970570255 0 0 16781312 514 6077334747669823751 0 0 17 7 0 0 0
/proc/20074/statm: 69753 5700 377 364 0 5671 0
[pid=20076] ppid=20074 vsize=1018364 CPUtime=8.99 cores=1,3,5,7
/proc/20076/stat : 20076 (gnovelty+2) R 20074 20076 20076 0 -1 4202496 668 0 0 0 899 0 0 0 25 0 1 0 670560993 1042804736 408 33554432000 134512640 135663704 4293450528 18446744073709551615 134544242 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/20076/statm: 254591 408 113 282 0 254307 0
[pid=20068/tid=20075] ppid=20066 vsize=289256 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20075/stat : 20075 (python) S 20066 20068 19558 0 -1 4202560 31 931 0 0 0 0 0 0 17 0 2 0 670560993 296198144 7204 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 10.19
Current children cumulated vsize (KiB) 1586632

[startup+25.5003 s]
/proc/loadavg: 4.17 4.11 4.03 5/571 20076
/proc/meminfo: memFree=3931384/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=289256 CPUtime=1.18 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 11113 931 1 0 105 13 0 0 16 0 2 0 670560622 296198144 7204 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/20068/statm: 72314 7204 1877 364 0 8232 0
[pid=20074] ppid=20068 vsize=279012 CPUtime=0.09 cores=1,3,5,7
/proc/20074/stat : 20074 (python) S 20068 20068 19558 0 -1 4202560 894 0 0 0 4 5 0 0 15 0 1 0 670560992 285708288 5700 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970570255 0 0 16781312 514 4726017635530014983 0 0 17 7 0 0 0
/proc/20074/statm: 69753 5700 377 364 0 5671 0
[pid=20076] ppid=20074 vsize=1018364 CPUtime=21.79 cores=1,3,5,7
/proc/20076/stat : 20076 (gnovelty+2) R 20074 20076 20076 0 -1 4202496 668 0 0 0 2179 0 0 0 25 0 1 0 670560993 1042804736 408 33554432000 134512640 135663704 4293450528 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/20076/statm: 254591 408 113 282 0 254307 0
[pid=20068/tid=20075] ppid=20066 vsize=289256 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20075/stat : 20075 (python) S 20066 20068 19558 0 -1 4202560 31 931 0 0 0 0 0 0 17 0 2 0 670560993 296198144 7204 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.06
Current children cumulated vsize (KiB) 1586632

[startup+51.1009 s]
/proc/loadavg: 4.19 4.12 4.03 5/571 20076
/proc/meminfo: memFree=3928152/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=289256 CPUtime=1.18 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 11113 931 1 0 105 13 0 0 16 0 2 0 670560622 296198144 7204 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/20068/statm: 72314 7204 1877 364 0 8232 0
[pid=20074] ppid=20068 vsize=279012 CPUtime=0.19 cores=1,3,5,7
/proc/20074/stat : 20074 (python) S 20068 20068 19558 0 -1 4202560 902 0 0 0 9 10 0 0 15 0 1 0 670560992 285708288 5700 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970570255 0 0 16781312 514 4726017635530014983 0 0 17 7 0 0 0
/proc/20074/statm: 69753 5700 377 364 0 5671 0
[pid=20076] ppid=20074 vsize=1018364 CPUtime=47.39 cores=1,3,5,7
/proc/20076/stat : 20076 (gnovelty+2) R 20074 20076 20076 0 -1 4202496 668 0 0 0 4739 0 0 0 25 0 1 0 670560993 1042804736 408 33554432000 134512640 135663704 4293450528 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/20076/statm: 254591 408 113 282 0 254307 0
[pid=20068/tid=20075] ppid=20066 vsize=289256 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20075/stat : 20075 (python) S 20066 20068 19558 0 -1 4202560 31 931 0 0 0 0 0 0 17 0 2 0 670560993 296198144 7204 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 48.76
Current children cumulated vsize (KiB) 1586632

[startup+102.319 s]
/proc/loadavg: 4.08 4.10 4.03 5/571 20078
/proc/meminfo: memFree=3921808/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=289256 CPUtime=1.18 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 11113 931 1 0 105 13 0 0 16 0 2 0 670560622 296198144 7204 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/20068/statm: 72314 7204 1877 364 0 8232 0
[pid=20074] ppid=20068 vsize=279012 CPUtime=0.4 cores=1,3,5,7
/proc/20074/stat : 20074 (python) S 20068 20068 19558 0 -1 4202560 921 0 0 0 20 20 0 0 15 0 1 0 670560992 285708288 5700 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970570255 0 0 16781312 514 4726017635530014983 0 0 17 7 0 0 0
/proc/20074/statm: 69753 5700 377 364 0 5671 0
[pid=20076] ppid=20074 vsize=1018364 CPUtime=98.61 cores=1,3,5,7
/proc/20076/stat : 20076 (gnovelty+2) R 20074 20076 20076 0 -1 4202496 668 0 0 0 9861 0 0 0 25 0 1 0 670560993 1042804736 408 33554432000 134512640 135663704 4293450528 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/20076/statm: 254591 408 113 282 0 254307 0
[pid=20068/tid=20075] ppid=20066 vsize=289256 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20075/stat : 20075 (python) S 20066 20068 19558 0 -1 4202560 31 931 0 0 0 0 0 0 17 0 2 0 670560993 296198144 7204 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.19
Current children cumulated vsize (KiB) 1586632

[startup+162.301 s]
/proc/loadavg: 4.03 4.08 4.02 5/575 20084
/proc/meminfo: memFree=3908592/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=300120 CPUtime=1.21 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 11986 931 1 0 108 13 0 0 18 0 3 0 670560622 307322880 7346 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/20068/statm: 75030 7346 1880 364 0 10945 0
[pid=20074] ppid=20068 vsize=289256 CPUtime=0.42 cores=1,3,5,7
/proc/20074/stat : 20074 (python) S 20068 20068 19558 0 -1 4202560 1076 0 0 0 21 21 0 0 17 0 2 0 670560992 296198144 5738 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20074/statm: 72314 5738 410 364 0 8232 0
[pid=20076] ppid=20074 vsize=1018364 CPUtime=101.48 cores=1,3,5,7
/proc/20076/stat : 20076 (gnovelty+2) T 20074 20076 20076 0 -1 4202496 668 0 0 0 10148 0 0 0 25 0 1 0 670560993 1042804736 408 33554432000 134512640 135663704 4293450528 18446744073709551615 134524744 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/20076/statm: 254591 408 113 282 0 254307 0
[pid=20074/tid=20079] ppid=20068 vsize=289256 CPUtime=0 cores=1,3,5,7
/proc/20074/task/20079/stat : 20079 (python) S 20068 20068 19558 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 670571141 296198144 5738 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604458622650304 0 0 -1 7 0 0 0
[pid=20080] ppid=20068 vsize=289876 CPUtime=0.23 cores=1,3,5,7
/proc/20080/stat : 20080 (python) S 20068 20068 19558 0 -1 4202560 912 0 0 0 10 13 0 0 18 0 1 0 670571144 296833024 5833 33554432000 4194304 5683644 140736669196240 18446744073709551615 242970570310 0 0 16781312 514 4726017635530014982 0 0 17 7 0 0 0
/proc/20080/statm: 72469 5833 371 364 0 8384 0
[pid=20082] ppid=20080 vsize=1018364 CPUtime=57.07 cores=1,3,5,7
/proc/20082/stat : 20082 (gnovelty+2) R 20080 20082 20082 0 -1 4202496 673 0 0 0 5707 0 0 0 25 0 1 0 670571144 1042804736 408 33554432000 134512640 135663704 4286932256 18446744073709551615 134525243 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/20082/statm: 254591 408 113 282 0 254307 0
[pid=20068/tid=20075] ppid=20066 vsize=300120 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20075/stat : 20075 (python) S 20066 20068 19558 0 -1 4202560 31 931 0 0 0 0 0 0 17 0 3 0 670560993 307322880 7346 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
[pid=20068/tid=20081] ppid=20066 vsize=300120 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20081/stat : 20081 (python) S 20066 20068 19558 0 -1 4202560 25 931 0 0 0 0 0 0 19 0 3 0 670571144 307322880 7346 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 160.41
Current children cumulated vsize (KiB) 2915980

[startup+222.301 s]
/proc/loadavg: 4.01 4.06 4.02 5/579 20090
/proc/meminfo: memFree=3893764/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=310376 CPUtime=1.24 cores=1,3,5,7

################
# More data... #
################

[pid=20068/tid=20184] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20184/stat : 20184 (python) S 20066 20068 19558 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 16 0 670651915 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 1 0 0 0
[pid=20068/tid=20198] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20198/stat : 20198 (python) S 20066 20068 19558 0 -1 4202560 32 931 0 0 0 0 0 0 20 0 16 0 670661961 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
[pid=20068/tid=20211] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20211/stat : 20211 (python) S 20066 20068 19558 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 16 0 670681447 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 1 0 0 0
[pid=20068/tid=20217] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20217/stat : 20217 (python) S 20066 20068 19558 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 16 0 670691394 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
[pid=20068/tid=20228] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20228/stat : 20228 (python) S 20066 20068 19558 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 16 0 670710880 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 3 0 0 0
[pid=20068/tid=20236] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20236/stat : 20236 (python) S 20066 20068 19558 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 16 0 670730565 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3230.78
Current children cumulated vsize (KiB) 13637816

Solver just ended. Dumping a history of the last processes samples

[startup+3222.7 s]
/proc/loadavg: 4.00 4.03 4.00 5/600 20290
/proc/meminfo: memFree=3008560/32951132 swapFree=59792360/67111528
[pid=20068] ppid=20066 vsize=433952 CPUtime=1.67 cores=1,3,5,7
/proc/20068/stat : 20068 (python) S 20066 20068 19558 0 -1 4202496 23944 931 1 0 151 16 0 0 20 0 16 0 670560622 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/20068/statm: 108488 7550 1906 364 0 44364 0
[pid=20074] ppid=20068 vsize=289256 CPUtime=0.42 cores=1,3,5,7
/proc/20074/stat : 20074 (python) S 20068 20068 19558 0 -1 4202560 1076 0 0 0 21 21 0 0 17 0 2 0 670560992 296198144 5738 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20074/statm: 72314 5738 410 364 0 8232 0
[pid=20076] ppid=20074 vsize=1018364 CPUtime=101.48 cores=1,3,5,7
/proc/20076/stat : 20076 (gnovelty+2) T 20074 20076 20076 0 -1 4202496 668 0 0 0 10148 0 0 0 25 0 1 0 670560993 1042804736 408 33554432000 134512640 135663704 4293450528 18446744073709551615 134524744 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/20076/statm: 254591 408 113 282 0 254307 0
[pid=20074/tid=20079] ppid=20068 vsize=289256 CPUtime=0 cores=1,3,5,7
/proc/20074/task/20079/stat : 20079 (python) S 20068 20068 19558 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 670571141 296198144 5738 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604458622650304 0 0 -1 7 0 0 0
[pid=20080] ppid=20068 vsize=289876 CPUtime=0.43 cores=1,3,5,7
/proc/20080/stat : 20080 (python) S 20068 20068 19558 0 -1 4202560 1081 0 0 0 21 22 0 0 19 0 2 0 670571144 296833024 5863 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20080/statm: 72469 5863 400 364 0 8384 0
[pid=20082] ppid=20080 vsize=1018364 CPUtime=102.46 cores=1,3,5,7
/proc/20082/stat : 20082 (gnovelty+2) T 20080 20082 20082 0 -1 4202496 673 0 0 0 10246 0 0 0 25 0 1 0 670571144 1042804736 408 33554432000 134512640 135663704 4286932256 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/20082/statm: 254591 408 113 282 0 254307 0
[pid=20080/tid=20085] ppid=20068 vsize=289876 CPUtime=0 cores=1,3,5,7
/proc/20080/task/20085/stat : 20085 (python) S 20068 20068 19558 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 670581391 296833024 5863 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604469213821120 0 0 -1 1 0 0 0
[pid=20086] ppid=20068 vsize=300132 CPUtime=0.4 cores=1,3,5,7
/proc/20086/stat : 20086 (python) S 20068 20068 19558 0 -1 4202560 1095 0 0 0 20 20 0 0 19 0 2 0 670581394 307335168 5867 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20086/statm: 75033 5867 400 364 0 10945 0
[pid=20088] ppid=20086 vsize=417976 CPUtime=100.36 cores=1,3,5,7
/proc/20088/stat : 20088 (adaptg2wsat2009) T 20086 20088 20088 0 -1 4202496 1005 0 0 0 10036 0 0 0 25 0 1 0 670581394 428007424 736 33554432000 134512640 135107411 4293033952 18446744073709551615 134531709 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/20088/statm: 104494 736 59 146 0 103370 0
[pid=20086/tid=20093] ppid=20068 vsize=300132 CPUtime=0 cores=1,3,5,7
/proc/20086/task/20093/stat : 20093 (python) S 20068 20068 19558 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670591434 307335168 5867 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604454887134528 0 0 -1 7 0 0 0
[pid=20094] ppid=20068 vsize=310388 CPUtime=0.43 cores=1,3,5,7
/proc/20094/stat : 20094 (python) S 20068 20068 19558 0 -1 4202560 1119 0 0 0 21 22 0 0 19 0 2 0 670591437 317837312 5871 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20094/statm: 77597 5871 400 364 0 13506 0
[pid=20096] ppid=20094 vsize=417976 CPUtime=102.45 cores=1,3,5,7
/proc/20096/stat : 20096 (adaptg2wsat2009) T 20094 20096 20096 0 -1 4202496 1002 0 0 0 10245 0 0 0 25 0 1 0 670591437 428007424 735 33554432000 134512640 135107411 4286917856 18446744073709551615 134532293 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/20096/statm: 104494 735 59 146 0 103370 0
[pid=20094/tid=20099] ppid=20068 vsize=310388 CPUtime=0 cores=1,3,5,7
/proc/20094/task/20099/stat : 20099 (python) S 20068 20068 19558 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670601683 317837312 5871 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604465410507200 0 0 -1 7 0 0 0
[pid=20100] ppid=20068 vsize=320644 CPUtime=0.4 cores=1,3,5,7
/proc/20100/stat : 20100 (python) S 20068 20068 19558 0 -1 4202560 1113 0 0 0 20 20 0 0 19 0 2 0 670601687 328339456 5875 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/20100/statm: 80161 5875 400 364 0 16067 0
[pid=20102] ppid=20100 vsize=417976 CPUtime=100.27 cores=1,3,5,7
/proc/20102/stat : 20102 (adaptg2wsat2009) T 20100 20102 20102 0 -1 4202496 1000 0 0 0 10027 0 0 0 25 0 1 0 670601687 428007424 735 33554432000 134512640 135107411 4287214832 18446744073709551615 134531661 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/20102/statm: 104494 735 59 146 0 103370 0
[pid=20100/tid=20107] ppid=20068 vsize=320644 CPUtime=0 cores=1,3,5,7
/proc/20100/task/20107/stat : 20107 (python) S 20068 20068 19558 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670611726 328339456 5875 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604459166728320 0 0 -1 7 0 0 0
[pid=20108] ppid=20068 vsize=330900 CPUtime=0.4 cores=1,3,5,7
/proc/20108/stat : 20108 (python) S 20068 20068 19558 0 -1 4202560 1143 0 0 0 20 20 0 0 16 0 2 0 670611730 338841600 5879 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/20108/statm: 82725 5879 400 364 0 18628 0
[pid=20110] ppid=20108 vsize=1018364 CPUtime=98.42 cores=1,3,5,7
/proc/20110/stat : 20110 (gnovelty+2) T 20108 20110 20110 0 -1 4202496 675 0 0 0 9842 0 0 0 25 0 1 0 670611730 1042804736 408 33554432000 134512640 135663704 4286755328 18446744073709551615 134525229 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/20110/statm: 254591 408 113 282 0 254307 0
[pid=20108/tid=20113] ppid=20068 vsize=330900 CPUtime=0 cores=1,3,5,7
/proc/20108/task/20113/stat : 20113 (python) S 20068 20068 19558 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 670621573 338841600 5879 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604465194281664 0 0 -1 1 0 0 0
[pid=20114] ppid=20068 vsize=341156 CPUtime=0.41 cores=1,3,5,7
/proc/20114/stat : 20114 (python) S 20068 20068 19558 0 -1 4202560 1169 0 0 0 23 18 0 0 19 0 2 0 670621577 349343744 5915 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20114/statm: 85289 5915 406 364 0 21189 0
[pid=20116] ppid=20114 vsize=247992 CPUtime=100.41 cores=1,3,5,7
/proc/20116/stat : 20116 (FH) T 20114 20116 20116 0 -1 4202496 924 0 0 0 10041 0 0 0 25 0 1 0 670621577 253943808 659 33554432000 134512640 134936988 4287021520 18446744073709551615 134552321 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/20116/statm: 61998 659 41 104 0 61502 0
[pid=20114/tid=20119] ppid=20068 vsize=341156 CPUtime=0 cores=1,3,5,7
/proc/20114/task/20119/stat : 20119 (python) S 20068 20068 19558 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 670631619 349343744 5915 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604467872928192 0 0 -1 7 0 0 0
[pid=20120] ppid=20068 vsize=351412 CPUtime=0.4 cores=1,3,5,7
/proc/20120/stat : 20120 (python) S 20068 20068 19558 0 -1 4202560 1166 0 0 0 20 20 0 0 19 0 2 0 670631622 359845888 5919 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/20120/statm: 87853 5919 406 364 0 23750 0
[pid=20122] ppid=20120 vsize=417976 CPUtime=100.28 cores=1,3,5,7
/proc/20122/stat : 20122 (adaptg2wsat2009) T 20120 20122 20122 0 -1 4202496 1010 0 0 0 10028 0 0 0 25 0 1 0 670631623 428007424 736 33554432000 134512640 135107411 4290319728 18446744073709551615 134531239 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/20122/statm: 104494 736 59 146 0 103370 0
[pid=20120/tid=20131] ppid=20068 vsize=351412 CPUtime=0 cores=1,3,5,7
/proc/20120/task/20131/stat : 20131 (python) S 20068 20068 19558 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 670641662 359845888 5919 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604465194278976 0 0 -1 1 0 0 0
[pid=20132] ppid=20068 vsize=361828 CPUtime=0.42 cores=1,3,5,7
/proc/20132/stat : 20132 (python) S 20068 20068 19558 0 -1 4202560 1141 0 0 0 23 19 0 0 19 0 2 0 670641666 370511872 5931 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20132/statm: 90457 5931 400 364 0 26351 0
[pid=20134] ppid=20132 vsize=417976 CPUtime=101.31 cores=1,3,5,7
/proc/20134/stat : 20134 (adaptg2wsat2009) T 20132 20134 20134 0 -1 4202496 1006 0 0 0 10125 6 0 0 25 0 1 0 670641666 428007424 735 33554432000 134512640 135107411 4289129360 18446744073709551615 134531246 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/20134/statm: 104494 735 59 146 0 103370 0
[pid=20132/tid=20182] ppid=20068 vsize=361828 CPUtime=0 cores=1,3,5,7
/proc/20132/task/20182/stat : 20182 (python) S 20068 20068 19558 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 670651911 370511872 5931 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604470261281920 0 0 -1 7 0 0 0
[pid=20183] ppid=20068 vsize=372084 CPUtime=0.4 cores=1,3,5,7
/proc/20183/stat : 20183 (python) S 20068 20068 19558 0 -1 4202560 1142 0 0 0 21 19 0 0 19 0 2 0 670651915 381014016 5935 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/20183/statm: 93021 5935 400 364 0 28912 0
[pid=20185] ppid=20183 vsize=247996 CPUtime=100.38 cores=1,3,5,7
/proc/20185/stat : 20185 (FH) T 20183 20185 20185 0 -1 4202496 928 0 0 0 10038 0 0 0 25 0 1 0 670651915 253947904 659 33554432000 134512640 134936988 4289673072 18446744073709551615 134554594 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/20185/statm: 61999 659 41 104 0 61503 0
[pid=20183/tid=20196] ppid=20068 vsize=372084 CPUtime=0 cores=1,3,5,7
/proc/20183/task/20196/stat : 20196 (python) S 20068 20068 19558 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 670661957 381014016 5935 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604460463394944 0 0 -1 3 0 0 0
[pid=20197] ppid=20068 vsize=382340 CPUtime=0.79 cores=1,3,5,7
/proc/20197/stat : 20197 (python) S 20068 20068 19558 0 -1 4202560 1166 0 0 0 40 39 0 0 19 0 2 0 670661960 391516160 5954 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20197/statm: 95585 5954 400 364 0 31473 0
[pid=20199] ppid=20197 vsize=268420 CPUtime=194.74 cores=1,3,5,7
/proc/20199/stat : 20199 (hybridGM3) T 20197 20199 20199 0 -1 4202496 5057 0 0 0 19474 0 0 0 25 0 1 0 670661961 274862080 4786 33554432000 134512640 135204385 4290306704 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/20199/statm: 67105 4786 63 169 0 66935 0
[pid=20197/tid=20209] ppid=20068 vsize=382340 CPUtime=0 cores=1,3,5,7
/proc/20197/task/20209/stat : 20209 (python) S 20068 20068 19558 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 670681444 391516160 5954 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604460110985280 0 0 -1 1 0 0 0
[pid=20210] ppid=20068 vsize=392596 CPUtime=0.4 cores=1,3,5,7
/proc/20210/stat : 20210 (python) S 20068 20068 19558 0 -1 4202560 1150 0 0 0 20 20 0 0 19 0 2 0 670681447 402018304 5958 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/20210/statm: 98149 5958 400 364 0 34034 0
[pid=20212] ppid=20210 vsize=1018364 CPUtime=99.37 cores=1,3,5,7
/proc/20212/stat : 20212 (gnovelty+2) T 20210 20212 20212 0 -1 4202496 681 0 0 0 9937 0 0 0 25 0 1 0 670681448 1042804736 408 33554432000 134512640 135663704 4290748928 18446744073709551615 134525699 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/20212/statm: 254591 408 113 282 0 254307 0
[pid=20210/tid=20215] ppid=20068 vsize=392596 CPUtime=0 cores=1,3,5,7
/proc/20210/task/20215/stat : 20215 (python) S 20068 20068 19558 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 670691390 402018304 5958 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604463442609408 0 0 -1 7 0 0 0
[pid=20216] ppid=20068 vsize=403040 CPUtime=0.79 cores=1,3,5,7
/proc/20216/stat : 20216 (python) S 20068 20068 19558 0 -1 4202560 1165 0 0 0 40 39 0 0 19 0 2 0 670691394 412712960 5994 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/20216/statm: 100760 5994 400 364 0 36642 0
[pid=20218] ppid=20216 vsize=268420 CPUtime=194.69 cores=1,3,5,7
/proc/20218/stat : 20218 (hybridGM3) T 20216 20218 20218 0 -1 4202496 5061 0 0 0 19469 0 0 0 25 0 1 0 670691395 274862080 4786 33554432000 134512640 135204385 4289395696 18446744073709551615 134538432 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/20218/statm: 67105 4786 63 169 0 66935 0
[pid=20216/tid=20226] ppid=20068 vsize=403040 CPUtime=0 cores=1,3,5,7
/proc/20216/task/20226/stat : 20226 (python) S 20068 20068 19558 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 670710877 412712960 5994 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604463442608512 0 0 -1 3 0 0 0
[pid=20227] ppid=20068 vsize=413452 CPUtime=0.78 cores=1,3,5,7
/proc/20227/stat : 20227 (python) S 20068 20068 19558 0 -1 4202560 1182 0 0 0 40 38 0 0 19 0 2 0 670710880 423374848 6037 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982376907 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/20227/statm: 103363 6037 400 364 0 39242 0
[pid=20229] ppid=20227 vsize=268420 CPUtime=196.54 cores=1,3,5,7
/proc/20229/stat : 20229 (hybridGM3) T 20227 20229 20229 0 -1 4202496 5058 0 0 0 19654 0 0 0 25 0 1 0 670710881 274862080 4786 33554432000 134512640 135204385 4291797280 18446744073709551615 134538034 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/20229/statm: 67105 4786 63 169 0 66935 0
[pid=20227/tid=20234] ppid=20068 vsize=413452 CPUtime=0 cores=1,3,5,7
/proc/20227/task/20234/stat : 20234 (python) S 20068 20068 19558 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 670730561 423374848 6037 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 514 18446604458622649408 0 0 -1 7 0 0 0
[pid=20235] ppid=20068 vsize=423708 CPUtime=1529.47 cores=1,3,5,7
/proc/20235/stat : 20235 (python) R 20068 20068 19558 0 -1 4202560 1134 934 0 0 316 317 152314 0 15 0 1 0 670730565 433876992 6023 33554432000 4194304 5683644 140736669196240 18446744073709551615 4941796 0 0 16781312 514 0 0 0 17 3 0 0 0
/proc/20235/statm: 105927 6023 383 364 0 41803 0
[pid=20068/tid=20075] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20075/stat : 20075 (python) S 20066 20068 19558 0 -1 4202560 31 931 0 0 0 0 0 0 17 0 16 0 670560993 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
[pid=20068/tid=20081] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20081/stat : 20081 (python) S 20066 20068 19558 0 -1 4202560 25 931 0 0 0 0 0 0 19 0 16 0 670571144 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
[pid=20068/tid=20087] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20087/stat : 20087 (python) S 20066 20068 19558 0 -1 4202560 23 931 0 0 0 0 0 0 20 0 16 0 670581394 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 1 0 0 0
[pid=20068/tid=20095] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20095/stat : 20095 (python) S 20066 20068 19558 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 16 0 670591437 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 1 0 0 0
[pid=20068/tid=20101] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20101/stat : 20101 (python) S 20066 20068 19558 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 16 0 670601687 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 1 0 0 0
[pid=20068/tid=20109] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20109/stat : 20109 (python) S 20066 20068 19558 0 -1 4202560 32 931 0 0 0 0 0 0 20 0 16 0 670611730 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 1 0 0 0
[pid=20068/tid=20115] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20115/stat : 20115 (python) S 20066 20068 19558 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 16 0 670621577 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 1 0 0 0
[pid=20068/tid=20121] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20121/stat : 20121 (python) S 20066 20068 19558 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 16 0 670631623 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
[pid=20068/tid=20133] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20133/stat : 20133 (python) S 20066 20068 19558 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 16 0 670641666 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 1 0 0 0
[pid=20068/tid=20184] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20184/stat : 20184 (python) S 20066 20068 19558 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 16 0 670651915 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 1 0 0 0
[pid=20068/tid=20198] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20198/stat : 20198 (python) S 20066 20068 19558 0 -1 4202560 32 931 0 0 0 0 0 0 20 0 16 0 670661961 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
[pid=20068/tid=20211] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20211/stat : 20211 (python) S 20066 20068 19558 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 16 0 670681447 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 1 0 0 0
[pid=20068/tid=20217] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20217/stat : 20217 (python) S 20066 20068 19558 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 16 0 670691394 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
[pid=20068/tid=20228] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20228/stat : 20228 (python) S 20066 20068 19558 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 16 0 670710880 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 3 0 0 0
[pid=20068/tid=20236] ppid=20066 vsize=433952 CPUtime=0 cores=1,3,5,7
/proc/20068/task/20236/stat : 20236 (python) S 20066 20068 19558 0 -1 4202560 28 931 0 0 0 0 0 0 20 0 16 0 670730565 444366848 7550 33554432000 4194304 5683644 140736669196240 18446744073709551615 242982373809 0 0 16781312 2 18446604469274038528 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3231.17
Current children cumulated vsize (KiB) 13181348

Child status: 0
Real time (s): 3222.75
CPU time (s): 3231.53
CPU user time (s): 3224.6
CPU system time (s): 6.93195
CPU usage (%): 100.273
Max. virtual memory (cumulated for all children) (KiB): 13637820

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3224.6
system time used= 6.93195
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 72733
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7159
involuntary context switches= 35370

runsolver used 25.2512 second user time and 55.4756 second system time

The end

Launcher Data 

Begin job on node128 at 2011-05-17 01:47:00
IDJOB=3386619
IDBENCH=82684
IDSOLVER=1872
FILE ID=node128/3386619-1305589619
RUNJOBID= node128-1305586146-19577
PBS_JOBID= 13350350
Free space on /tmp= 73452 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v150-c12750-S1290198737-013-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386619-1305589619/watcher-3386619-1305589619 -o /tmp/evaluation-result-3386619-1305589619/solver-3386619-1305589619 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386619-1305589619.cnf -seed 2096126216 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 707c4bcddcda116edc4a57a77dc3ba68
RANDOM SEED=2096126216

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:       3963952 kB
Buffers:         78508 kB
Cached:         746456 kB
SwapCached:     122436 kB
Active:       13655532 kB
Inactive:     15035964 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:       3963952 kB
SwapTotal:    67111528 kB
SwapFree:     59792360 kB
Dirty:           32268 kB
Writeback:           4 kB
AnonPages:    27752956 kB
Mapped:          27568 kB
Slab:            99432 kB
PageTables:     123952 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 174016064 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73408 MiB
End job on node128 at 2011-05-17 02:40:43