Trace number 3386734

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (TO) 5000.05 4983.87

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S2124915970-046.UNKNOWN.cnf
MD5SUMe6a3a97a5be52c43f493d905174d1bee
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data 

0.37/0.63	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.37/0.63	c INFO: solving HOME/instance-3386734-1305591245.cnf
0.37/0.63	c INFO: computing task features
0.37/0.64	c INFO: computed variable-clause graph statistics
0.37/0.64	c INFO: computed clause balance statistics
0.45/0.73	c INFO: computed variable balance statistics
0.45/0.77	c INFO: computed small-clause counts
0.45/0.77	c INFO: computed Horn-clause counts
0.45/0.77	c INFO: computed variable graph statistics
0.45/0.77	c INFO: collected features for HOME/instance-3386734-1305591245.cnf in 0.15 s
0.56/0.80	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.63)
101.13/101.17	c INFO: running gnovelty+2@0 for 97 with 4899 remaining (b = 0.08)
200.85/200.53	c INFO: running march_hi@0 for 679 with 4800 remaining (b = 0.35)
886.24/883.61	c INFO: running march_hi@682 for 97 with 4117 remaining (b = 0.06)
981.46/978.54	c INFO: running march_hi@0 for 388 with 4022 remaining (b = 0.22)
1375.64/1371.56	c INFO: running march_hi@392 for 97 with 3629 remaining (b = 0.08)
1469.58/1465.20	c INFO: running march_hi@486 for 194 with 3535 remaining (b = 0.13)
1665.67/1660.69	c INFO: running march_hi@0 for 388 with 3340 remaining (b = 0.20)
2055.73/2049.51	c INFO: running march_hi@388 for 97 with 2951 remaining (b = 0.06)
2156.34/2149.84	c INFO: running march_hi@488 for 194 with 2851 remaining (b = 0.10)
2347.79/2340.65	c INFO: running march_hi@0 for 388 with 2660 remaining (b = 0.18)
2741.62/2733.20	c INFO: running march_hi@392 for 97 with 2268 remaining (b = 0.05)
2836.22/2827.53	c INFO: running march_hi@0 for 388 with 2173 remaining (b = 0.16)
3229.41/3219.37	c INFO: running march_hi@391 for 97 with 1782 remaining (b = 0.04)
3324.14/3313.70	c INFO: running adaptg2wsat2009++@0 for 97 with 1687 remaining (b = 0.03)
3423.76/3413.06	c INFO: running march_hi@777 for 1358 with 1588 remaining (b = 0.38)
4790.20/4774.74	c INFO: running march_hi@2139 for 97 with 226 remaining (b = 0.11)
4884.82/4869.09	c INFO: running march_hi@486 for 132 with 132 remaining (b = 0.04)
5000.05/4983.85	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386734-1305591245/watcher-3386734-1305591245 -o /tmp/evaluation-result-3386734-1305591245/solver-3386734-1305591245 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386734-1305591245.cnf -seed 594693782 -budget 5000 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.01 4.06 4.02 5/479 18358
/proc/meminfo: memFree=15471668/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=15772 CPUtime=0 cores=0,2,4,6
/proc/18358/stat : 18358 (python) R 18356 18358 17732 0 -1 4202496 878 0 0 0 0 0 0 0 25 0 1 0 651540382 16150528 760 33554432000 4194304 5683644 140733206834592 18446744073709551615 220815897285 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18358/statm: 3943 760 343 364 0 430 0

[startup+0.111509 s]
/proc/loadavg: 4.01 4.06 4.02 5/479 18358
/proc/meminfo: memFree=15471668/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=99372 CPUtime=0.07 cores=0,2,4,6
/proc/18358/stat : 18358 (python) R 18356 18358 17732 0 -1 4202496 2884 0 0 0 5 2 0 0 25 0 1 0 651540382 101756928 2581 33554432000 4194304 5683644 140733206834592 18446744073709551615 47801102476576 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18358/statm: 24843 2583 831 364 0 1694 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 99372

[startup+0.200495 s]
/proc/loadavg: 4.01 4.06 4.02 5/479 18358
/proc/meminfo: memFree=15471668/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=126296 CPUtime=0.12 cores=0,2,4,6
/proc/18358/stat : 18358 (python) R 18356 18358 17732 0 -1 4202496 4709 934 1 0 8 4 0 0 18 0 1 0 651540382 129327104 3895 33554432000 4194304 5683644 140733206834592 18446744073709551615 5178114 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18358/statm: 31574 3895 1001 364 0 2869 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 126296

[startup+0.300483 s]
/proc/loadavg: 4.01 4.06 4.02 5/479 18358
/proc/meminfo: memFree=15471668/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=135748 CPUtime=0.19 cores=0,2,4,6
/proc/18358/stat : 18358 (python) S 18356 18358 17732 0 -1 4202496 5972 934 1 0 14 5 0 0 18 0 1 0 651540382 139005952 4149 33554432000 4194304 5683644 140733206834592 18446744073709551615 220816232453 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/18358/statm: 33937 4149 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700439 s]
/proc/loadavg: 4.01 4.06 4.02 5/479 18358
/proc/meminfo: memFree=15471668/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=278764 CPUtime=0.45 cores=0,2,4,6
/proc/18358/stat : 18358 (python) R 18356 18358 17732 0 -1 4202496 9407 934 1 0 35 10 0 0 17 0 1 0 651540382 285454336 7066 33554432000 4194304 5683644 140733206834592 18446744073709551615 47801102701514 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18358/statm: 69691 7066 1826 364 0 5615 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 278764

[startup+1.50028 s]
/proc/loadavg: 4.01 4.06 4.02 5/483 18366
/proc/meminfo: memFree=15445968/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=288820 CPUtime=0.57 cores=0,2,4,6
/proc/18358/stat : 18358 (python) S 18356 18358 17732 0 -1 4202496 9899 934 1 0 46 11 0 0 19 0 2 0 651540382 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18358/statm: 72205 7082 1867 364 0 8123 0
[pid=18364] ppid=18358 vsize=278576 CPUtime=0 cores=0,2,4,6
/proc/18364/stat : 18364 (python) S 18358 18358 17732 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 651540463 285261824 5565 33554432000 4194304 5683644 140733206834592 18446744073709551615 220816256527 0 0 16781312 514 7476075991043932159 0 0 17 0 0 0 0
/proc/18364/statm: 69644 5565 354 364 0 5562 0
[pid=18366] ppid=18364 vsize=1017940 CPUtime=0.68 cores=0,2,4,6
/proc/18366/stat : 18366 (gnovelty+2) R 18364 18366 18366 0 -1 4202496 454 0 0 0 68 0 0 0 21 0 1 0 651540463 1042370560 192 33554432000 134512640 135663704 4293525712 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18366/statm: 254485 192 113 282 0 254201 0
[pid=18358/tid=18365] ppid=18356 vsize=288820 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18365/stat : 18365 (python) S 18356 18358 17732 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 2 0 651540463 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 1585336

[startup+3.10098 s]
/proc/loadavg: 4.01 4.06 4.02 5/483 18366
/proc/meminfo: memFree=15445100/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=288820 CPUtime=0.57 cores=0,2,4,6
/proc/18358/stat : 18358 (python) S 18356 18358 17732 0 -1 4202496 9899 934 1 0 46 11 0 0 19 0 2 0 651540382 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18358/statm: 72205 7082 1867 364 0 8123 0
[pid=18364] ppid=18358 vsize=278576 CPUtime=0 cores=0,2,4,6
/proc/18364/stat : 18364 (python) S 18358 18358 17732 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 651540463 285261824 5565 33554432000 4194304 5683644 140733206834592 18446744073709551615 220816256527 0 0 16781312 514 7476075991043899650 0 0 17 0 0 0 0
/proc/18364/statm: 69644 5565 354 364 0 5562 0
[pid=18366] ppid=18364 vsize=1017940 CPUtime=2.28 cores=0,2,4,6
/proc/18366/stat : 18366 (gnovelty+2) R 18364 18366 18366 0 -1 4202496 454 0 0 0 228 0 0 0 25 0 1 0 651540463 1042370560 192 33554432000 134512640 135663704 4293525712 18446744073709551615 134524653 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18366/statm: 254485 192 113 282 0 254201 0
[pid=18358/tid=18365] ppid=18356 vsize=288820 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18365/stat : 18365 (python) S 18356 18358 17732 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 2 0 651540463 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.85
Current children cumulated vsize (KiB) 1585336

[startup+6.30039 s]
/proc/loadavg: 4.09 4.08 4.02 5/483 18366
/proc/meminfo: memFree=15444224/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=288820 CPUtime=0.57 cores=0,2,4,6
/proc/18358/stat : 18358 (python) S 18356 18358 17732 0 -1 4202496 9899 934 1 0 46 11 0 0 19 0 2 0 651540382 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18358/statm: 72205 7082 1867 364 0 8123 0
[pid=18364] ppid=18358 vsize=278576 CPUtime=0.02 cores=0,2,4,6
/proc/18364/stat : 18364 (python) S 18358 18358 17732 0 -1 4202560 885 0 0 0 1 1 0 0 18 0 1 0 651540463 285261824 5588 33554432000 4194304 5683644 140733206834592 18446744073709551615 220816256527 0 0 16781312 514 7476075991043899650 0 0 17 0 0 0 0
/proc/18364/statm: 69644 5588 377 364 0 5562 0
[pid=18366] ppid=18364 vsize=1017940 CPUtime=5.47 cores=0,2,4,6
/proc/18366/stat : 18366 (gnovelty+2) R 18364 18366 18366 0 -1 4202496 454 0 0 0 547 0 0 0 25 0 1 0 651540463 1042370560 192 33554432000 134512640 135663704 4293525712 18446744073709551615 134544212 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18366/statm: 254485 192 113 282 0 254201 0
[pid=18358/tid=18365] ppid=18356 vsize=288820 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18365/stat : 18365 (python) S 18356 18358 17732 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 2 0 651540463 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.06
Current children cumulated vsize (KiB) 1585336

[startup+12.7012 s]
/proc/loadavg: 4.08 4.08 4.02 5/483 18366
/proc/meminfo: memFree=15443332/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=288820 CPUtime=0.57 cores=0,2,4,6
/proc/18358/stat : 18358 (python) S 18356 18358 17732 0 -1 4202496 9899 934 1 0 46 11 0 0 19 0 2 0 651540382 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18358/statm: 72205 7082 1867 364 0 8123 0
[pid=18364] ppid=18358 vsize=278576 CPUtime=0.04 cores=0,2,4,6
/proc/18364/stat : 18364 (python) S 18358 18358 17732 0 -1 4202560 887 0 0 0 2 2 0 0 18 0 1 0 651540463 285261824 5588 33554432000 4194304 5683644 140733206834592 18446744073709551615 220816256527 0 0 16781312 514 11110802493188047106 0 0 17 0 0 0 0
/proc/18364/statm: 69644 5588 377 364 0 5562 0
[pid=18366] ppid=18364 vsize=1017940 CPUtime=11.87 cores=0,2,4,6
/proc/18366/stat : 18366 (gnovelty+2) R 18364 18366 18366 0 -1 4202496 454 0 0 0 1187 0 0 0 25 0 1 0 651540463 1042370560 192 33554432000 134512640 135663704 4293525712 18446744073709551615 134524923 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18366/statm: 254485 192 113 282 0 254201 0
[pid=18358/tid=18365] ppid=18356 vsize=288820 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18365/stat : 18365 (python) S 18356 18358 17732 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 2 0 651540463 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.48
Current children cumulated vsize (KiB) 1585336

[startup+25.5009 s]
/proc/loadavg: 4.06 4.07 4.02 5/483 18366
/proc/meminfo: memFree=15442464/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=288820 CPUtime=0.57 cores=0,2,4,6
/proc/18358/stat : 18358 (python) S 18356 18358 17732 0 -1 4202496 9899 934 1 0 46 11 0 0 19 0 2 0 651540382 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18358/statm: 72205 7082 1867 364 0 8123 0
[pid=18364] ppid=18358 vsize=278576 CPUtime=0.07 cores=0,2,4,6
/proc/18364/stat : 18364 (python) S 18358 18358 17732 0 -1 4202560 891 0 0 0 4 3 0 0 18 0 1 0 651540463 285261824 5588 33554432000 4194304 5683644 140733206834592 18446744073709551615 220816256527 0 0 16781312 514 11110802493188047106 0 0 17 0 0 0 0
/proc/18364/statm: 69644 5588 377 364 0 5562 0
[pid=18366] ppid=18364 vsize=1017940 CPUtime=24.66 cores=0,2,4,6
/proc/18366/stat : 18366 (gnovelty+2) R 18364 18366 18366 0 -1 4202496 454 0 0 0 2466 0 0 0 25 0 1 0 651540463 1042370560 192 33554432000 134512640 135663704 4293525712 18446744073709551615 134524551 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18366/statm: 254485 192 113 282 0 254201 0
[pid=18358/tid=18365] ppid=18356 vsize=288820 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18365/stat : 18365 (python) S 18356 18358 17732 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 2 0 651540463 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.3
Current children cumulated vsize (KiB) 1585336

[startup+51.1011 s]
/proc/loadavg: 4.04 4.07 4.02 5/483 18367
/proc/meminfo: memFree=15439248/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=288820 CPUtime=0.57 cores=0,2,4,6
/proc/18358/stat : 18358 (python) S 18356 18358 17732 0 -1 4202496 9899 934 1 0 46 11 0 0 19 0 2 0 651540382 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18358/statm: 72205 7082 1867 364 0 8123 0
[pid=18364] ppid=18358 vsize=278576 CPUtime=0.16 cores=0,2,4,6
/proc/18364/stat : 18364 (python) S 18358 18358 17732 0 -1 4202560 899 0 0 0 9 7 0 0 18 0 1 0 651540463 285261824 5588 33554432000 4194304 5683644 140733206834592 18446744073709551615 220816256527 0 0 16781312 514 11110802493188047106 0 0 17 0 0 0 0
/proc/18364/statm: 69644 5588 377 364 0 5562 0
[pid=18366] ppid=18364 vsize=1017940 CPUtime=50.24 cores=0,2,4,6
/proc/18366/stat : 18366 (gnovelty+2) R 18364 18366 18366 0 -1 4202496 454 0 0 0 5024 0 0 0 25 0 1 0 651540463 1042370560 192 33554432000 134512640 135663704 4293525712 18446744073709551615 134525533 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18366/statm: 254485 192 113 282 0 254201 0
[pid=18358/tid=18365] ppid=18356 vsize=288820 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18365/stat : 18365 (python) S 18356 18358 17732 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 2 0 651540463 295751680 7082 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.97
Current children cumulated vsize (KiB) 1585336

[startup+102.301 s]
/proc/loadavg: 4.02 4.05 4.01 5/487 18372
/proc/meminfo: memFree=15427876/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=299532 CPUtime=0.6 cores=0,2,4,6
/proc/18358/stat : 18358 (python) S 18356 18358 17732 0 -1 4202496 10737 934 1 0 49 11 0 0 20 0 3 0 651540382 306720768 7206 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18358/statm: 74883 7206 1870 364 0 10798 0
[pid=18364] ppid=18358 vsize=288820 CPUtime=0.34 cores=0,2,4,6
/proc/18364/stat : 18364 (python) S 18358 18358 17732 0 -1 4202560 1073 0 0 0 18 16 0 0 19 0 2 0 651540463 295751680 5626 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18364/statm: 72205 5626 410 364 0 8123 0
[pid=18366] ppid=18364 vsize=1017940 CPUtime=100.28 cores=0,2,4,6
/proc/18366/stat : 18366 (gnovelty+2) T 18364 18366 18366 0 -1 4202496 454 0 0 0 10028 0 0 0 25 0 1 0 651540463 1042370560 192 33554432000 134512640 135663704 4293525712 18446744073709551615 134545644 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/18366/statm: 254485 192 113 282 0 254201 0
[pid=18364/tid=18369] ppid=18358 vsize=288820 CPUtime=0 cores=0,2,4,6
/proc/18364/task/18369/stat : 18369 (python) S 18358 18358 17732 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 651550496 295751680 5626 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604441768450944 0 0 -1 6 0 0 0
[pid=18370] ppid=18358 vsize=289288 CPUtime=0 cores=0,2,4,6
/proc/18370/stat : 18370 (python) S 18358 18358 17732 0 -1 4202560 744 0 0 0 0 0 0 0 18 0 1 0 651550499 296230912 5680 33554432000 4194304 5683644 140733206834592 18446744073709551615 220816256582 0 0 16781312 514 4460121368490377476 0 0 17 4 0 0 0
/proc/18370/statm: 72322 5680 348 364 0 8237 0
[pid=18372] ppid=18370 vsize=1017940 CPUtime=1.11 cores=0,2,4,6
/proc/18372/stat : 18372 (gnovelty+2) R 18370 18372 18372 0 -1 4202496 458 0 0 0 111 0 0 0 24 0 1 0 651550499 1042370560 192 33554432000 134512640 135663704 4288067280 18446744073709551615 134524681 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18372/statm: 254485 192 113 282 0 254201 0
[pid=18358/tid=18365] ppid=18356 vsize=299532 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18365/stat : 18365 (python) S 18356 18358 17732 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 3 0 651540463 306720768 7206 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
[pid=18358/tid=18371] ppid=18356 vsize=299532 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18371/stat : 18371 (python) S 18356 18358 17732 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 3 0 651550499 306720768 7206 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 102.33
Current children cumulated vsize (KiB) 2913520

[startup+162.301 s]
/proc/loadavg: 4.12 4.07 4.02 5/487 18374
/proc/meminfo: memFree=15419768/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=299532 CPUtime=0.6 cores=0,2,4,6
/proc/18358/stat : 18358 (python) S 18356 18358 17732 0 -1 4202496 10737 934 1 0 49 11 0 0 20 0 3 0 651540382 306720768 7206 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18358/statm: 74883 7206 1870 364 0 10798 0
[pid=18364] ppid=18358 vsize=288820 CPUtime=0.34 cores=0,2,4,6

################
# More data... #
################

/proc/18379/stat : 18379 (march_hi) T 18377 18379 18379 0 -1 4202496 90624 0 0 0 223380 22 0 0 25 0 1 0 651560435 476774400 90348 33554432000 4194304 4955518 140737124458000 18446744073709551615 4235606 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18379/statm: 116400 90348 106 186 0 116213 0
[pid=18377/tid=18401] ppid=18358 vsize=299412 CPUtime=0 cores=0,2,4,6
/proc/18377/task/18401/stat : 18401 (python) S 18358 18358 17732 0 -1 4202560 51 0 0 0 0 0 0 0 15 0 2 0 651628741 306597888 5687 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604441142050880 0 0 -1 0 0 0 0
[pid=18405] ppid=18358 vsize=310024 CPUtime=2.4 cores=0,2,4,6
/proc/18405/stat : 18405 (python) S 18358 18358 17732 0 -1 4202560 1153 0 0 0 128 112 0 0 15 0 2 0 651638236 317464576 5802 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18405/statm: 77506 5802 400 364 0 13415 0
[pid=18407] ppid=18405 vsize=142636 CPUtime=681.81 cores=0,2,4,6
/proc/18407/stat : 18407 (march_hi) T 18405 18407 18407 0 -1 4202496 31773 0 0 0 68174 7 0 0 25 0 1 0 651638236 146059264 31498 33554432000 4194304 4955518 140737063184000 18446744073709551615 4208676 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18407/statm: 35659 31498 106 186 0 35472 0
[pid=18405/tid=18422] ppid=18358 vsize=310024 CPUtime=0 cores=0,2,4,6
/proc/18405/task/18422/stat : 18422 (python) S 18358 18358 17732 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 651677535 317464576 5802 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604448506086656 0 0 -1 6 0 0 0
[pid=18549] ppid=18358 vsize=320460 CPUtime=2.26 cores=0,2,4,6
/proc/18549/stat : 18549 (python) S 18358 18358 17732 0 -1 4202560 1172 0 0 0 125 101 0 0 15 0 2 0 651706451 328151040 5829 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18549/statm: 80115 5829 400 364 0 16021 0
[pid=18551] ppid=18549 vsize=142636 CPUtime=679.76 cores=0,2,4,6
/proc/18551/stat : 18551 (march_hi) T 18549 18551 18551 0 -1 4202496 30702 0 0 0 67970 6 0 0 25 0 1 0 651706451 146059264 30426 33554432000 4194304 4955518 140736821076160 18446744073709551615 4208656 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18551/statm: 35659 30426 106 186 0 35472 0
[pid=18549/tid=18597] ppid=18358 vsize=320460 CPUtime=0 cores=0,2,4,6
/proc/18549/task/18597/stat : 18597 (python) S 18358 18358 17732 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 651745331 328151040 5829 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604445786743232 0 0 -1 6 0 0 0
[pid=18793] ppid=18358 vsize=330612 CPUtime=2.04 cores=0,2,4,6
/proc/18793/stat : 18793 (python) S 18358 18358 17732 0 -1 4202560 1157 0 0 0 112 92 0 0 15 0 2 0 651774447 338546688 5833 33554432000 4194304 5683644 140733206834592 18446744073709551615 220816256582 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18793/statm: 82653 5833 400 364 0 18556 0
[pid=18795] ppid=18793 vsize=142636 CPUtime=601.48 cores=0,2,4,6
/proc/18795/stat : 18795 (march_hi) R 18793 18795 18795 0 -1 4202496 27230 0 0 0 60141 7 0 0 25 0 1 0 651774447 146059264 26952 33554432000 4194304 4955518 140734513530976 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18795/statm: 35659 26952 106 186 0 35472 0
[pid=18793/tid=18822] ppid=18358 vsize=330612 CPUtime=0 cores=0,2,4,6
/proc/18793/task/18822/stat : 18822 (python) S 18358 18358 17732 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 651813701 338546688 5833 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604441142052672 0 0 -1 6 0 0 0
[pid=18839] ppid=18358 vsize=341084 CPUtime=1.71 cores=0,2,4,6
/proc/18839/stat : 18839 (python) S 18358 18358 17732 0 -1 4202560 1161 0 0 0 93 78 0 0 15 0 2 0 651823135 349270016 5865 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18839/statm: 85271 5865 400 364 0 21171 0
[pid=18841] ppid=18839 vsize=94416 CPUtime=486.14 cores=0,2,4,6
/proc/18841/stat : 18841 (march_hi) T 18839 18841 18841 0 -1 4202496 22031 0 0 0 48609 5 0 0 25 0 1 0 651823136 96681984 21752 33554432000 4194304 4955518 140734735907712 18446744073709551615 4285664 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18841/statm: 23604 21752 106 186 0 23417 0
[pid=18839/tid=18864] ppid=18358 vsize=341084 CPUtime=0 cores=0,2,4,6
/proc/18839/task/18864/stat : 18864 (python) S 18358 18358 17732 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 651862317 349270016 5865 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604450361293760 0 0 -1 6 0 0 0
[pid=18872] ppid=18358 vsize=351660 CPUtime=0.34 cores=0,2,4,6
/proc/18872/stat : 18872 (python) S 18358 18358 17732 0 -1 4202560 1141 0 0 0 18 16 0 0 19 0 2 0 651871752 360099840 5955 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18872/statm: 87915 5955 406 364 0 23812 0
[pid=18874] ppid=18872 vsize=416280 CPUtime=99.33 cores=0,2,4,6
/proc/18874/stat : 18874 (adaptg2wsat2009) T 18872 18874 18874 0 -1 4202496 523 0 0 0 9933 0 0 0 25 0 1 0 651871753 426270720 252 33554432000 134512640 135107411 4291697168 18446744073709551615 134531613 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/18874/statm: 104070 252 59 146 0 102946 0
[pid=18872/tid=18878] ppid=18358 vsize=351660 CPUtime=0 cores=0,2,4,6
/proc/18872/task/18878/stat : 18878 (python) S 18358 18358 17732 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 651881687 360099840 5955 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604441325488128 0 0 -1 6 0 0 0
[pid=18358/tid=18365] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18365/stat : 18365 (python) S 18356 18358 17732 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 9 0 651540463 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
[pid=18358/tid=18371] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18371/stat : 18371 (python) S 18356 18358 17732 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 9 0 651550499 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 4 0 0 0
[pid=18358/tid=18378] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18378/stat : 18378 (python) S 18356 18358 17732 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 9 0 651560435 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 4 0 0 0
[pid=18358/tid=18406] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18406/stat : 18406 (python) S 18356 18358 17732 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 9 0 651638236 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 4 0 0 0
[pid=18358/tid=18550] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18550/stat : 18550 (python) S 18356 18358 17732 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 9 0 651706451 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
[pid=18358/tid=18794] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18794/stat : 18794 (python) S 18356 18358 17732 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 9 0 651774447 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 4 0 0 0
[pid=18358/tid=18840] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18840/stat : 18840 (python) S 18356 18358 17732 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 9 0 651823136 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 0 0 0 0
[pid=18358/tid=18873] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18873/stat : 18873 (python) S 18356 18358 17732 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 9 0 651871753 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5000.05
Current children cumulated vsize (KiB) 6332968

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4983.8 s]
/proc/loadavg: 4.04 4.03 4.00 6/522 18935
/proc/meminfo: memFree=13769828/32951124 swapFree=63485432/67111528
[pid=18358] ppid=18356 vsize=361524 CPUtime=0.91 cores=0,2,4,6
/proc/18358/stat : 18358 (python) S 18356 18358 17732 0 -1 4202496 17319 934 1 0 78 13 0 0 18 0 9 0 651540382 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/18358/statm: 90381 7379 1890 364 0 26278 0
[pid=18364] ppid=18358 vsize=288820 CPUtime=0.34 cores=0,2,4,6
/proc/18364/stat : 18364 (python) S 18358 18358 17732 0 -1 4202560 1073 0 0 0 18 16 0 0 19 0 2 0 651540463 295751680 5626 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18364/statm: 72205 5626 410 364 0 8123 0
[pid=18366] ppid=18364 vsize=1017940 CPUtime=100.28 cores=0,2,4,6
/proc/18366/stat : 18366 (gnovelty+2) T 18364 18366 18366 0 -1 4202496 454 0 0 0 10028 0 0 0 25 0 1 0 651540463 1042370560 192 33554432000 134512640 135663704 4293525712 18446744073709551615 134545644 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/18366/statm: 254485 192 113 282 0 254201 0
[pid=18364/tid=18369] ppid=18358 vsize=288820 CPUtime=0 cores=0,2,4,6
/proc/18364/task/18369/stat : 18369 (python) S 18358 18358 17732 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 651550496 295751680 5626 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604441768450944 0 0 -1 6 0 0 0
[pid=18370] ppid=18358 vsize=289288 CPUtime=0.33 cores=0,2,4,6
/proc/18370/stat : 18370 (python) S 18358 18358 17732 0 -1 4202560 1079 0 0 0 18 15 0 0 19 0 2 0 651550499 296230912 5733 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18370/statm: 72322 5733 400 364 0 8237 0
[pid=18372] ppid=18370 vsize=1017940 CPUtime=99.3 cores=0,2,4,6
/proc/18372/stat : 18372 (gnovelty+2) T 18370 18372 18372 0 -1 4202496 458 0 0 0 9930 0 0 0 25 0 1 0 651550499 1042370560 192 33554432000 134512640 135663704 4288067280 18446744073709551615 134525213 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18372/statm: 254485 192 113 282 0 254201 0
[pid=18370/tid=18376] ppid=18358 vsize=289288 CPUtime=0 cores=0,2,4,6
/proc/18370/task/18376/stat : 18376 (python) S 18358 18358 17732 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 651560432 296230912 5733 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604453951146176 0 0 -1 6 0 0 0
[pid=18377] ppid=18358 vsize=299412 CPUtime=7.6 cores=0,2,4,6
/proc/18377/stat : 18377 (python) S 18358 18358 17732 0 -1 4202560 1153 0 0 0 423 337 0 0 15 0 2 0 651560435 306597888 5687 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18377/statm: 74853 5687 400 364 0 10765 0
[pid=18379] ppid=18377 vsize=465600 CPUtime=2234.02 cores=0,2,4,6
/proc/18379/stat : 18379 (march_hi) T 18377 18379 18379 0 -1 4202496 90624 0 0 0 223380 22 0 0 25 0 1 0 651560435 476774400 90348 33554432000 4194304 4955518 140737124458000 18446744073709551615 4235606 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18379/statm: 116400 90348 106 186 0 116213 0
[pid=18377/tid=18401] ppid=18358 vsize=299412 CPUtime=0 cores=0,2,4,6
/proc/18377/task/18401/stat : 18401 (python) S 18358 18358 17732 0 -1 4202560 51 0 0 0 0 0 0 0 15 0 2 0 651628741 306597888 5687 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604441142050880 0 0 -1 0 0 0 0
[pid=18405] ppid=18358 vsize=310024 CPUtime=2.4 cores=0,2,4,6
/proc/18405/stat : 18405 (python) S 18358 18358 17732 0 -1 4202560 1153 0 0 0 128 112 0 0 15 0 2 0 651638236 317464576 5802 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18405/statm: 77506 5802 400 364 0 13415 0
[pid=18407] ppid=18405 vsize=142636 CPUtime=681.81 cores=0,2,4,6
/proc/18407/stat : 18407 (march_hi) T 18405 18407 18407 0 -1 4202496 31773 0 0 0 68174 7 0 0 25 0 1 0 651638236 146059264 31498 33554432000 4194304 4955518 140737063184000 18446744073709551615 4208676 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18407/statm: 35659 31498 106 186 0 35472 0
[pid=18405/tid=18422] ppid=18358 vsize=310024 CPUtime=0 cores=0,2,4,6
/proc/18405/task/18422/stat : 18422 (python) S 18358 18358 17732 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 651677535 317464576 5802 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604448506086656 0 0 -1 6 0 0 0
[pid=18549] ppid=18358 vsize=320460 CPUtime=2.26 cores=0,2,4,6
/proc/18549/stat : 18549 (python) S 18358 18358 17732 0 -1 4202560 1172 0 0 0 125 101 0 0 15 0 2 0 651706451 328151040 5829 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18549/statm: 80115 5829 400 364 0 16021 0
[pid=18551] ppid=18549 vsize=142636 CPUtime=679.76 cores=0,2,4,6
/proc/18551/stat : 18551 (march_hi) T 18549 18551 18551 0 -1 4202496 30702 0 0 0 67970 6 0 0 25 0 1 0 651706451 146059264 30426 33554432000 4194304 4955518 140736821076160 18446744073709551615 4208656 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18551/statm: 35659 30426 106 186 0 35472 0
[pid=18549/tid=18597] ppid=18358 vsize=320460 CPUtime=0 cores=0,2,4,6
/proc/18549/task/18597/stat : 18597 (python) S 18358 18358 17732 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 651745331 328151040 5829 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604445786743232 0 0 -1 6 0 0 0
[pid=18793] ppid=18358 vsize=330612 CPUtime=2.04 cores=0,2,4,6
/proc/18793/stat : 18793 (python) S 18358 18358 17732 0 -1 4202560 1157 0 0 0 112 92 0 0 15 0 2 0 651774447 338546688 5833 33554432000 4194304 5683644 140733206834592 18446744073709551615 220816256582 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18793/statm: 82653 5833 400 364 0 18556 0
[pid=18795] ppid=18793 vsize=142636 CPUtime=601.48 cores=0,2,4,6
/proc/18795/stat : 18795 (march_hi) R 18793 18795 18795 0 -1 4202496 27230 0 0 0 60141 7 0 0 25 0 1 0 651774447 146059264 26952 33554432000 4194304 4955518 140734513530976 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18795/statm: 35659 26952 106 186 0 35472 0
[pid=18793/tid=18822] ppid=18358 vsize=330612 CPUtime=0 cores=0,2,4,6
/proc/18793/task/18822/stat : 18822 (python) S 18358 18358 17732 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 651813701 338546688 5833 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604441142052672 0 0 -1 6 0 0 0
[pid=18839] ppid=18358 vsize=341084 CPUtime=1.71 cores=0,2,4,6
/proc/18839/stat : 18839 (python) S 18358 18358 17732 0 -1 4202560 1161 0 0 0 93 78 0 0 15 0 2 0 651823135 349270016 5865 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18839/statm: 85271 5865 400 364 0 21171 0
[pid=18841] ppid=18839 vsize=94416 CPUtime=486.14 cores=0,2,4,6
/proc/18841/stat : 18841 (march_hi) T 18839 18841 18841 0 -1 4202496 22031 0 0 0 48609 5 0 0 25 0 1 0 651823136 96681984 21752 33554432000 4194304 4955518 140734735907712 18446744073709551615 4285664 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18841/statm: 23604 21752 106 186 0 23417 0
[pid=18839/tid=18864] ppid=18358 vsize=341084 CPUtime=0 cores=0,2,4,6
/proc/18839/task/18864/stat : 18864 (python) S 18358 18358 17732 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 651862317 349270016 5865 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604450361293760 0 0 -1 6 0 0 0
[pid=18872] ppid=18358 vsize=351660 CPUtime=0.34 cores=0,2,4,6
/proc/18872/stat : 18872 (python) S 18358 18358 17732 0 -1 4202560 1141 0 0 0 18 16 0 0 19 0 2 0 651871752 360099840 5955 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828063179 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18872/statm: 87915 5955 406 364 0 23812 0
[pid=18874] ppid=18872 vsize=416280 CPUtime=99.33 cores=0,2,4,6
/proc/18874/stat : 18874 (adaptg2wsat2009) T 18872 18874 18874 0 -1 4202496 523 0 0 0 9933 0 0 0 25 0 1 0 651871753 426270720 252 33554432000 134512640 135107411 4291697168 18446744073709551615 134531613 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/18874/statm: 104070 252 59 146 0 102946 0
[pid=18872/tid=18878] ppid=18358 vsize=351660 CPUtime=0 cores=0,2,4,6
/proc/18872/task/18878/stat : 18878 (python) S 18358 18358 17732 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 651881687 360099840 5955 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 514 18446604441325488128 0 0 -1 6 0 0 0
[pid=18358/tid=18365] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18365/stat : 18365 (python) S 18356 18358 17732 0 -1 4202560 30 934 0 0 0 0 0 0 19 0 9 0 651540463 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
[pid=18358/tid=18371] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18371/stat : 18371 (python) S 18356 18358 17732 0 -1 4202560 28 934 0 0 0 0 0 0 20 0 9 0 651550499 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 4 0 0 0
[pid=18358/tid=18378] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18378/stat : 18378 (python) S 18356 18358 17732 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 9 0 651560435 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 4 0 0 0
[pid=18358/tid=18406] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18406/stat : 18406 (python) S 18356 18358 17732 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 9 0 651638236 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 4 0 0 0
[pid=18358/tid=18550] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18550/stat : 18550 (python) S 18356 18358 17732 0 -1 4202560 33 934 0 0 0 0 0 0 18 0 9 0 651706451 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 6 0 0 0
[pid=18358/tid=18794] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18794/stat : 18794 (python) S 18356 18358 17732 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 9 0 651774447 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 4 0 0 0
[pid=18358/tid=18840] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18840/stat : 18840 (python) S 18356 18358 17732 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 9 0 651823136 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 0 0 0 0
[pid=18358/tid=18873] ppid=18356 vsize=361524 CPUtime=0 cores=0,2,4,6
/proc/18358/task/18873/stat : 18873 (python) S 18356 18358 17732 0 -1 4202560 29 934 0 0 0 0 0 0 20 0 9 0 651871753 370200576 7379 33554432000 4194304 5683644 140733206834592 18446744073709551615 220828060081 0 0 16781312 2 18446604453936428160 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5000.05
Current children cumulated vsize (KiB) 6332968

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18358 and gives
#  childrusage.ru_utime.tv_sec=710
#  childrusage.ru_utime.tv_usec=980914
#  childrusage.ru_stime.tv_sec=7
#  childrusage.ru_stime.tv_usec=928794
# CPU time returned by wait4() is 718.91
# while last known CPU time is 5000.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4983.87
CPU time (s): 5000.05
CPU user time (s): 4991.78
CPU system time (s): 8.27
CPU usage (%): 100.325
Max. virtual memory (cumulated for all children) (KiB): 6332968

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 710.981
system time used= 7.92879
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 57080
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9377
involuntary context switches= 2158

runsolver used 29.7935 second user time and 58.3671 second system time

The end

Launcher Data 

Begin job on node147 at 2011-05-17 02:14:05
IDJOB=3386734
IDBENCH=82799
IDSOLVER=1872
FILE ID=node147/3386734-1305591245
RUNJOBID= node147-1305586142-17750
PBS_JOBID= 13350331
Free space on /tmp= 73076 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S2124915970-046.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386734-1305591245/watcher-3386734-1305591245 -o /tmp/evaluation-result-3386734-1305591245/solver-3386734-1305591245 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386734-1305591245.cnf -seed 594693782 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e6a3a97a5be52c43f493d905174d1bee
RANDOM SEED=594693782

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15472072 kB
Buffers:        331736 kB
Cached:        5562748 kB
SwapCached:      13124 kB
Active:       10734264 kB
Inactive:      6450052 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15472072 kB
SwapTotal:    67111528 kB
SwapFree:     63485432 kB
Dirty:           31892 kB
Writeback:           0 kB
AnonPages:    11285324 kB
Mapped:          30980 kB
Slab:           157352 kB
PageTables:      69112 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 115065400 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73032 MiB
End job on node147 at 2011-05-17 03:37:11