Trace number 3484051

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed, 1200 s timeout)? (MO) 703.09 705.364

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1250-c25000-S573815729-001-UNKNOWN.cnf
MD5SUM34a446d3b38e7b034208a35fa75247bf
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark172.11
Satisfiable
(Un)Satisfiability was proved
Number of variables1250
Number of clauses25000
Sum of the clauses size125000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 525000
Number of clauses of size over 50

Solver Data

0.50/3.05	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.50/3.05	c INFO: solving HOME/instance-3484051-1307747009.cnf
0.50/3.05	c INFO: computing task features
0.55/3.19	c INFO: computed variable-clause graph statistics
0.55/3.19	c INFO: computed clause balance statistics
1.25/3.84	c INFO: computed variable balance statistics
1.55/4.17	c INFO: computed small-clause counts
1.55/4.17	c INFO: computed Horn-clause counts
1.65/4.20	c INFO: computed variable graph statistics
1.65/4.20	c INFO: collected features for HOME/instance-3484051-1307747009.cnf in 1.13 s
1.65/4.21	c INFO: running gnovelty+2@0 for 97 with 1198 remaining (b = 0.38)
101.70/104.37	c INFO: running gnovelty+2@0 for 97 with 1098 remaining (b = 0.14)
201.00/203.53	c INFO: running adaptg2wsat2009++@0 for 97 with 999 remaining (b = 0.09)
301.11/303.66	c INFO: running adaptg2wsat2009++@0 for 97 with 899 remaining (b = 0.07)
401.45/403.81	c INFO: running adaptg2wsat2009++@0 for 97 with 799 remaining (b = 0.06)
501.67/503.96	c INFO: running gnovelty+2@0 for 97 with 699 remaining (b = 0.05)
601.91/604.14	c INFO: running FH@0 for 97 with 599 remaining (b = 0.04)
702.09/704.31	c INFO: running adaptg2wsat2009++@0 for 97 with 499 remaining (b = 0.03)

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 988)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3484051-1307747009/watcher-3484051-1307747009 -o /tmp/evaluation-result-3484051-1307747009/solver-3484051-1307747009 -C 1200 -W 1300 -M 7680 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3484051-1307747009.cnf -seed 5039089 -budget 1200 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.08 0.02 0.01 3/183 31446
/proc/meminfo: memFree=31486556/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=11804 CPUtime=0 cores=4,6
/proc/31445/stat : 31445 (runsolver) S 31437 31445 31379 0 -1 4202560 41 0 0 0 0 0 0 0 19 0 1 0 886300876 12087296 50 33554432000 4194304 5436572 140736529392160 18446744073709551615 4883175 0 2147483391 4096 24578 18446744071699968823 0 0 17 4 0 0 0
/proc/31445/statm: 2951 50 31 304 0 2643 0

[startup+0.0336791 s]
/proc/loadavg: 0.08 0.02 0.01 3/183 31446
/proc/meminfo: memFree=31486556/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=14820 CPUtime=0 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 512 0 0 0 0 0 0 0 20 0 1 0 886300876 15175680 419 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080228197 0 2147483391 4096 0 18446744071699207358 0 0 17 6 0 0 0
/proc/31445/statm: 3705 419 259 364 0 192 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 14820

[startup+0.100668 s]
/proc/loadavg: 0.08 0.02 0.01 3/183 31446
/proc/meminfo: memFree=31486556/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=15380 CPUtime=0 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 792 0 0 0 0 0 0 0 20 0 1 0 886300876 15749120 679 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/31445/statm: 3845 679 322 364 0 332 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15380

[startup+0.300635 s]
/proc/loadavg: 0.08 0.02 0.01 3/183 31446
/proc/meminfo: memFree=31486556/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=16392 CPUtime=0.01 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 1076 0 0 0 1 0 0 0 18 0 1 0 886300876 16785408 946 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080228197 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/31445/statm: 4098 946 382 364 0 585 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16392

[startup+0.700555 s]
/proc/loadavg: 0.08 0.02 0.01 3/183 31446
/proc/meminfo: memFree=31486556/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=91828 CPUtime=0.08 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 2679 0 0 0 4 4 0 0 15 0 1 0 886300876 94031872 2394 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080230400 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 2
/proc/31445/statm: 22957 2394 755 364 0 1622 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 91828

[startup+2.23426 s]
/proc/loadavg: 0.08 0.02 0.01 3/183 31446
/proc/meminfo: memFree=31486556/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=135748 CPUtime=0.28 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 5975 933 1 0 14 14 0 0 16 0 1 0 886300876 139005952 4150 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080228357 0 2147483391 16781312 2 18446744071699953811 0 0 17 6 0 0 2
/proc/31445/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 135748
heavy processes:

[startup+3.10009 s]
/proc/loadavg: 0.39 0.08 0.03 2/190 31472
/proc/meminfo: memFree=31428720/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=280976 CPUtime=0.55 cores=4,6
/proc/31445/stat : 31445 (python) R 31437 31445 31379 0 -1 4202496 9903 933 1 0 31 24 0 0 15 0 1 0 886300876 287719424 7574 33554432000 4194304 5683644 140734730279712 18446744073709551615 4602441 0 0 16781312 2 0 0 0 17 4 0 0 2
/proc/31445/statm: 70244 7576 1761 364 0 6168 0
Current children cumulated CPU time (s) 0.55
Current children cumulated vsize (KiB) 280976
heavy processes:

[startup+6.30048 s]
/proc/loadavg: 0.68 0.15 0.05 6/199 31481
/proc/meminfo: memFree=31337740/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=292288 CPUtime=1.66 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 12427 933 1 0 141 25 0 0 19 0 2 0 886300876 299302912 7937 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 2
/proc/31445/statm: 73072 7937 1869 364 0 8990 0
[pid=31479] ppid=31445 vsize=282044 CPUtime=0 cores=4,6
/proc/31479/stat : 31479 (python) S 31445 31445 31379 0 -1 4202560 727 0 0 0 0 0 0 0 18 0 1 0 886301297 288813056 6418 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080252431 0 0 16781312 514 4056709727625642244 0 0 17 4 0 0 0
/proc/31479/statm: 70511 6418 354 364 0 6429 0
[pid=31481] ppid=31479 vsize=1018800 CPUtime=2.08 cores=4,6
/proc/31481/stat : 31481 (gnovelty+2) R 31479 31481 31481 0 -1 4202496 866 0 0 0 208 0 0 0 25 0 1 0 886301297 1043251200 602 33554432000 134512640 135663704 4293385392 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31481/statm: 254700 602 113 282 0 254416 0
[pid=31445/tid=31480] ppid=31437 vsize=292288 CPUtime=0 cores=4,6
/proc/31445/task/31480/stat : 31480 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 2 0 886301297 299302912 7937 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.74
Current children cumulated vsize (KiB) 1593132
heavy processes:

[startup+12.7003 s]
/proc/loadavg: 0.95 0.21 0.07 6/202 31484
/proc/meminfo: memFree=31309612/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=292288 CPUtime=1.66 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 12427 933 1 0 141 25 0 0 19 0 2 0 886300876 299302912 7937 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 2
/proc/31445/statm: 73072 7937 1869 364 0 8990 0
[pid=31479] ppid=31445 vsize=282044 CPUtime=0 cores=4,6
/proc/31479/stat : 31479 (python) S 31445 31445 31379 0 -1 4202560 859 0 0 0 0 0 0 0 18 0 1 0 886301297 288813056 6441 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080252431 0 0 16781312 514 4056709727625642244 0 0 17 4 0 0 0
/proc/31479/statm: 70511 6441 377 364 0 6429 0
[pid=31481] ppid=31479 vsize=1018800 CPUtime=8.47 cores=4,6
/proc/31481/stat : 31481 (gnovelty+2) R 31479 31481 31481 0 -1 4202496 866 0 0 0 847 0 0 0 25 0 1 0 886301297 1043251200 602 33554432000 134512640 135663704 4293385392 18446744073709551615 134525056 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31481/statm: 254700 602 113 282 0 254416 0
[pid=31445/tid=31480] ppid=31437 vsize=292288 CPUtime=0 cores=4,6
/proc/31445/task/31480/stat : 31480 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 2 0 886301297 299302912 7937 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 10.13
Current children cumulated vsize (KiB) 1593132
heavy processes:

[startup+25.5009 s]
/proc/loadavg: 1.42 0.33 0.11 6/202 31486
/proc/meminfo: memFree=31310144/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=292288 CPUtime=1.66 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 12427 933 1 0 141 25 0 0 19 0 2 0 886300876 299302912 7937 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 2
/proc/31445/statm: 73072 7937 1869 364 0 8990 0
[pid=31479] ppid=31445 vsize=282044 CPUtime=0.01 cores=4,6
/proc/31479/stat : 31479 (python) S 31445 31445 31379 0 -1 4202560 864 0 0 0 1 0 0 0 18 0 1 0 886301297 288813056 6441 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080252431 0 0 16781312 514 5280734445882540292 0 0 17 4 0 0 0
/proc/31479/statm: 70511 6441 377 364 0 6429 0
[pid=31481] ppid=31479 vsize=1018800 CPUtime=21.26 cores=4,6
/proc/31481/stat : 31481 (gnovelty+2) R 31479 31481 31481 0 -1 4202496 866 0 0 0 2126 0 0 0 25 0 1 0 886301297 1043251200 602 33554432000 134512640 135663704 4293385392 18446744073709551615 134525137 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31481/statm: 254700 602 113 282 0 254416 0
[pid=31445/tid=31480] ppid=31437 vsize=292288 CPUtime=0 cores=4,6
/proc/31445/task/31480/stat : 31480 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 2 0 886301297 299302912 7937 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 22.93
Current children cumulated vsize (KiB) 1593132

[startup+51.101 s]
/proc/loadavg: 2.43 0.68 0.23 6/202 31488
/proc/meminfo: memFree=31306872/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=292288 CPUtime=1.66 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 12427 933 1 0 141 25 0 0 19 0 2 0 886300876 299302912 7937 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 2
/proc/31445/statm: 73072 7937 1869 364 0 8990 0
[pid=31479] ppid=31445 vsize=282044 CPUtime=0.06 cores=4,6
/proc/31479/stat : 31479 (python) S 31445 31445 31379 0 -1 4202560 879 0 0 0 4 2 0 0 18 0 1 0 886301297 288813056 6441 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080252431 0 0 16781312 514 5280734445882540292 0 0 17 4 0 0 0
/proc/31479/statm: 70511 6441 377 364 0 6429 0
[pid=31481] ppid=31479 vsize=1018800 CPUtime=46.8 cores=4,6
/proc/31481/stat : 31481 (gnovelty+2) R 31479 31481 31481 0 -1 4202496 866 0 0 0 4680 0 0 0 25 0 1 0 886301297 1043251200 602 33554432000 134512640 135663704 4293385392 18446744073709551615 134524901 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31481/statm: 254700 602 113 282 0 254416 0
[pid=31445/tid=31480] ppid=31437 vsize=292288 CPUtime=0 cores=4,6
/proc/31445/task/31480/stat : 31480 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 2 0 886301297 299302912 7937 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 48.52
Current children cumulated vsize (KiB) 1593132

[startup+102.3 s]
/proc/loadavg: 3.32 1.19 0.43 6/202 31535
/proc/meminfo: memFree=31328988/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=292288 CPUtime=1.66 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 12427 933 1 0 141 25 0 0 19 0 2 0 886300876 299302912 7937 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 2
/proc/31445/statm: 73072 7937 1869 364 0 8990 0
[pid=31479] ppid=31445 vsize=282044 CPUtime=0.12 cores=4,6
/proc/31479/stat : 31479 (python) S 31445 31445 31379 0 -1 4202560 902 0 0 0 7 5 0 0 18 0 1 0 886301297 288813056 6441 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080252431 0 0 16781312 514 5280734445882540292 0 0 17 4 0 0 0
/proc/31479/statm: 70511 6441 377 364 0 6429 0
[pid=31481] ppid=31479 vsize=1018800 CPUtime=97.92 cores=4,6
/proc/31481/stat : 31481 (gnovelty+2) R 31479 31481 31481 0 -1 4202496 866 0 0 0 9789 3 0 0 25 0 1 0 886301297 1043251200 602 33554432000 134512640 135663704 4293385392 18446744073709551615 134525323 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31481/statm: 254700 602 113 282 0 254416 0
[pid=31445/tid=31480] ppid=31437 vsize=292288 CPUtime=0 cores=4,6
/proc/31445/task/31480/stat : 31480 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 2 0 886301297 299302912 7937 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 99.7
Current children cumulated vsize (KiB) 1593132

[startup+162.301 s]
/proc/loadavg: 3.75 1.70 0.65 6/214 31549
/proc/meminfo: memFree=31283556/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=302544 CPUtime=1.66 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 13270 933 1 0 141 25 0 0 20 0 3 0 886300876 309805056 7944 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 2
/proc/31445/statm: 75636 7944 1872 364 0 11551 0
[pid=31479] ppid=31445 vsize=292288 CPUtime=0.13 cores=4,6
/proc/31479/stat : 31479 (python) S 31445 31445 31379 0 -1 4202560 1138 0 0 0 7 6 0 0 19 0 2 0 886301297 299302912 6484 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31479/statm: 73072 6484 415 364 0 8990 0
[pid=31481] ppid=31479 vsize=1018800 CPUtime=99.98 cores=4,6
/proc/31481/stat : 31481 (gnovelty+2) T 31479 31481 31481 0 -1 4202496 866 0 0 0 9995 3 0 0 25 0 1 0 886301297 1043251200 602 33554432000 134512640 135663704 4293385392 18446744073709551615 134524498 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31481/statm: 254700 602 113 282 0 254416 0
[pid=31479/tid=31540] ppid=31445 vsize=292288 CPUtime=0 cores=4,6
/proc/31479/task/31540/stat : 31540 (python) S 31445 31445 31379 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 886311312 299302912 6484 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453857219584 0 0 -1 4 0 0 0
[pid=31541] ppid=31445 vsize=292300 CPUtime=0.06 cores=4,6
/proc/31541/stat : 31541 (python) S 31445 31445 31379 0 -1 4202560 902 0 0 0 3 3 0 0 18 0 1 0 886311313 299315200 6439 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080252486 0 0 16781312 514 5280734445882540289 0 0 17 6 0 0 0
/proc/31541/statm: 73075 6439 371 364 0 8990 0
[pid=31543] ppid=31541 vsize=1018800 CPUtime=57.92 cores=4,6
/proc/31543/stat : 31543 (gnovelty+2) R 31541 31543 31543 0 -1 4202496 867 0 0 0 5792 0 0 0 25 0 1 0 886311313 1043251200 602 33554432000 134512640 135663704 4292255712 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31543/statm: 254700 602 113 282 0 254416 0
[pid=31445/tid=31480] ppid=31437 vsize=302544 CPUtime=0 cores=4,6
/proc/31445/task/31480/stat : 31480 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 3 0 886301297 309805056 7944 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 6 0 0 0
[pid=31445/tid=31542] ppid=31437 vsize=302544 CPUtime=0 cores=4,6
/proc/31445/task/31542/stat : 31542 (python) S 31437 31445 31379 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 3 0 886311313 309805056 7944 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 159.75
Current children cumulated vsize (KiB) 2924732

[startup+222.301 s]
/proc/loadavg: 3.91 2.12 0.86 6/230 31567

################
# More data... #
################

[pid=31556] ppid=31445 vsize=302704 CPUtime=0.13 cores=4,6
/proc/31556/stat : 31556 (python) S 31445 31445 31379 0 -1 4202560 1078 0 0 0 7 6 0 0 19 0 2 0 886321230 309968896 6510 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31556/statm: 75676 6510 400 364 0 11588 0
[pid=31558] ppid=31556 vsize=420484 CPUtime=99.98 cores=4,6
/proc/31558/stat : 31558 (adaptg2wsat2009) T 31556 31558 31558 0 -1 4202496 1758 0 0 0 9998 0 0 0 25 0 1 0 886321230 430575616 1493 33554432000 134512640 135107411 4293497920 18446744073709551615 134532349 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31558/statm: 105121 1493 59 146 0 103997 0
[pid=31556/tid=31578] ppid=31445 vsize=302704 CPUtime=0 cores=4,6
/proc/31556/task/31578/stat : 31578 (python) S 31445 31445 31379 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 886331242 309968896 6510 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453876357952 0 0 -1 6 0 0 0
[pid=31579] ppid=31445 vsize=312960 CPUtime=0.14 cores=4,6
/proc/31579/stat : 31579 (python) S 31445 31445 31379 0 -1 4202560 1086 0 0 0 7 7 0 0 19 0 2 0 886331243 320471040 6535 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31579/statm: 78240 6535 400 364 0 14149 0
[pid=31581] ppid=31579 vsize=420484 CPUtime=100.12 cores=4,6
/proc/31581/stat : 31581 (adaptg2wsat2009) T 31579 31581 31581 0 -1 4202496 1756 0 0 0 10012 0 0 0 25 0 1 0 886331243 430575616 1491 33554432000 134512640 135107411 4287974832 18446744073709551615 134532135 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31581/statm: 105121 1491 59 146 0 103997 0
[pid=31579/tid=31593] ppid=31445 vsize=312960 CPUtime=0 cores=4,6
/proc/31579/task/31593/stat : 31593 (python) S 31445 31445 31379 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 886341257 320471040 6535 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453854265728 0 0 -1 4 0 0 0
[pid=31594] ppid=31445 vsize=323216 CPUtime=0.15 cores=4,6
/proc/31594/stat : 31594 (python) S 31445 31445 31379 0 -1 4202560 1082 0 0 0 7 8 0 0 19 0 2 0 886341258 330973184 6539 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31594/statm: 80804 6539 400 364 0 16710 0
[pid=31596] ppid=31594 vsize=420484 CPUtime=100.13 cores=4,6
/proc/31596/stat : 31596 (adaptg2wsat2009) T 31594 31596 31596 0 -1 4202496 1757 0 0 0 10013 0 0 0 25 0 1 0 886341258 430575616 1492 33554432000 134512640 135107411 4291458976 18446744073709551615 134531781 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31596/statm: 105121 1492 59 146 0 103997 0
[pid=31594/tid=31608] ppid=31445 vsize=323216 CPUtime=0 cores=4,6
/proc/31594/task/31608/stat : 31608 (python) S 31445 31445 31379 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 886351272 330973184 6539 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453896964864 0 0 -1 6 0 0 0
[pid=31609] ppid=31445 vsize=333608 CPUtime=0.14 cores=4,6
/proc/31609/stat : 31609 (python) S 31445 31445 31379 0 -1 4202560 1090 0 0 0 8 6 0 0 19 0 2 0 886351273 341614592 6556 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31609/statm: 83402 6556 400 364 0 19305 0
[pid=31611] ppid=31609 vsize=1018800 CPUtime=100.06 cores=4,6
/proc/31611/stat : 31611 (gnovelty+2) T 31609 31611 31611 0 -1 4202496 868 0 0 0 10006 0 0 0 25 0 1 0 886351273 1043251200 603 33554432000 134512640 135663704 4294873728 18446744073709551615 134524888 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31611/statm: 254700 603 113 282 0 254416 0
[pid=31609/tid=31627] ppid=31445 vsize=333608 CPUtime=0 cores=4,6
/proc/31609/task/31627/stat : 31627 (python) S 31445 31445 31379 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 886361290 341614592 6556 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453985334208 0 0 -1 6 0 0 0
[pid=31628] ppid=31445 vsize=343864 CPUtime=0.16 cores=4,6
/proc/31628/stat : 31628 (python) S 31445 31445 31379 0 -1 4202560 1088 0 0 0 9 7 0 0 19 0 2 0 886361291 352116736 6586 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31628/statm: 85966 6586 400 364 0 21866 0
[pid=31630] ppid=31628 vsize=250368 CPUtime=99.98 cores=4,6
/proc/31630/stat : 31630 (FH) T 31628 31630 31630 0 -1 4202496 1678 0 0 0 9998 0 0 0 25 0 1 0 886361291 256376832 1407 33554432000 134512640 134936988 4289396160 18446744073709551615 134553505 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31630/statm: 62592 1407 41 104 0 62096 0
[pid=31628/tid=31644] ppid=31445 vsize=343864 CPUtime=0 cores=4,6
/proc/31628/task/31644/stat : 31644 (python) S 31445 31445 31379 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 886371307 352116736 6586 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604451493853312 0 0 -1 6 0 0 0
[pid=31645] ppid=31445 vsize=354120 CPUtime=0 cores=4,6
/proc/31645/stat : 31645 (python) S 31445 31445 31379 0 -1 4202560 834 0 0 0 0 0 0 0 19 0 1 0 886371308 362618880 6539 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080252486 0 0 16781312 514 4036870139814084607 0 0 17 4 0 0 0
/proc/31645/statm: 88530 6539 350 364 0 24427 0
[pid=31647] ppid=31645 vsize=420484 CPUtime=0.99 cores=4,6
/proc/31647/stat : 31647 (adaptg2wsat2009) R 31645 31647 31647 0 -1 4202496 1756 0 0 0 99 0 0 0 23 0 1 0 886371308 430575616 1492 33554432000 134512640 135107411 4287078688 18446744073709551615 134531232 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31647/statm: 105121 1492 59 146 0 103997 0
[pid=31445/tid=31480] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31480/stat : 31480 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 9 0 886301297 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 6 0 0 0
[pid=31445/tid=31542] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31542/stat : 31542 (python) S 31437 31445 31379 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 9 0 886311313 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
[pid=31445/tid=31557] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31557/stat : 31557 (python) S 31437 31445 31379 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 9 0 886321230 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
[pid=31445/tid=31580] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31580/stat : 31580 (python) S 31437 31445 31379 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 9 0 886331243 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 6 0 0 0
[pid=31445/tid=31595] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31595/stat : 31595 (python) S 31437 31445 31379 0 -1 4202560 27 933 0 0 0 0 0 0 20 0 9 0 886341258 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
[pid=31445/tid=31610] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31610/stat : 31610 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 9 0 886351273 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
[pid=31445/tid=31629] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31629/stat : 31629 (python) S 31437 31445 31379 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 9 0 886361291 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
[pid=31445/tid=31646] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31646/stat : 31646 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 9 0 886371308 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 703.09
Current children cumulated vsize (KiB) 7908128

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+705.301 s]
/proc/loadavg: 4.00 3.63 2.12 4/265 31650
/proc/meminfo: memFree=31117332/32950928 swapFree=67055948/67111528
[pid=31445] ppid=31437 vsize=364364 CPUtime=1.72 cores=4,6
/proc/31445/stat : 31445 (python) S 31437 31445 31379 0 -1 4202496 18383 933 1 0 146 26 0 0 20 0 9 0 886300876 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 2
/proc/31445/statm: 91091 8077 1884 364 0 26988 0
[pid=31479] ppid=31445 vsize=292288 CPUtime=0.13 cores=4,6
/proc/31479/stat : 31479 (python) S 31445 31445 31379 0 -1 4202560 1138 0 0 0 7 6 0 0 19 0 2 0 886301297 299302912 6484 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31479/statm: 73072 6484 415 364 0 8990 0
[pid=31481] ppid=31479 vsize=1018800 CPUtime=99.98 cores=4,6
/proc/31481/stat : 31481 (gnovelty+2) T 31479 31481 31481 0 -1 4202496 866 0 0 0 9995 3 0 0 25 0 1 0 886301297 1043251200 602 33554432000 134512640 135663704 4293385392 18446744073709551615 134524498 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31481/statm: 254700 602 113 282 0 254416 0
[pid=31479/tid=31540] ppid=31445 vsize=292288 CPUtime=0 cores=4,6
/proc/31479/task/31540/stat : 31540 (python) S 31445 31445 31379 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 886311312 299302912 6484 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453857219584 0 0 -1 4 0 0 0
[pid=31541] ppid=31445 vsize=292300 CPUtime=0.13 cores=4,6
/proc/31541/stat : 31541 (python) S 31445 31445 31379 0 -1 4202560 1076 0 0 0 7 6 0 0 19 0 2 0 886311313 299315200 6469 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31541/statm: 73075 6469 400 364 0 8990 0
[pid=31543] ppid=31541 vsize=1018800 CPUtime=99.15 cores=4,6
/proc/31543/stat : 31543 (gnovelty+2) T 31541 31543 31543 0 -1 4202496 867 0 0 0 9915 0 0 0 25 0 1 0 886311313 1043251200 602 33554432000 134512640 135663704 4292255712 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31543/statm: 254700 602 113 282 0 254416 0
[pid=31541/tid=31555] ppid=31445 vsize=292300 CPUtime=0 cores=4,6
/proc/31541/task/31555/stat : 31555 (python) S 31445 31445 31379 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 886321229 299315200 6469 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453835440320 0 0 -1 6 0 0 0
[pid=31556] ppid=31445 vsize=302704 CPUtime=0.13 cores=4,6
/proc/31556/stat : 31556 (python) S 31445 31445 31379 0 -1 4202560 1078 0 0 0 7 6 0 0 19 0 2 0 886321230 309968896 6510 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31556/statm: 75676 6510 400 364 0 11588 0
[pid=31558] ppid=31556 vsize=420484 CPUtime=99.98 cores=4,6
/proc/31558/stat : 31558 (adaptg2wsat2009) T 31556 31558 31558 0 -1 4202496 1758 0 0 0 9998 0 0 0 25 0 1 0 886321230 430575616 1493 33554432000 134512640 135107411 4293497920 18446744073709551615 134532349 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31558/statm: 105121 1493 59 146 0 103997 0
[pid=31556/tid=31578] ppid=31445 vsize=302704 CPUtime=0 cores=4,6
/proc/31556/task/31578/stat : 31578 (python) S 31445 31445 31379 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 886331242 309968896 6510 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453876357952 0 0 -1 6 0 0 0
[pid=31579] ppid=31445 vsize=312960 CPUtime=0.14 cores=4,6
/proc/31579/stat : 31579 (python) S 31445 31445 31379 0 -1 4202560 1086 0 0 0 7 7 0 0 19 0 2 0 886331243 320471040 6535 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31579/statm: 78240 6535 400 364 0 14149 0
[pid=31581] ppid=31579 vsize=420484 CPUtime=100.12 cores=4,6
/proc/31581/stat : 31581 (adaptg2wsat2009) T 31579 31581 31581 0 -1 4202496 1756 0 0 0 10012 0 0 0 25 0 1 0 886331243 430575616 1491 33554432000 134512640 135107411 4287974832 18446744073709551615 134532135 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31581/statm: 105121 1491 59 146 0 103997 0
[pid=31579/tid=31593] ppid=31445 vsize=312960 CPUtime=0 cores=4,6
/proc/31579/task/31593/stat : 31593 (python) S 31445 31445 31379 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 886341257 320471040 6535 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453854265728 0 0 -1 4 0 0 0
[pid=31594] ppid=31445 vsize=323216 CPUtime=0.15 cores=4,6
/proc/31594/stat : 31594 (python) S 31445 31445 31379 0 -1 4202560 1082 0 0 0 7 8 0 0 19 0 2 0 886341258 330973184 6539 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31594/statm: 80804 6539 400 364 0 16710 0
[pid=31596] ppid=31594 vsize=420484 CPUtime=100.13 cores=4,6
/proc/31596/stat : 31596 (adaptg2wsat2009) T 31594 31596 31596 0 -1 4202496 1757 0 0 0 10013 0 0 0 25 0 1 0 886341258 430575616 1492 33554432000 134512640 135107411 4291458976 18446744073709551615 134531781 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31596/statm: 105121 1492 59 146 0 103997 0
[pid=31594/tid=31608] ppid=31445 vsize=323216 CPUtime=0 cores=4,6
/proc/31594/task/31608/stat : 31608 (python) S 31445 31445 31379 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 886351272 330973184 6539 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453896964864 0 0 -1 6 0 0 0
[pid=31609] ppid=31445 vsize=333608 CPUtime=0.14 cores=4,6
/proc/31609/stat : 31609 (python) S 31445 31445 31379 0 -1 4202560 1090 0 0 0 8 6 0 0 19 0 2 0 886351273 341614592 6556 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31609/statm: 83402 6556 400 364 0 19305 0
[pid=31611] ppid=31609 vsize=1018800 CPUtime=100.06 cores=4,6
/proc/31611/stat : 31611 (gnovelty+2) T 31609 31611 31611 0 -1 4202496 868 0 0 0 10006 0 0 0 25 0 1 0 886351273 1043251200 603 33554432000 134512640 135663704 4294873728 18446744073709551615 134524888 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31611/statm: 254700 603 113 282 0 254416 0
[pid=31609/tid=31627] ppid=31445 vsize=333608 CPUtime=0 cores=4,6
/proc/31609/task/31627/stat : 31627 (python) S 31445 31445 31379 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 886361290 341614592 6556 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604453985334208 0 0 -1 6 0 0 0
[pid=31628] ppid=31445 vsize=343864 CPUtime=0.16 cores=4,6
/proc/31628/stat : 31628 (python) S 31445 31445 31379 0 -1 4202560 1088 0 0 0 9 7 0 0 19 0 2 0 886361291 352116736 6586 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092059083 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31628/statm: 85966 6586 400 364 0 21866 0
[pid=31630] ppid=31628 vsize=250368 CPUtime=99.98 cores=4,6
/proc/31630/stat : 31630 (FH) T 31628 31630 31630 0 -1 4202496 1678 0 0 0 9998 0 0 0 25 0 1 0 886361291 256376832 1407 33554432000 134512640 134936988 4289396160 18446744073709551615 134553505 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31630/statm: 62592 1407 41 104 0 62096 0
[pid=31628/tid=31644] ppid=31445 vsize=343864 CPUtime=0 cores=4,6
/proc/31628/task/31644/stat : 31644 (python) S 31445 31445 31379 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 886371307 352116736 6586 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 514 18446604451493853312 0 0 -1 6 0 0 0
[pid=31645] ppid=31445 vsize=354120 CPUtime=0 cores=4,6
/proc/31645/stat : 31645 (python) S 31445 31445 31379 0 -1 4202560 834 0 0 0 0 0 0 0 19 0 1 0 886371308 362618880 6539 33554432000 4194304 5683644 140734730279712 18446744073709551615 208080252486 0 0 16781312 514 4036870139814084607 0 0 17 4 0 0 0
/proc/31645/statm: 88530 6539 350 364 0 24427 0
[pid=31647] ppid=31645 vsize=420484 CPUtime=0.99 cores=4,6
/proc/31647/stat : 31647 (adaptg2wsat2009) R 31645 31647 31647 0 -1 4202496 1756 0 0 0 99 0 0 0 23 0 1 0 886371308 430575616 1492 33554432000 134512640 135107411 4287078688 18446744073709551615 134531232 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31647/statm: 105121 1492 59 146 0 103997 0
[pid=31445/tid=31480] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31480/stat : 31480 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 9 0 886301297 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 6 0 0 0
[pid=31445/tid=31542] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31542/stat : 31542 (python) S 31437 31445 31379 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 9 0 886311313 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
[pid=31445/tid=31557] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31557/stat : 31557 (python) S 31437 31445 31379 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 9 0 886321230 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
[pid=31445/tid=31580] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31580/stat : 31580 (python) S 31437 31445 31379 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 9 0 886331243 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 6 0 0 0
[pid=31445/tid=31595] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31595/stat : 31595 (python) S 31437 31445 31379 0 -1 4202560 27 933 0 0 0 0 0 0 20 0 9 0 886341258 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
[pid=31445/tid=31610] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31610/stat : 31610 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 9 0 886351273 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
[pid=31445/tid=31629] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31629/stat : 31629 (python) S 31437 31445 31379 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 9 0 886361291 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
[pid=31445/tid=31646] ppid=31437 vsize=364364 CPUtime=0 cores=4,6
/proc/31445/task/31646/stat : 31646 (python) S 31437 31445 31379 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 9 0 886371308 373108736 8077 33554432000 4194304 5683644 140734730279712 18446744073709551615 208092055985 0 0 16781312 2 18446604453588257664 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 703.09
Current children cumulated vsize (KiB) 7908128

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31445 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=466777
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=271958
# CPU time returned by wait4() is 1.73873
# while last known CPU time is 703.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 705.364
CPU time (s): 703.09
CPU user time (s): 702.34
CPU system time (s): 0.75
CPU usage (%): 99.6776
Max. virtual memory (cumulated for all children) (KiB): 7908128

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.46678
system time used= 0.271958
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 19322
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12943
involuntary context switches= 56

runsolver used 1.56276 second user time and 3.40248 second system time

The end

Launcher Data

Begin job on node127 at 2011-06-11 01:03:29
IDJOB=3484051
IDBENCH=82562
IDSOLVER=1975
FILE ID=node127/3484051-1307747009
RUNJOBID= node127-1307747008-31398
PBS_JOBID= 13550830
Free space on /tmp= 74088 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed, 1200 s timeout)
BENCH NAME= SAT11/random/large/unif-k5-r20-v1250-c25000-S573815729-001-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3484051-1307747009/watcher-3484051-1307747009 -o /tmp/evaluation-result-3484051-1307747009/solver-3484051-1307747009 -C 1200 -W 1300 -M 7680  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3484051-1307747009.cnf -seed 5039089 -budget 1200

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 34a446d3b38e7b034208a35fa75247bf
RANDOM SEED=5039089

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31488340 kB
Buffers:        268048 kB
Cached:         975164 kB
SwapCached:       9372 kB
Active:         603724 kB
Inactive:       659660 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31488340 kB
SwapTotal:    67111528 kB
SwapFree:     67055948 kB
Dirty:          130388 kB
Writeback:           0 kB
AnonPages:       17988 kB
Mapped:          12644 kB
Slab:           134348 kB
PageTables:       5120 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   190504 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73964 MiB
End job on node127 at 2011-06-11 01:15:19