Trace number 3322219

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 35.5316 5.28551

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v350-c1491-S804294807-063.UNKNOWN.cnf
MD5SUMb542abc79e1a870fc4bd1b25791c8222
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4.32334
Satisfiable
(Un)Satisfiability was proved
Number of variables350
Number of clauses1491
Sum of the clauses size4473
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31491
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.33/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.33/0.67	c INFO: solving HOME/instance-3322219-1304376160.cnf
0.33/0.67	c INFO: computing task features
0.33/0.68	c INFO: computed variable-clause graph statistics
0.33/0.68	c INFO: computed clause balance statistics
0.42/0.71	c INFO: computed variable balance statistics
0.42/0.73	c INFO: computed small-clause counts
0.42/0.73	c INFO: computed Horn-clause counts
0.42/0.73	c INFO: computed variable graph statistics
0.42/0.73	c INFO: collected features for HOME/instance-3322219-1304376160.cnf in 0.06 s
0.42/0.77	c INFO: running TNM@0 for 97 with 39999 remaining (b = 0.56)
0.52/0.80	c INFO: running march_hi@0 for 194 with 39999 remaining (b = 0.28)
0.52/0.84	c INFO: running march_hi@0 for 194 with 39999 remaining (b = 0.20)
0.52/0.88	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.28)
0.62/0.92	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.07)
0.62/0.96	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.30)
0.62/1.00	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.27)
1.49/1.04	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.20)
34.86/5.26	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322219-1304376160/watcher-3322219-1304376160 -o /tmp/evaluation-result-3322219-1304376160/solver-3322219-1304376160 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322219-1304376160.cnf -seed 1139614181 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.43 8.49 8.29 1/283 31972
/proc/meminfo: memFree=25708076/32951124 swapFree=67107192/67111528
[pid=31972] ppid=31970 vsize=15760 CPUtime=0 cores=0-7
/proc/31972/stat : 31972 (python) S 31970 31972 30480 0 -1 4202496 845 0 0 0 0 0 0 0 22 0 1 0 549214537 16138240 727 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/31972/statm: 3940 727 334 364 0 427 0

[startup+0.098535 s]
/proc/loadavg: 8.43 8.49 8.29 1/283 31972
/proc/meminfo: memFree=25708076/32951124 swapFree=67107192/67111528
[pid=31972] ppid=31970 vsize=85616 CPUtime=0.05 cores=0-7
/proc/31972/stat : 31972 (python) R 31970 31972 30480 0 -1 4202496 2628 0 0 0 4 1 0 0 18 0 1 0 549214537 87670784 2347 33554432000 4194304 5683644 140736994657024 18446744073709551615 5212936 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/31972/statm: 21404 2347 713 364 0 1621 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85616

[startup+0.100564 s]
/proc/loadavg: 8.43 8.49 8.29 1/283 31972
/proc/meminfo: memFree=25708076/32951124 swapFree=67107192/67111528
[pid=31972] ppid=31970 vsize=87700 CPUtime=0.05 cores=0-7
/proc/31972/stat : 31972 (python) R 31970 31972 30480 0 -1 4202496 2635 0 0 0 4 1 0 0 18 0 1 0 549214537 89804800 2351 33554432000 4194304 5683644 140736994657024 18446744073709551615 210199684864 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/31972/statm: 21925 2353 717 364 0 1621 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 87700

[startup+0.300539 s]
/proc/loadavg: 8.43 8.49 8.29 1/283 31972
/proc/meminfo: memFree=25708076/32951124 swapFree=67107192/67111528
[pid=31972] ppid=31970 vsize=135744 CPUtime=0.18 cores=0-7
/proc/31972/stat : 31972 (python) R 31970 31972 30480 0 -1 4202496 5963 931 1 0 12 6 0 0 17 0 1 0 549214537 139001856 4150 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204643333 0 2147483391 16781312 2 0 0 0 17 6 0 0 0
/proc/31972/statm: 33936 4150 1032 364 0 3122 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135744

[startup+0.700441 s]
/proc/loadavg: 8.43 8.49 8.29 1/283 31972
/proc/meminfo: memFree=25708076/32951124 swapFree=67107192/67111528
[pid=31972] ppid=31970 vsize=278256 CPUtime=0.42 cores=0-7
/proc/31972/stat : 31972 (python) R 31970 31972 30480 0 -1 4202496 9286 931 1 0 30 12 0 0 16 0 1 0 549214537 284934144 6955 33554432000 4194304 5683644 140736994657024 18446744073709551615 4662302 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/31972/statm: 69564 6955 1826 364 0 5488 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 278256

[startup+1.50126 s]
/proc/loadavg: 7.75 8.35 8.24 8/302 31995
/proc/meminfo: memFree=25658572/32951124 swapFree=67107192/67111528
[pid=31972] ppid=31970 vsize=361264 CPUtime=0.76 cores=0-7
/proc/31972/stat : 31972 (python) S 31970 31972 30480 0 -1 4202496 15843 931 1 0 62 14 0 0 20 0 9 0 549214537 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/31972/statm: 90316 7281 1889 364 0 26213 0
[pid=31978] ppid=31972 vsize=278612 CPUtime=0 cores=0-7
/proc/31978/stat : 31978 (python) S 31972 31972 30480 0 -1 4202560 705 0 0 0 0 0 0 0 18 0 1 0 549214615 285298688 5563 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667407 0 0 16781312 514 4294692697265930239 0 0 17 1 0 0 0
/proc/31978/statm: 69653 5563 347 364 0 5571 0
[pid=31980] ppid=31978 vsize=454896 CPUtime=0.72 cores=0-7
/proc/31980/stat : 31980 (TNM) R 31978 31980 31980 0 -1 4202496 413 0 0 0 72 0 0 0 21 0 1 0 549214615 465813504 151 33554432000 134512640 135008748 4287328512 18446744073709551615 134529678 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/31980/statm: 113724 151 46 122 0 112624 0
[pid=31981] ppid=31972 vsize=289284 CPUtime=0 cores=0-7
/proc/31981/stat : 31981 (python) S 31972 31972 30480 0 -1 4202560 743 0 0 0 0 0 0 0 15 0 1 0 549214618 296226816 5678 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 5058615509180711172 0 0 17 0 0 0 0
/proc/31981/statm: 72321 5678 348 364 0 8236 0
[pid=31983] ppid=31981 vsize=1808 CPUtime=0.68 cores=0-7
/proc/31983/stat : 31983 (march_hi) R 31981 31983 31983 0 -1 4202496 542 0 0 0 68 0 0 0 21 0 1 0 549214619 1851392 280 33554432000 4194304 4955518 140735005870864 18446744073709551615 4209701 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/31983/statm: 452 280 104 186 0 265 0
[pid=31984] ppid=31972 vsize=299188 CPUtime=0 cores=0-7
/proc/31984/stat : 31984 (python) S 31972 31972 30480 0 -1 4202560 751 0 0 0 0 0 0 0 15 0 1 0 549214622 306368512 5604 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 16283481338634273027 0 0 17 2 0 0 0
/proc/31984/statm: 74797 5604 348 364 0 10709 0
[pid=31986] ppid=31984 vsize=1808 CPUtime=0.63 cores=0-7
/proc/31986/stat : 31986 (march_hi) R 31984 31986 31986 0 -1 4202496 544 0 0 0 63 0 0 0 24 0 1 0 549214622 1851392 280 33554432000 4194304 4955518 140735675484816 18446744073709551615 4306934 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31986/statm: 452 280 104 186 0 265 0
[pid=31987] ppid=31972 vsize=309896 CPUtime=0 cores=0-7
/proc/31987/stat : 31987 (python) S 31972 31972 30480 0 -1 4202560 765 0 0 0 0 0 0 0 15 0 1 0 549214626 317333504 5695 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 4818987945023209732 0 0 17 6 0 0 0
/proc/31987/statm: 77474 5695 348 364 0 13383 0
[pid=31989] ppid=31987 vsize=1808 CPUtime=0.6 cores=0-7
/proc/31989/stat : 31989 (march_hi) R 31987 31989 31989 0 -1 4202496 544 0 0 0 60 0 0 0 22 0 1 0 549214626 1851392 280 33554432000 4194304 4955518 140737428115168 18446744073709551615 4224628 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/31989/statm: 452 280 104 186 0 265 0
[pid=31990] ppid=31972 vsize=320152 CPUtime=0 cores=0-7
/proc/31990/stat : 31990 (python) S 31972 31972 30480 0 -1 4202560 762 0 0 0 0 0 0 0 21 0 1 0 549214630 327835648 5716 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 7400408150576201727 0 0 17 0 0 0 0
/proc/31990/statm: 80038 5716 348 364 0 15944 0
[pid=31992] ppid=31990 vsize=1017800 CPUtime=0.54 cores=0-7
/proc/31992/stat : 31992 (gnovelty+2) R 31990 31992 31992 0 -1 4202496 430 0 0 0 54 0 0 0 25 0 1 0 549214630 1042227200 163 33554432000 134512640 135663704 4291663424 18446744073709551615 134545619 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/31992/statm: 254450 163 113 282 0 254166 0
[pid=31993] ppid=31972 vsize=330408 CPUtime=0 cores=0-7
/proc/31993/stat : 31993 (python) S 31972 31972 30480 0 -1 4202560 777 0 0 0 0 0 0 0 15 0 1 0 549214634 338337792 5720 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 5950680079120957698 0 0 17 2 0 0 0
/proc/31993/statm: 82602 5720 348 364 0 18505 0
[pid=31995] ppid=31993 vsize=1808 CPUtime=0.53 cores=0-7
/proc/31995/stat : 31995 (march_hi) R 31993 31995 31995 0 -1 4202496 543 0 0 0 53 0 0 0 22 0 1 0 549214634 1851392 280 33554432000 4194304 4955518 140734183554528 18446744073709551615 4328148 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/31995/statm: 452 280 104 186 0 265 0
[pid=31972/tid=31979] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31979/stat : 31979 (python) S 31970 31972 30480 0 -1 4202560 25 931 0 0 0 0 0 0 17 0 9 0 549214615 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31982] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31982/stat : 31982 (python) S 31970 31972 30480 0 -1 4202560 23 931 0 0 0 0 0 0 19 0 9 0 549214618 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 6 0 0 0
[pid=31972/tid=31985] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31985/stat : 31985 (python) S 31970 31972 30480 0 -1 4202560 21 931 0 0 0 0 0 0 21 0 9 0 549214622 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 4 0 0 0
[pid=31972/tid=31988] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31988/stat : 31988 (python) S 31970 31972 30480 0 -1 4202560 21 931 0 0 0 0 0 0 20 0 9 0 549214626 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 6 0 0 0
[pid=31972/tid=31991] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31991/stat : 31991 (python) S 31970 31972 30480 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 9 0 549214630 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31994] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31994/stat : 31994 (python) S 31970 31972 30480 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 9 0 549214634 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31997] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31997/stat : 31997 (python) S 31970 31972 30480 0 -1 4202560 26 931 0 0 0 0 0 0 22 0 9 0 549214638 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.46
Current children cumulated vsize (KiB) 3668732

[startup+3.10099 s]
/proc/loadavg: 7.75 8.35 8.24 9/308 32001
/proc/meminfo: memFree=25649084/32951124 swapFree=67107192/67111528
[pid=31972] ppid=31970 vsize=361264 CPUtime=0.76 cores=0-7
/proc/31972/stat : 31972 (python) S 31970 31972 30480 0 -1 4202496 15843 931 1 0 62 14 0 0 20 0 9 0 549214537 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/31972/statm: 90316 7281 1889 364 0 26213 0
[pid=31978] ppid=31972 vsize=278612 CPUtime=0 cores=0-7
/proc/31978/stat : 31978 (python) S 31972 31972 30480 0 -1 4202560 728 0 0 0 0 0 0 0 18 0 1 0 549214615 285298688 5570 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667407 0 0 16781312 514 4294692697265897732 0 0 17 1 0 0 0
/proc/31978/statm: 69653 5570 354 364 0 5571 0
[pid=31980] ppid=31978 vsize=454896 CPUtime=2.31 cores=0-7
/proc/31980/stat : 31980 (TNM) R 31978 31980 31980 0 -1 4202496 413 0 0 0 231 0 0 0 25 0 1 0 549214615 465813504 151 33554432000 134512640 135008748 4287328512 18446744073709551615 134529517 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/31980/statm: 113724 151 46 122 0 112624 0
[pid=31981] ppid=31972 vsize=289284 CPUtime=0 cores=0-7
/proc/31981/stat : 31981 (python) S 31972 31972 30480 0 -1 4202560 748 0 0 0 0 0 0 0 15 0 1 0 549214618 296226816 5678 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 5058615509180711172 0 0 17 0 0 0 0
/proc/31981/statm: 72321 5678 348 364 0 8236 0
[pid=31983] ppid=31981 vsize=1972 CPUtime=2.28 cores=0-7
/proc/31983/stat : 31983 (march_hi) R 31981 31983 31983 0 -1 4202496 562 0 0 0 228 0 0 0 25 0 1 0 549214619 2019328 300 33554432000 4194304 4955518 140735005870864 18446744073709551615 4209664 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/31983/statm: 493 300 104 186 0 306 0
[pid=31984] ppid=31972 vsize=299188 CPUtime=0 cores=0-7
/proc/31984/stat : 31984 (python) S 31972 31972 30480 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 549214622 306368512 5604 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 16283481338634273027 0 0 17 2 0 0 0
/proc/31984/statm: 74797 5604 348 364 0 10709 0
[pid=31986] ppid=31984 vsize=1972 CPUtime=2.22 cores=0-7
/proc/31986/stat : 31986 (march_hi) R 31984 31986 31986 0 -1 4202496 563 0 0 0 222 0 0 0 25 0 1 0 549214622 2019328 299 33554432000 4194304 4955518 140735675484816 18446744073709551615 4238756 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31986/statm: 493 299 104 186 0 306 0
[pid=31987] ppid=31972 vsize=309896 CPUtime=0 cores=0-7
/proc/31987/stat : 31987 (python) S 31972 31972 30480 0 -1 4202560 771 0 0 0 0 0 0 0 15 0 1 0 549214626 317333504 5695 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 4818987945023209732 0 0 17 6 0 0 0
/proc/31987/statm: 77474 5695 348 364 0 13383 0
[pid=31989] ppid=31987 vsize=1972 CPUtime=2.2 cores=0-7
/proc/31989/stat : 31989 (march_hi) R 31987 31989 31989 0 -1 4202496 563 0 0 0 220 0 0 0 25 0 1 0 549214626 2019328 299 33554432000 4194304 4955518 140737428115168 18446744073709551615 4224648 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/31989/statm: 493 299 104 186 0 306 0
[pid=31990] ppid=31972 vsize=320152 CPUtime=0 cores=0-7
/proc/31990/stat : 31990 (python) S 31972 31972 30480 0 -1 4202560 762 0 0 0 0 0 0 0 18 0 1 0 549214630 327835648 5716 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 7400408150576169217 0 0 17 0 0 0 0
/proc/31990/statm: 80038 5716 348 364 0 15944 0
[pid=31992] ppid=31990 vsize=1017800 CPUtime=2.14 cores=0-7
/proc/31992/stat : 31992 (gnovelty+2) R 31990 31992 31992 0 -1 4202496 430 0 0 0 214 0 0 0 25 0 1 0 549214630 1042227200 163 33554432000 134512640 135663704 4291663424 18446744073709551615 134545646 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/31992/statm: 254450 163 113 282 0 254166 0
[pid=31993] ppid=31972 vsize=330408 CPUtime=0 cores=0-7
/proc/31993/stat : 31993 (python) S 31972 31972 30480 0 -1 4202560 784 0 0 0 0 0 0 0 15 0 1 0 549214634 338337792 5720 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 7254192345535479807 0 0 17 2 0 0 0
/proc/31993/statm: 82602 5720 348 364 0 18505 0
[pid=31995] ppid=31993 vsize=1972 CPUtime=2.12 cores=0-7
/proc/31995/stat : 31995 (march_hi) R 31993 31995 31995 0 -1 4202496 562 0 0 0 212 0 0 0 25 0 1 0 549214634 2019328 299 33554432000 4194304 4955518 140734183554528 18446744073709551615 4227104 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/31995/statm: 493 299 104 186 0 306 0
[pid=31996] ppid=31972 vsize=340288 CPUtime=0 cores=0-7
/proc/31996/stat : 31996 (python) S 31972 31972 30480 0 -1 4202560 788 0 0 0 0 0 0 0 15 0 1 0 549214638 348454912 5614 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 4338796032801341697 0 0 17 2 0 0 0
/proc/31996/statm: 85072 5614 348 364 0 20972 0
[pid=31998] ppid=31996 vsize=1972 CPUtime=2.08 cores=0-7
/proc/31998/stat : 31998 (march_hi) R 31996 31998 31998 0 -1 4202496 563 0 0 0 208 0 0 0 25 0 1 0 549214638 2019328 299 33554432000 4194304 4955518 140734154975648 18446744073709551615 4299850 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/31998/statm: 493 299 104 186 0 306 0
[pid=31999] ppid=31972 vsize=351020 CPUtime=0 cores=0-7
/proc/31999/stat : 31999 (python) S 31972 31972 30480 0 -1 4202560 817 0 0 0 0 0 0 0 15 0 1 0 549214642 359444480 5742 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 1931362547227656452 0 0 17 4 0 0 0
/proc/31999/statm: 87755 5742 354 364 0 23652 0
[pid=32001] ppid=31999 vsize=1972 CPUtime=2.03 cores=0-7
/proc/32001/stat : 32001 (march_hi) R 31999 32001 32001 0 -1 4202496 571 0 0 0 203 0 0 0 25 0 1 0 549214642 2019328 299 33554432000 4194304 4955518 140734426311344 18446744073709551615 4209733 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32001/statm: 493 299 104 186 0 306 0
[pid=31972/tid=31979] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31979/stat : 31979 (python) S 31970 31972 30480 0 -1 4202560 25 931 0 0 0 0 0 0 17 0 9 0 549214615 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31982] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31982/stat : 31982 (python) S 31970 31972 30480 0 -1 4202560 23 931 0 0 0 0 0 0 19 0 9 0 549214618 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 6 0 0 0
[pid=31972/tid=31985] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31985/stat : 31985 (python) S 31970 31972 30480 0 -1 4202560 21 931 0 0 0 0 0 0 21 0 9 0 549214622 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 4 0 0 0
[pid=31972/tid=31988] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31988/stat : 31988 (python) S 31970 31972 30480 0 -1 4202560 21 931 0 0 0 0 0 0 20 0 9 0 549214626 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 6 0 0 0
[pid=31972/tid=31991] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31991/stat : 31991 (python) S 31970 31972 30480 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 9 0 549214630 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31994] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31994/stat : 31994 (python) S 31970 31972 30480 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 9 0 549214634 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31997] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31997/stat : 31997 (python) S 31970 31972 30480 0 -1 4202560 26 931 0 0 0 0 0 0 22 0 9 0 549214638 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 2 0 0 0
[pid=31972/tid=32000] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/32000/stat : 32000 (python) S 31970 31972 30480 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 9 0 549214642 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 18.14
Current children cumulated vsize (KiB) 4364640

Solver just ended. Dumping a history of the last processes samples

[startup+3.90086 s]
/proc/loadavg: 7.75 8.35 8.24 9/308 32001

################
# More data... #
################

[pid=31999] ppid=31972 vsize=351020 CPUtime=0 cores=0-7
/proc/31999/stat : 31999 (python) S 31972 31972 30480 0 -1 4202560 822 0 0 0 0 0 0 0 15 0 1 0 549214642 359444480 5742 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 1931362547227656452 0 0 17 4 0 0 0
/proc/31999/statm: 87755 5742 354 364 0 23652 0
[pid=32001] ppid=31999 vsize=1972 CPUtime=3.64 cores=0-7
/proc/32001/stat : 32001 (march_hi) R 31999 32001 32001 0 -1 4202496 577 0 0 0 363 1 0 0 25 0 1 0 549214642 2019328 305 33554432000 4194304 4955518 140734426311344 18446744073709551615 4238703 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32001/statm: 493 305 104 186 0 306 0
[pid=31972/tid=31979] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31979/stat : 31979 (python) S 31970 31972 30480 0 -1 4202560 25 931 0 0 0 0 0 0 17 0 9 0 549214615 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31982] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31982/stat : 31982 (python) S 31970 31972 30480 0 -1 4202560 23 931 0 0 0 0 0 0 19 0 9 0 549214618 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 6 0 0 0
[pid=31972/tid=31985] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31985/stat : 31985 (python) S 31970 31972 30480 0 -1 4202560 21 931 0 0 0 0 0 0 21 0 9 0 549214622 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 4 0 0 0
[pid=31972/tid=31988] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31988/stat : 31988 (python) S 31970 31972 30480 0 -1 4202560 21 931 0 0 0 0 0 0 20 0 9 0 549214626 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 6 0 0 0
[pid=31972/tid=31991] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31991/stat : 31991 (python) S 31970 31972 30480 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 9 0 549214630 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31994] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31994/stat : 31994 (python) S 31970 31972 30480 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 9 0 549214634 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31997] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31997/stat : 31997 (python) S 31970 31972 30480 0 -1 4202560 26 931 0 0 0 0 0 0 22 0 9 0 549214638 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 2 0 0 0
[pid=31972/tid=32000] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/32000/stat : 32000 (python) S 31970 31972 30480 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 9 0 549214642 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 30.93
Current children cumulated vsize (KiB) 4364640

[startup+5.10165 s]
/proc/loadavg: 7.75 8.35 8.24 9/308 32001
/proc/meminfo: memFree=25648588/32951124 swapFree=67107192/67111528
[pid=31972] ppid=31970 vsize=361264 CPUtime=0.76 cores=0-7
/proc/31972/stat : 31972 (python) S 31970 31972 30480 0 -1 4202496 15843 931 1 0 62 14 0 0 20 0 9 0 549214537 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/31972/statm: 90316 7281 1889 364 0 26213 0
[pid=31978] ppid=31972 vsize=278612 CPUtime=0 cores=0-7
/proc/31978/stat : 31978 (python) S 31972 31972 30480 0 -1 4202560 895 0 0 0 0 0 0 0 18 0 1 0 549214615 285298688 5592 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667407 0 0 16781312 514 4294692697265897732 0 0 17 1 0 0 0
/proc/31978/statm: 69653 5592 376 364 0 5571 0
[pid=31980] ppid=31978 vsize=454896 CPUtime=4.3 cores=0-7
/proc/31980/stat : 31980 (TNM) R 31978 31980 31980 0 -1 4202496 413 0 0 0 430 0 0 0 25 0 1 0 549214615 465813504 151 33554432000 134512640 135008748 4287328512 18446744073709551615 134536485 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/31980/statm: 113724 151 46 122 0 112624 0
[pid=31981] ppid=31972 vsize=289284 CPUtime=0.01 cores=0-7
/proc/31981/stat : 31981 (python) S 31972 31972 30480 0 -1 4202560 913 0 0 0 1 0 0 0 15 0 1 0 549214618 296226816 5701 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 5058615509180711172 0 0 17 5 0 0 0
/proc/31981/statm: 72321 5701 371 364 0 8236 0
[pid=31983] ppid=31981 vsize=1972 CPUtime=4.28 cores=0-7
/proc/31983/stat : 31983 (march_hi) R 31981 31983 31983 0 -1 4202496 572 0 0 0 428 0 0 0 25 0 1 0 549214619 2019328 310 33554432000 4194304 4955518 140735005870864 18446744073709551615 4286687 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/31983/statm: 493 310 104 186 0 306 0
[pid=31984] ppid=31972 vsize=299188 CPUtime=0 cores=0-7
/proc/31984/stat : 31984 (python) S 31972 31972 30480 0 -1 4202560 911 0 0 0 0 0 0 0 15 0 1 0 549214622 306368512 5627 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 16283481338634273027 0 0 17 7 0 0 0
/proc/31984/statm: 74797 5627 371 364 0 10709 0
[pid=31986] ppid=31984 vsize=1972 CPUtime=4.2 cores=0-7
/proc/31986/stat : 31986 (march_hi) R 31984 31986 31986 0 -1 4202496 573 0 0 0 420 0 0 0 25 0 1 0 549214622 2019328 309 33554432000 4194304 4955518 140735675484816 18446744073709551615 4238438 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31986/statm: 493 309 104 186 0 306 0
[pid=31987] ppid=31972 vsize=309896 CPUtime=0.02 cores=0-7
/proc/31987/stat : 31987 (python) S 31972 31972 30480 0 -1 4202560 924 0 0 0 1 1 0 0 15 0 1 0 549214626 317333504 5718 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 4818987945023209732 0 0 17 6 0 0 0
/proc/31987/statm: 77474 5718 371 364 0 13383 0
[pid=31989] ppid=31987 vsize=1972 CPUtime=4.21 cores=0-7
/proc/31989/stat : 31989 (march_hi) R 31987 31989 31989 0 -1 4202496 574 0 0 0 421 0 0 0 25 0 1 0 549214626 2019328 310 33554432000 4194304 4955518 140737428115168 18446744073709551615 4227565 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/31989/statm: 493 310 104 186 0 306 0
[pid=31990] ppid=31972 vsize=320152 CPUtime=0 cores=0-7
/proc/31990/stat : 31990 (python) S 31972 31972 30480 0 -1 4202560 932 0 0 0 0 0 0 0 18 0 1 0 549214630 327835648 5739 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 7400408150576169217 0 0 17 0 0 0 0
/proc/31990/statm: 80038 5739 371 364 0 15944 0
[pid=31992] ppid=31990 vsize=1017800 CPUtime=4.13 cores=0-7
/proc/31992/stat : 31992 (gnovelty+2) R 31990 31992 31992 0 -1 4202496 430 0 0 0 413 0 0 0 25 0 1 0 549214630 1042227200 163 33554432000 134512640 135663704 4291663424 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/31992/statm: 254450 163 113 282 0 254166 0
[pid=31993] ppid=31972 vsize=330408 CPUtime=0.01 cores=0-7
/proc/31993/stat : 31993 (python) S 31972 31972 30480 0 -1 4202560 956 0 0 0 1 0 0 0 15 0 1 0 549214634 338337792 5743 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 5950680079120957698 0 0 17 2 0 0 0
/proc/31993/statm: 82602 5743 371 364 0 18505 0
[pid=31995] ppid=31993 vsize=1972 CPUtime=4.09 cores=0-7
/proc/31995/stat : 31995 (march_hi) R 31993 31995 31995 0 -1 4202496 572 0 0 0 409 0 0 0 25 0 1 0 549214634 2019328 309 33554432000 4194304 4955518 140734183554528 18446744073709551615 4224648 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/31995/statm: 493 309 104 186 0 306 0
[pid=31996] ppid=31972 vsize=340288 CPUtime=0.01 cores=0-7
/proc/31996/stat : 31996 (python) S 31972 31972 30480 0 -1 4202560 956 0 0 0 0 1 0 0 15 0 1 0 549214638 348454912 5637 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 4338796032801341697 0 0 17 2 0 0 0
/proc/31996/statm: 85072 5637 371 364 0 20972 0
[pid=31998] ppid=31996 vsize=1972 CPUtime=4.02 cores=0-7
/proc/31998/stat : 31998 (march_hi) R 31996 31998 31998 0 -1 4202496 572 0 0 0 402 0 0 0 25 0 1 0 549214638 2019328 308 33554432000 4194304 4955518 140734154975648 18446744073709551615 4209653 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/31998/statm: 493 308 104 186 0 306 0
[pid=31999] ppid=31972 vsize=351020 CPUtime=0.01 cores=0-7
/proc/31999/stat : 31999 (python) S 31972 31972 30480 0 -1 4202560 1005 0 0 0 1 0 0 0 15 0 1 0 549214642 359444480 5765 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 1931362547227656452 0 0 17 4 0 0 0
/proc/31999/statm: 87755 5765 377 364 0 23652 0
[pid=32001] ppid=31999 vsize=1972 CPUtime=4.02 cores=0-7
/proc/32001/stat : 32001 (march_hi) R 31999 32001 32001 0 -1 4202496 580 0 0 0 401 1 0 0 25 0 1 0 549214642 2019328 308 33554432000 4194304 4955518 140734426311344 18446744073709551615 4227576 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32001/statm: 493 308 104 186 0 306 0
[pid=31972/tid=31979] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31979/stat : 31979 (python) S 31970 31972 30480 0 -1 4202560 25 931 0 0 0 0 0 0 17 0 9 0 549214615 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31982] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31982/stat : 31982 (python) S 31970 31972 30480 0 -1 4202560 23 931 0 0 0 0 0 0 19 0 9 0 549214618 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 6 0 0 0
[pid=31972/tid=31985] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31985/stat : 31985 (python) S 31970 31972 30480 0 -1 4202560 21 931 0 0 0 0 0 0 21 0 9 0 549214622 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 4 0 0 0
[pid=31972/tid=31988] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31988/stat : 31988 (python) S 31970 31972 30480 0 -1 4202560 21 931 0 0 0 0 0 0 20 0 9 0 549214626 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 6 0 0 0
[pid=31972/tid=31991] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31991/stat : 31991 (python) S 31970 31972 30480 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 9 0 549214630 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31994] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31994/stat : 31994 (python) S 31970 31972 30480 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 9 0 549214634 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31997] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31997/stat : 31997 (python) S 31970 31972 30480 0 -1 4202560 26 931 0 0 0 0 0 0 22 0 9 0 549214638 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 2 0 0 0
[pid=31972/tid=32000] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/32000/stat : 32000 (python) S 31970 31972 30480 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 9 0 549214642 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 34.07
Current children cumulated vsize (KiB) 4364640

[startup+5.20164 s]
/proc/loadavg: 7.75 8.35 8.24 9/308 32001
/proc/meminfo: memFree=25648588/32951124 swapFree=67107192/67111528
[pid=31972] ppid=31970 vsize=361264 CPUtime=0.76 cores=0-7
/proc/31972/stat : 31972 (python) S 31970 31972 30480 0 -1 4202496 15843 931 1 0 62 14 0 0 20 0 9 0 549214537 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216474059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/31972/statm: 90316 7281 1889 364 0 26213 0
[pid=31978] ppid=31972 vsize=278612 CPUtime=0 cores=0-7
/proc/31978/stat : 31978 (python) S 31972 31972 30480 0 -1 4202560 895 0 0 0 0 0 0 0 18 0 1 0 549214615 285298688 5592 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667407 0 0 16781312 514 4294692697265897732 0 0 17 1 0 0 0
/proc/31978/statm: 69653 5592 376 364 0 5571 0
[pid=31980] ppid=31978 vsize=454896 CPUtime=4.4 cores=0-7
/proc/31980/stat : 31980 (TNM) R 31978 31980 31980 0 -1 4202496 413 0 0 0 440 0 0 0 25 0 1 0 549214615 465813504 151 33554432000 134512640 135008748 4287328512 18446744073709551615 134529678 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/31980/statm: 113724 151 46 122 0 112624 0
[pid=31981] ppid=31972 vsize=289284 CPUtime=0.02 cores=0-7
/proc/31981/stat : 31981 (python) R 31972 31972 30480 0 -1 4202560 916 0 0 0 2 0 0 0 15 0 1 0 549214618 296226816 5701 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216477503 0 0 16781312 514 0 0 0 17 5 0 0 0
/proc/31981/statm: 72321 5701 371 364 0 8236 0
[pid=31983] ppid=31981 vsize=0 CPUtime=4.36 cores=0-7
/proc/31983/stat : 31983 (march_hi) R 31981 31983 31983 0 -1 4202500 574 0 0 0 436 0 0 0 25 0 1 0 549214619 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/31983/statm: 0 0 0 0 0 0 0
[pid=31984] ppid=31972 vsize=299188 CPUtime=0 cores=0-7
/proc/31984/stat : 31984 (python) S 31972 31972 30480 0 -1 4202560 918 0 0 0 0 0 0 0 15 0 1 0 549214622 306368512 5627 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 16283481338634273027 0 0 17 7 0 0 0
/proc/31984/statm: 74797 5627 371 364 0 10709 0
[pid=31986] ppid=31984 vsize=1972 CPUtime=4.3 cores=0-7
/proc/31986/stat : 31986 (march_hi) R 31984 31986 31986 0 -1 4202496 574 0 0 0 430 0 0 0 25 0 1 0 549214622 2019328 310 33554432000 4194304 4955518 140735675484816 18446744073709551615 4227827 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31986/statm: 493 310 104 186 0 306 0
[pid=31987] ppid=31972 vsize=309896 CPUtime=0.02 cores=0-7
/proc/31987/stat : 31987 (python) S 31972 31972 30480 0 -1 4202560 924 0 0 0 1 1 0 0 15 0 1 0 549214626 317333504 5718 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 4818987945023209732 0 0 17 6 0 0 0
/proc/31987/statm: 77474 5718 371 364 0 13383 0
[pid=31989] ppid=31987 vsize=1972 CPUtime=4.31 cores=0-7
/proc/31989/stat : 31989 (march_hi) R 31987 31989 31989 0 -1 4202496 574 0 0 0 431 0 0 0 25 0 1 0 549214626 2019328 310 33554432000 4194304 4955518 140737428115168 18446744073709551615 4209664 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/31989/statm: 493 310 104 186 0 306 0
[pid=31990] ppid=31972 vsize=320152 CPUtime=0 cores=0-7
/proc/31990/stat : 31990 (python) S 31972 31972 30480 0 -1 4202560 932 0 0 0 0 0 0 0 18 0 1 0 549214630 327835648 5739 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 7400408150576169217 0 0 17 0 0 0 0
/proc/31990/statm: 80038 5739 371 364 0 15944 0
[pid=31992] ppid=31990 vsize=1017800 CPUtime=4.23 cores=0-7
/proc/31992/stat : 31992 (gnovelty+2) R 31990 31992 31992 0 -1 4202496 430 0 0 0 423 0 0 0 25 0 1 0 549214630 1042227200 163 33554432000 134512640 135663704 4291663424 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/31992/statm: 254450 163 113 282 0 254166 0
[pid=31993] ppid=31972 vsize=330408 CPUtime=0.01 cores=0-7
/proc/31993/stat : 31993 (python) S 31972 31972 30480 0 -1 4202560 957 0 0 0 1 0 0 0 15 0 1 0 549214634 338337792 5743 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 5950680079120957698 0 0 17 2 0 0 0
/proc/31993/statm: 82602 5743 371 364 0 18505 0
[pid=31995] ppid=31993 vsize=1972 CPUtime=4.19 cores=0-7
/proc/31995/stat : 31995 (march_hi) R 31993 31995 31995 0 -1 4202496 572 0 0 0 419 0 0 0 25 0 1 0 549214634 2019328 309 33554432000 4194304 4955518 140734183554528 18446744073709551615 4209664 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/31995/statm: 493 309 104 186 0 306 0
[pid=31996] ppid=31972 vsize=340288 CPUtime=0.01 cores=0-7
/proc/31996/stat : 31996 (python) S 31972 31972 30480 0 -1 4202560 958 0 0 0 0 1 0 0 15 0 1 0 549214638 348454912 5637 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 4338796032801341697 0 0 17 2 0 0 0
/proc/31996/statm: 85072 5637 371 364 0 20972 0
[pid=31998] ppid=31996 vsize=1972 CPUtime=4.12 cores=0-7
/proc/31998/stat : 31998 (march_hi) R 31996 31998 31998 0 -1 4202496 573 0 0 0 412 0 0 0 25 0 1 0 549214638 2019328 309 33554432000 4194304 4955518 140734154975648 18446744073709551615 4224679 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/31998/statm: 493 309 104 186 0 306 0
[pid=31999] ppid=31972 vsize=351020 CPUtime=0.01 cores=0-7
/proc/31999/stat : 31999 (python) S 31972 31972 30480 0 -1 4202560 1005 0 0 0 1 0 0 0 15 0 1 0 549214642 359444480 5765 33554432000 4194304 5683644 140736994657024 18446744073709551615 210204667462 0 0 16781312 514 1931362547227656452 0 0 17 4 0 0 0
/proc/31999/statm: 87755 5765 377 364 0 23652 0
[pid=32001] ppid=31999 vsize=1972 CPUtime=4.12 cores=0-7
/proc/32001/stat : 32001 (march_hi) R 31999 32001 32001 0 -1 4202496 581 0 0 0 411 1 0 0 25 0 1 0 549214642 2019328 309 33554432000 4194304 4955518 140734426311344 18446744073709551615 4299850 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32001/statm: 493 309 104 186 0 306 0
[pid=31972/tid=31979] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31979/stat : 31979 (python) S 31970 31972 30480 0 -1 4202560 25 931 0 0 0 0 0 0 17 0 9 0 549214615 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31982] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31982/stat : 31982 (python) S 31970 31972 30480 0 -1 4202560 23 931 0 0 0 0 0 0 19 0 9 0 549214618 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 6 0 0 0
[pid=31972/tid=31985] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31985/stat : 31985 (python) S 31970 31972 30480 0 -1 4202560 21 931 0 0 0 0 0 0 21 0 9 0 549214622 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 4 0 0 0
[pid=31972/tid=31988] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31988/stat : 31988 (python) S 31970 31972 30480 0 -1 4202560 21 931 0 0 0 0 0 0 20 0 9 0 549214626 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 6 0 0 0
[pid=31972/tid=31991] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31991/stat : 31991 (python) S 31970 31972 30480 0 -1 4202560 24 931 0 0 0 0 0 0 22 0 9 0 549214630 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31994] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31994/stat : 31994 (python) S 31970 31972 30480 0 -1 4202560 25 931 0 0 0 0 0 0 20 0 9 0 549214634 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 0 0 0 0
[pid=31972/tid=31997] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/31997/stat : 31997 (python) S 31970 31972 30480 0 -1 4202560 26 931 0 0 0 0 0 0 22 0 9 0 549214638 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 2 0 0 0
[pid=31972/tid=32000] ppid=31970 vsize=361264 CPUtime=0 cores=0-7
/proc/31972/task/32000/stat : 32000 (python) S 31970 31972 30480 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 9 0 549214642 369934336 7281 33554432000 4194304 5683644 140736994657024 18446744073709551615 210216470961 0 0 16781312 2 18446604441005599424 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 34.86
Current children cumulated vsize (KiB) 4362668

Child status: 0
Real time (s): 5.28551
CPU time (s): 35.5316
CPU user time (s): 35.2546
CPU system time (s): 0.276957
CPU usage (%): 672.245
Max. virtual memory (cumulated for all children) (KiB): 4364640

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 35.2546
system time used= 0.276957
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33673
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5131
involuntary context switches= 2146

runsolver used 0.012998 second user time and 0.040993 second system time

The end

Launcher Data 

Begin job on node130 at 2011-05-03 00:42:40
IDJOB=3322219
IDBENCH=82997
IDSOLVER=1712
FILE ID=node130/3322219-1304376160
RUNJOBID= node130-1304366466-30494
PBS_JOBID= 13181741
Free space on /tmp= 73452 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v350-c1491-S804294807-063.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322219-1304376160/watcher-3322219-1304376160 -o /tmp/evaluation-result-3322219-1304376160/solver-3322219-1304376160 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322219-1304376160.cnf -seed 1139614181 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b542abc79e1a870fc4bd1b25791c8222
RANDOM SEED=1139614181

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25708232 kB
Buffers:        276624 kB
Cached:        2527716 kB
SwapCached:       2028 kB
Active:        4752312 kB
Inactive:      2179156 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25708232 kB
SwapTotal:    67111528 kB
SwapFree:     67107192 kB
Dirty:           31924 kB
Writeback:           0 kB
AnonPages:     4126764 kB
Mapped:          23160 kB
Slab:           221732 kB
PageTables:      23408 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 50850460 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73420 MiB
End job on node130 at 2011-05-03 00:42:46