Trace number 3385602

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 378.271 66.8368

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v50-c4450-S1034575833-022.UNKNOWN.cnf
MD5SUMd8b7f1701bbfddf0d556cafbec39b80e
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark32.607
Satisfiable
(Un)Satisfiability was proved
Number of variables50
Number of clauses4450
Sum of the clauses size31150
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 54450

Solver Data 

0.29/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.29/0.47	c INFO: solving HOME/instance-3385602-1305570279.cnf
0.29/0.47	c INFO: computing task features
0.38/0.50	c INFO: computed variable-clause graph statistics
0.38/0.50	c INFO: computed clause balance statistics
0.48/0.67	c INFO: computed variable balance statistics
0.58/0.73	c INFO: computed small-clause counts
0.58/0.73	c INFO: computed Horn-clause counts
0.58/0.74	c INFO: computed variable graph statistics
0.58/0.74	c INFO: collected features for HOME/instance-3385602-1305570279.cnf in 0.27 s
0.58/0.77	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.58)
0.69/0.80	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.09)
0.69/0.83	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.04)
0.69/0.86	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.03)
0.69/0.89	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.02)
0.78/0.93	c INFO: running FH@0 for 97 with 4999 remaining (b = 0.02)
0.78/0.96	c INFO: running march_hi@0 for 2134 with 4999 remaining (b = 0.38)
0.78/1.00	c INFO: running march_hi@0 for 2134 with 4999 remaining (b = 0.36)
378.06/66.81	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385602-1305570279/watcher-3385602-1305570279 -o /tmp/evaluation-result-3385602-1305570279/solver-3385602-1305570279 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385602-1305570279.cnf -seed 1733752495 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.53 10.96 10.85 6/337 17735
/proc/meminfo: memFree=14363616/32950904 swapFree=67057400/67111528
[pid=17735] ppid=17733 vsize=15776 CPUtime=0 cores=0-7
/proc/17735/stat : 17735 (python) R 17733 17735 16801 0 -1 4202496 902 0 0 0 0 0 0 0 25 0 1 0 668627632 16154624 783 33554432000 4194304 5683644 140736903712896 18446744073709551615 4570874 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/17735/statm: 3944 783 345 364 0 431 0

[startup+0.042528 s]
/proc/loadavg: 10.53 10.96 10.85 6/337 17735
/proc/meminfo: memFree=14363616/32950904 swapFree=67057400/67111528
[pid=17735] ppid=17733 vsize=21104 CPUtime=0.02 cores=0-7
/proc/17735/stat : 17735 (python) S 17733 17735 16801 0 -1 4202496 1315 0 0 0 2 0 0 0 25 0 1 0 668627632 21610496 1166 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/17735/statm: 5276 1166 428 364 0 723 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 21104

[startup+0.100518 s]
/proc/loadavg: 10.53 10.96 10.85 6/337 17735
/proc/meminfo: memFree=14363616/32950904 swapFree=67057400/67111528
[pid=17735] ppid=17733 vsize=104228 CPUtime=0.06 cores=0-7
/proc/17735/stat : 17735 (python) S 17733 17735 16801 0 -1 4202496 3066 0 0 0 6 0 0 0 25 0 1 0 668627632 106729472 2748 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278877696 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/17735/statm: 26057 2748 847 364 0 1805 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104228

[startup+0.300424 s]
/proc/loadavg: 10.53 10.96 10.85 6/337 17735
/proc/meminfo: memFree=14363616/32950904 swapFree=67057400/67111528
[pid=17735] ppid=17733 vsize=187688 CPUtime=0.22 cores=0-7
/proc/17735/stat : 17735 (python) R 17733 17735 16801 0 -1 4202496 6827 934 1 0 18 4 0 0 25 0 1 0 668627632 192192512 4884 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278877696 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/17735/statm: 46922 4884 1399 364 0 3723 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 187688

[startup+0.700352 s]
/proc/loadavg: 10.53 10.96 10.85 6/337 17735
/proc/meminfo: memFree=14363616/32950904 swapFree=67057400/67111528
[pid=17735] ppid=17733 vsize=279220 CPUtime=0.58 cores=0-7
/proc/17735/stat : 17735 (python) R 17733 17735 16801 0 -1 4202496 9529 934 1 0 52 6 0 0 25 0 1 0 668627632 285921280 7200 33554432000 4194304 5683644 140736903712896 18446744073709551615 47611517200251 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/17735/statm: 69805 7200 1827 364 0 5729 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 279220

[startup+1.50121 s]
/proc/loadavg: 10.53 10.96 10.85 13/358 17761
/proc/meminfo: memFree=14306408/32950904 swapFree=67057400/67111528
[pid=17735] ppid=17733 vsize=361668 CPUtime=0.88 cores=0-7
/proc/17735/stat : 17735 (python) S 17733 17735 16801 0 -1 4202496 16122 934 1 0 79 9 0 0 25 0 9 0 668627632 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17735/statm: 90417 7384 1891 364 0 26314 0
[pid=17741] ppid=17735 vsize=279244 CPUtime=0 cores=0-7
/proc/17741/stat : 17741 (python) S 17735 17735 16801 0 -1 4202560 740 0 0 0 0 0 0 0 25 0 1 0 668627709 285945856 5727 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899727 0 0 16781312 514 5698269317901058047 0 0 17 1 0 0 0
/proc/17741/statm: 69811 5727 354 364 0 5729 0
[pid=17743] ppid=17741 vsize=1017932 CPUtime=0.7 cores=0-7
/proc/17743/stat : 17743 (gnovelty+2) R 17741 17743 17743 0 -1 4202496 493 0 0 0 70 0 0 0 25 0 1 0 668627710 1042362368 227 33554432000 134512640 135663704 4289991776 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/17743/statm: 254483 227 113 282 0 254199 0
[pid=17744] ppid=17735 vsize=289888 CPUtime=0 cores=0-7
/proc/17744/stat : 17744 (python) S 17735 17735 16801 0 -1 4202560 744 0 0 0 0 0 0 0 25 0 1 0 668627712 296845312 5813 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 13873434588799303679 0 0 17 2 0 0 0
/proc/17744/statm: 72472 5813 348 364 0 8387 0
[pid=17746] ppid=17744 vsize=1017932 CPUtime=0.69 cores=0-7
/proc/17746/stat : 17746 (gnovelty+2) R 17744 17746 17746 0 -1 4202496 489 0 0 0 69 0 0 0 25 0 1 0 668627713 1042362368 227 33554432000 134512640 135663704 4288828848 18446744073709551615 134525529 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17746/statm: 254483 227 113 282 0 254199 0
[pid=17747] ppid=17735 vsize=300144 CPUtime=0 cores=0-7
/proc/17747/stat : 17747 (python) S 17735 17735 16801 0 -1 4202560 722 0 0 0 0 0 0 0 25 0 1 0 668627716 307347456 5813 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 581347261150134271 0 0 17 2 0 0 0
/proc/17747/statm: 75036 5813 344 364 0 10948 0
[pid=17749] ppid=17747 vsize=416524 CPUtime=0.63 cores=0-7
/proc/17749/stat : 17749 (adaptg2wsat2009) R 17747 17749 17749 0 -1 4202496 585 0 0 0 63 0 0 0 25 0 1 0 668627716 426520576 320 33554432000 134512640 135107411 4289591840 18446744073709551615 134532347 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17749/statm: 104131 320 59 146 0 103007 0
[pid=17750] ppid=17735 vsize=310400 CPUtime=0 cores=0-7
/proc/17750/stat : 17750 (python) S 17735 17735 16801 0 -1 4202560 731 0 0 0 0 0 0 0 24 0 1 0 668627719 317849600 5817 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 15489569072193994751 0 0 17 0 0 0 0
/proc/17750/statm: 77600 5817 344 364 0 13509 0
[pid=17752] ppid=17750 vsize=416520 CPUtime=0.22 cores=0-7
/proc/17752/stat : 17752 (adaptg2wsat2009) R 17750 17752 17752 0 -1 4202496 532 0 0 0 22 0 0 0 25 0 1 0 668627721 426516480 265 33554432000 134512640 135107411 4293449760 18446744073709551615 134523339 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/17752/statm: 104130 265 49 146 0 103006 0
[pid=17753] ppid=17735 vsize=320656 CPUtime=0 cores=0-7
/proc/17753/stat : 17753 (python) S 17735 17735 16801 0 -1 4202560 738 0 0 0 0 0 0 0 25 0 1 0 668627722 328351744 5821 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 11563682540870959103 0 0 17 0 0 0 0
/proc/17753/statm: 80164 5821 344 364 0 16070 0
[pid=17755] ppid=17753 vsize=416520 CPUtime=0.51 cores=0-7
/proc/17755/stat : 17755 (adaptg2wsat2009) R 17753 17755 17755 0 -1 4202496 532 0 0 0 51 0 0 0 25 0 1 0 668627725 426516480 265 33554432000 134512640 135107411 4293127904 18446744073709551615 134523304 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/17755/statm: 104130 265 49 146 0 103006 0
[pid=17756] ppid=17735 vsize=330912 CPUtime=0 cores=0-7
/proc/17756/stat : 17756 (python) S 17735 17735 16801 0 -1 4202560 744 0 0 0 0 0 0 0 24 0 1 0 668627725 338853888 5825 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 18021202016851722239 0 0 17 0 0 0 0
/proc/17756/statm: 82728 5825 344 364 0 18631 0
[pid=17758] ppid=17756 vsize=245316 CPUtime=0.21 cores=0-7
/proc/17758/stat : 17758 (FH) R 17756 17758 17758 0 -1 4202496 489 0 0 0 21 0 0 0 25 0 1 0 668627728 251203584 223 33554432000 134512640 134936988 4289573648 18446744073709551615 134523663 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/17758/statm: 61329 223 37 104 0 60833 0
[pid=17759] ppid=17735 vsize=341168 CPUtime=0 cores=0-7
/proc/17759/stat : 17759 (python) S 17735 17735 16801 0 -1 4202560 752 0 0 0 0 0 0 0 25 0 1 0 668627729 349356032 5829 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 4253162493817389055 0 0 17 0 0 0 0
/proc/17759/statm: 85292 5829 344 364 0 21192 0
[pid=17735/tid=17742] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17742/stat : 17742 (python) S 17733 17735 16801 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668627710 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17745] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17745/stat : 17745 (python) S 17733 17735 16801 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 668627713 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17748] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17748/stat : 17748 (python) S 17733 17735 16801 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 9 0 668627716 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17751] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17751/stat : 17751 (python) S 17733 17735 16801 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 9 0 668627719 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17754] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17754/stat : 17754 (python) S 17733 17735 16801 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668627722 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17757] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17757/stat : 17757 (python) S 17733 17735 16801 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 668627726 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17760] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17760/stat : 17760 (python) S 17733 17735 16801 0 -1 4202560 39 934 0 0 0 0 0 0 25 0 9 0 668627729 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17762] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17762/stat : 17762 (python) S 17733 17735 16801 0 -1 4202560 24 934 0 0 0 0 0 0 25 0 9 0 668627732 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.84
Current children cumulated vsize (KiB) 6064824

[startup+3.10092 s]
/proc/loadavg: 10.89 11.03 10.88 14/362 17764
/proc/meminfo: memFree=14299812/32950904 swapFree=67057400/67111528
[pid=17735] ppid=17733 vsize=361668 CPUtime=0.88 cores=0-7
/proc/17735/stat : 17735 (python) S 17733 17735 16801 0 -1 4202496 16122 934 1 0 79 9 0 0 25 0 9 0 668627632 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17735/statm: 90417 7384 1891 364 0 26314 0
[pid=17741] ppid=17735 vsize=279244 CPUtime=0 cores=0-7
/proc/17741/stat : 17741 (python) S 17735 17735 16801 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 668627709 285945856 5727 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899727 0 0 16781312 514 5698269317901025540 0 0 17 1 0 0 0
/proc/17741/statm: 69811 5727 354 364 0 5729 0
[pid=17743] ppid=17741 vsize=1017932 CPUtime=2.29 cores=0-7
/proc/17743/stat : 17743 (gnovelty+2) R 17741 17743 17743 0 -1 4202496 493 0 0 0 229 0 0 0 25 0 1 0 668627710 1042362368 227 33554432000 134512640 135663704 4289991776 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/17743/statm: 254483 227 113 282 0 254199 0
[pid=17744] ppid=17735 vsize=289888 CPUtime=0 cores=0-7
/proc/17744/stat : 17744 (python) S 17735 17735 16801 0 -1 4202560 744 0 0 0 0 0 0 0 18 0 1 0 668627712 296845312 5813 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 13873434588799271171 0 0 17 2 0 0 0
/proc/17744/statm: 72472 5813 348 364 0 8387 0
[pid=17746] ppid=17744 vsize=1017932 CPUtime=2.29 cores=0-7
/proc/17746/stat : 17746 (gnovelty+2) R 17744 17746 17746 0 -1 4202496 489 0 0 0 229 0 0 0 25 0 1 0 668627713 1042362368 227 33554432000 134512640 135663704 4288828848 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17746/statm: 254483 227 113 282 0 254199 0
[pid=17747] ppid=17735 vsize=300144 CPUtime=0 cores=0-7
/proc/17747/stat : 17747 (python) S 17735 17735 16801 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 668627716 307347456 5817 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 581347261150101764 0 0 17 2 0 0 0
/proc/17747/statm: 75036 5817 348 364 0 10948 0
[pid=17749] ppid=17747 vsize=416524 CPUtime=2.23 cores=0-7
/proc/17749/stat : 17749 (adaptg2wsat2009) R 17747 17749 17749 0 -1 4202496 585 0 0 0 223 0 0 0 25 0 1 0 668627716 426520576 320 33554432000 134512640 135107411 4289591840 18446744073709551615 134532128 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17749/statm: 104131 320 59 146 0 103007 0
[pid=17750] ppid=17735 vsize=310400 CPUtime=0 cores=0-7
/proc/17750/stat : 17750 (python) S 17735 17735 16801 0 -1 4202560 749 0 0 0 0 0 0 0 18 0 1 0 668627719 317849600 5821 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 15489569072193962244 0 0 17 0 0 0 0
/proc/17750/statm: 77600 5821 348 364 0 13509 0
[pid=17752] ppid=17750 vsize=416524 CPUtime=1.02 cores=0-7
/proc/17752/stat : 17752 (adaptg2wsat2009) R 17750 17752 17752 0 -1 4202496 588 0 0 0 102 0 0 0 25 0 1 0 668627721 426520576 321 33554432000 134512640 135107411 4293449760 18446744073709551615 134532088 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/17752/statm: 104131 321 59 146 0 103007 0
[pid=17753] ppid=17735 vsize=320656 CPUtime=0 cores=0-7
/proc/17753/stat : 17753 (python) S 17735 17735 16801 0 -1 4202560 756 0 0 0 0 0 0 0 18 0 1 0 668627722 328351744 5825 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 11563682540870926595 0 0 17 0 0 0 0
/proc/17753/statm: 80164 5825 348 364 0 16070 0
[pid=17755] ppid=17753 vsize=416524 CPUtime=2.11 cores=0-7
/proc/17755/stat : 17755 (adaptg2wsat2009) R 17753 17755 17755 0 -1 4202496 587 0 0 0 211 0 0 0 25 0 1 0 668627725 426520576 320 33554432000 134512640 135107411 4293127904 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/17755/statm: 104131 320 59 146 0 103007 0
[pid=17756] ppid=17735 vsize=330912 CPUtime=0 cores=0-7
/proc/17756/stat : 17756 (python) S 17735 17735 16801 0 -1 4202560 764 0 0 0 0 0 0 0 18 0 1 0 668627725 338853888 5829 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 18021202016851689729 0 0 17 0 0 0 0
/proc/17756/statm: 82728 5829 348 364 0 18631 0
[pid=17758] ppid=17756 vsize=246800 CPUtime=1.01 cores=0-7
/proc/17758/stat : 17758 (FH) R 17756 17758 17758 0 -1 4202496 554 0 0 0 101 0 0 0 25 0 1 0 668627728 252723200 286 33554432000 134512640 134936988 4289573648 18446744073709551615 134554258 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/17758/statm: 61700 286 41 104 0 61204 0
[pid=17759] ppid=17735 vsize=341168 CPUtime=0 cores=0-7
/proc/17759/stat : 17759 (python) S 17735 17735 16801 0 -1 4202560 781 0 0 0 0 0 0 0 15 0 1 0 668627729 349356032 5833 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 5607381668114432258 0 0 17 0 0 0 0
/proc/17759/statm: 85292 5833 348 364 0 21192 0
[pid=17763] ppid=17759 vsize=2264 CPUtime=0.99 cores=0-7
/proc/17763/stat : 17763 (march_hi) R 17759 17763 17763 0 -1 4202496 995 0 0 0 99 0 0 0 25 0 1 0 668627733 2318336 392 33554432000 4194304 4955518 140736357980624 18446744073709551615 4224450 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/17763/statm: 566 392 106 186 0 379 0
[pid=17761] ppid=17735 vsize=351424 CPUtime=0 cores=0-7
/proc/17761/stat : 17761 (python) S 17735 17735 16801 0 -1 4202560 825 0 0 0 0 0 0 0 15 0 1 0 668627732 359858176 5843 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 5607381668114432257 0 0 17 0 0 0 0
/proc/17761/statm: 87856 5843 354 364 0 23753 0
[pid=17764] ppid=17761 vsize=2264 CPUtime=0.99 cores=0-7
/proc/17764/stat : 17764 (march_hi) R 17761 17764 17764 0 -1 4202496 998 0 0 0 99 0 0 0 25 0 1 0 668627733 2318336 391 33554432000 4194304 4955518 140736271863472 18446744073709551615 4224471 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/17764/statm: 566 391 106 186 0 379 0
[pid=17735/tid=17742] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17742/stat : 17742 (python) S 17733 17735 16801 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668627710 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17745] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17745/stat : 17745 (python) S 17733 17735 16801 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 668627713 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17748] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17748/stat : 17748 (python) S 17733 17735 16801 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 9 0 668627716 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17751] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17751/stat : 17751 (python) S 17733 17735 16801 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 9 0 668627719 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17754] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17754/stat : 17754 (python) S 17733 17735 16801 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668627722 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17757] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17757/stat : 17757 (python) S 17733 17735 16801 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 668627726 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17760] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17760/stat : 17760 (python) S 17733 17735 16801 0 -1 4202560 39 934 0 0 0 0 0 0 25 0 9 0 668627729 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17762] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17762/stat : 17762 (python) S 17733 17735 16801 0 -1 4202560 24 934 0 0 0 0 0 0 25 0 9 0 668627732 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 13.81
Current children cumulated vsize (KiB) 6422268

################
# More data... #
################

[pid=17756] ppid=17735 vsize=330912 CPUtime=0.16 cores=0-7
/proc/17756/stat : 17756 (python) S 17735 17735 16801 0 -1 4202560 946 0 0 0 9 7 0 0 18 0 1 0 668627725 338853888 5852 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793857 0 0 17 0 0 0 0
/proc/17756/statm: 82728 5852 371 364 0 18631 0
[pid=17758] ppid=17756 vsize=246800 CPUtime=32.51 cores=0-7
/proc/17758/stat : 17758 (FH) R 17756 17758 17758 0 -1 4202496 554 0 0 0 3251 0 0 0 25 0 1 0 668627728 252723200 286 33554432000 134512640 134936988 4289573648 18446744073709551615 134553427 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/17758/statm: 61700 286 41 104 0 61204 0
[pid=17759] ppid=17735 vsize=341168 CPUtime=0.2 cores=0-7
/proc/17759/stat : 17759 (python) S 17735 17735 16801 0 -1 4202560 1000 0 0 0 11 9 0 0 15 0 1 0 668627729 349356032 5856 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 13316088571266826498 0 0 17 0 0 0 0
/proc/17759/statm: 85292 5856 371 364 0 21192 0
[pid=17763] ppid=17759 vsize=2264 CPUtime=32.6 cores=0-7
/proc/17763/stat : 17763 (march_hi) R 17759 17763 17763 0 -1 4202496 995 0 0 0 3260 0 0 0 25 0 1 0 668627733 2318336 392 33554432000 4194304 4955518 140736357980624 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/17763/statm: 566 392 106 186 0 379 0
[pid=17761] ppid=17735 vsize=351424 CPUtime=0.2 cores=0-7
/proc/17761/stat : 17761 (python) S 17735 17735 16801 0 -1 4202560 1044 0 0 0 12 8 0 0 15 0 1 0 668627732 359858176 5866 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 3228632336375447809 0 0 17 0 0 0 0
/proc/17761/statm: 87856 5866 377 364 0 23753 0
[pid=17764] ppid=17761 vsize=2264 CPUtime=32.61 cores=0-7
/proc/17764/stat : 17764 (march_hi) R 17761 17764 17764 0 -1 4202496 998 0 0 0 3261 0 0 0 25 0 1 0 668627733 2318336 391 33554432000 4194304 4955518 140736271863472 18446744073709551615 4297490 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/17764/statm: 566 391 106 186 0 379 0
[pid=17735/tid=17742] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17742/stat : 17742 (python) S 17733 17735 16801 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668627710 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17745] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17745/stat : 17745 (python) S 17733 17735 16801 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 668627713 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17748] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17748/stat : 17748 (python) S 17733 17735 16801 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 9 0 668627716 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17751] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17751/stat : 17751 (python) S 17733 17735 16801 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 9 0 668627719 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17754] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17754/stat : 17754 (python) S 17733 17735 16801 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668627722 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17757] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17757/stat : 17757 (python) S 17733 17735 16801 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 668627726 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17760] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17760/stat : 17760 (python) S 17733 17735 16801 0 -1 4202560 39 934 0 0 0 0 0 0 25 0 9 0 668627729 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17762] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17762/stat : 17762 (python) S 17733 17735 16801 0 -1 4202560 24 934 0 0 0 0 0 0 25 0 9 0 668627732 370348032 7384 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 375.36
Current children cumulated vsize (KiB) 6422268

[startup+66.7016 s]
/proc/loadavg: 11.78 11.25 10.96 13/362 17765
/proc/meminfo: memFree=14300432/32950904 swapFree=67057400/67111528
[pid=17735] ppid=17733 vsize=361668 CPUtime=0.88 cores=0-7
/proc/17735/stat : 17735 (python) S 17733 17735 16801 0 -1 4202496 16161 934 1 0 79 9 0 0 17 0 9 0 668627632 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290709823 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17735/statm: 90417 7385 1892 364 0 26314 0
[pid=17741] ppid=17735 vsize=279244 CPUtime=0.16 cores=0-7
/proc/17741/stat : 17741 (python) S 17735 17735 16801 0 -1 4202560 940 0 0 0 8 8 0 0 15 0 1 0 668627709 285945856 5754 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290709765 0 0 16781824 2 18446744071562232103 0 0 17 1 0 0 0
/proc/17741/statm: 69811 5754 381 364 0 5729 0
[pid=17743] ppid=17741 vsize=1017932 CPUtime=59.4 cores=0-7
/proc/17743/stat : 17743 (gnovelty+2) R 17741 17743 17743 0 -1 4202496 493 0 0 0 5940 0 0 0 25 0 1 0 668627710 1042362368 227 33554432000 134512640 135663704 4289991776 18446744073709551615 134524548 256 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17743/statm: 254483 227 113 282 0 254199 0
[pid=17744] ppid=17735 vsize=289888 CPUtime=0.16 cores=0-7
/proc/17744/stat : 17744 (python) S 17735 17735 16801 0 -1 4202560 928 0 0 0 8 8 0 0 18 0 1 0 668627712 296845312 5836 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793859 0 0 17 2 0 0 0
/proc/17744/statm: 72472 5836 371 364 0 8387 0
[pid=17746] ppid=17744 vsize=1017932 CPUtime=50.1 cores=0-7
/proc/17746/stat : 17746 (gnovelty+2) R 17744 17746 17746 0 -1 4202496 489 0 0 0 5010 0 0 0 25 0 1 0 668627713 1042362368 227 33554432000 134512640 135663704 4288828848 18446744073709551615 134545619 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/17746/statm: 254483 227 113 282 0 254199 0
[pid=17747] ppid=17735 vsize=300144 CPUtime=0.16 cores=0-7
/proc/17747/stat : 17747 (python) S 17735 17735 16801 0 -1 4202560 920 0 0 0 9 7 0 0 18 0 1 0 668627716 307347456 5840 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793860 0 0 17 2 0 0 0
/proc/17747/statm: 75036 5840 371 364 0 10948 0
[pid=17749] ppid=17747 vsize=416524 CPUtime=65.5 cores=0-7
/proc/17749/stat : 17749 (adaptg2wsat2009) R 17747 17749 17749 0 -1 4202496 585 0 0 0 6550 0 0 0 25 0 1 0 668627716 426520576 320 33554432000 134512640 135107411 4289591840 18446744073709551615 134532371 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17749/statm: 104131 320 59 146 0 103007 0
[pid=17750] ppid=17735 vsize=310400 CPUtime=0.16 cores=0-7
/proc/17750/stat : 17750 (python) S 17735 17735 16801 0 -1 4202560 944 0 0 0 8 8 0 0 18 0 1 0 668627719 317849600 5844 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793860 0 0 17 0 0 0 0
/proc/17750/statm: 77600 5844 371 364 0 13509 0
[pid=17752] ppid=17750 vsize=416524 CPUtime=37.23 cores=0-7
/proc/17752/stat : 17752 (adaptg2wsat2009) R 17750 17752 17752 0 -1 4202496 588 0 0 0 3723 0 0 0 25 0 1 0 668627721 426520576 321 33554432000 134512640 135107411 4293449760 18446744073709551615 134532379 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17752/statm: 104131 321 59 146 0 103007 0
[pid=17753] ppid=17735 vsize=320656 CPUtime=0.15 cores=0-7
/proc/17753/stat : 17753 (python) S 17735 17735 16801 0 -1 4202560 952 0 0 0 8 7 0 0 18 0 1 0 668627722 328351744 5848 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793859 0 0 17 0 0 0 0
/proc/17753/statm: 80164 5848 371 364 0 16070 0
[pid=17755] ppid=17753 vsize=416524 CPUtime=64.78 cores=0-7
/proc/17755/stat : 17755 (adaptg2wsat2009) R 17753 17755 17755 0 -1 4202496 587 0 0 0 6478 0 0 0 25 0 1 0 668627725 426520576 320 33554432000 134512640 135107411 4293127904 18446744073709551615 134531340 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/17755/statm: 104131 320 59 146 0 103007 0
[pid=17756] ppid=17735 vsize=330912 CPUtime=0.16 cores=0-7
/proc/17756/stat : 17756 (python) S 17735 17735 16801 0 -1 4202560 946 0 0 0 9 7 0 0 18 0 1 0 668627725 338853888 5852 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793857 0 0 17 0 0 0 0
/proc/17756/statm: 82728 5852 371 364 0 18631 0
[pid=17758] ppid=17756 vsize=246800 CPUtime=32.71 cores=0-7
/proc/17758/stat : 17758 (FH) R 17756 17758 17758 0 -1 4202496 554 0 0 0 3271 0 0 0 25 0 1 0 668627728 252723200 286 33554432000 134512640 134936988 4289573648 18446744073709551615 134554591 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/17758/statm: 61700 286 41 104 0 61204 0
[pid=17759] ppid=17735 vsize=341168 CPUtime=0.2 cores=0-7
/proc/17759/stat : 17759 (python) S 17735 17735 16801 0 -1 4202560 1003 0 0 0 11 9 0 0 15 0 1 0 668627729 349356032 5857 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 5607381942992339202 0 0 17 0 0 0 0
/proc/17759/statm: 85292 5857 372 364 0 21192 0
[pid=17763] ppid=17759 vsize=2264 CPUtime=32.81 cores=0-7
/proc/17763/stat : 17763 (march_hi) R 17759 17763 17763 0 -1 4202496 995 0 0 0 3280 1 0 0 25 0 1 0 668627733 2318336 392 33554432000 4194304 4955518 140736357980624 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/17763/statm: 566 392 106 186 0 379 0
[pid=17761] ppid=17735 vsize=0 CPUtime=33 cores=0-7
/proc/17761/stat : 17761 (python) Z 17735 17735 16801 0 -1 4202588 1277 999 0 0 12 8 3280 0 16 0 1 0 668627732 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17761/statm: 0 0 0 0 0 0 0
[pid=17735/tid=17742] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17742/stat : 17742 (python) S 17733 17735 16801 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668627710 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17745] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17745/stat : 17745 (python) S 17733 17735 16801 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 668627713 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17748] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17748/stat : 17748 (python) S 17733 17735 16801 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 9 0 668627716 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17751] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17751/stat : 17751 (python) S 17733 17735 16801 0 -1 4202560 26 934 0 0 0 0 0 0 25 0 9 0 668627719 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17754] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17754/stat : 17754 (python) S 17733 17735 16801 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 668627722 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17757] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17757/stat : 17757 (python) S 17733 17735 16801 0 -1 4202560 22 934 0 0 0 0 0 0 25 0 9 0 668627726 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17760] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17760/stat : 17760 (python) S 17733 17735 16801 0 -1 4202560 39 934 0 0 0 0 0 0 25 0 9 0 668627729 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17762] ppid=17733 vsize=361668 CPUtime=0 cores=0-7
/proc/17735/task/17762/stat : 17762 (python) S 17733 17735 16801 0 -1 4202560 24 934 0 0 0 0 0 0 25 0 9 0 668627732 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 377.56
Current children cumulated vsize (KiB) 6068580

[startup+66.8016 s]
/proc/loadavg: 11.78 11.25 10.96 13/362 17765
/proc/meminfo: memFree=14300432/32950904 swapFree=67057400/67111528
[pid=17735] ppid=17733 vsize=361668 CPUtime=60.44 cores=0-7
/proc/17735/stat : 17735 (python) S 17733 17735 16801 0 -1 4202496 16164 2395 1 0 79 9 5948 8 17 0 9 0 668627632 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290709823 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17735/statm: 90417 7385 1892 364 0 26314 0
[pid=17744] ppid=17735 vsize=289888 CPUtime=0.16 cores=0-7
/proc/17744/stat : 17744 (python) S 17735 17735 16801 0 -1 4202560 928 0 0 0 8 8 0 0 18 0 1 0 668627712 296845312 5836 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793859 0 0 17 2 0 0 0
/proc/17744/statm: 72472 5836 371 364 0 8387 0
[pid=17746] ppid=17744 vsize=1017932 CPUtime=50.2 cores=0-7
/proc/17746/stat : 17746 (gnovelty+2) R 17744 17746 17746 0 -1 4202496 489 0 0 0 5020 0 0 0 25 0 1 0 668627713 1042362368 227 33554432000 134512640 135663704 4288828848 18446744073709551615 134525229 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/17746/statm: 254483 227 113 282 0 254199 0
[pid=17747] ppid=17735 vsize=300144 CPUtime=0.16 cores=0-7
/proc/17747/stat : 17747 (python) S 17735 17735 16801 0 -1 4202560 920 0 0 0 9 7 0 0 18 0 1 0 668627716 307347456 5840 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793860 0 0 17 2 0 0 0
/proc/17747/statm: 75036 5840 371 364 0 10948 0
[pid=17749] ppid=17747 vsize=416524 CPUtime=65.6 cores=0-7
/proc/17749/stat : 17749 (adaptg2wsat2009) R 17747 17749 17749 0 -1 4202496 585 0 0 0 6560 0 0 0 25 0 1 0 668627716 426520576 320 33554432000 134512640 135107411 4289591840 18446744073709551615 134531741 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/17749/statm: 104131 320 59 146 0 103007 0
[pid=17750] ppid=17735 vsize=310400 CPUtime=0.16 cores=0-7
/proc/17750/stat : 17750 (python) S 17735 17735 16801 0 -1 4202560 944 0 0 0 8 8 0 0 18 0 1 0 668627719 317849600 5844 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793860 0 0 17 0 0 0 0
/proc/17750/statm: 77600 5844 371 364 0 13509 0
[pid=17752] ppid=17750 vsize=416524 CPUtime=37.33 cores=0-7
/proc/17752/stat : 17752 (adaptg2wsat2009) R 17750 17752 17752 0 -1 4202496 588 0 0 0 3733 0 0 0 25 0 1 0 668627721 426520576 321 33554432000 134512640 135107411 4293449760 18446744073709551615 134532306 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/17752/statm: 104131 321 59 146 0 103007 0
[pid=17753] ppid=17735 vsize=320656 CPUtime=0.15 cores=0-7
/proc/17753/stat : 17753 (python) S 17735 17735 16801 0 -1 4202560 952 0 0 0 8 7 0 0 18 0 1 0 668627722 328351744 5848 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793859 0 0 17 0 0 0 0
/proc/17753/statm: 80164 5848 371 364 0 16070 0
[pid=17755] ppid=17753 vsize=416524 CPUtime=64.88 cores=0-7
/proc/17755/stat : 17755 (adaptg2wsat2009) R 17753 17755 17755 0 -1 4202496 587 0 0 0 6488 0 0 0 25 0 1 0 668627725 426520576 320 33554432000 134512640 135107411 4293127904 18446744073709551615 134531411 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/17755/statm: 104131 320 59 146 0 103007 0
[pid=17756] ppid=17735 vsize=330912 CPUtime=0.16 cores=0-7
/proc/17756/stat : 17756 (python) S 17735 17735 16801 0 -1 4202560 946 0 0 0 9 7 0 0 18 0 1 0 668627725 338853888 5852 33554432000 4194304 5683644 140736903712896 18446744073709551615 237278899782 0 0 16781312 514 8504907158800793857 0 0 17 0 0 0 0
/proc/17756/statm: 82728 5852 371 364 0 18631 0
[pid=17758] ppid=17756 vsize=246800 CPUtime=32.81 cores=0-7
/proc/17758/stat : 17758 (FH) R 17756 17758 17758 0 -1 4202496 554 0 0 0 3281 0 0 0 25 0 1 0 668627728 252723200 286 33554432000 134512640 134936988 4289573648 18446744073709551615 134552088 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/17758/statm: 61700 286 41 104 0 61204 0
[pid=17759] ppid=17735 vsize=341168 CPUtime=0.2 cores=0-7
/proc/17759/stat : 17759 (python) S 17735 17735 16801 0 -1 4202560 1021 0 0 0 11 9 0 0 15 0 1 0 668627729 349356032 5862 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290709823 0 0 16781824 2 18446744071562232103 0 0 17 0 0 0 0
/proc/17759/statm: 85292 5862 377 364 0 21192 0
[pid=17763] ppid=17759 vsize=2264 CPUtime=32.81 cores=0-7
/proc/17763/stat : 17763 (march_hi) R 17759 17763 17763 0 -1 4202496 995 0 0 0 3280 1 0 0 25 0 1 0 668627733 2318336 392 33554432000 4194304 4955518 140736357980624 18446744073709551615 4297477 256 0 16781312 0 0 0 0 17 4 0 0 0
/proc/17763/statm: 566 392 106 186 0 379 0
[pid=17761] ppid=17735 vsize=0 CPUtime=33 cores=0-7
/proc/17761/stat : 17761 (python) Z 17735 17735 16801 0 -1 4202588 1277 999 0 0 12 8 3280 0 16 0 1 0 668627732 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 0 0 0 0
/proc/17761/statm: 0 0 0 0 0 0 0
[pid=17735/tid=17742] ppid=17733 vsize=361668 CPUtime=59.56 cores=0-7
/proc/17735/task/17742/stat : 17742 (python) S 17733 17735 16801 0 -1 4202560 27 2395 0 0 0 0 5948 8 25 0 9 0 668627710 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17745] ppid=17733 vsize=361668 CPUtime=59.56 cores=0-7
/proc/17735/task/17745/stat : 17745 (python) S 17733 17735 16801 0 -1 4202560 22 2395 0 0 0 0 5948 8 25 0 9 0 668627713 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17748] ppid=17733 vsize=361668 CPUtime=59.56 cores=0-7
/proc/17735/task/17748/stat : 17748 (python) S 17733 17735 16801 0 -1 4202560 25 2395 0 0 0 0 5948 8 25 0 9 0 668627716 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 2 0 0 0
[pid=17735/tid=17751] ppid=17733 vsize=361668 CPUtime=59.56 cores=0-7
/proc/17735/task/17751/stat : 17751 (python) S 17733 17735 16801 0 -1 4202560 26 2395 0 0 0 0 5948 8 25 0 9 0 668627719 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17754] ppid=17733 vsize=361668 CPUtime=59.56 cores=0-7
/proc/17735/task/17754/stat : 17754 (python) S 17733 17735 16801 0 -1 4202560 27 2395 0 0 0 0 5948 8 25 0 9 0 668627722 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17757] ppid=17733 vsize=361668 CPUtime=59.56 cores=0-7
/proc/17735/task/17757/stat : 17757 (python) S 17733 17735 16801 0 -1 4202560 22 2395 0 0 0 0 5948 8 25 0 9 0 668627726 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17760] ppid=17733 vsize=361668 CPUtime=59.56 cores=0-7
/proc/17735/task/17760/stat : 17760 (python) S 17733 17735 16801 0 -1 4202560 39 2395 0 0 0 0 5948 8 25 0 9 0 668627729 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
[pid=17735/tid=17762] ppid=17733 vsize=361668 CPUtime=59.56 cores=0-7
/proc/17735/task/17762/stat : 17762 (python) S 17733 17735 16801 0 -1 4202560 24 2395 0 0 0 0 5948 8 25 0 9 0 668627732 370348032 7385 33554432000 4194304 5683644 140736903712896 18446744073709551615 237290703281 0 0 16781312 2 18446604452813611328 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 378.06
Current children cumulated vsize (KiB) 4771404

Child status: 0
Real time (s): 66.8368
CPU time (s): 378.271
CPU user time (s): 377.468
CPU system time (s): 0.802877
CPU usage (%): 565.961
Max. virtual memory (cumulated for all children) (KiB): 6422272

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 377.468
system time used= 0.802877
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 34966
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2322
involuntary context switches= 5071

runsolver used 0.229965 second user time and 0.507922 second system time

The end

Launcher Data 

Begin job on node121 at 2011-05-16 20:24:39
IDJOB=3385602
IDBENCH=82867
IDSOLVER=1870
FILE ID=node121/3385602-1305570279
RUNJOBID= node121-1305564964-16815
PBS_JOBID= 13350129
Free space on /tmp= 73420 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v50-c4450-S1034575833-022.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385602-1305570279/watcher-3385602-1305570279 -o /tmp/evaluation-result-3385602-1305570279/solver-3385602-1305570279 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385602-1305570279.cnf -seed 1733752495 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= d8b7f1701bbfddf0d556cafbec39b80e
RANDOM SEED=1733752495

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      14363648 kB
Buffers:        336288 kB
Cached:        7053752 kB
SwapCached:       7656 kB
Active:       12533848 kB
Inactive:      5673680 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      14363648 kB
SwapTotal:    67111528 kB
SwapFree:     67057400 kB
Dirty:           33384 kB
Writeback:           0 kB
AnonPages:    10815380 kB
Mapped:          27428 kB
Slab:           268596 kB
PageTables:      41776 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS: 62366712 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73392 MiB
End job on node121 at 2011-05-16 20:25:46