Trace number 3385800

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 85.0221 17.0482

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v75-c1597-S1750722942-074.UNKNOWN.cnf
MD5SUM55d30b10c45b8bb435e547799f98f891
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark6.99194
Satisfiable
(Un)Satisfiability was proved
Number of variables75
Number of clauses1597
Sum of the clauses size7985
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 51597
Number of clauses of size over 50

Solver Data 

0.30/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.30/0.46	c INFO: solving HOME/instance-3385800-1305575350.cnf
0.30/0.46	c INFO: computing task features
0.30/0.47	c INFO: computed variable-clause graph statistics
0.30/0.47	c INFO: computed clause balance statistics
0.39/0.51	c INFO: computed variable balance statistics
0.39/0.53	c INFO: computed small-clause counts
0.39/0.53	c INFO: computed Horn-clause counts
0.39/0.53	c INFO: computed variable graph statistics
0.39/0.53	c INFO: collected features for HOME/instance-3385800-1305575350.cnf in 0.07 s
0.39/0.56	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.61)
0.39/0.59	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.38)
0.49/0.62	c INFO: running march_hi@0 for 388 with 4999 remaining (b = 0.33)
0.49/0.65	c INFO: running march_hi@0 for 97 with 4999 remaining (b = 0.11)
0.49/0.69	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.08)
0.59/0.72	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.27)
0.59/0.75	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.24)
0.59/0.79	c INFO: running march_hi@0 for 485 with 4999 remaining (b = 0.22)
84.74/17.02	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385800-1305575350/watcher-3385800-1305575350 -o /tmp/evaluation-result-3385800-1305575350/solver-3385800-1305575350 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385800-1305575350.cnf -seed 1457085967 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.39 9.95 10.07 5/337 18252
/proc/meminfo: memFree=14373904/32950904 swapFree=67057400/67111528
[pid=18252] ppid=18250 vsize=15908 CPUtime=0 cores=0-7
/proc/18252/stat : 18252 (python) R 18250 18252 18114 0 -1 4202496 957 0 0 0 0 0 0 0 25 0 1 0 669134731 16289792 833 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278922842 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/18252/statm: 3978 834 357 364 0 465 0

[startup+0.030175 s]
/proc/loadavg: 9.39 9.95 10.07 5/337 18252
/proc/meminfo: memFree=14373904/32950904 swapFree=67057400/67111528
[pid=18252] ppid=18250 vsize=18884 CPUtime=0.01 cores=0-7
/proc/18252/stat : 18252 (python) R 18250 18252 18114 0 -1 4202496 1273 0 0 0 1 0 0 0 25 0 1 0 669134731 19337216 1126 33554432000 4194304 5683644 140734557043536 18446744073709551615 4527582 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/18252/statm: 4721 1126 421 364 0 690 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18884

[startup+0.100163 s]
/proc/loadavg: 9.39 9.95 10.07 5/337 18252
/proc/meminfo: memFree=14373904/32950904 swapFree=67057400/67111528
[pid=18252] ppid=18250 vsize=104232 CPUtime=0.07 cores=0-7
/proc/18252/stat : 18252 (python) R 18250 18252 18114 0 -1 4202496 3061 0 0 0 5 2 0 0 25 0 1 0 669134731 106733568 2744 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278509123 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/18252/statm: 26058 2744 847 364 0 1806 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104232

[startup+0.300184 s]
/proc/loadavg: 9.39 9.95 10.07 5/337 18252
/proc/meminfo: memFree=14373904/32950904 swapFree=67057400/67111528
[pid=18252] ppid=18250 vsize=187692 CPUtime=0.22 cores=0-7
/proc/18252/stat : 18252 (python) R 18250 18252 18114 0 -1 4202496 6828 936 1 0 16 6 0 0 18 0 1 0 669134731 192196608 4884 33554432000 4194304 5683644 140734557043536 18446744073709551615 237273955975 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/18252/statm: 46923 4884 1399 364 0 3724 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 187692

[startup+0.701057 s]
/proc/loadavg: 9.39 9.95 10.07 5/337 18252
/proc/meminfo: memFree=14373904/32950904 swapFree=67057400/67111528
[pid=18252] ppid=18250 vsize=330416 CPUtime=0.59 cores=0-7
/proc/18252/stat : 18252 (python) R 18250 18252 18114 0 -1 4202496 13522 936 1 0 50 9 0 0 25 0 6 0 669134731 338345984 7246 33554432000 4194304 5683644 140734557043536 18446744073709551615 237282288297 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/18252/statm: 82604 7246 1881 364 0 18510 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 330416

[startup+1.50091 s]
/proc/loadavg: 9.04 9.87 10.04 13/362 18281
/proc/meminfo: memFree=14316268/32950904 swapFree=67057400/67111528
[pid=18252] ppid=18250 vsize=361184 CPUtime=0.68 cores=0-7
/proc/18252/stat : 18252 (python) S 18250 18252 18114 0 -1 4202496 15713 936 1 0 58 10 0 0 25 0 9 0 669134731 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/18252/statm: 90296 7283 1889 364 0 26193 0
[pid=18258] ppid=18252 vsize=278456 CPUtime=0 cores=0-7
/proc/18258/stat : 18258 (python) S 18252 18252 18114 0 -1 4202560 733 0 0 0 0 0 0 0 19 0 1 0 669134787 285138944 5532 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899727 0 0 16781312 514 18156481804364677119 0 0 17 3 0 0 0
/proc/18258/statm: 69614 5532 354 364 0 5532 0
[pid=18260] ppid=18258 vsize=1017800 CPUtime=0.91 cores=0-7
/proc/18260/stat : 18260 (gnovelty+2) R 18258 18260 18260 0 -1 4202496 426 0 0 0 91 0 0 0 23 0 1 0 669134788 1042227200 161 33554432000 134512640 135663704 4290348256 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18260/statm: 254450 161 113 282 0 254166 0
[pid=18261] ppid=18252 vsize=289236 CPUtime=0 cores=0-7
/proc/18261/stat : 18261 (python) S 18252 18252 18114 0 -1 4202560 748 0 0 0 0 0 0 0 15 0 1 0 669134790 296177664 5665 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 9070579507307446531 0 0 17 3 0 0 0
/proc/18261/statm: 72309 5665 348 364 0 8224 0
[pid=18263] ppid=18261 vsize=1420 CPUtime=0.61 cores=0-7
/proc/18263/stat : 18263 (march_hi) R 18261 18263 18263 0 -1 4202496 471 0 0 0 61 0 0 0 24 0 1 0 669134791 1454080 209 33554432000 4194304 4955518 140737276746288 18446744073709551615 4297056 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18263/statm: 355 209 106 186 0 168 0
[pid=18264] ppid=18252 vsize=299052 CPUtime=0 cores=0-7
/proc/18264/stat : 18264 (python) S 18252 18252 18114 0 -1 4202560 758 0 0 0 0 0 0 0 15 0 1 0 669134794 306229248 5575 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 4349303515672215551 0 0 17 0 0 0 0
/proc/18264/statm: 74763 5575 348 364 0 10675 0
[pid=18266] ppid=18264 vsize=1420 CPUtime=0.61 cores=0-7
/proc/18266/stat : 18266 (march_hi) R 18264 18266 18266 0 -1 4202496 472 0 0 0 61 0 0 0 25 0 1 0 669134794 1454080 209 33554432000 4194304 4955518 140733404579152 18446744073709551615 4285313 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18266/statm: 355 209 106 186 0 168 0
[pid=18267] ppid=18252 vsize=309916 CPUtime=0 cores=0-7
/proc/18267/stat : 18267 (python) S 18252 18252 18114 0 -1 4202560 763 0 0 0 0 0 0 0 16 0 1 0 669134797 317353984 5699 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 3888216167738736898 0 0 17 2 0 0 0
/proc/18267/statm: 77479 5699 348 364 0 13388 0
[pid=18269] ppid=18267 vsize=1420 CPUtime=0.27 cores=0-7
/proc/18269/stat : 18269 (march_hi) R 18267 18269 18269 0 -1 4202496 473 0 0 0 27 0 0 0 25 0 1 0 669134799 1454080 208 33554432000 4194304 4955518 140737081516656 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18269/statm: 355 208 106 186 0 168 0
[pid=18270] ppid=18252 vsize=320172 CPUtime=0 cores=0-7
/proc/18270/stat : 18270 (python) S 18252 18252 18114 0 -1 4202560 754 0 0 0 0 0 0 0 25 0 1 0 669134800 327856128 5703 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 5698277014482452479 0 0 17 2 0 0 0
/proc/18270/statm: 80043 5703 348 364 0 15949 0
[pid=18272] ppid=18270 vsize=1017800 CPUtime=0.72 cores=0-7
/proc/18272/stat : 18272 (gnovelty+2) R 18270 18272 18272 0 -1 4202496 427 0 0 0 72 0 0 0 25 0 1 0 669134802 1042227200 162 33554432000 134512640 135663704 4294166576 18446744073709551615 134524518 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18272/statm: 254450 162 113 282 0 254166 0
[pid=18273] ppid=18252 vsize=330428 CPUtime=0 cores=0-7
/proc/18273/stat : 18273 (python) S 18252 18252 18114 0 -1 4202560 773 0 0 0 0 0 0 0 18 0 1 0 669134803 338358272 5713 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 5607403439303655683 0 0 17 2 0 0 0
/proc/18273/statm: 82607 5713 348 364 0 18510 0
[pid=18275] ppid=18273 vsize=1420 CPUtime=0.24 cores=0-7
/proc/18275/stat : 18275 (march_hi) R 18273 18275 18275 0 -1 4202496 473 0 0 0 24 0 0 0 25 0 1 0 669134806 1454080 208 33554432000 4194304 4955518 140736664727664 18446744073709551615 4346669 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18275/statm: 355 208 106 186 0 168 0
[pid=18276] ppid=18252 vsize=340684 CPUtime=0 cores=0-7
/proc/18276/stat : 18276 (python) S 18252 18252 18114 0 -1 4202560 771 0 0 0 0 0 0 0 20 0 1 0 669134807 348860416 5734 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 1289582008141316354 0 0 17 2 0 0 0
/proc/18276/statm: 85171 5734 348 364 0 21071 0
[pid=18280] ppid=18276 vsize=1420 CPUtime=0.21 cores=0-7
/proc/18280/stat : 18280 (march_hi) R 18276 18280 18280 0 -1 4202496 475 0 0 0 21 0 0 0 25 0 1 0 669134810 1454080 209 33554432000 4194304 4955518 140736104162624 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18280/statm: 355 209 106 186 0 168 0
[pid=18278] ppid=18252 vsize=350940 CPUtime=0 cores=0-7
/proc/18278/stat : 18278 (python) S 18252 18252 18114 0 -1 4202560 817 0 0 0 0 0 0 0 19 0 1 0 669134810 359362560 5744 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 15670037413218976003 0 0 17 2 0 0 0
/proc/18278/statm: 87735 5744 354 364 0 23632 0
[pid=18281] ppid=18278 vsize=1420 CPUtime=0.3 cores=0-7
/proc/18281/stat : 18281 (march_hi) R 18278 18281 18281 0 -1 4202496 482 0 0 0 30 0 0 0 25 0 1 0 669134811 1454080 209 33554432000 4194304 4955518 140734119524112 18446744073709551615 4224471 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18281/statm: 355 209 106 186 0 168 0
[pid=18252/tid=18259] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18259/stat : 18259 (python) S 18250 18252 18114 0 -1 4202560 27 936 0 0 0 0 0 0 19 0 9 0 669134788 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18262] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18262/stat : 18262 (python) S 18250 18252 18114 0 -1 4202560 22 936 0 0 0 0 0 0 21 0 9 0 669134791 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18265] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18265/stat : 18265 (python) S 18250 18252 18114 0 -1 4202560 25 936 0 0 0 0 0 0 23 0 9 0 669134794 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18268] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18268/stat : 18268 (python) S 18250 18252 18114 0 -1 4202560 21 936 0 0 0 0 0 0 25 0 9 0 669134797 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18271] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18271/stat : 18271 (python) S 18250 18252 18114 0 -1 4202560 23 936 0 0 0 0 0 0 25 0 9 0 669134800 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18274] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18274/stat : 18274 (python) S 18250 18252 18114 0 -1 4202560 22 936 0 0 0 0 0 0 25 0 9 0 669134804 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18277] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18277/stat : 18277 (python) S 18250 18252 18114 0 -1 4202560 36 936 0 0 0 0 0 0 25 0 9 0 669134807 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18279] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18279/stat : 18279 (python) S 18250 18252 18114 0 -1 4202560 26 936 0 0 0 0 0 0 25 0 9 0 669134810 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.55
Current children cumulated vsize (KiB) 4924188

[startup+3.10163 s]
/proc/loadavg: 9.04 9.87 10.04 13/362 18281
/proc/meminfo: memFree=14314532/32950904 swapFree=67057400/67111528
[pid=18252] ppid=18250 vsize=361184 CPUtime=0.68 cores=0-7
/proc/18252/stat : 18252 (python) S 18250 18252 18114 0 -1 4202496 15713 936 1 0 58 10 0 0 25 0 9 0 669134731 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/18252/statm: 90296 7283 1889 364 0 26193 0
[pid=18258] ppid=18252 vsize=278456 CPUtime=0 cores=0-7
/proc/18258/stat : 18258 (python) S 18252 18252 18114 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 669134787 285138944 5532 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899727 0 0 16781312 514 18156481804364644610 0 0 17 3 0 0 0
/proc/18258/statm: 69614 5532 354 364 0 5532 0
[pid=18260] ppid=18258 vsize=1017800 CPUtime=2.5 cores=0-7
/proc/18260/stat : 18260 (gnovelty+2) R 18258 18260 18260 0 -1 4202496 426 0 0 0 250 0 0 0 25 0 1 0 669134788 1042227200 161 33554432000 134512640 135663704 4290348256 18446744073709551615 134524551 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18260/statm: 254450 161 113 282 0 254166 0
[pid=18261] ppid=18252 vsize=289236 CPUtime=0 cores=0-7
/proc/18261/stat : 18261 (python) S 18252 18252 18114 0 -1 4202560 750 0 0 0 0 0 0 0 15 0 1 0 669134790 296177664 5665 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 5607403447893590275 0 0 17 3 0 0 0
/proc/18261/statm: 72309 5665 348 364 0 8224 0
[pid=18263] ppid=18261 vsize=1420 CPUtime=1.41 cores=0-7
/proc/18263/stat : 18263 (march_hi) R 18261 18263 18263 0 -1 4202496 471 0 0 0 141 0 0 0 25 0 1 0 669134791 1454080 209 33554432000 4194304 4955518 140737276746288 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18263/statm: 355 209 106 186 0 168 0
[pid=18264] ppid=18252 vsize=299052 CPUtime=0 cores=0-7
/proc/18264/stat : 18264 (python) S 18252 18252 18114 0 -1 4202560 763 0 0 0 0 0 0 0 15 0 1 0 669134794 306229248 5575 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 4349303515672215551 0 0 17 0 0 0 0
/proc/18264/statm: 74763 5575 348 364 0 10675 0
[pid=18266] ppid=18264 vsize=1420 CPUtime=1.41 cores=0-7
/proc/18266/stat : 18266 (march_hi) R 18264 18266 18266 0 -1 4202496 472 0 0 0 141 0 0 0 25 0 1 0 669134794 1454080 209 33554432000 4194304 4955518 140733404579152 18446744073709551615 4224850 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18266/statm: 355 209 106 186 0 168 0
[pid=18267] ppid=18252 vsize=309916 CPUtime=0 cores=0-7
/proc/18267/stat : 18267 (python) S 18252 18252 18114 0 -1 4202560 768 0 0 0 0 0 0 0 15 0 1 0 669134797 317353984 5699 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 3888216167738736898 0 0 17 2 0 0 0
/proc/18267/statm: 77479 5699 348 364 0 13388 0
[pid=18269] ppid=18267 vsize=1420 CPUtime=1.07 cores=0-7
/proc/18269/stat : 18269 (march_hi) R 18267 18269 18269 0 -1 4202496 473 0 0 0 107 0 0 0 25 0 1 0 669134799 1454080 208 33554432000 4194304 4955518 140737081516656 18446744073709551615 4421280 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18269/statm: 355 208 106 186 0 168 0
[pid=18270] ppid=18252 vsize=320172 CPUtime=0 cores=0-7
/proc/18270/stat : 18270 (python) S 18252 18252 18114 0 -1 4202560 754 0 0 0 0 0 0 0 18 0 1 0 669134800 327856128 5703 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 5698277014482419971 0 0 17 2 0 0 0
/proc/18270/statm: 80043 5703 348 364 0 15949 0
[pid=18272] ppid=18270 vsize=1017800 CPUtime=2.32 cores=0-7
/proc/18272/stat : 18272 (gnovelty+2) R 18270 18272 18272 0 -1 4202496 427 0 0 0 232 0 0 0 25 0 1 0 669134802 1042227200 162 33554432000 134512640 135663704 4294166576 18446744073709551615 134545699 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18272/statm: 254450 162 113 282 0 254166 0
[pid=18273] ppid=18252 vsize=330428 CPUtime=0 cores=0-7
/proc/18273/stat : 18273 (python) S 18252 18252 18114 0 -1 4202560 775 0 0 0 0 0 0 0 15 0 1 0 669134803 338358272 5713 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 8878661951702401283 0 0 17 2 0 0 0
/proc/18273/statm: 82607 5713 348 364 0 18510 0
[pid=18275] ppid=18273 vsize=1420 CPUtime=1.04 cores=0-7
/proc/18275/stat : 18275 (march_hi) R 18273 18275 18275 0 -1 4202496 473 0 0 0 104 0 0 0 25 0 1 0 669134806 1454080 208 33554432000 4194304 4955518 140736664727664 18446744073709551615 4224468 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18275/statm: 355 208 106 186 0 168 0
[pid=18276] ppid=18252 vsize=340684 CPUtime=0 cores=0-7
/proc/18276/stat : 18276 (python) S 18252 18252 18114 0 -1 4202560 776 0 0 0 0 0 0 0 15 0 1 0 669134807 348860416 5734 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 1289582008141316354 0 0 17 2 0 0 0
/proc/18276/statm: 85171 5734 348 364 0 21071 0
[pid=18280] ppid=18276 vsize=1420 CPUtime=1 cores=0-7
/proc/18280/stat : 18280 (march_hi) R 18276 18280 18280 0 -1 4202496 475 0 0 0 100 0 0 0 25 0 1 0 669134810 1454080 209 33554432000 4194304 4955518 140736104162624 18446744073709551615 4208669 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18280/statm: 355 209 106 186 0 168 0
[pid=18278] ppid=18252 vsize=350940 CPUtime=0 cores=0-7
/proc/18278/stat : 18278 (python) S 18252 18252 18114 0 -1 4202560 818 0 0 0 0 0 0 0 15 0 1 0 669134810 359362560 5744 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 15670037413218976003 0 0 17 2 0 0 0
/proc/18278/statm: 87735 5744 354 364 0 23632 0
[pid=18281] ppid=18278 vsize=1420 CPUtime=1.1 cores=0-7
/proc/18281/stat : 18281 (march_hi) R 18278 18281 18281 0 -1 4202496 482 0 0 0 110 0 0 0 25 0 1 0 669134811 1454080 209 33554432000 4194304 4955518 140734119524112 18446744073709551615 4210549 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18281/statm: 355 209 106 186 0 168 0
[pid=18252/tid=18259] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18259/stat : 18259 (python) S 18250 18252 18114 0 -1 4202560 27 936 0 0 0 0 0 0 19 0 9 0 669134788 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18262] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18262/stat : 18262 (python) S 18250 18252 18114 0 -1 4202560 22 936 0 0 0 0 0 0 21 0 9 0 669134791 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18265] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18265/stat : 18265 (python) S 18250 18252 18114 0 -1 4202560 25 936 0 0 0 0 0 0 23 0 9 0 669134794 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18268] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18268/stat : 18268 (python) S 18250 18252 18114 0 -1 4202560 21 936 0 0 0 0 0 0 25 0 9 0 669134797 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18271] ppid=18250 vsize=361184 CPUtime=0 cores=0-7

################
# More data... #
################

[pid=18280] ppid=18276 vsize=0 CPUtime=7.03 cores=0-7
/proc/18280/stat : 18280 (march_hi) R 18276 18280 18280 0 -1 4202500 481 0 0 0 703 0 0 0 25 0 1 0 669134810 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/18280/statm: 0 0 0 0 0 0 0
[pid=18278] ppid=18252 vsize=350940 CPUtime=1.7 cores=0-7
/proc/18278/stat : 18278 (python) R 18252 18252 18114 0 -1 4202560 1016 0 0 0 146 24 0 0 17 0 1 0 669134810 359362560 5767 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781312 514 0 0 0 17 5 0 0 0
/proc/18278/statm: 87735 5767 377 364 0 23632 0
[pid=18281] ppid=18278 vsize=0 CPUtime=7.03 cores=0-7
/proc/18281/stat : 18281 (march_hi) R 18278 18281 18281 0 -1 4202500 488 0 0 0 703 0 0 0 25 0 1 0 669134811 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/18281/statm: 0 0 0 0 0 0 0
[pid=18252/tid=18259] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18259/stat : 18259 (python) S 18250 18252 18114 0 -1 4202560 27 936 0 0 0 0 0 0 19 0 9 0 669134788 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18262] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18262/stat : 18262 (python) S 18250 18252 18114 0 -1 4202560 22 936 0 0 0 0 0 0 21 0 9 0 669134791 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18265] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18265/stat : 18265 (python) S 18250 18252 18114 0 -1 4202560 25 936 0 0 0 0 0 0 23 0 9 0 669134794 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18268] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18268/stat : 18268 (python) S 18250 18252 18114 0 -1 4202560 21 936 0 0 0 0 0 0 25 0 9 0 669134797 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18271] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18271/stat : 18271 (python) S 18250 18252 18114 0 -1 4202560 23 936 0 0 0 0 0 0 25 0 9 0 669134800 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18274] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18274/stat : 18274 (python) S 18250 18252 18114 0 -1 4202560 22 936 0 0 0 0 0 0 25 0 9 0 669134804 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18277] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18277/stat : 18277 (python) S 18250 18252 18114 0 -1 4202560 36 936 0 0 0 0 0 0 25 0 9 0 669134807 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18279] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18279/stat : 18279 (python) S 18250 18252 18114 0 -1 4202560 26 936 0 0 0 0 0 0 25 0 9 0 669134810 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 82.79
Current children cumulated vsize (KiB) 4915668

[startup+16.9012 s]
/proc/loadavg: 10.09 10.06 10.10 24/362 18281
/proc/meminfo: memFree=14314744/32950904 swapFree=67057400/67111528
[pid=18252] ppid=18250 vsize=361184 CPUtime=0.68 cores=0-7
/proc/18252/stat : 18252 (python) S 18250 18252 18114 0 -1 4202496 15713 936 1 0 58 10 0 0 25 0 9 0 669134731 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290706379 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/18252/statm: 90296 7283 1889 364 0 26193 0
[pid=18258] ppid=18252 vsize=278456 CPUtime=0.04 cores=0-7
/proc/18258/stat : 18258 (python) S 18252 18252 18114 0 -1 4202560 900 0 0 0 1 3 0 0 18 0 1 0 669134787 285138944 5555 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899727 0 0 16781312 514 6556590146567766274 0 0 17 7 0 0 0
/proc/18258/statm: 69614 5555 377 364 0 5532 0
[pid=18260] ppid=18258 vsize=1017800 CPUtime=15.23 cores=0-7
/proc/18260/stat : 18260 (gnovelty+2) R 18258 18260 18260 0 -1 4202496 426 0 0 0 1523 0 0 0 25 0 1 0 669134788 1042227200 161 33554432000 134512640 135663704 4290348256 18446744073709551615 134525544 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18260/statm: 254450 161 113 282 0 254166 0
[pid=18261] ppid=18252 vsize=289236 CPUtime=2.52 cores=0-7
/proc/18261/stat : 18261 (python) R 18252 18252 18114 0 -1 4202560 936 0 0 0 217 35 0 0 18 0 1 0 669134790 296177664 5688 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 0 0 0 17 3 0 0 0
/proc/18261/statm: 72309 5688 371 364 0 8224 0
[pid=18263] ppid=18261 vsize=0 CPUtime=7.02 cores=0-7
/proc/18263/stat : 18263 (march_hi) R 18261 18263 18263 0 -1 4202500 477 0 0 0 702 0 0 0 25 0 1 0 669134791 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/18263/statm: 0 0 0 0 0 0 0
[pid=18264] ppid=18252 vsize=299052 CPUtime=2.5 cores=0-7
/proc/18264/stat : 18264 (python) R 18252 18252 18114 0 -1 4202560 936 0 0 0 221 29 0 0 18 0 1 0 669134794 306229248 5598 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/18264/statm: 74763 5598 371 364 0 10675 0
[pid=18266] ppid=18264 vsize=0 CPUtime=7.03 cores=0-7
/proc/18266/stat : 18266 (march_hi) R 18264 18266 18266 0 -1 4202500 478 0 0 0 703 0 0 0 25 0 1 0 669134794 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18266/statm: 0 0 0 0 0 0 0
[pid=18267] ppid=18252 vsize=309916 CPUtime=1.7 cores=0-7
/proc/18267/stat : 18267 (python) R 18252 18252 18114 0 -1 4202560 956 0 0 0 147 23 0 0 17 0 1 0 669134797 317353984 5722 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/18267/statm: 77479 5722 371 364 0 13388 0
[pid=18269] ppid=18267 vsize=0 CPUtime=7.03 cores=0-7
/proc/18269/stat : 18269 (march_hi) R 18267 18269 18269 0 -1 4202500 479 0 0 0 703 0 0 0 25 0 1 0 669134799 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/18269/statm: 0 0 0 0 0 0 0
[pid=18270] ppid=18252 vsize=320172 CPUtime=0.02 cores=0-7
/proc/18270/stat : 18270 (python) R 18252 18252 18114 0 -1 4202560 935 0 0 0 1 1 0 0 18 0 1 0 669134800 327856128 5726 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/18270/statm: 80043 5726 371 364 0 15949 0
[pid=18272] ppid=18270 vsize=1017800 CPUtime=13.81 cores=0-7
/proc/18272/stat : 18272 (gnovelty+2) R 18270 18272 18272 0 -1 4202496 427 0 0 0 1381 0 0 0 25 0 1 0 669134802 1042227200 162 33554432000 134512640 135663704 4294166576 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18272/statm: 254450 162 113 282 0 254166 0
[pid=18273] ppid=18252 vsize=330428 CPUtime=1.8 cores=0-7
/proc/18273/stat : 18273 (python) R 18252 18252 18114 0 -1 4202560 969 0 0 0 152 28 0 0 17 0 1 0 669134803 338358272 5737 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/18273/statm: 82607 5737 372 364 0 18510 0
[pid=18275] ppid=18273 vsize=0 CPUtime=7.05 cores=0-7
/proc/18275/stat : 18275 (march_hi) R 18273 18275 18275 0 -1 4202500 479 0 0 0 705 0 0 0 25 0 1 0 669134806 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/18275/statm: 0 0 0 0 0 0 0
[pid=18276] ppid=18252 vsize=340684 CPUtime=1.69 cores=0-7
/proc/18276/stat : 18276 (python) R 18252 18252 18114 0 -1 4202560 962 0 0 0 145 24 0 0 17 0 1 0 669134807 348860416 5757 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/18276/statm: 85171 5757 371 364 0 21071 0
[pid=18280] ppid=18276 vsize=0 CPUtime=7.03 cores=0-7
/proc/18280/stat : 18280 (march_hi) R 18276 18280 18280 0 -1 4202500 481 0 0 0 703 0 0 0 25 0 1 0 669134810 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/18280/statm: 0 0 0 0 0 0 0
[pid=18278] ppid=18252 vsize=350940 CPUtime=1.9 cores=0-7
/proc/18278/stat : 18278 (python) R 18252 18252 18114 0 -1 4202560 1016 0 0 0 164 26 0 0 17 0 1 0 669134810 359362560 5767 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781312 514 0 0 0 17 5 0 0 0
/proc/18278/statm: 87735 5767 377 364 0 23632 0
[pid=18281] ppid=18278 vsize=0 CPUtime=7.03 cores=0-7
/proc/18281/stat : 18281 (march_hi) R 18278 18281 18281 0 -1 4202500 488 0 0 0 703 0 0 0 25 0 1 0 669134811 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/18281/statm: 0 0 0 0 0 0 0
[pid=18252/tid=18259] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18259/stat : 18259 (python) S 18250 18252 18114 0 -1 4202560 27 936 0 0 0 0 0 0 19 0 9 0 669134788 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18262] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18262/stat : 18262 (python) S 18250 18252 18114 0 -1 4202560 22 936 0 0 0 0 0 0 21 0 9 0 669134791 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18265] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18265/stat : 18265 (python) S 18250 18252 18114 0 -1 4202560 25 936 0 0 0 0 0 0 23 0 9 0 669134794 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18268] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18268/stat : 18268 (python) S 18250 18252 18114 0 -1 4202560 21 936 0 0 0 0 0 0 25 0 9 0 669134797 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18271] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18271/stat : 18271 (python) S 18250 18252 18114 0 -1 4202560 23 936 0 0 0 0 0 0 25 0 9 0 669134800 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18274] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18274/stat : 18274 (python) S 18250 18252 18114 0 -1 4202560 22 936 0 0 0 0 0 0 25 0 9 0 669134804 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18277] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18277/stat : 18277 (python) S 18250 18252 18114 0 -1 4202560 36 936 0 0 0 0 0 0 25 0 9 0 669134807 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18279] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18279/stat : 18279 (python) S 18250 18252 18114 0 -1 4202560 26 936 0 0 0 0 0 0 25 0 9 0 669134810 369852416 7283 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 84.08
Current children cumulated vsize (KiB) 4915668

[startup+17.0012 s]
/proc/loadavg: 10.09 10.06 10.10 24/362 18281
/proc/meminfo: memFree=14314744/32950904 swapFree=67057400/67111528
[pid=18252] ppid=18250 vsize=361184 CPUtime=0.68 cores=0-7
/proc/18252/stat : 18252 (python) S 18250 18252 18114 0 -1 4202496 15748 936 1 0 58 10 0 0 17 0 9 0 669134731 369852416 7284 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/18252/statm: 90296 7284 1890 364 0 26193 0
[pid=18258] ppid=18252 vsize=278456 CPUtime=0.04 cores=0-7
/proc/18258/stat : 18258 (python) S 18252 18252 18114 0 -1 4202560 900 0 0 0 1 3 0 0 18 0 1 0 669134787 285138944 5555 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899727 0 0 16781312 514 6556590146567766274 0 0 17 7 0 0 0
/proc/18258/statm: 69614 5555 377 364 0 5532 0
[pid=18260] ppid=18258 vsize=1017800 CPUtime=15.31 cores=0-7
/proc/18260/stat : 18260 (gnovelty+2) R 18258 18260 18260 0 -1 4202496 426 0 0 0 1531 0 0 0 25 0 1 0 669134788 1042227200 161 33554432000 134512640 135663704 4290348256 18446744073709551615 134525455 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18260/statm: 254450 161 113 282 0 254166 0
[pid=18261] ppid=18252 vsize=0 CPUtime=9.63 cores=0-7
/proc/18261/stat : 18261 (python) Z 18252 18252 18114 0 -1 4202588 1157 477 0 0 225 36 702 0 19 0 1 0 669134790 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 3 0 0 0
/proc/18261/statm: 0 0 0 0 0 0 0
[pid=18264] ppid=18252 vsize=299052 CPUtime=2.6 cores=0-7
/proc/18264/stat : 18264 (python) R 18252 18252 18114 0 -1 4202560 936 0 0 0 230 30 0 0 18 0 1 0 669134794 306229248 5598 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/18264/statm: 74763 5598 371 364 0 10675 0
[pid=18266] ppid=18264 vsize=0 CPUtime=7.03 cores=0-7
/proc/18266/stat : 18266 (march_hi) R 18264 18266 18266 0 -1 4202500 478 0 0 0 703 0 0 0 25 0 1 0 669134794 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/18266/statm: 0 0 0 0 0 0 0
[pid=18267] ppid=18252 vsize=309916 CPUtime=1.8 cores=0-7
/proc/18267/stat : 18267 (python) R 18252 18252 18114 0 -1 4202560 956 0 0 0 156 24 0 0 17 0 1 0 669134797 317353984 5722 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/18267/statm: 77479 5722 371 364 0 13388 0
[pid=18269] ppid=18267 vsize=0 CPUtime=7.03 cores=0-7
/proc/18269/stat : 18269 (march_hi) R 18267 18269 18269 0 -1 4202500 479 0 0 0 703 0 0 0 25 0 1 0 669134799 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/18269/statm: 0 0 0 0 0 0 0
[pid=18270] ppid=18252 vsize=320172 CPUtime=0.02 cores=0-7
/proc/18270/stat : 18270 (python) R 18252 18252 18114 0 -1 4202560 937 0 0 0 1 1 0 0 18 0 1 0 669134800 327856128 5726 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278922887 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/18270/statm: 80043 5726 371 364 0 15949 0
[pid=18272] ppid=18270 vsize=1017800 CPUtime=13.81 cores=0-7
/proc/18272/stat : 18272 (gnovelty+2) R 18270 18272 18272 0 -1 4202496 427 0 0 0 1381 0 0 0 25 0 1 0 669134802 1042227200 162 33554432000 134512640 135663704 4294166576 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18272/statm: 254450 162 113 282 0 254166 0
[pid=18273] ppid=18252 vsize=330428 CPUtime=1.9 cores=0-7
/proc/18273/stat : 18273 (python) S 18252 18252 18114 0 -1 4202560 989 0 0 0 160 30 0 0 17 0 1 0 669134803 338358272 5742 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781824 2 18446744071562232103 0 0 17 2 0 0 0
/proc/18273/statm: 82607 5742 377 364 0 18510 0
[pid=18275] ppid=18273 vsize=0 CPUtime=7.05 cores=0-7
/proc/18275/stat : 18275 (march_hi) R 18273 18275 18275 0 -1 4202500 479 0 0 0 705 0 0 0 25 0 1 0 669134806 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/18275/statm: 0 0 0 0 0 0 0
[pid=18276] ppid=18252 vsize=340684 CPUtime=1.79 cores=0-7
/proc/18276/stat : 18276 (python) R 18252 18252 18114 0 -1 4202560 962 0 0 0 153 26 0 0 17 0 1 0 669134807 348860416 5757 33554432000 4194304 5683644 140734557043536 18446744073709551615 237278899782 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/18276/statm: 85171 5757 371 364 0 21071 0
[pid=18280] ppid=18276 vsize=0 CPUtime=7.03 cores=0-7
/proc/18280/stat : 18280 (march_hi) R 18276 18280 18280 0 -1 4202500 481 0 0 0 703 0 0 0 25 0 1 0 669134810 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/18280/statm: 0 0 0 0 0 0 0
[pid=18278] ppid=18252 vsize=350940 CPUtime=1.99 cores=0-7
/proc/18278/stat : 18278 (python) R 18252 18252 18114 0 -1 4202560 1016 0 0 0 172 27 0 0 18 0 1 0 669134810 359362560 5767 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290709823 0 0 16781312 514 0 0 0 17 5 0 0 0
/proc/18278/statm: 87735 5767 377 364 0 23632 0
[pid=18281] ppid=18278 vsize=0 CPUtime=7.03 cores=0-7
/proc/18281/stat : 18281 (march_hi) R 18278 18281 18281 0 -1 4202500 488 0 0 0 703 0 0 0 25 0 1 0 669134811 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/18281/statm: 0 0 0 0 0 0 0
[pid=18252/tid=18259] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18259/stat : 18259 (python) S 18250 18252 18114 0 -1 4202560 27 936 0 0 0 0 0 0 19 0 9 0 669134788 369852416 7284 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18262] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18262/stat : 18262 (python) S 18250 18252 18114 0 -1 4202560 22 936 0 0 0 0 0 0 21 0 9 0 669134791 369852416 7284 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18265] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18265/stat : 18265 (python) S 18250 18252 18114 0 -1 4202560 25 936 0 0 0 0 0 0 23 0 9 0 669134794 369852416 7284 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 0 0 0 0
[pid=18252/tid=18268] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18268/stat : 18268 (python) S 18250 18252 18114 0 -1 4202560 21 936 0 0 0 0 0 0 25 0 9 0 669134797 369852416 7284 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18271] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18271/stat : 18271 (python) S 18250 18252 18114 0 -1 4202560 23 936 0 0 0 0 0 0 25 0 9 0 669134800 369852416 7284 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18274] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18274/stat : 18274 (python) S 18250 18252 18114 0 -1 4202560 22 936 0 0 0 0 0 0 25 0 9 0 669134804 369852416 7284 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18277] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18277/stat : 18277 (python) S 18250 18252 18114 0 -1 4202560 36 936 0 0 0 0 0 0 25 0 9 0 669134807 369852416 7284 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
[pid=18252/tid=18279] ppid=18250 vsize=361184 CPUtime=0 cores=0-7
/proc/18252/task/18279/stat : 18279 (python) S 18250 18252 18114 0 -1 4202560 26 936 0 0 0 0 0 0 25 0 9 0 669134810 369852416 7284 33554432000 4194304 5683644 140734557043536 18446744073709551615 237290703281 0 0 16781312 2 18446604453907893056 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 84.74
Current children cumulated vsize (KiB) 4626432

Child status: 0
Real time (s): 17.0482
CPU time (s): 85.0221
CPU user time (s): 83.0664
CPU system time (s): 1.9557
CPU usage (%): 498.715
Max. virtual memory (cumulated for all children) (KiB): 4924192

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 83.0664
system time used= 1.9557
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33351
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3777
involuntary context switches= 3311

runsolver used 0.069989 second user time and 0.12898 second system time

The end

Launcher Data 

Begin job on node121 at 2011-05-16 21:49:10
IDJOB=3385800
IDBENCH=83065
IDSOLVER=1870
FILE ID=node121/3385800-1305575350
RUNJOBID= node121-1305575347-18128
PBS_JOBID= 13350162
Free space on /tmp= 73424 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v75-c1597-S1750722942-074.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385800-1305575350/watcher-3385800-1305575350 -o /tmp/evaluation-result-3385800-1305575350/solver-3385800-1305575350 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385800-1305575350.cnf -seed 1457085967 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 55d30b10c45b8bb435e547799f98f891
RANDOM SEED=1457085967

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      14374068 kB
Buffers:        337980 kB
Cached:        7050144 kB
SwapCached:       7656 kB
Active:       12522672 kB
Inactive:      5673408 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      14374068 kB
SwapTotal:    67111528 kB
SwapFree:     67057400 kB
Dirty:           32928 kB
Writeback:           0 kB
AnonPages:    10805628 kB
Mapped:          28392 kB
Slab:           269368 kB
PageTables:      41848 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS: 61614808 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73396 MiB
End job on node121 at 2011-05-16 21:49:27