Trace number 3322179

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-randomUNSAT 61.4447 9.02838

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v350-c1491-S1404138730-025.UNKNOWN.cnf
MD5SUM2e059a7f69d15193cd88ec6d57d9e297
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark6.42702
Satisfiable
(Un)Satisfiability was proved
Number of variables350
Number of clauses1491
Sum of the clauses size4473
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31491
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.36/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.36/0.67	c INFO: solving HOME/instance-3322179-1304375544.cnf
0.36/0.67	c INFO: computing task features
0.36/0.68	c INFO: computed variable-clause graph statistics
0.36/0.68	c INFO: computed clause balance statistics
0.43/0.71	c INFO: computed variable balance statistics
0.43/0.73	c INFO: computed small-clause counts
0.43/0.73	c INFO: computed Horn-clause counts
0.43/0.73	c INFO: computed variable graph statistics
0.43/0.73	c INFO: collected features for HOME/instance-3322179-1304375544.cnf in 0.06 s
0.43/0.77	c INFO: running TNM@0 for 97 with 39999 remaining (b = 0.56)
0.52/0.81	c INFO: running march_hi@0 for 194 with 39999 remaining (b = 0.28)
0.52/0.84	c INFO: running march_hi@0 for 194 with 39999 remaining (b = 0.19)
0.52/0.88	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.27)
0.62/0.92	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.07)
0.62/0.96	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.30)
0.62/1.00	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.23)
1.51/1.04	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.20)
61.27/9.00	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322179-1304375544/watcher-3322179-1304375544 -o /tmp/evaluation-result-3322179-1304375544/solver-3322179-1304375544 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322179-1304375544.cnf -seed 172577614 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.10 2.94 5.33 2/323 27437
/proc/meminfo: memFree=3838132/32950928 swapFree=63349324/67111528
[pid=27437] ppid=27435 vsize=15772 CPUtime=0 cores=0-7
/proc/27437/stat : 27437 (python) S 27435 27437 26145 0 -1 4202496 894 0 0 0 0 0 0 0 17 0 1 0 627785120 16150528 776 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/27437/statm: 3943 776 343 364 0 430 0

[startup+0.0276471 s]
/proc/loadavg: 2.10 2.94 5.33 2/323 27437
/proc/meminfo: memFree=3838132/32950928 swapFree=63349324/67111528
[pid=27437] ppid=27435 vsize=16392 CPUtime=0.01 cores=0-7
/proc/27437/stat : 27437 (python) S 27435 27437 26145 0 -1 4202496 1116 0 0 0 1 0 0 0 17 0 1 0 627785120 16785408 984 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367542629 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/27437/statm: 4098 984 409 364 0 585 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16392

[startup+0.100606 s]
/proc/loadavg: 2.10 2.94 5.33 2/323 27437
/proc/meminfo: memFree=3838132/32950928 swapFree=63349324/67111528
[pid=27437] ppid=27435 vsize=87700 CPUtime=0.06 cores=0-7
/proc/27437/stat : 27437 (python) R 27435 27437 26145 0 -1 4202496 2637 0 0 0 4 2 0 0 17 0 1 0 627785120 89804800 2353 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367590023 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27437/statm: 21925 2353 717 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87700

[startup+0.300585 s]
/proc/loadavg: 2.10 2.94 5.33 2/323 27437
/proc/meminfo: memFree=3838132/32950928 swapFree=63349324/67111528
[pid=27437] ppid=27435 vsize=135744 CPUtime=0.18 cores=0-7
/proc/27437/stat : 27437 (python) S 27435 27437 26145 0 -1 4202496 5966 936 1 0 13 5 0 0 17 0 1 0 627785120 139001856 4150 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367542789 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/27437/statm: 33936 4150 1032 364 0 3122 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135744

[startup+0.700504 s]
/proc/loadavg: 2.10 2.94 5.33 2/323 27437
/proc/meminfo: memFree=3838132/32950928 swapFree=63349324/67111528
[pid=27437] ppid=27435 vsize=278256 CPUtime=0.43 cores=0-7
/proc/27437/stat : 27437 (python) R 27435 27437 26145 0 -1 4202496 9291 936 1 0 33 10 0 0 16 0 1 0 627785120 284934144 6955 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367206477 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/27437/statm: 69564 6955 1826 364 0 5488 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 278256

[startup+1.50127 s]
/proc/loadavg: 2.10 2.94 5.33 9/342 27460
/proc/meminfo: memFree=3788624/32950928 swapFree=63349324/67111528
[pid=27437] ppid=27435 vsize=361228 CPUtime=0.77 cores=0-7
/proc/27437/stat : 27437 (python) S 27435 27437 26145 0 -1 4202496 15770 936 1 0 65 12 0 0 24 0 9 0 627785120 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/27437/statm: 90307 7272 1889 364 0 26204 0
[pid=27443] ppid=27437 vsize=278572 CPUtime=0 cores=0-7
/proc/27443/stat : 27443 (python) S 27437 27437 26145 0 -1 4202560 707 0 0 0 0 0 0 0 18 0 1 0 627785197 285257728 5546 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566863 0 0 16781312 514 10043198697145106431 0 0 17 0 0 0 0
/proc/27443/statm: 69643 5546 347 364 0 5561 0
[pid=27445] ppid=27443 vsize=454900 CPUtime=0.72 cores=0-7
/proc/27445/stat : 27445 (TNM) R 27443 27445 27445 0 -1 4202496 414 0 0 0 72 0 0 0 21 0 1 0 627785198 465817600 150 33554432000 134512640 135008748 4289316912 18446744073709551615 134527111 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/27445/statm: 113725 150 46 122 0 112625 0
[pid=27446] ppid=27437 vsize=289280 CPUtime=0 cores=0-7
/proc/27446/stat : 27446 (python) S 27437 27437 26145 0 -1 4202560 755 0 0 0 0 0 0 0 15 0 1 0 627785201 296222720 5677 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 10043187152273014783 0 0 17 7 0 0 0
/proc/27446/statm: 72320 5677 348 364 0 8235 0
[pid=27448] ppid=27446 vsize=1808 CPUtime=0.67 cores=0-7
/proc/27448/stat : 27448 (march_hi) R 27446 27448 27448 0 -1 4202496 546 0 0 0 67 0 0 0 22 0 1 0 627785201 1851392 284 33554432000 4194304 4955518 140735054028720 18446744073709551615 4284778 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/27448/statm: 452 284 104 186 0 265 0
[pid=27449] ppid=27437 vsize=299668 CPUtime=0 cores=0-7
/proc/27449/stat : 27449 (python) S 27437 27437 26145 0 -1 4202560 764 0 0 0 0 0 0 0 16 0 1 0 627785205 306860032 5698 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 17558822742755639295 0 0 17 2 0 0 0
/proc/27449/statm: 74917 5698 348 364 0 10829 0
[pid=27451] ppid=27449 vsize=1808 CPUtime=0.64 cores=0-7
/proc/27451/stat : 27451 (march_hi) R 27449 27451 27451 0 -1 4202496 546 0 0 0 64 0 0 0 25 0 1 0 627785205 1851392 284 33554432000 4194304 4955518 140733417599664 18446744073709551615 4209727 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/27451/statm: 452 284 104 186 0 265 0
[pid=27452] ppid=27437 vsize=309924 CPUtime=0 cores=0-7
/proc/27452/stat : 27452 (python) S 27437 27437 26145 0 -1 4202560 772 0 0 0 0 0 0 0 15 0 1 0 627785209 317362176 5702 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 10687991898091520258 0 0 17 6 0 0 0
/proc/27452/statm: 77481 5702 348 364 0 13390 0
[pid=27454] ppid=27452 vsize=1808 CPUtime=0.6 cores=0-7
/proc/27454/stat : 27454 (march_hi) R 27452 27454 27454 0 -1 4202496 546 0 0 0 60 0 0 0 22 0 1 0 627785209 1851392 284 33554432000 4194304 4955518 140735418416688 18446744073709551615 4209737 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/27454/statm: 452 284 104 186 0 265 0
[pid=27455] ppid=27437 vsize=320180 CPUtime=0 cores=0-7
/proc/27455/stat : 27455 (python) S 27437 27437 26145 0 -1 4202560 757 0 0 0 0 0 0 0 19 0 1 0 627785213 327864320 5715 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 12807270598937935871 0 0 17 4 0 0 0
/proc/27455/statm: 80045 5715 348 364 0 15951 0
[pid=27457] ppid=27455 vsize=1017800 CPUtime=0.57 cores=0-7
/proc/27457/stat : 27457 (gnovelty+2) R 27455 27457 27457 0 -1 4202496 426 0 0 0 57 0 0 0 22 0 1 0 627785213 1042227200 162 33554432000 134512640 135663704 4289781616 18446744073709551615 134525229 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/27457/statm: 254450 162 113 282 0 254166 0
[pid=27458] ppid=27437 vsize=330436 CPUtime=0 cores=0-7
/proc/27458/stat : 27458 (python) S 27437 27437 26145 0 -1 4202560 778 0 0 0 0 0 0 0 17 0 1 0 627785217 338366464 5719 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 1331746080043270404 0 0 17 1 0 0 0
/proc/27458/statm: 82609 5719 348 364 0 18512 0
[pid=27460] ppid=27458 vsize=1808 CPUtime=0.51 cores=0-7
/proc/27460/stat : 27460 (march_hi) R 27458 27460 27460 0 -1 4202496 546 0 0 0 51 0 0 0 25 0 1 0 627785218 1851392 283 33554432000 4194304 4955518 140736986795728 18446744073709551615 4263701 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/27460/statm: 452 283 104 186 0 265 0
[pid=27437/tid=27444] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27444/stat : 27444 (python) S 27435 27437 26145 0 -1 4202560 25 936 0 0 0 0 0 0 18 0 9 0 627785197 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27447] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27447/stat : 27447 (python) S 27435 27437 26145 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 9 0 627785201 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 6 0 0 0
[pid=27437/tid=27450] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27450/stat : 27450 (python) S 27435 27437 26145 0 -1 4202560 22 936 0 0 0 0 0 0 22 0 9 0 627785205 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27453] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27453/stat : 27453 (python) S 27435 27437 26145 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 9 0 627785209 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27456] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27456/stat : 27456 (python) S 27435 27437 26145 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 9 0 627785213 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 4 0 0 0
[pid=27437/tid=27459] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27459/stat : 27459 (python) S 27435 27437 26145 0 -1 4202560 26 936 0 0 0 0 0 0 21 0 9 0 627785217 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 1 0 0 0
[pid=27437/tid=27462] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27462/stat : 27462 (python) S 27435 27437 26145 0 -1 4202560 39 936 0 0 0 0 0 0 23 0 9 0 627785221 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.48
Current children cumulated vsize (KiB) 3669220

[startup+3.10098 s]
/proc/loadavg: 2.65 3.04 5.35 10/348 27466
/proc/meminfo: memFree=3777160/32950928 swapFree=63349324/67111528
[pid=27437] ppid=27435 vsize=361228 CPUtime=0.77 cores=0-7
/proc/27437/stat : 27437 (python) S 27435 27437 26145 0 -1 4202496 15770 936 1 0 65 12 0 0 24 0 9 0 627785120 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/27437/statm: 90307 7272 1889 364 0 26204 0
[pid=27443] ppid=27437 vsize=278572 CPUtime=0 cores=0-7
/proc/27443/stat : 27443 (python) S 27437 27437 26145 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 627785197 285257728 5553 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566863 0 0 16781312 514 10043198697145073924 0 0 17 0 0 0 0
/proc/27443/statm: 69643 5553 354 364 0 5561 0
[pid=27445] ppid=27443 vsize=454900 CPUtime=2.32 cores=0-7
/proc/27445/stat : 27445 (TNM) R 27443 27445 27445 0 -1 4202496 414 0 0 0 232 0 0 0 25 0 1 0 627785198 465817600 150 33554432000 134512640 135008748 4289316912 18446744073709551615 134527503 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/27445/statm: 113725 150 46 122 0 112625 0
[pid=27446] ppid=27437 vsize=289280 CPUtime=0 cores=0-7
/proc/27446/stat : 27446 (python) S 27437 27437 26145 0 -1 4202560 763 0 0 0 0 0 0 0 15 0 1 0 627785201 296222720 5677 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 10837806954445766916 0 0 17 7 0 0 0
/proc/27446/statm: 72320 5677 348 364 0 8235 0
[pid=27448] ppid=27446 vsize=1940 CPUtime=2.25 cores=0-7
/proc/27448/stat : 27448 (march_hi) R 27446 27448 27448 0 -1 4202496 573 0 0 0 225 0 0 0 25 0 1 0 627785201 1986560 311 33554432000 4194304 4955518 140735054028720 18446744073709551615 4238776 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/27448/statm: 485 311 104 186 0 298 0
[pid=27449] ppid=27437 vsize=299668 CPUtime=0 cores=0-7
/proc/27449/stat : 27449 (python) S 27437 27437 26145 0 -1 4202560 771 0 0 0 0 0 0 0 15 0 1 0 627785205 306860032 5698 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 15146749043234799873 0 0 17 2 0 0 0
/proc/27449/statm: 74917 5698 348 364 0 10829 0
[pid=27451] ppid=27449 vsize=1940 CPUtime=2.24 cores=0-7
/proc/27451/stat : 27451 (march_hi) R 27449 27451 27451 0 -1 4202496 573 0 0 0 224 0 0 0 25 0 1 0 627785205 1986560 311 33554432000 4194304 4955518 140733417599664 18446744073709551615 4227841 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/27451/statm: 485 311 104 186 0 298 0
[pid=27452] ppid=27437 vsize=309924 CPUtime=0 cores=0-7
/proc/27452/stat : 27452 (python) S 27437 27437 26145 0 -1 4202560 782 0 0 0 0 0 0 0 15 0 1 0 627785209 317362176 5702 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 10687991898091520258 0 0 17 6 0 0 0
/proc/27452/statm: 77481 5702 348 364 0 13390 0
[pid=27454] ppid=27452 vsize=1940 CPUtime=2.2 cores=0-7
/proc/27454/stat : 27454 (march_hi) R 27452 27454 27454 0 -1 4202496 572 0 0 0 220 0 0 0 25 0 1 0 627785209 1986560 310 33554432000 4194304 4955518 140735418416688 18446744073709551615 4224682 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/27454/statm: 485 310 104 186 0 298 0
[pid=27455] ppid=27437 vsize=320180 CPUtime=0 cores=0-7
/proc/27455/stat : 27455 (python) S 27437 27437 26145 0 -1 4202560 757 0 0 0 0 0 0 0 18 0 1 0 627785213 327864320 5715 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 12807270598937903361 0 0 17 4 0 0 0
/proc/27455/statm: 80045 5715 348 364 0 15951 0
[pid=27457] ppid=27455 vsize=1017800 CPUtime=2.17 cores=0-7
/proc/27457/stat : 27457 (gnovelty+2) R 27455 27457 27457 0 -1 4202496 426 0 0 0 217 0 0 0 25 0 1 0 627785213 1042227200 162 33554432000 134512640 135663704 4289781616 18446744073709551615 134544212 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/27457/statm: 254450 162 113 282 0 254166 0
[pid=27458] ppid=27437 vsize=330436 CPUtime=0 cores=0-7
/proc/27458/stat : 27458 (python) S 27437 27437 26145 0 -1 4202560 786 0 0 0 0 0 0 0 15 0 1 0 627785217 338366464 5719 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 1331746080043270404 0 0 17 1 0 0 0
/proc/27458/statm: 82609 5719 348 364 0 18512 0
[pid=27460] ppid=27458 vsize=1940 CPUtime=2.1 cores=0-7
/proc/27460/stat : 27460 (march_hi) R 27458 27460 27460 0 -1 4202496 573 0 0 0 210 0 0 0 25 0 1 0 627785218 1986560 310 33554432000 4194304 4955518 140736986795728 18446744073709551615 4314216 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/27460/statm: 485 310 104 186 0 298 0
[pid=27461] ppid=27437 vsize=340268 CPUtime=0 cores=0-7
/proc/27461/stat : 27461 (python) S 27437 27437 26145 0 -1 4202560 778 0 0 0 0 0 0 0 15 0 1 0 627785221 348434432 5634 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 16473600093216276739 0 0 17 0 0 0 0
/proc/27461/statm: 85067 5634 348 364 0 20967 0
[pid=27465] ppid=27461 vsize=1940 CPUtime=1.02 cores=0-7
/proc/27465/stat : 27465 (march_hi) R 27461 27465 27465 0 -1 4202496 557 0 0 0 102 0 0 0 25 0 1 0 627785225 1986560 292 33554432000 4194304 4955518 140733506759616 18446744073709551615 4209672 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/27465/statm: 485 292 104 186 0 298 0
[pid=27463] ppid=27437 vsize=350984 CPUtime=0 cores=0-7
/proc/27463/stat : 27463 (python) S 27437 27437 26145 0 -1 4202560 837 0 0 0 0 0 0 0 15 0 1 0 627785225 359407616 5733 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 16167258561531838722 0 0 17 0 0 0 0
/proc/27463/statm: 87746 5733 354 364 0 23643 0
[pid=27466] ppid=27463 vsize=1940 CPUtime=2.03 cores=0-7
/proc/27466/stat : 27466 (march_hi) R 27463 27466 27466 0 -1 4202496 578 0 0 0 203 0 0 0 25 0 1 0 627785225 1986560 309 33554432000 4194304 4955518 140737410826160 18446744073709551615 4209787 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/27466/statm: 485 309 104 186 0 298 0
[pid=27437/tid=27444] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27444/stat : 27444 (python) S 27435 27437 26145 0 -1 4202560 25 936 0 0 0 0 0 0 18 0 9 0 627785197 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27447] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27447/stat : 27447 (python) S 27435 27437 26145 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 9 0 627785201 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 6 0 0 0
[pid=27437/tid=27450] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27450/stat : 27450 (python) S 27435 27437 26145 0 -1 4202560 22 936 0 0 0 0 0 0 22 0 9 0 627785205 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27453] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27453/stat : 27453 (python) S 27435 27437 26145 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 9 0 627785209 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27456] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27456/stat : 27456 (python) S 27435 27437 26145 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 9 0 627785213 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 4 0 0 0
[pid=27437/tid=27459] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27459/stat : 27459 (python) S 27435 27437 26145 0 -1 4202560 26 936 0 0 0 0 0 0 21 0 9 0 627785217 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 1 0 0 0
[pid=27437/tid=27462] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27462/stat : 27462 (python) S 27435 27437 26145 0 -1 4202560 39 936 0 0 0 0 0 0 23 0 9 0 627785221 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27464] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27464/stat : 27464 (python) S 27435 27437 26145 0 -1 4202560 25 936 0 0 0 0 0 0 24 0 9 0 627785225 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 17.1
Current children cumulated vsize (KiB) 4364880

[startup+6.30139 s]
/proc/loadavg: 2.65 3.04 5.35 10/348 27466
/proc/meminfo: memFree=3773560/32950928 swapFree=63349324/67111528
[pid=27437] ppid=27435 vsize=361228 CPUtime=0.77 cores=0-7

################
# More data... #
################

[pid=27454] ppid=27452 vsize=0 CPUtime=5.91 cores=0-7
/proc/27454/stat : 27454 (march_hi) R 27452 27454 27454 0 -1 4202500 629 0 0 0 591 0 0 0 25 0 1 0 627785209 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/27454/statm: 0 0 0 0 0 0 0
[pid=27455] ppid=27437 vsize=320180 CPUtime=0 cores=0-7
/proc/27455/stat : 27455 (python) S 27437 27437 26145 0 -1 4202560 934 0 0 0 0 0 0 0 18 0 1 0 627785213 327864320 5737 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 12807270598937903361 0 0 17 4 0 0 0
/proc/27455/statm: 80045 5737 370 364 0 15951 0
[pid=27457] ppid=27455 vsize=1017800 CPUtime=7.76 cores=0-7
/proc/27457/stat : 27457 (gnovelty+2) R 27455 27457 27457 0 -1 4202496 426 0 0 0 776 0 0 0 25 0 1 0 627785213 1042227200 162 33554432000 134512640 135663704 4289781616 18446744073709551615 134524857 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/27457/statm: 254450 162 113 282 0 254166 0
[pid=27458] ppid=27437 vsize=330436 CPUtime=1.8 cores=0-7
/proc/27458/stat : 27458 (python) R 27437 27437 26145 0 -1 4202560 939 0 0 0 159 21 0 0 17 0 1 0 627785217 338366464 5741 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379376959 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/27458/statm: 82609 5741 370 364 0 18512 0
[pid=27460] ppid=27458 vsize=0 CPUtime=5.91 cores=0-7
/proc/27460/stat : 27460 (march_hi) R 27458 27460 27460 0 -1 4202500 630 0 0 0 591 0 0 0 25 0 1 0 627785218 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/27460/statm: 0 0 0 0 0 0 0
[pid=27461] ppid=27437 vsize=340268 CPUtime=0.01 cores=0-7
/proc/27461/stat : 27461 (python) S 27437 27437 26145 0 -1 4202560 962 0 0 0 1 0 0 0 15 0 1 0 627785221 348434432 5657 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 16473600093216276739 0 0 17 0 0 0 0
/proc/27461/statm: 85067 5657 371 364 0 20967 0
[pid=27465] ppid=27461 vsize=2076 CPUtime=3.83 cores=0-7
/proc/27465/stat : 27465 (march_hi) R 27461 27465 27465 0 -1 4202496 611 0 0 0 383 0 0 0 25 0 1 0 627785225 2125824 346 33554432000 4194304 4955518 140733506759616 18446744073709551615 4209776 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/27465/statm: 519 346 104 186 0 332 0
[pid=27463] ppid=27437 vsize=350984 CPUtime=1.69 cores=0-7
/proc/27463/stat : 27463 (python) R 27437 27437 26145 0 -1 4202560 1017 0 0 0 152 17 0 0 17 0 1 0 627785225 359407616 5756 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/27463/statm: 87746 5756 377 364 0 23643 0
[pid=27466] ppid=27463 vsize=0 CPUtime=5.91 cores=0-7
/proc/27466/stat : 27466 (march_hi) R 27463 27466 27466 0 -1 4202500 636 0 0 0 591 0 0 0 25 0 1 0 627785225 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/27466/statm: 0 0 0 0 0 0 0
[pid=27437/tid=27444] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27444/stat : 27444 (python) S 27435 27437 26145 0 -1 4202560 25 936 0 0 0 0 0 0 18 0 9 0 627785197 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27447] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27447/stat : 27447 (python) S 27435 27437 26145 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 9 0 627785201 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 6 0 0 0
[pid=27437/tid=27450] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27450/stat : 27450 (python) S 27435 27437 26145 0 -1 4202560 22 936 0 0 0 0 0 0 22 0 9 0 627785205 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27453] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27453/stat : 27453 (python) S 27435 27437 26145 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 9 0 627785209 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27456] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27456/stat : 27456 (python) S 27435 27437 26145 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 9 0 627785213 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 4 0 0 0
[pid=27437/tid=27459] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27459/stat : 27459 (python) S 27435 27437 26145 0 -1 4202560 26 936 0 0 0 0 0 0 21 0 9 0 627785217 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 1 0 0 0
[pid=27437/tid=27462] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27462/stat : 27462 (python) S 27435 27437 26145 0 -1 4202560 39 936 0 0 0 0 0 0 23 0 9 0 627785221 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27464] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27464/stat : 27464 (python) S 27435 27437 26145 0 -1 4202560 25 936 0 0 0 0 0 0 24 0 9 0 627785225 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 59.05
Current children cumulated vsize (KiB) 4355316

[startup+8.9009 s]
/proc/loadavg: 3.32 3.17 5.38 16/348 27466
/proc/meminfo: memFree=3777544/32950928 swapFree=63349324/67111528
[pid=27437] ppid=27435 vsize=361228 CPUtime=0.77 cores=0-7
/proc/27437/stat : 27437 (python) S 27435 27437 26145 0 -1 4202496 15770 936 1 0 65 12 0 0 24 0 9 0 627785120 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/27437/statm: 90307 7272 1889 364 0 26204 0
[pid=27443] ppid=27437 vsize=278572 CPUtime=0.01 cores=0-7
/proc/27443/stat : 27443 (python) S 27437 27437 26145 0 -1 4202560 897 0 0 0 0 1 0 0 18 0 1 0 627785197 285257728 5576 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566863 0 0 16781312 514 10043198697145073924 0 0 17 4 0 0 0
/proc/27443/statm: 69643 5576 377 364 0 5561 0
[pid=27445] ppid=27443 vsize=454900 CPUtime=8.12 cores=0-7
/proc/27445/stat : 27445 (TNM) R 27443 27445 27445 0 -1 4202496 414 0 0 0 812 0 0 0 25 0 1 0 627785198 465817600 150 33554432000 134512640 135008748 4289316912 18446744073709551615 134529384 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/27445/statm: 113725 150 46 122 0 112625 0
[pid=27446] ppid=27437 vsize=289280 CPUtime=2.04 cores=0-7
/proc/27446/stat : 27446 (python) R 27437 27437 26145 0 -1 4202560 911 0 0 0 175 29 0 0 18 0 1 0 627785201 296222720 5700 33554432000 4194304 5683644 140734633177504 18446744073709551615 4952600 0 0 16781312 514 0 0 0 17 7 0 0 0
/proc/27446/statm: 72320 5700 371 364 0 8235 0
[pid=27448] ppid=27446 vsize=0 CPUtime=5.94 cores=0-7
/proc/27448/stat : 27448 (march_hi) R 27446 27448 27448 0 -1 4202500 629 0 0 0 594 0 0 0 25 0 1 0 627785201 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/27448/statm: 0 0 0 0 0 0 0
[pid=27449] ppid=27437 vsize=299668 CPUtime=2.11 cores=0-7
/proc/27449/stat : 27449 (python) R 27437 27437 26145 0 -1 4202560 923 0 0 0 185 26 0 0 18 0 1 0 627785205 306860032 5720 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379376959 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/27449/statm: 74917 5720 370 364 0 10829 0
[pid=27451] ppid=27449 vsize=0 CPUtime=5.91 cores=0-7
/proc/27451/stat : 27451 (march_hi) R 27449 27451 27451 0 -1 4202500 629 0 0 0 591 0 0 0 25 0 1 0 627785205 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/27451/statm: 0 0 0 0 0 0 0
[pid=27452] ppid=27437 vsize=309924 CPUtime=2.09 cores=0-7
/proc/27452/stat : 27452 (python) R 27437 27437 26145 0 -1 4202560 927 0 0 0 180 29 0 0 18 0 1 0 627785209 317362176 5724 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379376959 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/27452/statm: 77481 5724 370 364 0 13390 0
[pid=27454] ppid=27452 vsize=0 CPUtime=5.91 cores=0-7
/proc/27454/stat : 27454 (march_hi) R 27452 27454 27454 0 -1 4202500 629 0 0 0 591 0 0 0 25 0 1 0 627785209 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/27454/statm: 0 0 0 0 0 0 0
[pid=27455] ppid=27437 vsize=320180 CPUtime=0 cores=0-7
/proc/27455/stat : 27455 (python) S 27437 27437 26145 0 -1 4202560 934 0 0 0 0 0 0 0 18 0 1 0 627785213 327864320 5737 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 12807270598937903361 0 0 17 4 0 0 0
/proc/27455/statm: 80045 5737 370 364 0 15951 0
[pid=27457] ppid=27455 vsize=1017800 CPUtime=7.95 cores=0-7
/proc/27457/stat : 27457 (gnovelty+2) R 27455 27457 27457 0 -1 4202496 426 0 0 0 795 0 0 0 25 0 1 0 627785213 1042227200 162 33554432000 134512640 135663704 4289781616 18446744073709551615 134524566 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/27457/statm: 254450 162 113 282 0 254166 0
[pid=27458] ppid=27437 vsize=330436 CPUtime=1.98 cores=0-7
/proc/27458/stat : 27458 (python) R 27437 27437 26145 0 -1 4202560 939 0 0 0 176 22 0 0 18 0 1 0 627785217 338366464 5741 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/27458/statm: 82609 5741 370 364 0 18512 0
[pid=27460] ppid=27458 vsize=0 CPUtime=5.91 cores=0-7
/proc/27460/stat : 27460 (march_hi) R 27458 27460 27460 0 -1 4202500 630 0 0 0 591 0 0 0 25 0 1 0 627785218 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 1 0 0 0
/proc/27460/statm: 0 0 0 0 0 0 0
[pid=27461] ppid=27437 vsize=340268 CPUtime=0.01 cores=0-7
/proc/27461/stat : 27461 (python) S 27437 27437 26145 0 -1 4202560 962 0 0 0 1 0 0 0 15 0 1 0 627785221 348434432 5657 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 16473600093216276739 0 0 17 0 0 0 0
/proc/27461/statm: 85067 5657 371 364 0 20967 0
[pid=27465] ppid=27461 vsize=2076 CPUtime=3.92 cores=0-7
/proc/27465/stat : 27465 (march_hi) R 27461 27465 27465 0 -1 4202496 611 0 0 0 392 0 0 0 25 0 1 0 627785225 2125824 346 33554432000 4194304 4955518 140733506759616 18446744073709551615 4286512 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/27465/statm: 519 346 104 186 0 332 0
[pid=27463] ppid=27437 vsize=350984 CPUtime=1.88 cores=0-7
/proc/27463/stat : 27463 (python) R 27437 27437 26145 0 -1 4202560 1017 0 0 0 169 19 0 0 18 0 1 0 627785225 359407616 5756 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379376959 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/27463/statm: 87746 5756 377 364 0 23643 0
[pid=27466] ppid=27463 vsize=0 CPUtime=5.91 cores=0-7
/proc/27466/stat : 27466 (march_hi) R 27463 27466 27466 0 -1 4202500 636 0 0 0 591 0 0 0 25 0 1 0 627785225 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/27466/statm: 0 0 0 0 0 0 0
[pid=27437/tid=27444] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27444/stat : 27444 (python) S 27435 27437 26145 0 -1 4202560 25 936 0 0 0 0 0 0 18 0 9 0 627785197 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27447] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27447/stat : 27447 (python) S 27435 27437 26145 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 9 0 627785201 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 6 0 0 0
[pid=27437/tid=27450] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27450/stat : 27450 (python) S 27435 27437 26145 0 -1 4202560 22 936 0 0 0 0 0 0 22 0 9 0 627785205 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27453] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27453/stat : 27453 (python) S 27435 27437 26145 0 -1 4202560 23 936 0 0 0 0 0 0 20 0 9 0 627785209 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27456] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27456/stat : 27456 (python) S 27435 27437 26145 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 9 0 627785213 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 4 0 0 0
[pid=27437/tid=27459] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27459/stat : 27459 (python) S 27435 27437 26145 0 -1 4202560 26 936 0 0 0 0 0 0 21 0 9 0 627785217 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 1 0 0 0
[pid=27437/tid=27462] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27462/stat : 27462 (python) S 27435 27437 26145 0 -1 4202560 39 936 0 0 0 0 0 0 23 0 9 0 627785221 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27464] ppid=27435 vsize=361228 CPUtime=0 cores=0-7
/proc/27437/task/27464/stat : 27464 (python) S 27435 27437 26145 0 -1 4202560 25 936 0 0 0 0 0 0 24 0 9 0 627785225 369897472 7272 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 60.46
Current children cumulated vsize (KiB) 4355316

[startup+9.00089 s]
/proc/loadavg: 3.32 3.17 5.38 16/348 27466
/proc/meminfo: memFree=3777544/32950928 swapFree=63349324/67111528
[pid=27437] ppid=27435 vsize=361228 CPUtime=16.97 cores=0-7
/proc/27437/stat : 27437 (python) S 27435 27437 26145 0 -1 4202496 15802 4305 1 0 65 12 1558 62 17 0 9 0 627785120 369897472 7273 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379376959 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/27437/statm: 90307 7273 1890 364 0 26204 0
[pid=27443] ppid=27437 vsize=278572 CPUtime=0.01 cores=0-7
/proc/27443/stat : 27443 (python) S 27437 27437 26145 0 -1 4202560 897 0 0 0 0 1 0 0 18 0 1 0 627785197 285257728 5576 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566863 0 0 16781312 514 10043198697145073924 0 0 17 4 0 0 0
/proc/27443/statm: 69643 5576 377 364 0 5561 0
[pid=27445] ppid=27443 vsize=454900 CPUtime=8.22 cores=0-7
/proc/27445/stat : 27445 (TNM) R 27443 27445 27445 0 -1 4202496 414 0 0 0 822 0 0 0 25 0 1 0 627785198 465817600 150 33554432000 134512640 135008748 4289316912 18446744073709551615 134527524 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/27445/statm: 113725 150 46 122 0 112625 0
[pid=27449] ppid=27437 vsize=0 CPUtime=8.12 cores=0-7
/proc/27449/stat : 27449 (python) Z 27437 27437 26145 0 -1 4202588 1144 629 0 0 193 28 591 0 18 0 1 0 627785205 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 2 0 0 0
/proc/27449/statm: 0 0 0 0 0 0 0
[pid=27455] ppid=27437 vsize=320180 CPUtime=0 cores=0-7
/proc/27455/stat : 27455 (python) S 27437 27437 26145 0 -1 4202560 934 0 0 0 0 0 0 0 18 0 1 0 627785213 327864320 5737 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 12807270598937903361 0 0 17 4 0 0 0
/proc/27455/statm: 80045 5737 370 364 0 15951 0
[pid=27457] ppid=27455 vsize=1017800 CPUtime=8.05 cores=0-7
/proc/27457/stat : 27457 (gnovelty+2) R 27455 27457 27457 0 -1 4202496 426 0 0 0 805 0 0 0 25 0 1 0 627785213 1042227200 162 33554432000 134512640 135663704 4289781616 18446744073709551615 134545635 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/27457/statm: 254450 162 113 282 0 254166 0
[pid=27458] ppid=27437 vsize=0 CPUtime=7.99 cores=0-7
/proc/27458/stat : 27458 (python) R 27437 27437 26145 0 -1 4202564 1025 630 0 0 184 24 591 0 18 0 1 0 627785217 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 1 0 0 0
/proc/27458/statm: 0 0 0 0 0 0 0
[pid=27461] ppid=27437 vsize=340268 CPUtime=0.01 cores=0-7
/proc/27461/stat : 27461 (python) S 27437 27437 26145 0 -1 4202560 962 0 0 0 1 0 0 0 15 0 1 0 627785221 348434432 5657 33554432000 4194304 5683644 140734633177504 18446744073709551615 251367566918 0 0 16781312 514 16473600093216276739 0 0 17 0 0 0 0
/proc/27461/statm: 85067 5657 371 364 0 20967 0
[pid=27465] ppid=27461 vsize=2076 CPUtime=4.01 cores=0-7
/proc/27465/stat : 27465 (march_hi) R 27461 27465 27465 0 -1 4202496 612 0 0 0 401 0 0 0 25 0 1 0 627785225 2125824 347 33554432000 4194304 4955518 140733506759616 18446744073709551615 4209780 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/27465/statm: 519 347 104 186 0 332 0
[pid=27463] ppid=27437 vsize=0 CPUtime=7.89 cores=0-7
/proc/27463/stat : 27463 (python) Z 27437 27437 26145 0 -1 4202588 1249 636 0 0 178 20 591 0 19 0 1 0 627785225 0 0 33554432000 0 0 0 0 0 0 0 16781824 2 18446744073709551615 0 0 17 0 0 0 0
/proc/27463/statm: 0 0 0 0 0 0 0
[pid=27437/tid=27444] ppid=27435 vsize=361228 CPUtime=24.22 cores=0-7
/proc/27437/task/27444/stat : 27444 (python) S 27435 27437 26145 0 -1 4202560 25 5960 0 0 0 0 2335 87 18 0 9 0 627785197 369897472 7273 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27447] ppid=27435 vsize=361228 CPUtime=24.22 cores=0-7
/proc/27437/task/27447/stat : 27447 (python) S 27435 27437 26145 0 -1 4202560 23 5960 0 0 0 0 2335 87 20 0 9 0 627785201 369897472 7273 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 6 0 0 0
[pid=27437/tid=27450] ppid=27435 vsize=361228 CPUtime=24.22 cores=0-7
/proc/27437/task/27450/stat : 27450 (python) S 27435 27437 26145 0 -1 4202560 22 5960 0 0 0 0 2335 87 22 0 9 0 627785205 369897472 7273 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27453] ppid=27435 vsize=361228 CPUtime=24.22 cores=0-7
/proc/27437/task/27453/stat : 27453 (python) S 27435 27437 26145 0 -1 4202560 23 5960 0 0 0 0 2335 87 20 0 9 0 627785209 369897472 7273 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27456] ppid=27435 vsize=361228 CPUtime=24.22 cores=0-7
/proc/27437/task/27456/stat : 27456 (python) S 27435 27437 26145 0 -1 4202560 28 5960 0 0 0 0 2335 87 20 0 9 0 627785213 369897472 7273 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 4 0 0 0
[pid=27437/tid=27459] ppid=27435 vsize=361228 CPUtime=24.22 cores=0-7
/proc/27437/task/27459/stat : 27459 (python) S 27435 27437 26145 0 -1 4202560 26 5960 0 0 0 0 2335 87 21 0 9 0 627785217 369897472 7273 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 1 0 0 0
[pid=27437/tid=27462] ppid=27435 vsize=361228 CPUtime=24.22 cores=0-7
/proc/27437/task/27462/stat : 27462 (python) S 27435 27437 26145 0 -1 4202560 39 5960 0 0 0 0 2335 87 23 0 9 0 627785221 369897472 7273 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
[pid=27437/tid=27464] ppid=27435 vsize=361228 CPUtime=24.22 cores=0-7
/proc/27437/task/27464/stat : 27464 (python) S 27435 27437 26145 0 -1 4202560 25 5960 0 0 0 0 2335 87 24 0 9 0 627785225 369897472 7273 33554432000 4194304 5683644 140734633177504 18446744073709551615 251379370417 0 0 16781312 2 18446604443009718208 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 61.27
Current children cumulated vsize (KiB) 2775024

Child status: 0
Real time (s): 9.02838
CPU time (s): 61.4447
CPU user time (s): 59.9009
CPU system time (s): 1.54377
CPU usage (%): 680.573
Max. virtual memory (cumulated for all children) (KiB): 4365900

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 59.9009
system time used= 1.54377
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 34117
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5652
involuntary context switches= 2916

runsolver used 0.032994 second user time and 0.071989 second system time

The end

Launcher Data 

Begin job on node113 at 2011-05-03 00:32:24
IDJOB=3322179
IDBENCH=82957
IDSOLVER=1712
FILE ID=node113/3322179-1304375544
RUNJOBID= node113-1304366468-26159
PBS_JOBID= 13181757
Free space on /tmp= 73520 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v350-c1491-S1404138730-025.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322179-1304375544/watcher-3322179-1304375544 -o /tmp/evaluation-result-3322179-1304375544/solver-3322179-1304375544 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322179-1304375544.cnf -seed 172577614 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 2e059a7f69d15193cd88ec6d57d9e297
RANDOM SEED=172577614

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       3838288 kB
Buffers:         29032 kB
Cached:         245856 kB
SwapCached:      80540 kB
Active:       17482456 kB
Inactive:     11384976 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       3838288 kB
SwapTotal:    67111528 kB
SwapFree:     63349324 kB
Dirty:           31816 kB
Writeback:           0 kB
AnonPages:    28522316 kB
Mapped:          17608 kB
Slab:            89516 kB
PageTables:      87892 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 75264452 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73488 MiB
End job on node113 at 2011-05-03 00:32:34