Trace number 3378584

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 157.171 39.8877

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v400-c1704-S690749326-001.UNKNOWN.cnf
MD5SUM20f33ec190b502d21efebab5417989ef
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark36.7644
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses1704
Sum of the clauses size5112
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31704
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.33/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.33/0.46	c INFO: solving HOME/instance-3378584-1305466312.cnf
0.33/0.46	c INFO: computing task features
0.33/0.47	c INFO: computed variable-clause graph statistics
0.33/0.47	c INFO: computed clause balance statistics
0.41/0.50	c INFO: computed variable balance statistics
0.41/0.52	c INFO: computed small-clause counts
0.41/0.52	c INFO: computed Horn-clause counts
0.41/0.53	c INFO: computed variable graph statistics
0.41/0.53	c INFO: collected features for HOME/instance-3378584-1305466312.cnf in 0.06 s
0.41/0.53	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.56)
0.41/0.55	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.39)
0.41/0.55	c INFO: running march_hi@0 for 679 with 1199 remaining (b = 0.44)
0.41/0.57	c INFO: running march_hi@0 for 97 with 1199 remaining (b = 0.14)
156.79/39.86	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378584-1305466312/watcher-3378584-1305466312 -o /tmp/evaluation-result-3378584-1305466312/solver-3378584-1305466312 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378584-1305466312.cnf -seed 1949294598 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.15 8.19 8.02 5/496 22646
/proc/meminfo: memFree=21816012/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=16248 CPUtime=0 cores=0,2,4,6
/proc/22646/stat : 22646 (python) R 22644 22646 20819 0 -1 4202496 1051 0 0 0 0 0 0 0 25 0 1 0 639047447 16637952 923 33554432000 4194304 5683644 140736685513040 18446744073709551615 5292994 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22646/statm: 4062 923 381 364 0 549 0

[startup+0.088926 s]
/proc/loadavg: 8.15 8.19 8.02 5/496 22646
/proc/meminfo: memFree=21816012/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=99344 CPUtime=0.06 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 2853 0 0 0 5 1 0 0 17 0 1 0 639047447 101728256 2555 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039653376 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/22646/statm: 24837 2555 818 364 0 1688 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 99344

[startup+0.100932 s]
/proc/loadavg: 8.15 8.19 8.02 5/496 22646
/proc/meminfo: memFree=21816012/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=104232 CPUtime=0.07 cores=0,2,4,6
/proc/22646/stat : 22646 (python) R 22644 22646 20819 0 -1 4202496 3086 0 0 0 5 2 0 0 17 0 1 0 639047447 106733568 2767 33554432000 4194304 5683644 140736685513040 18446744073709551615 5114052 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/22646/statm: 26058 2767 847 364 0 1806 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104232

[startup+0.301061 s]
/proc/loadavg: 8.15 8.19 8.02 5/496 22646
/proc/meminfo: memFree=21816012/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=194420 CPUtime=0.23 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 6905 932 1 0 16 7 0 0 17 0 1 0 639047447 199086080 4960 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039653376 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/22646/statm: 48605 4960 1431 364 0 3724 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 194420

[startup+0.700773 s]
/proc/loadavg: 8.15 8.19 8.02 5/496 22646
/proc/meminfo: memFree=21816012/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=320184 CPUtime=0.48 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 12138 932 1 0 37 11 0 0 19 0 5 0 639047447 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22646/statm: 80046 7242 1881 364 0 15955 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 320184

[startup+1.50063 s]
/proc/loadavg: 8.15 8.19 8.02 9/509 22663
/proc/meminfo: memFree=21776840/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=320184 CPUtime=0.48 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 12138 932 1 0 37 11 0 0 19 0 5 0 639047447 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22646/statm: 80046 7242 1881 364 0 15955 0
[pid=22652] ppid=22646 vsize=278428 CPUtime=0 cores=0,2,4,6
/proc/22652/stat : 22652 (python) S 22646 22646 20819 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 639047501 285110272 5530 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675407 0 0 16781312 514 17758809614196932607 0 0 17 4 0 0 0
/proc/22652/statm: 69607 5530 354 364 0 5525 0
[pid=22654] ppid=22652 vsize=1017800 CPUtime=0.95 cores=0,2,4,6
/proc/22654/stat : 22654 (gnovelty+2) R 22652 22654 22654 0 -1 4202496 430 0 0 0 95 0 0 0 21 0 1 0 639047502 1042227200 168 33554432000 134512640 135663704 4291254912 18446744073709551615 134525465 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22654/statm: 254450 168 113 282 0 254166 0
[pid=22655] ppid=22646 vsize=289292 CPUtime=0 cores=0,2,4,6
/proc/22655/stat : 22655 (python) S 22646 22646 20819 0 -1 4202560 747 0 0 0 0 0 0 0 15 0 1 0 639047502 296235008 5680 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 7114038148098654467 0 0 17 2 0 0 0
/proc/22655/statm: 72323 5680 348 364 0 8238 0
[pid=22657] ppid=22655 vsize=1972 CPUtime=0.94 cores=0,2,4,6
/proc/22657/stat : 22657 (march_hi) R 22655 22657 22657 0 -1 4202496 580 0 0 0 94 0 0 0 25 0 1 0 639047502 2019328 316 33554432000 4194304 4955518 140737030037168 18446744073709551615 4286401 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/22657/statm: 493 316 104 186 0 306 0
[pid=22658] ppid=22646 vsize=299548 CPUtime=0 cores=0,2,4,6
/proc/22658/stat : 22658 (python) S 22646 22646 20819 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 639047503 306737152 5684 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 3135741196014420226 0 0 17 2 0 0 0
/proc/22658/statm: 74887 5684 348 364 0 10799 0
[pid=22660] ppid=22658 vsize=1972 CPUtime=0.93 cores=0,2,4,6
/proc/22660/stat : 22660 (march_hi) R 22658 22660 22660 0 -1 4202496 577 0 0 0 93 0 0 0 25 0 1 0 639047503 2019328 316 33554432000 4194304 4955518 140733419507520 18446744073709551615 4224679 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/22660/statm: 493 316 104 186 0 306 0
[pid=22661] ppid=22646 vsize=309940 CPUtime=0 cores=0,2,4,6
/proc/22661/stat : 22661 (python) S 22646 22646 20819 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 639047504 317378560 5705 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 17826074162171445506 0 0 17 4 0 0 0
/proc/22661/statm: 77485 5705 348 364 0 13394 0
[pid=22663] ppid=22661 vsize=1972 CPUtime=0.91 cores=0,2,4,6
/proc/22663/stat : 22663 (march_hi) R 22661 22663 22663 0 -1 4202496 576 0 0 0 91 0 0 0 23 0 1 0 639047504 2019328 316 33554432000 4194304 4955518 140733678301040 18446744073709551615 4209699 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/22663/statm: 493 316 104 186 0 306 0
[pid=22646/tid=22653] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22653/stat : 22653 (python) S 22644 22646 20819 0 -1 4202560 24 932 0 0 0 0 0 0 19 0 5 0 639047501 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
[pid=22646/tid=22656] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22656/stat : 22656 (python) S 22644 22646 20819 0 -1 4202560 23 932 0 0 0 0 0 0 21 0 5 0 639047502 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22659] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22659/stat : 22659 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 23 0 5 0 639047503 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22662] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22662/stat : 22662 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 5 0 639047504 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4.21
Current children cumulated vsize (KiB) 2521108

[startup+3.10134 s]
/proc/loadavg: 8.15 8.19 8.02 9/509 22663
/proc/meminfo: memFree=21775780/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=320184 CPUtime=0.48 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 12138 932 1 0 37 11 0 0 19 0 5 0 639047447 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22646/statm: 80046 7242 1881 364 0 15955 0
[pid=22652] ppid=22646 vsize=278428 CPUtime=0 cores=0,2,4,6
/proc/22652/stat : 22652 (python) S 22646 22646 20819 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 639047501 285110272 5530 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675407 0 0 16781312 514 17758809614196900099 0 0 17 4 0 0 0
/proc/22652/statm: 69607 5530 354 364 0 5525 0
[pid=22654] ppid=22652 vsize=1017800 CPUtime=2.55 cores=0,2,4,6
/proc/22654/stat : 22654 (gnovelty+2) R 22652 22654 22654 0 -1 4202496 430 0 0 0 255 0 0 0 25 0 1 0 639047502 1042227200 168 33554432000 134512640 135663704 4291254912 18446744073709551615 134545619 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22654/statm: 254450 168 113 282 0 254166 0
[pid=22655] ppid=22646 vsize=289292 CPUtime=0 cores=0,2,4,6
/proc/22655/stat : 22655 (python) S 22646 22646 20819 0 -1 4202560 748 0 0 0 0 0 0 0 15 0 1 0 639047502 296235008 5680 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 7114038148098654467 0 0 17 2 0 0 0
/proc/22655/statm: 72323 5680 348 364 0 8238 0
[pid=22657] ppid=22655 vsize=2188 CPUtime=2.54 cores=0,2,4,6
/proc/22657/stat : 22657 (march_hi) R 22655 22657 22657 0 -1 4202496 610 0 0 0 254 0 0 0 25 0 1 0 639047502 2240512 346 33554432000 4194304 4955518 140737030037168 18446744073709551615 4209717 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/22657/statm: 547 346 104 186 0 360 0
[pid=22658] ppid=22646 vsize=299548 CPUtime=0 cores=0,2,4,6
/proc/22658/stat : 22658 (python) S 22646 22646 20819 0 -1 4202560 754 0 0 0 0 0 0 0 15 0 1 0 639047503 306737152 5684 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 3135741196014420226 0 0 17 2 0 0 0
/proc/22658/statm: 74887 5684 348 364 0 10799 0
[pid=22660] ppid=22658 vsize=2188 CPUtime=2.53 cores=0,2,4,6
/proc/22660/stat : 22660 (march_hi) R 22658 22660 22660 0 -1 4202496 607 0 0 0 253 0 0 0 25 0 1 0 639047503 2240512 346 33554432000 4194304 4955518 140733419507520 18446744073709551615 4235272 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/22660/statm: 547 346 104 186 0 360 0
[pid=22661] ppid=22646 vsize=309940 CPUtime=0 cores=0,2,4,6
/proc/22661/stat : 22661 (python) S 22646 22646 20819 0 -1 4202560 757 0 0 0 0 0 0 0 15 0 1 0 639047504 317378560 5705 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 17826074162171445506 0 0 17 4 0 0 0
/proc/22661/statm: 77485 5705 348 364 0 13394 0
[pid=22663] ppid=22661 vsize=2188 CPUtime=2.49 cores=0,2,4,6
/proc/22663/stat : 22663 (march_hi) R 22661 22663 22663 0 -1 4202496 605 0 0 0 249 0 0 0 25 0 1 0 639047504 2240512 345 33554432000 4194304 4955518 140733678301040 18446744073709551615 4227917 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/22663/statm: 547 345 104 186 0 360 0
[pid=22646/tid=22653] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22653/stat : 22653 (python) S 22644 22646 20819 0 -1 4202560 24 932 0 0 0 0 0 0 19 0 5 0 639047501 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
[pid=22646/tid=22656] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22656/stat : 22656 (python) S 22644 22646 20819 0 -1 4202560 23 932 0 0 0 0 0 0 21 0 5 0 639047502 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22659] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22659/stat : 22659 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 23 0 5 0 639047503 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22662] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22662/stat : 22662 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 5 0 639047504 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10.59
Current children cumulated vsize (KiB) 2521756

[startup+6.30077 s]
/proc/loadavg: 8.13 8.18 8.02 9/509 22663
/proc/meminfo: memFree=21773512/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=320184 CPUtime=0.48 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 12138 932 1 0 37 11 0 0 19 0 5 0 639047447 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22646/statm: 80046 7242 1881 364 0 15955 0
[pid=22652] ppid=22646 vsize=278428 CPUtime=0.01 cores=0,2,4,6
/proc/22652/stat : 22652 (python) S 22646 22646 20819 0 -1 4202560 893 0 0 0 0 1 0 0 18 0 1 0 639047501 285110272 5552 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675407 0 0 16781312 514 17758809614196900099 0 0 17 4 0 0 0
/proc/22652/statm: 69607 5552 376 364 0 5525 0
[pid=22654] ppid=22652 vsize=1017800 CPUtime=5.71 cores=0,2,4,6
/proc/22654/stat : 22654 (gnovelty+2) R 22652 22654 22654 0 -1 4202496 430 0 0 0 571 0 0 0 25 0 1 0 639047502 1042227200 168 33554432000 134512640 135663704 4291254912 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22654/statm: 254450 168 113 282 0 254166 0
[pid=22655] ppid=22646 vsize=289292 CPUtime=0.01 cores=0,2,4,6
/proc/22655/stat : 22655 (python) S 22646 22646 20819 0 -1 4202560 921 0 0 0 1 0 0 0 15 0 1 0 639047502 296235008 5703 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 7114038148098654467 0 0 17 0 0 0 0
/proc/22655/statm: 72323 5703 371 364 0 8238 0
[pid=22657] ppid=22655 vsize=2188 CPUtime=5.74 cores=0,2,4,6
/proc/22657/stat : 22657 (march_hi) R 22655 22657 22657 0 -1 4202496 641 0 0 0 574 0 0 0 25 0 1 0 639047502 2240512 377 33554432000 4194304 4955518 140737030037168 18446744073709551615 4209776 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/22657/statm: 547 377 104 186 0 360 0
[pid=22658] ppid=22646 vsize=299548 CPUtime=0.02 cores=0,2,4,6
/proc/22658/stat : 22658 (python) S 22646 22646 20819 0 -1 4202560 914 0 0 0 2 0 0 0 15 0 1 0 639047503 306737152 5707 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 3135741196014420226 0 0 17 2 0 0 0
/proc/22658/statm: 74887 5707 371 364 0 10799 0
[pid=22660] ppid=22658 vsize=2188 CPUtime=5.68 cores=0,2,4,6
/proc/22660/stat : 22660 (march_hi) R 22658 22660 22660 0 -1 4202496 638 0 0 0 568 0 0 0 25 0 1 0 639047503 2240512 377 33554432000 4194304 4955518 140733419507520 18446744073709551615 4295566 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/22660/statm: 547 377 104 186 0 360 0
[pid=22661] ppid=22646 vsize=309940 CPUtime=0.01 cores=0,2,4,6
/proc/22661/stat : 22661 (python) S 22646 22646 20819 0 -1 4202560 912 0 0 0 1 0 0 0 15 0 1 0 639047504 317378560 5728 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 17826074162171445506 0 0 17 4 0 0 0
/proc/22661/statm: 77485 5728 371 364 0 13394 0
[pid=22663] ppid=22661 vsize=2188 CPUtime=5.64 cores=0,2,4,6
/proc/22663/stat : 22663 (march_hi) R 22661 22663 22663 0 -1 4202496 637 0 0 0 564 0 0 0 25 0 1 0 639047504 2240512 377 33554432000 4194304 4955518 140733678301040 18446744073709551615 4210456 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/22663/statm: 547 377 104 186 0 360 0
[pid=22646/tid=22653] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22653/stat : 22653 (python) S 22644 22646 20819 0 -1 4202560 24 932 0 0 0 0 0 0 19 0 5 0 639047501 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
[pid=22646/tid=22656] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22656/stat : 22656 (python) S 22644 22646 20819 0 -1 4202560 23 932 0 0 0 0 0 0 21 0 5 0 639047502 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22659] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22659/stat : 22659 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 23 0 5 0 639047503 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22662] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22662/stat : 22662 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 5 0 639047504 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 23.3
Current children cumulated vsize (KiB) 2521756

[startup+12.7006 s]
/proc/loadavg: 8.20 8.20 8.02 9/509 22663
/proc/meminfo: memFree=21771908/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=320184 CPUtime=0.48 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 12138 932 1 0 37 11 0 0 19 0 5 0 639047447 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22646/statm: 80046 7242 1881 364 0 15955 0
[pid=22652] ppid=22646 vsize=278428 CPUtime=0.04 cores=0,2,4,6
/proc/22652/stat : 22652 (python) S 22646 22646 20819 0 -1 4202560 897 0 0 0 2 2 0 0 18 0 1 0 639047501 285110272 5553 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675407 0 0 16781312 514 7011787960467030275 0 0 17 4 0 0 0
/proc/22652/statm: 69607 5553 377 364 0 5525 0
[pid=22654] ppid=22652 vsize=1017800 CPUtime=12.07 cores=0,2,4,6
/proc/22654/stat : 22654 (gnovelty+2) R 22652 22654 22654 0 -1 4202496 430 0 0 0 1207 0 0 0 25 0 1 0 639047502 1042227200 168 33554432000 134512640 135663704 4291254912 18446744073709551615 134525007 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22654/statm: 254450 168 113 282 0 254166 0
[pid=22655] ppid=22646 vsize=289292 CPUtime=0.04 cores=0,2,4,6

################
# More data... #
################

[pid=22646/tid=22659] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22659/stat : 22659 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 23 0 5 0 639047503 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22662] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22662/stat : 22662 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 5 0 639047504 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 150.83
Current children cumulated vsize (KiB) 2519972

[startup+39.1009 s]
/proc/loadavg: 8.12 8.18 8.02 12/462 22796
/proc/meminfo: memFree=21883468/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=320184 CPUtime=0.48 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 12138 932 1 0 37 11 0 0 19 0 5 0 639047447 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22646/statm: 80046 7242 1881 364 0 15955 0
[pid=22652] ppid=22646 vsize=278428 CPUtime=0.1 cores=0,2,4,6
/proc/22652/stat : 22652 (python) S 22646 22646 20819 0 -1 4202560 907 0 0 0 5 5 0 0 18 0 1 0 639047501 285110272 5553 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675407 0 0 16781312 514 7011787960467030275 0 0 17 4 0 0 0
/proc/22652/statm: 69607 5553 377 364 0 5525 0
[pid=22654] ppid=22652 vsize=1017800 CPUtime=38.31 cores=0,2,4,6
/proc/22654/stat : 22654 (gnovelty+2) R 22652 22654 22654 0 -1 4202496 430 0 0 0 3831 0 0 0 25 0 1 0 639047502 1042227200 168 33554432000 134512640 135663704 4291254912 18446744073709551615 134545631 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22654/statm: 254450 168 113 282 0 254166 0
[pid=22655] ppid=22646 vsize=289292 CPUtime=1.38 cores=0,2,4,6
/proc/22655/stat : 22655 (python) R 22646 22646 20819 0 -1 4202560 942 0 0 0 119 19 0 0 17 0 1 0 639047502 296235008 5703 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/22655/statm: 72323 5703 371 364 0 8238 0
[pid=22657] ppid=22655 vsize=0 CPUtime=37.16 cores=0,2,4,6
/proc/22657/stat : 22657 (march_hi) R 22655 22657 22657 0 -1 4202500 1209 0 0 0 3716 0 0 0 25 0 1 0 639047502 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22657/statm: 0 0 0 0 0 0 0
[pid=22658] ppid=22646 vsize=299548 CPUtime=1.56 cores=0,2,4,6
/proc/22658/stat : 22658 (python) R 22646 22646 20819 0 -1 4202560 937 0 0 0 130 26 0 0 17 0 1 0 639047503 306737152 5707 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051485503 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/22658/statm: 74887 5707 371 364 0 10799 0
[pid=22660] ppid=22658 vsize=0 CPUtime=36.95 cores=0,2,4,6
/proc/22660/stat : 22660 (march_hi) R 22658 22660 22660 0 -1 4202500 1206 0 0 0 3695 0 0 0 25 0 1 0 639047503 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/22660/statm: 0 0 0 0 0 0 0
[pid=22661] ppid=22646 vsize=309940 CPUtime=0.91 cores=0,2,4,6
/proc/22661/stat : 22661 (python) R 22646 22646 20819 0 -1 4202560 939 0 0 0 74 17 0 0 16 0 1 0 639047504 317378560 5728 33554432000 4194304 5683644 140736685513040 18446744073709551615 5308861 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/22661/statm: 77485 5728 371 364 0 13394 0
[pid=22663] ppid=22661 vsize=0 CPUtime=37.17 cores=0,2,4,6
/proc/22663/stat : 22663 (march_hi) R 22661 22663 22663 0 -1 4202500 1205 0 0 0 3717 0 0 0 25 0 1 0 639047504 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/22663/statm: 0 0 0 0 0 0 0
[pid=22646/tid=22653] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22653/stat : 22653 (python) S 22644 22646 20819 0 -1 4202560 24 932 0 0 0 0 0 0 19 0 5 0 639047501 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
[pid=22646/tid=22656] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22656/stat : 22656 (python) S 22644 22646 20819 0 -1 4202560 23 932 0 0 0 0 0 0 21 0 5 0 639047502 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22659] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22659/stat : 22659 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 23 0 5 0 639047503 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22662] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22662/stat : 22662 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 5 0 639047504 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 154.02
Current children cumulated vsize (KiB) 2515192

[startup+39.5008 s]
/proc/loadavg: 8.12 8.18 8.02 13/462 22796
/proc/meminfo: memFree=21883228/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=320184 CPUtime=0.48 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 12138 932 1 0 37 11 0 0 19 0 5 0 639047447 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22646/statm: 80046 7242 1881 364 0 15955 0
[pid=22652] ppid=22646 vsize=278428 CPUtime=0.1 cores=0,2,4,6
/proc/22652/stat : 22652 (python) S 22646 22646 20819 0 -1 4202560 907 0 0 0 5 5 0 0 18 0 1 0 639047501 285110272 5553 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675407 0 0 16781312 514 7011787960467030275 0 0 17 4 0 0 0
/proc/22652/statm: 69607 5553 377 364 0 5525 0
[pid=22654] ppid=22652 vsize=1017800 CPUtime=38.73 cores=0,2,4,6
/proc/22654/stat : 22654 (gnovelty+2) R 22652 22654 22654 0 -1 4202496 430 0 0 0 3873 0 0 0 25 0 1 0 639047502 1042227200 168 33554432000 134512640 135663704 4291254912 18446744073709551615 135008500 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22654/statm: 254450 168 113 282 0 254166 0
[pid=22655] ppid=22646 vsize=289292 CPUtime=1.8 cores=0,2,4,6
/proc/22655/stat : 22655 (python) R 22646 22646 20819 0 -1 4202560 942 0 0 0 156 24 0 0 17 0 1 0 639047502 296235008 5703 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/22655/statm: 72323 5703 371 364 0 8238 0
[pid=22657] ppid=22655 vsize=0 CPUtime=37.16 cores=0,2,4,6
/proc/22657/stat : 22657 (march_hi) R 22655 22657 22657 0 -1 4202500 1209 0 0 0 3716 0 0 0 25 0 1 0 639047502 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22657/statm: 0 0 0 0 0 0 0
[pid=22658] ppid=22646 vsize=299548 CPUtime=1.96 cores=0,2,4,6
/proc/22658/stat : 22658 (python) R 22646 22646 20819 0 -1 4202560 937 0 0 0 166 30 0 0 17 0 1 0 639047503 306737152 5707 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051485503 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/22658/statm: 74887 5707 371 364 0 10799 0
[pid=22660] ppid=22658 vsize=0 CPUtime=36.95 cores=0,2,4,6
/proc/22660/stat : 22660 (march_hi) R 22658 22660 22660 0 -1 4202500 1206 0 0 0 3695 0 0 0 25 0 1 0 639047503 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/22660/statm: 0 0 0 0 0 0 0
[pid=22661] ppid=22646 vsize=309940 CPUtime=1.31 cores=0,2,4,6
/proc/22661/stat : 22661 (python) R 22646 22646 20819 0 -1 4202560 939 0 0 0 109 22 0 0 17 0 1 0 639047504 317378560 5728 33554432000 4194304 5683644 140736685513040 18446744073709551615 4884891 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/22661/statm: 77485 5728 371 364 0 13394 0
[pid=22663] ppid=22661 vsize=0 CPUtime=37.17 cores=0,2,4,6
/proc/22663/stat : 22663 (march_hi) R 22661 22663 22663 0 -1 4202500 1205 0 0 0 3717 0 0 0 25 0 1 0 639047504 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/22663/statm: 0 0 0 0 0 0 0
[pid=22646/tid=22653] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22653/stat : 22653 (python) S 22644 22646 20819 0 -1 4202560 24 932 0 0 0 0 0 0 19 0 5 0 639047501 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
[pid=22646/tid=22656] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22656/stat : 22656 (python) S 22644 22646 20819 0 -1 4202560 23 932 0 0 0 0 0 0 21 0 5 0 639047502 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22659] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22659/stat : 22659 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 23 0 5 0 639047503 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22662] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22662/stat : 22662 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 5 0 639047504 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 155.66
Current children cumulated vsize (KiB) 2515192

[startup+39.7008 s]
/proc/loadavg: 8.12 8.18 8.02 13/462 22796
/proc/meminfo: memFree=21883228/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=320184 CPUtime=0.48 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 12138 932 1 0 37 11 0 0 19 0 5 0 639047447 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22646/statm: 80046 7242 1881 364 0 15955 0
[pid=22652] ppid=22646 vsize=278428 CPUtime=0.1 cores=0,2,4,6
/proc/22652/stat : 22652 (python) S 22646 22646 20819 0 -1 4202560 907 0 0 0 5 5 0 0 18 0 1 0 639047501 285110272 5553 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675407 0 0 16781312 514 7011787960467030275 0 0 17 4 0 0 0
/proc/22652/statm: 69607 5553 377 364 0 5525 0
[pid=22654] ppid=22652 vsize=1017800 CPUtime=38.91 cores=0,2,4,6
/proc/22654/stat : 22654 (gnovelty+2) R 22652 22654 22654 0 -1 4202496 430 0 0 0 3891 0 0 0 25 0 1 0 639047502 1042227200 168 33554432000 134512640 135663704 4291254912 18446744073709551615 134525535 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22654/statm: 254450 168 113 282 0 254166 0
[pid=22655] ppid=22646 vsize=289292 CPUtime=1.98 cores=0,2,4,6
/proc/22655/stat : 22655 (python) R 22646 22646 20819 0 -1 4202560 942 0 0 0 172 26 0 0 17 0 1 0 639047502 296235008 5703 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675462 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/22655/statm: 72323 5703 371 364 0 8238 0
[pid=22657] ppid=22655 vsize=0 CPUtime=37.16 cores=0,2,4,6
/proc/22657/stat : 22657 (march_hi) R 22655 22657 22657 0 -1 4202500 1209 0 0 0 3716 0 0 0 25 0 1 0 639047502 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22657/statm: 0 0 0 0 0 0 0
[pid=22658] ppid=22646 vsize=299548 CPUtime=2.15 cores=0,2,4,6
/proc/22658/stat : 22658 (python) R 22646 22646 20819 0 -1 4202560 937 0 0 0 182 33 0 0 18 0 1 0 639047503 306737152 5707 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051485503 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/22658/statm: 74887 5707 371 364 0 10799 0
[pid=22660] ppid=22658 vsize=0 CPUtime=36.95 cores=0,2,4,6
/proc/22660/stat : 22660 (march_hi) R 22658 22660 22660 0 -1 4202500 1206 0 0 0 3695 0 0 0 25 0 1 0 639047503 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/22660/statm: 0 0 0 0 0 0 0
[pid=22661] ppid=22646 vsize=309940 CPUtime=1.5 cores=0,2,4,6
/proc/22661/stat : 22661 (python) R 22646 22646 20819 0 -1 4202560 939 0 0 0 126 24 0 0 17 0 1 0 639047504 317378560 5728 33554432000 4194304 5683644 140736685513040 18446744073709551615 4509705 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/22661/statm: 77485 5728 371 364 0 13394 0
[pid=22663] ppid=22661 vsize=0 CPUtime=37.17 cores=0,2,4,6
/proc/22663/stat : 22663 (march_hi) R 22661 22663 22663 0 -1 4202500 1205 0 0 0 3717 0 0 0 25 0 1 0 639047504 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/22663/statm: 0 0 0 0 0 0 0
[pid=22646/tid=22653] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22653/stat : 22653 (python) S 22644 22646 20819 0 -1 4202560 24 932 0 0 0 0 0 0 19 0 5 0 639047501 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
[pid=22646/tid=22656] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22656/stat : 22656 (python) S 22644 22646 20819 0 -1 4202560 23 932 0 0 0 0 0 0 21 0 5 0 639047502 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22659] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22659/stat : 22659 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 23 0 5 0 639047503 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22662] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22662/stat : 22662 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 5 0 639047504 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 156.4
Current children cumulated vsize (KiB) 2515192

[startup+39.8008 s]
/proc/loadavg: 8.12 8.18 8.02 13/462 22796
/proc/meminfo: memFree=21883228/32951124 swapFree=51873460/67111528
[pid=22646] ppid=22644 vsize=320184 CPUtime=0.48 cores=0,2,4,6
/proc/22646/stat : 22646 (python) S 22644 22646 20819 0 -1 4202496 12138 932 1 0 37 11 0 0 19 0 5 0 639047447 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051482059 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22646/statm: 80046 7242 1881 364 0 15955 0
[pid=22652] ppid=22646 vsize=278428 CPUtime=0.1 cores=0,2,4,6
/proc/22652/stat : 22652 (python) S 22646 22646 20819 0 -1 4202560 907 0 0 0 5 5 0 0 18 0 1 0 639047501 285110272 5553 33554432000 4194304 5683644 140736685513040 18446744073709551615 212039675407 0 0 16781312 514 7011787960467030275 0 0 17 4 0 0 0
/proc/22652/statm: 69607 5553 377 364 0 5525 0
[pid=22654] ppid=22652 vsize=1017800 CPUtime=39.01 cores=0,2,4,6
/proc/22654/stat : 22654 (gnovelty+2) R 22652 22654 22654 0 -1 4202496 430 0 0 0 3901 0 0 0 25 0 1 0 639047502 1042227200 168 33554432000 134512640 135663704 4291254912 18446744073709551615 134525506 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22654/statm: 254450 168 113 282 0 254166 0
[pid=22655] ppid=22646 vsize=289292 CPUtime=2.08 cores=0,2,4,6
/proc/22655/stat : 22655 (python) R 22646 22646 20819 0 -1 4202560 942 0 0 0 181 27 0 0 18 0 1 0 639047502 296235008 5703 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051485503 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/22655/statm: 72323 5703 371 364 0 8238 0
[pid=22657] ppid=22655 vsize=0 CPUtime=37.16 cores=0,2,4,6
/proc/22657/stat : 22657 (march_hi) R 22655 22657 22657 0 -1 4202500 1209 0 0 0 3716 0 0 0 25 0 1 0 639047502 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22657/statm: 0 0 0 0 0 0 0
[pid=22658] ppid=22646 vsize=299548 CPUtime=2.25 cores=0,2,4,6
/proc/22658/stat : 22658 (python) R 22646 22646 20819 0 -1 4202560 937 0 0 0 190 35 0 0 18 0 1 0 639047503 306737152 5707 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051485503 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/22658/statm: 74887 5707 371 364 0 10799 0
[pid=22660] ppid=22658 vsize=0 CPUtime=36.95 cores=0,2,4,6
/proc/22660/stat : 22660 (march_hi) R 22658 22660 22660 0 -1 4202500 1206 0 0 0 3695 0 0 0 25 0 1 0 639047503 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/22660/statm: 0 0 0 0 0 0 0
[pid=22661] ppid=22646 vsize=309940 CPUtime=1.59 cores=0,2,4,6
/proc/22661/stat : 22661 (python) R 22646 22646 20819 0 -1 4202560 939 0 0 0 134 25 0 0 17 0 1 0 639047504 317378560 5728 33554432000 4194304 5683644 140736685513040 18446744073709551615 4531453 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/22661/statm: 77485 5728 371 364 0 13394 0
[pid=22663] ppid=22661 vsize=0 CPUtime=37.17 cores=0,2,4,6
/proc/22663/stat : 22663 (march_hi) R 22661 22663 22663 0 -1 4202500 1205 0 0 0 3717 0 0 0 25 0 1 0 639047504 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 6 0 0 0
/proc/22663/statm: 0 0 0 0 0 0 0
[pid=22646/tid=22653] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22653/stat : 22653 (python) S 22644 22646 20819 0 -1 4202560 24 932 0 0 0 0 0 0 19 0 5 0 639047501 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
[pid=22646/tid=22656] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22656/stat : 22656 (python) S 22644 22646 20819 0 -1 4202560 23 932 0 0 0 0 0 0 21 0 5 0 639047502 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22659] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22659/stat : 22659 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 23 0 5 0 639047503 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 2 0 0 0
[pid=22646/tid=22662] ppid=22644 vsize=320184 CPUtime=0 cores=0,2,4,6
/proc/22646/task/22662/stat : 22662 (python) S 22644 22646 20819 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 5 0 639047504 327868416 7242 33554432000 4194304 5683644 140736685513040 18446744073709551615 212051478961 0 0 16781312 2 18446604452428456320 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 156.79
Current children cumulated vsize (KiB) 2515192

Child status: 0
Real time (s): 39.8877
CPU time (s): 157.171
CPU user time (s): 156.069
CPU system time (s): 1.10183
CPU usage (%): 394.034
Max. virtual memory (cumulated for all children) (KiB): 2529532

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 156.069
system time used= 1.10183
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25650
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3152
involuntary context switches= 2862

runsolver used 0.186971 second user time and 0.39294 second system time

The end

Launcher Data 

Begin job on node146 at 2011-05-15 15:31:52
IDJOB=3378584
IDBENCH=82993
IDSOLVER=1859
FILE ID=node146/3378584-1305466312
RUNJOBID= node146-1305463158-20837
PBS_JOBID= 13324984
Free space on /tmp= 73260 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v400-c1704-S690749326-001.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378584-1305466312/watcher-3378584-1305466312 -o /tmp/evaluation-result-3378584-1305466312/solver-3378584-1305466312 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378584-1305466312.cnf -seed 1949294598 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 20f33ec190b502d21efebab5417989ef
RANDOM SEED=1949294598

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21816292 kB
Buffers:        154408 kB
Cached:        1084748 kB
SwapCached:      56148 kB
Active:        8337532 kB
Inactive:      2520168 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21816292 kB
SwapTotal:    67111528 kB
SwapFree:     51873460 kB
Dirty:           32792 kB
Writeback:           0 kB
AnonPages:     9569972 kB
Mapped:          30364 kB
Slab:           115876 kB
PageTables:      91720 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 127108024 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73228 MiB
End job on node146 at 2011-05-15 15:32:32