Trace number 3386987

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)UNSAT 867.994 864.214

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v60-c5340-S1831136826-075.UNKNOWN.cnf
MD5SUM1e7a565e93334fc4a75fcaa13a0d446a
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark364.595
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of clauses5340
Sum of the clauses size37380
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55340

Solver Data 

0.34/0.64	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.34/0.64	c INFO: solving HOME/instance-3386987-1305595713.cnf
0.34/0.64	c INFO: computing task features
0.34/0.68	c INFO: computed variable-clause graph statistics
0.34/0.68	c INFO: computed clause balance statistics
0.52/0.87	c INFO: computed variable balance statistics
0.62/0.94	c INFO: computed small-clause counts
0.62/0.94	c INFO: computed Horn-clause counts
0.62/0.95	c INFO: computed variable graph statistics
0.62/0.95	c INFO: collected features for HOME/instance-3386987-1305595713.cnf in 0.30 s
0.62/0.98	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.54)
99.51/99.45	c INFO: running gnovelty+2@0 for 97 with 4901 remaining (b = 0.09)
200.47/199.92	c INFO: running adaptg2wsat2009++@0 for 97 with 4800 remaining (b = 0.04)
300.39/299.40	c INFO: running adaptg2wsat2009++@0 for 97 with 4701 remaining (b = 0.03)
400.19/398.88	c INFO: running adaptg2wsat2009++@0 for 97 with 4601 remaining (b = 0.03)
500.16/498.36	c INFO: running march_hi@0 for 388 with 4502 remaining (b = 0.09)
867.78/864.19	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386987-1305595713/watcher-3386987-1305595713 -o /tmp/evaluation-result-3386987-1305595713/solver-3386987-1305595713 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386987-1305595713.cnf -seed 1921214857 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 4.01 4.00 4/582 12146
/proc/meminfo: memFree=12540108/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=15772 CPUtime=0 cores=1,3,5,7
/proc/12146/stat : 12146 (python) R 12144 12146 10801 0 -1 4202496 897 0 0 0 0 0 0 0 25 0 1 0 671169029 16150528 778 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687718535 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/12146/statm: 3943 778 343 364 0 430 0

[startup+0.0998111 s]
/proc/loadavg: 4.00 4.01 4.00 4/582 12146
/proc/meminfo: memFree=12540108/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=87708 CPUtime=0.05 cores=1,3,5,7
/proc/12146/stat : 12146 (python) R 12144 12146 10801 0 -1 4202496 2638 0 0 0 4 1 0 0 17 0 1 0 671169029 89812992 2355 33554432000 4194304 5683644 140734322719712 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/12146/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 87708

[startup+0.100804 s]
/proc/loadavg: 4.00 4.01 4.00 4/582 12146
/proc/meminfo: memFree=12540108/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=89768 CPUtime=0.05 cores=1,3,5,7
/proc/12146/stat : 12146 (python) R 12144 12146 10801 0 -1 4202496 2672 0 0 0 4 1 0 0 17 0 1 0 671169029 91922432 2388 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687671141 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/12146/statm: 22442 2388 750 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 89768

[startup+0.300813 s]
/proc/loadavg: 4.00 4.01 4.00 4/582 12146
/proc/meminfo: memFree=12540108/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=135748 CPUtime=0.17 cores=1,3,5,7
/proc/12146/stat : 12146 (python) R 12144 12146 10801 0 -1 4202496 5970 937 1 0 13 4 0 0 17 0 1 0 671169029 139005952 4149 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687671301 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/12146/statm: 33937 4149 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135748

[startup+0.700722 s]
/proc/loadavg: 4.00 4.01 4.00 4/582 12146
/proc/meminfo: memFree=12540108/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=279652 CPUtime=0.42 cores=1,3,5,7
/proc/12146/stat : 12146 (python) R 12144 12146 10801 0 -1 4202496 9711 937 1 0 33 9 0 0 15 0 1 0 671169029 286363648 7298 33554432000 4194304 5683644 140734322719712 18446744073709551615 4619985 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/12146/statm: 69913 7298 1826 364 0 5837 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 279652

[startup+1.50055 s]
/proc/loadavg: 4.00 4.01 4.00 5/586 12154
/proc/meminfo: memFree=12513788/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=289192 CPUtime=0.7 cores=1,3,5,7
/proc/12146/stat : 12146 (python) S 12144 12146 10801 0 -1 4202496 10009 937 1 0 61 9 0 0 17 0 2 0 671169029 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12146/statm: 72298 7203 1877 364 0 8216 0
[pid=12152] ppid=12146 vsize=278948 CPUtime=0 cores=1,3,5,7
/proc/12152/stat : 12152 (python) S 12146 12146 10801 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 671169127 285642752 5676 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687695375 0 0 16781312 514 16836852621632339967 0 0 17 1 0 0 0
/proc/12152/statm: 69737 5676 354 364 0 5655 0
[pid=12154] ppid=12152 vsize=1017932 CPUtime=0.51 cores=1,3,5,7
/proc/12154/stat : 12154 (gnovelty+2) R 12152 12154 12154 0 -1 4202496 513 0 0 0 51 0 0 0 20 0 1 0 671169127 1042362368 247 33554432000 134512640 135663704 4287827232 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12154/statm: 254483 247 113 282 0 254199 0
[pid=12146/tid=12153] ppid=12144 vsize=289192 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12153/stat : 12153 (python) S 12144 12146 10801 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 2 0 671169127 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 1586072

[startup+3.10027 s]
/proc/loadavg: 4.00 4.01 4.00 5/586 12154
/proc/meminfo: memFree=12513168/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=289192 CPUtime=0.7 cores=1,3,5,7
/proc/12146/stat : 12146 (python) S 12144 12146 10801 0 -1 4202496 10009 937 1 0 61 9 0 0 17 0 2 0 671169029 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12146/statm: 72298 7203 1877 364 0 8216 0
[pid=12152] ppid=12146 vsize=278948 CPUtime=0 cores=1,3,5,7
/proc/12152/stat : 12152 (python) S 12146 12146 10801 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 671169127 285642752 5676 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687695375 0 0 16781312 514 16836852621632307464 0 0 17 1 0 0 0
/proc/12152/statm: 69737 5676 354 364 0 5655 0
[pid=12154] ppid=12152 vsize=1017932 CPUtime=2.11 cores=1,3,5,7
/proc/12154/stat : 12154 (gnovelty+2) R 12152 12154 12154 0 -1 4202496 513 0 0 0 211 0 0 0 25 0 1 0 671169127 1042362368 247 33554432000 134512640 135663704 4287827232 18446744073709551615 134524718 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12154/statm: 254483 247 113 282 0 254199 0
[pid=12146/tid=12153] ppid=12144 vsize=289192 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12153/stat : 12153 (python) S 12144 12146 10801 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 2 0 671169127 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.81
Current children cumulated vsize (KiB) 1586072

[startup+6.30067 s]
/proc/loadavg: 4.24 4.06 4.02 5/586 12155
/proc/meminfo: memFree=12511680/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=289192 CPUtime=0.7 cores=1,3,5,7
/proc/12146/stat : 12146 (python) S 12144 12146 10801 0 -1 4202496 10009 937 1 0 61 9 0 0 17 0 2 0 671169029 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12146/statm: 72298 7203 1877 364 0 8216 0
[pid=12152] ppid=12146 vsize=278948 CPUtime=0.02 cores=1,3,5,7
/proc/12152/stat : 12152 (python) S 12146 12146 10801 0 -1 4202560 878 0 0 0 1 1 0 0 18 0 1 0 671169127 285642752 5699 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687695375 0 0 16781312 514 16836852621632307464 0 0 17 7 0 0 0
/proc/12152/statm: 69737 5699 377 364 0 5655 0
[pid=12154] ppid=12152 vsize=1017932 CPUtime=5.31 cores=1,3,5,7
/proc/12154/stat : 12154 (gnovelty+2) R 12152 12154 12154 0 -1 4202496 513 0 0 0 531 0 0 0 25 0 1 0 671169127 1042362368 247 33554432000 134512640 135663704 4287827232 18446744073709551615 134544259 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12154/statm: 254483 247 113 282 0 254199 0
[pid=12146/tid=12153] ppid=12144 vsize=289192 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12153/stat : 12153 (python) S 12144 12146 10801 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 2 0 671169127 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 1586072

[startup+12.7005 s]
/proc/loadavg: 4.22 4.06 4.02 5/586 12155
/proc/meminfo: memFree=12510640/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=289192 CPUtime=0.7 cores=1,3,5,7
/proc/12146/stat : 12146 (python) S 12144 12146 10801 0 -1 4202496 10009 937 1 0 61 9 0 0 17 0 2 0 671169029 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12146/statm: 72298 7203 1877 364 0 8216 0
[pid=12152] ppid=12146 vsize=278948 CPUtime=0.04 cores=1,3,5,7
/proc/12152/stat : 12152 (python) S 12146 12146 10801 0 -1 4202560 883 0 0 0 1 3 0 0 18 0 1 0 671169127 285642752 5699 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687695375 0 0 16781312 514 11682742053678055688 0 0 17 7 0 0 0
/proc/12152/statm: 69737 5699 377 364 0 5655 0
[pid=12154] ppid=12152 vsize=1017932 CPUtime=11.71 cores=1,3,5,7
/proc/12154/stat : 12154 (gnovelty+2) R 12152 12154 12154 0 -1 4202496 513 0 0 0 1171 0 0 0 25 0 1 0 671169127 1042362368 247 33554432000 134512640 135663704 4287827232 18446744073709551615 134545631 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12154/statm: 254483 247 113 282 0 254199 0
[pid=12146/tid=12153] ppid=12144 vsize=289192 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12153/stat : 12153 (python) S 12144 12146 10801 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 2 0 671169127 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.45
Current children cumulated vsize (KiB) 1586072

[startup+25.5012 s]
/proc/loadavg: 4.17 4.05 4.01 5/586 12155
/proc/meminfo: memFree=12509748/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=289192 CPUtime=0.7 cores=1,3,5,7
/proc/12146/stat : 12146 (python) S 12144 12146 10801 0 -1 4202496 10009 937 1 0 61 9 0 0 17 0 2 0 671169029 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12146/statm: 72298 7203 1877 364 0 8216 0
[pid=12152] ppid=12146 vsize=278948 CPUtime=0.09 cores=1,3,5,7
/proc/12152/stat : 12152 (python) S 12146 12146 10801 0 -1 4202560 888 0 0 0 4 5 0 0 18 0 1 0 671169127 285642752 5699 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687695375 0 0 16781312 514 11682742053678055688 0 0 17 7 0 0 0
/proc/12152/statm: 69737 5699 377 364 0 5655 0
[pid=12154] ppid=12152 vsize=1017932 CPUtime=24.51 cores=1,3,5,7
/proc/12154/stat : 12154 (gnovelty+2) R 12152 12154 12154 0 -1 4202496 513 0 0 0 2451 0 0 0 25 0 1 0 671169127 1042362368 247 33554432000 134512640 135663704 4287827232 18446744073709551615 134525271 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12154/statm: 254483 247 113 282 0 254199 0
[pid=12146/tid=12153] ppid=12144 vsize=289192 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12153/stat : 12153 (python) S 12144 12146 10801 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 2 0 671169127 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.3
Current children cumulated vsize (KiB) 1586072

[startup+51.1005 s]
/proc/loadavg: 4.11 4.05 4.01 5/589 12159
/proc/meminfo: memFree=12504872/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=289192 CPUtime=0.7 cores=1,3,5,7
/proc/12146/stat : 12146 (python) S 12144 12146 10801 0 -1 4202496 10009 937 1 0 61 9 0 0 17 0 2 0 671169029 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12146/statm: 72298 7203 1877 364 0 8216 0
[pid=12152] ppid=12146 vsize=278948 CPUtime=0.2 cores=1,3,5,7
/proc/12152/stat : 12152 (python) S 12146 12146 10801 0 -1 4202560 900 0 0 0 10 10 0 0 18 0 1 0 671169127 285642752 5699 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687695375 0 0 16781312 514 11682742053678055688 0 0 17 7 0 0 0
/proc/12152/statm: 69737 5699 377 364 0 5655 0
[pid=12154] ppid=12152 vsize=1017932 CPUtime=50.11 cores=1,3,5,7
/proc/12154/stat : 12154 (gnovelty+2) R 12152 12154 12154 0 -1 4202496 513 0 0 0 5011 0 0 0 25 0 1 0 671169127 1042362368 247 33554432000 134512640 135663704 4287827232 18446744073709551615 134524961 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12154/statm: 254483 247 113 282 0 254199 0
[pid=12146/tid=12153] ppid=12144 vsize=289192 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12153/stat : 12153 (python) S 12144 12146 10801 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 2 0 671169127 296132608 7203 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 51.01
Current children cumulated vsize (KiB) 1586072

[startup+102.321 s]
/proc/loadavg: 4.09 4.05 4.01 5/593 12164
/proc/meminfo: memFree=12501220/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=299448 CPUtime=0.72 cores=1,3,5,7
/proc/12146/stat : 12146 (python) S 12144 12146 10801 0 -1 4202496 10895 937 1 0 63 9 0 0 19 0 3 0 671169029 306634752 7210 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12146/statm: 74862 7210 1880 364 0 10777 0
[pid=12152] ppid=12146 vsize=289192 CPUtime=0.42 cores=1,3,5,7
/proc/12152/stat : 12152 (python) S 12146 12146 10801 0 -1 4202560 1078 0 0 0 21 21 0 0 19 0 2 0 671169127 296132608 5737 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12152/statm: 72298 5737 410 364 0 8216 0
[pid=12154] ppid=12152 vsize=1017932 CPUtime=98.43 cores=1,3,5,7
/proc/12154/stat : 12154 (gnovelty+2) T 12152 12154 12154 0 -1 4202496 513 0 0 0 9843 0 0 0 25 0 1 0 671169127 1042362368 247 33554432000 134512640 135663704 4287827232 18446744073709551615 134525224 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12154/statm: 254483 247 113 282 0 254199 0
[pid=12152/tid=12161] ppid=12146 vsize=289192 CPUtime=0 cores=1,3,5,7
/proc/12152/task/12161/stat : 12161 (python) S 12146 12146 10801 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 671178971 296132608 5737 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604469717730368 0 0 -1 7 0 0 0
[pid=12162] ppid=12146 vsize=289204 CPUtime=0 cores=1,3,5,7
/proc/12162/stat : 12162 (python) S 12146 12146 10801 0 -1 4202560 746 0 0 0 0 0 0 0 18 0 1 0 671178974 296144896 5674 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687695430 0 0 16781312 514 11153824738210447620 0 0 17 7 0 0 0
/proc/12162/statm: 72301 5674 348 364 0 8216 0
[pid=12164] ppid=12162 vsize=1017932 CPUtime=2.86 cores=1,3,5,7
/proc/12164/stat : 12164 (gnovelty+2) R 12162 12164 12164 0 -1 4202496 511 0 0 0 286 0 0 0 25 0 1 0 671178974 1042362368 247 33554432000 134512640 135663704 4289303728 18446744073709551615 134525162 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12164/statm: 254483 247 113 282 0 254199 0
[pid=12146/tid=12153] ppid=12144 vsize=299448 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12153/stat : 12153 (python) S 12144 12146 10801 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 3 0 671169127 306634752 7210 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12163] ppid=12144 vsize=299448 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12163/stat : 12163 (python) S 12144 12146 10801 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 3 0 671178974 306634752 7210 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 102.43
Current children cumulated vsize (KiB) 2913708

[startup+162.301 s]
/proc/loadavg: 4.03 4.04 4.01 5/594 12167
/proc/meminfo: memFree=12493268/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=299448 CPUtime=0.72 cores=1,3,5,7
/proc/12146/stat : 12146 (python) S 12144 12146 10801 0 -1 4202496 10895 937 1 0 63 9 0 0 19 0 3 0 671169029 306634752 7210 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12146/statm: 74862 7210 1880 364 0 10777 0
[pid=12152] ppid=12146 vsize=289192 CPUtime=0.42 cores=1,3,5,7

################
# More data... #
################

/proc/12185/statm: 104197 363 59 146 0 103073 0
[pid=12183/tid=12189] ppid=12146 vsize=320420 CPUtime=0 cores=1,3,5,7
/proc/12183/task/12189/stat : 12189 (python) S 12146 12146 10801 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 671218862 328110080 5819 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604461875048640 0 0 -1 7 0 0 0
[pid=12190] ppid=12146 vsize=330676 CPUtime=1.81 cores=1,3,5,7
/proc/12190/stat : 12190 (python) S 12146 12146 10801 0 -1 4202560 1015 0 0 0 94 87 0 0 15 0 1 0 671218865 338612224 5818 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687695430 0 0 16781312 514 2921798223481766152 0 0 17 7 0 0 0
/proc/12190/statm: 82669 5818 371 364 0 18572 0
[pid=12192] ppid=12190 vsize=3932 CPUtime=364.74 cores=1,3,5,7
/proc/12192/stat : 12192 (march_hi) R 12190 12192 12192 0 -1 4202496 1692 0 0 0 36474 0 0 0 25 0 1 0 671218865 4026368 797 33554432000 4194304 4955518 140733221715216 18446744073709551615 4237786 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12192/statm: 983 797 106 186 0 796 0
[pid=12146/tid=12153] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12153/stat : 12153 (python) S 12144 12146 10801 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 7 0 671169127 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12163] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12163/stat : 12163 (python) S 12144 12146 10801 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 7 0 671178974 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12171] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12171/stat : 12171 (python) S 12144 12146 10801 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 7 0 671189022 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12177] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12177/stat : 12177 (python) S 12144 12146 10801 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 7 0 671198970 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12184] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12184/stat : 12184 (python) S 12144 12146 10801 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 7 0 671208917 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12191] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12191/stat : 12191 (python) S 12144 12146 10801 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 7 0 671218865 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 866.77
Current children cumulated vsize (KiB) 5470300

[startup+863.901 s]
/proc/loadavg: 4.01 4.04 4.00 5/614 12205
/proc/meminfo: memFree=12370336/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=340920 CPUtime=0.87 cores=1,3,5,7
/proc/12146/stat : 12146 (python) S 12144 12146 10801 0 -1 4202496 14384 937 1 0 76 11 0 0 19 0 7 0 671169029 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12146/statm: 85230 7339 1888 364 0 21133 0
[pid=12152] ppid=12146 vsize=289192 CPUtime=0.42 cores=1,3,5,7
/proc/12152/stat : 12152 (python) S 12146 12146 10801 0 -1 4202560 1078 0 0 0 21 21 0 0 19 0 2 0 671169127 296132608 5737 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12152/statm: 72298 5737 410 364 0 8216 0
[pid=12154] ppid=12152 vsize=1017932 CPUtime=98.43 cores=1,3,5,7
/proc/12154/stat : 12154 (gnovelty+2) T 12152 12154 12154 0 -1 4202496 513 0 0 0 9843 0 0 0 25 0 1 0 671169127 1042362368 247 33554432000 134512640 135663704 4287827232 18446744073709551615 134525224 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12154/statm: 254483 247 113 282 0 254199 0
[pid=12152/tid=12161] ppid=12146 vsize=289192 CPUtime=0 cores=1,3,5,7
/proc/12152/task/12161/stat : 12161 (python) S 12146 12146 10801 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 671178971 296132608 5737 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604469717730368 0 0 -1 7 0 0 0
[pid=12162] ppid=12146 vsize=289204 CPUtime=0.44 cores=1,3,5,7
/proc/12162/stat : 12162 (python) S 12146 12146 10801 0 -1 4202560 1081 0 0 0 22 22 0 0 19 0 2 0 671178974 296144896 5727 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12162/statm: 72301 5727 400 364 0 8216 0
[pid=12164] ppid=12162 vsize=1017932 CPUtime=100.44 cores=1,3,5,7
/proc/12164/stat : 12164 (gnovelty+2) T 12162 12164 12164 0 -1 4202496 511 0 0 0 10044 0 0 0 25 0 1 0 671178974 1042362368 247 33554432000 134512640 135663704 4289303728 18446744073709551615 134525276 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12164/statm: 254483 247 113 282 0 254199 0
[pid=12162/tid=12169] ppid=12146 vsize=289204 CPUtime=0 cores=1,3,5,7
/proc/12162/task/12169/stat : 12169 (python) S 12146 12146 10801 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 671189019 296144896 5727 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604464099580032 0 0 -1 7 0 0 0
[pid=12170] ppid=12146 vsize=299736 CPUtime=0.43 cores=1,3,5,7
/proc/12170/stat : 12170 (python) S 12146 12146 10801 0 -1 4202560 1090 0 0 0 21 22 0 0 19 0 2 0 671189022 306929664 5768 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12170/statm: 74934 5768 400 364 0 10846 0
[pid=12172] ppid=12170 vsize=416788 CPUtime=99.44 cores=1,3,5,7
/proc/12172/stat : 12172 (adaptg2wsat2009) T 12170 12172 12172 0 -1 4202496 632 0 0 0 9944 0 0 0 25 0 1 0 671189022 426790912 365 33554432000 134512640 135107411 4286783664 18446744073709551615 134531613 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12172/statm: 104197 365 59 146 0 103073 0
[pid=12170/tid=12175] ppid=12146 vsize=299736 CPUtime=0 cores=1,3,5,7
/proc/12170/task/12175/stat : 12175 (python) S 12146 12146 10801 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 671198966 306929664 5768 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604470159159616 0 0 -1 7 0 0 0
[pid=12176] ppid=12146 vsize=309992 CPUtime=0.44 cores=1,3,5,7
/proc/12176/stat : 12176 (python) S 12146 12146 10801 0 -1 4202560 1104 0 0 0 24 20 0 0 19 0 2 0 671198969 317431808 5793 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12176/statm: 77498 5793 400 364 0 13407 0
[pid=12178] ppid=12176 vsize=416788 CPUtime=99.43 cores=1,3,5,7
/proc/12178/stat : 12178 (adaptg2wsat2009) T 12176 12178 12178 0 -1 4202496 630 0 0 0 9943 0 0 0 25 0 1 0 671198970 426790912 362 33554432000 134512640 135107411 4290063328 18446744073709551615 134537748 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12178/statm: 104197 362 59 146 0 103073 0
[pid=12176/tid=12182] ppid=12146 vsize=309992 CPUtime=0 cores=1,3,5,7
/proc/12176/task/12182/stat : 12182 (python) S 12146 12146 10801 0 -1 4202560 52 0 0 0 0 0 0 0 19 0 2 0 671208914 317431808 5793 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604470736623488 0 0 -1 7 0 0 0
[pid=12183] ppid=12146 vsize=320420 CPUtime=0.44 cores=1,3,5,7
/proc/12183/stat : 12183 (python) S 12146 12146 10801 0 -1 4202560 1102 0 0 0 22 22 0 0 19 0 2 0 671208917 328110080 5819 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12183/statm: 80105 5819 400 364 0 16011 0
[pid=12185] ppid=12183 vsize=416788 CPUtime=99.44 cores=1,3,5,7
/proc/12185/stat : 12185 (adaptg2wsat2009) T 12183 12185 12185 0 -1 4202496 635 0 0 0 9944 0 0 0 25 0 1 0 671208917 426790912 363 33554432000 134512640 135107411 4293384656 18446744073709551615 134532135 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12185/statm: 104197 363 59 146 0 103073 0
[pid=12183/tid=12189] ppid=12146 vsize=320420 CPUtime=0 cores=1,3,5,7
/proc/12183/task/12189/stat : 12189 (python) S 12146 12146 10801 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 671218862 328110080 5819 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604461875048640 0 0 -1 7 0 0 0
[pid=12190] ppid=12146 vsize=330676 CPUtime=1.82 cores=1,3,5,7
/proc/12190/stat : 12190 (python) S 12146 12146 10801 0 -1 4202560 1017 0 0 0 95 87 0 0 15 0 1 0 671218865 338612224 5818 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687695430 0 0 16781312 514 5607494604279480584 0 0 17 7 0 0 0
/proc/12190/statm: 82669 5818 371 364 0 18572 0
[pid=12192] ppid=12190 vsize=4696 CPUtime=365.54 cores=1,3,5,7
/proc/12192/stat : 12192 (march_hi) R 12190 12192 12192 0 -1 4202496 1694 0 0 0 36554 0 0 0 25 0 1 0 671218865 4808704 799 33554432000 4194304 4955518 140733221715216 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12192/statm: 1174 799 106 186 0 987 0
[pid=12146/tid=12153] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12153/stat : 12153 (python) S 12144 12146 10801 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 7 0 671169127 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12163] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12163/stat : 12163 (python) S 12144 12146 10801 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 7 0 671178974 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12171] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12171/stat : 12171 (python) S 12144 12146 10801 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 7 0 671189022 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12177] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12177/stat : 12177 (python) S 12144 12146 10801 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 7 0 671198970 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12184] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12184/stat : 12184 (python) S 12144 12146 10801 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 7 0 671208917 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12191] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12191/stat : 12191 (python) S 12144 12146 10801 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 7 0 671218865 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 867.58
Current children cumulated vsize (KiB) 5471064

[startup+864.101 s]
/proc/loadavg: 4.01 4.04 4.00 5/614 12205
/proc/meminfo: memFree=12370336/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=340920 CPUtime=0.87 cores=1,3,5,7
/proc/12146/stat : 12146 (python) S 12144 12146 10801 0 -1 4202496 14384 937 1 0 76 11 0 0 19 0 7 0 671169029 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/12146/statm: 85230 7339 1888 364 0 21133 0
[pid=12152] ppid=12146 vsize=289192 CPUtime=0.42 cores=1,3,5,7
/proc/12152/stat : 12152 (python) S 12146 12146 10801 0 -1 4202560 1078 0 0 0 21 21 0 0 19 0 2 0 671169127 296132608 5737 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12152/statm: 72298 5737 410 364 0 8216 0
[pid=12154] ppid=12152 vsize=1017932 CPUtime=98.43 cores=1,3,5,7
/proc/12154/stat : 12154 (gnovelty+2) T 12152 12154 12154 0 -1 4202496 513 0 0 0 9843 0 0 0 25 0 1 0 671169127 1042362368 247 33554432000 134512640 135663704 4287827232 18446744073709551615 134525224 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12154/statm: 254483 247 113 282 0 254199 0
[pid=12152/tid=12161] ppid=12146 vsize=289192 CPUtime=0 cores=1,3,5,7
/proc/12152/task/12161/stat : 12161 (python) S 12146 12146 10801 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 671178971 296132608 5737 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604469717730368 0 0 -1 7 0 0 0
[pid=12162] ppid=12146 vsize=289204 CPUtime=0.44 cores=1,3,5,7
/proc/12162/stat : 12162 (python) S 12146 12146 10801 0 -1 4202560 1081 0 0 0 22 22 0 0 19 0 2 0 671178974 296144896 5727 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12162/statm: 72301 5727 400 364 0 8216 0
[pid=12164] ppid=12162 vsize=1017932 CPUtime=100.44 cores=1,3,5,7
/proc/12164/stat : 12164 (gnovelty+2) T 12162 12164 12164 0 -1 4202496 511 0 0 0 10044 0 0 0 25 0 1 0 671178974 1042362368 247 33554432000 134512640 135663704 4289303728 18446744073709551615 134525276 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12164/statm: 254483 247 113 282 0 254199 0
[pid=12162/tid=12169] ppid=12146 vsize=289204 CPUtime=0 cores=1,3,5,7
/proc/12162/task/12169/stat : 12169 (python) S 12146 12146 10801 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 671189019 296144896 5727 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604464099580032 0 0 -1 7 0 0 0
[pid=12170] ppid=12146 vsize=299736 CPUtime=0.43 cores=1,3,5,7
/proc/12170/stat : 12170 (python) S 12146 12146 10801 0 -1 4202560 1090 0 0 0 21 22 0 0 19 0 2 0 671189022 306929664 5768 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12170/statm: 74934 5768 400 364 0 10846 0
[pid=12172] ppid=12170 vsize=416788 CPUtime=99.44 cores=1,3,5,7
/proc/12172/stat : 12172 (adaptg2wsat2009) T 12170 12172 12172 0 -1 4202496 632 0 0 0 9944 0 0 0 25 0 1 0 671189022 426790912 365 33554432000 134512640 135107411 4286783664 18446744073709551615 134531613 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12172/statm: 104197 365 59 146 0 103073 0
[pid=12170/tid=12175] ppid=12146 vsize=299736 CPUtime=0 cores=1,3,5,7
/proc/12170/task/12175/stat : 12175 (python) S 12146 12146 10801 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 671198966 306929664 5768 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604470159159616 0 0 -1 7 0 0 0
[pid=12176] ppid=12146 vsize=309992 CPUtime=0.44 cores=1,3,5,7
/proc/12176/stat : 12176 (python) S 12146 12146 10801 0 -1 4202560 1104 0 0 0 24 20 0 0 19 0 2 0 671198969 317431808 5793 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12176/statm: 77498 5793 400 364 0 13407 0
[pid=12178] ppid=12176 vsize=416788 CPUtime=99.43 cores=1,3,5,7
/proc/12178/stat : 12178 (adaptg2wsat2009) T 12176 12178 12178 0 -1 4202496 630 0 0 0 9943 0 0 0 25 0 1 0 671198970 426790912 362 33554432000 134512640 135107411 4290063328 18446744073709551615 134537748 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12178/statm: 104197 362 59 146 0 103073 0
[pid=12176/tid=12182] ppid=12146 vsize=309992 CPUtime=0 cores=1,3,5,7
/proc/12176/task/12182/stat : 12182 (python) S 12146 12146 10801 0 -1 4202560 52 0 0 0 0 0 0 0 19 0 2 0 671208914 317431808 5793 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604470736623488 0 0 -1 7 0 0 0
[pid=12183] ppid=12146 vsize=320420 CPUtime=0.44 cores=1,3,5,7
/proc/12183/stat : 12183 (python) S 12146 12146 10801 0 -1 4202560 1102 0 0 0 22 22 0 0 19 0 2 0 671208917 328110080 5819 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/12183/statm: 80105 5819 400 364 0 16011 0
[pid=12185] ppid=12183 vsize=416788 CPUtime=99.44 cores=1,3,5,7
/proc/12185/stat : 12185 (adaptg2wsat2009) T 12183 12185 12185 0 -1 4202496 635 0 0 0 9944 0 0 0 25 0 1 0 671208917 426790912 363 33554432000 134512640 135107411 4293384656 18446744073709551615 134532135 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/12185/statm: 104197 363 59 146 0 103073 0
[pid=12183/tid=12189] ppid=12146 vsize=320420 CPUtime=0 cores=1,3,5,7
/proc/12183/task/12189/stat : 12189 (python) S 12146 12146 10801 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 671218862 328110080 5819 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 514 18446604461875048640 0 0 -1 7 0 0 0
[pid=12190] ppid=12146 vsize=330676 CPUtime=1.82 cores=1,3,5,7
/proc/12190/stat : 12190 (python) S 12146 12146 10801 0 -1 4202560 1017 0 0 0 95 87 0 0 15 0 1 0 671218865 338612224 5818 33554432000 4194304 5683644 140734322719712 18446744073709551615 212687695430 0 0 16781312 514 5607494604279480584 0 0 17 7 0 0 0
/proc/12190/statm: 82669 5818 371 364 0 18572 0
[pid=12192] ppid=12190 vsize=4696 CPUtime=365.74 cores=1,3,5,7
/proc/12192/stat : 12192 (march_hi) R 12190 12192 12192 0 -1 4202496 1695 0 0 0 36574 0 0 0 25 0 1 0 671218865 4808704 800 33554432000 4194304 4955518 140733221715216 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/12192/statm: 1174 800 106 186 0 987 0
[pid=12146/tid=12153] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12153/stat : 12153 (python) S 12144 12146 10801 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 7 0 671169127 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12163] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12163/stat : 12163 (python) S 12144 12146 10801 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 7 0 671178974 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12171] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12171/stat : 12171 (python) S 12144 12146 10801 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 7 0 671189022 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12177] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12177/stat : 12177 (python) S 12144 12146 10801 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 7 0 671198970 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12184] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12184/stat : 12184 (python) S 12144 12146 10801 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 7 0 671208917 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12191] ppid=12144 vsize=340920 CPUtime=0 cores=1,3,5,7
/proc/12146/task/12191/stat : 12191 (python) S 12144 12146 10801 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 7 0 671218865 349102080 7339 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 2 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 867.78
Current children cumulated vsize (KiB) 5471064

[startup+864.201 s]
/proc/loadavg: 4.01 4.04 4.00 5/614 12205
/proc/meminfo: memFree=12370336/32951124 swapFree=67111348/67111528
[pid=12146] ppid=12144 vsize=330600 CPUtime=867.97 cores=1,3,5,7
/proc/12146/stat : 12146 (python) R 12144 12146 10801 0 -1 4202496 16551 12372 1 0 77 11 86510 199 17 0 3 0 671169029 338534400 7324 33554432000 4194304 5683644 140734322719712 18446744073709551615 5114199 0 0 16781312 0 18446744073709551615 0 0 17 3 0 0 0
/proc/12146/statm: 82650 7324 1877 364 0 18572 0
[pid=12146/tid=12184] ppid=12144 vsize=330600 CPUtime=867.09 cores=1,3,5,7
/proc/12146/task/12184/stat : 12184 (python) S 12144 12146 10801 0 -1 4202560 30 12372 0 0 0 0 86510 199 18 0 3 0 671208917 338534400 7324 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 0 18446604467764639040 0 0 -1 1 0 0 0
[pid=12146/tid=12191] ppid=12144 vsize=330600 CPUtime=867.09 cores=1,3,5,7
/proc/12146/task/12191/stat : 12191 (python) S 12144 12146 10801 0 -1 4202560 30 12372 0 0 0 0 86510 199 18 0 3 0 671218865 338534400 7324 33554432000 4194304 5683644 140734322719712 18446744073709551615 212699498929 0 0 16781312 0 18446604467764639040 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 867.97
Current children cumulated vsize (KiB) 330600

Child status: 0
Real time (s): 864.214
CPU time (s): 867.994
CPU user time (s): 865.885
CPU system time (s): 2.10868
CPU usage (%): 100.437
Max. virtual memory (cumulated for all children) (KiB): 5471064

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 865.885
system time used= 2.10868
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 31150
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4478
involuntary context switches= 1547

runsolver used 4.98324 second user time and 11.5372 second system time

The end

Launcher Data 

Begin job on node139 at 2011-05-17 03:28:33
IDJOB=3386987
IDBENCH=83052
IDSOLVER=1872
FILE ID=node139/3386987-1305595713
RUNJOBID= node139-1305586143-10820
PBS_JOBID= 13350339
Free space on /tmp= 73200 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v60-c5340-S1831136826-075.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386987-1305595713/watcher-3386987-1305595713 -o /tmp/evaluation-result-3386987-1305595713/solver-3386987-1305595713 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3386987-1305595713.cnf -seed 1921214857 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1e7a565e93334fc4a75fcaa13a0d446a
RANDOM SEED=1921214857

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12540140 kB
Buffers:        349552 kB
Cached:        3447504 kB
SwapCached:          0 kB
Active:       17852908 kB
Inactive:      2194076 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12540140 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           31840 kB
Writeback:           0 kB
AnonPages:    16249524 kB
Mapped:          50440 kB
Slab:           211740 kB
PageTables:      80860 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 170532388 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73168 MiB
End job on node139 at 2011-05-17 03:42:57