Trace number 3385575

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)UNSAT 3625.38 478.703

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v60-c5340-S614849838-039.UNKNOWN.cnf
MD5SUMc6bf5481c82f3a24100e294aa3a73c9c
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark367.053
Satisfiable
(Un)Satisfiability was proved
Number of variables60
Number of clauses5340
Sum of the clauses size37380
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 55340

Solver Data

0.30/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.30/0.46	c INFO: solving HOME/instance-3385575-1305568651.cnf
0.30/0.46	c INFO: computing task features
0.30/0.49	c INFO: computed variable-clause graph statistics
0.30/0.49	c INFO: computed clause balance statistics
0.49/0.68	c INFO: computed variable balance statistics
0.59/0.75	c INFO: computed small-clause counts
0.59/0.75	c INFO: computed Horn-clause counts
0.59/0.76	c INFO: computed variable graph statistics
0.59/0.76	c INFO: collected features for HOME/instance-3385575-1305568651.cnf in 0.30 s
0.59/0.79	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.55)
0.68/0.82	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.10)
0.68/0.85	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.05)
0.68/0.88	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.04)
0.78/0.91	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.03)
0.78/0.94	c INFO: running gnovelty+2@0 for 97 with 4999 remaining (b = 0.02)
0.78/0.98	c INFO: running FH@0 for 97 with 4999 remaining (b = 0.02)
1.67/1.01	c INFO: running adaptg2wsat2009++@0 for 97 with 4999 remaining (b = 0.01)
725.86/101.14	c INFO: running march_hi@0 for 2134 with 4899 remaining (b = 0.31)
725.86/101.21	c INFO: running march_hi@0 for 2134 with 4899 remaining (b = 0.29)
726.54/101.25	c INFO: running march_hi@0 for 388 with 4899 remaining (b = 0.11)
726.54/101.29	c INFO: running march_hi@0 for 388 with 4899 remaining (b = 0.09)
726.98/101.35	c INFO: running adaptg2wsat2009++@0 for 97 with 4899 remaining (b = 0.01)
809.59/113.15	c INFO: running adaptg2wsat2009++@0 for 97 with 4887 remaining (b = 0.01)
824.98/115.34	c INFO: running adaptg2wsat2009++@99 for 97 with 4885 remaining (b = 0.01)
1064.12/149.55	c INFO: running FH@0 for 97 with 4850 remaining (b = 0.01)
1386.11/195.67	c INFO: running march_hi@0 for 2134 with 4804 remaining (b = 0.25)
1504.81/212.67	c INFO: running march_hi@0 for 485 with 4787 remaining (b = 0.09)
1800.05/249.89	c INFO: running march_hi@0 for 388 with 4750 remaining (b = 0.06)
1910.18/263.66	c INFO: running march_hi@0 for 388 with 4736 remaining (b = 0.05)
3624.46/478.68	s UNSATISFIABLE

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385575-1305568651/watcher-3385575-1305568651 -o /tmp/evaluation-result-3385575-1305568651/solver-3385575-1305568651 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385575-1305568651.cnf -seed 1769660859 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.13 9.35 9.42 3/391 13272
/proc/meminfo: memFree=23123480/32951124 swapFree=44485784/67111528
[pid=13272] ppid=13270 vsize=16236 CPUtime=0 cores=0-7
/proc/13272/stat : 13272 (python) R 13270 13272 12176 0 -1 4202496 1037 0 0 0 0 0 0 0 25 0 1 0 668465584 16625664 909 33554432000 4194304 5683644 140735270722480 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/13272/statm: 4059 910 380 364 0 546 0

[startup+0.0733651 s]
/proc/loadavg: 9.13 9.35 9.42 3/391 13272
/proc/meminfo: memFree=23123480/32951124 swapFree=44485784/67111528
[pid=13272] ppid=13270 vsize=84472 CPUtime=0.04 cores=0-7
/proc/13272/stat : 13272 (python) R 13270 13272 12176 0 -1 4202496 2325 0 0 0 3 1 0 0 18 0 1 0 668465584 86499328 2055 33554432000 4194304 5683644 140735270722480 18446744073709551615 244560134304 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/13272/statm: 21118 2061 668 364 0 1335 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 84472

[startup+0.100341 s]
/proc/loadavg: 9.13 9.35 9.42 3/391 13272
/proc/meminfo: memFree=23123480/32951124 swapFree=44485784/67111528
[pid=13272] ppid=13270 vsize=104612 CPUtime=0.07 cores=0-7
/proc/13272/stat : 13272 (python) R 13270 13272 12176 0 -1 4202496 3098 0 0 0 5 2 0 0 17 0 1 0 668465584 107122688 2778 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446943232 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/13272/statm: 26153 2778 847 364 0 1901 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104612

[startup+0.300302 s]
/proc/loadavg: 9.13 9.35 9.42 3/391 13272
/proc/meminfo: memFree=23123480/32951124 swapFree=44485784/67111528
[pid=13272] ppid=13270 vsize=194548 CPUtime=0.22 cores=0-7
/proc/13272/stat : 13272 (python) S 13270 13272 12176 0 -1 4202496 6908 931 1 0 16 6 0 0 17 0 1 0 668465584 199217152 4965 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446943232 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/13272/statm: 48638 4966 1431 364 0 3757 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 194548

[startup+0.70022 s]
/proc/loadavg: 9.13 9.35 9.42 3/391 13272
/proc/meminfo: memFree=23123480/32951124 swapFree=44485784/67111528
[pid=13272] ppid=13270 vsize=279552 CPUtime=0.59 cores=0-7
/proc/13272/stat : 13272 (python) R 13270 13272 12176 0 -1 4202496 9748 931 1 0 51 8 0 0 17 0 1 0 668465584 286261248 7274 33554432000 4194304 5683644 140735270722480 18446744073709551615 47963203007626 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/13272/statm: 69888 7274 1827 364 0 5812 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 279552

[startup+1.50104 s]
/proc/loadavg: 8.56 9.22 9.38 10/412 13297
/proc/meminfo: memFree=23067264/32951124 swapFree=44485784/67111528
[pid=13272] ppid=13270 vsize=361336 CPUtime=0.89 cores=0-7
/proc/13272/stat : 13272 (python) S 13270 13272 12176 0 -1 4202496 16186 931 1 0 79 10 0 0 24 0 9 0 668465584 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13272/statm: 90334 7301 1891 364 0 26231 0
[pid=13278] ppid=13272 vsize=278700 CPUtime=0 cores=0-7
/proc/13278/stat : 13278 (python) S 13272 13272 12176 0 -1 4202560 733 0 0 0 0 0 0 0 19 0 1 0 668465663 285388800 5614 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965263 0 0 16781312 514 9364414369103871999 0 0 17 1 0 0 0
/proc/13278/statm: 69675 5614 354 364 0 5593 0
[pid=13280] ppid=13278 vsize=1017932 CPUtime=0.5 cores=0-7
/proc/13280/stat : 13280 (gnovelty+2) R 13278 13280 13280 0 -1 4202496 510 0 0 0 50 0 0 0 22 0 1 0 668465664 1042362368 247 33554432000 134512640 135663704 4290388992 18446744073709551615 134524498 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/13280/statm: 254483 247 113 282 0 254199 0
[pid=13281] ppid=13272 vsize=289352 CPUtime=0 cores=0-7
/proc/13281/stat : 13281 (python) S 13272 13272 12176 0 -1 4202560 739 0 0 0 0 0 0 0 21 0 1 0 668465666 296296448 5696 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 6989362875357724671 0 0 17 5 0 0 0
/proc/13281/statm: 72338 5696 348 364 0 8253 0
[pid=13283] ppid=13281 vsize=1017932 CPUtime=0.66 cores=0-7
/proc/13283/stat : 13283 (gnovelty+2) R 13281 13283 13283 0 -1 4202496 512 0 0 0 66 0 0 0 25 0 1 0 668465667 1042362368 248 33554432000 134512640 135663704 4294289008 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/13283/statm: 254483 248 113 282 0 254199 0
[pid=13284] ppid=13272 vsize=299300 CPUtime=0 cores=0-7
/proc/13284/stat : 13284 (python) S 13272 13272 12176 0 -1 4202560 721 0 0 0 0 0 0 0 19 0 1 0 668465669 306483200 5606 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 16763370610280628223 0 0 17 7 0 0 0
/proc/13284/statm: 74825 5606 344 364 0 10737 0
[pid=13286] ppid=13284 vsize=416652 CPUtime=0.63 cores=0-7
/proc/13286/stat : 13286 (adaptg2wsat2009) R 13284 13286 13286 0 -1 4202496 568 0 0 0 63 0 0 0 22 0 1 0 668465670 426651648 304 33554432000 134512640 135107411 4290392896 18446744073709551615 134523457 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/13286/statm: 104163 304 49 146 0 103039 0
[pid=13287] ppid=13272 vsize=310000 CPUtime=0 cores=0-7
/proc/13287/stat : 13287 (python) S 13272 13272 12176 0 -1 4202560 729 0 0 0 0 0 0 0 19 0 1 0 668465673 317440000 5717 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 17300709914234060799 0 0 17 3 0 0 0
/proc/13287/statm: 77500 5717 344 364 0 13409 0
[pid=13289] ppid=13287 vsize=416652 CPUtime=0.6 cores=0-7
/proc/13289/stat : 13289 (adaptg2wsat2009) R 13287 13289 13289 0 -1 4202496 569 0 0 0 60 0 0 0 22 0 1 0 668465673 426651648 302 33554432000 134512640 135107411 4291046608 18446744073709551615 134523319 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/13289/statm: 104163 302 49 146 0 103039 0
[pid=13290] ppid=13272 vsize=320256 CPUtime=0 cores=0-7
/proc/13290/stat : 13290 (python) S 13272 13272 12176 0 -1 4202560 740 0 0 0 0 0 0 0 21 0 1 0 668465676 327942144 5738 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 14175838219588861951 0 0 17 1 0 0 0
/proc/13290/statm: 80064 5738 344 364 0 15970 0
[pid=13292] ppid=13290 vsize=416652 CPUtime=0.56 cores=0-7
/proc/13292/stat : 13292 (adaptg2wsat2009) R 13290 13292 13292 0 -1 4202496 569 0 0 0 56 0 0 0 25 0 1 0 668465676 426651648 302 33554432000 134512640 135107411 4288174720 18446744073709551615 134523302 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/13292/statm: 104163 302 49 146 0 103039 0
[pid=13293] ppid=13272 vsize=330512 CPUtime=0 cores=0-7
/proc/13293/stat : 13293 (python) S 13272 13272 12176 0 -1 4202560 767 0 0 0 0 0 0 0 19 0 1 0 668465679 338444288 5746 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 15453910260837777407 0 0 17 3 0 0 0
/proc/13293/statm: 82628 5746 348 364 0 18531 0
[pid=13295] ppid=13293 vsize=1017932 CPUtime=0.54 cores=0-7
/proc/13295/stat : 13295 (gnovelty+2) R 13293 13295 13295 0 -1 4202496 514 0 0 0 54 0 0 0 22 0 1 0 668465679 1042362368 247 33554432000 134512640 135663704 4289520736 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/13295/statm: 254483 247 113 282 0 254199 0
[pid=13296] ppid=13272 vsize=340228 CPUtime=0 cores=0-7
/proc/13296/stat : 13296 (python) S 13272 13272 12176 0 -1 4202560 755 0 0 0 0 0 0 0 20 0 1 0 668465682 348393472 5626 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 14175849764460953599 0 0 17 1 0 0 0
/proc/13296/statm: 85057 5626 344 364 0 20957 0
[pid=13272/tid=13279] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13279/stat : 13279 (python) S 13270 13272 12176 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 9 0 668465663 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 3 0 0 0
[pid=13272/tid=13282] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13282/stat : 13282 (python) S 13270 13272 12176 0 -1 4202560 21 931 0 0 0 0 0 0 22 0 9 0 668465667 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 5 0 0 0
[pid=13272/tid=13285] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13285/stat : 13285 (python) S 13270 13272 12176 0 -1 4202560 23 931 0 0 0 0 0 0 20 0 9 0 668465670 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 7 0 0 0
[pid=13272/tid=13288] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13288/stat : 13288 (python) S 13270 13272 12176 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 9 0 668465673 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
[pid=13272/tid=13291] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13291/stat : 13291 (python) S 13270 13272 12176 0 -1 4202560 26 931 0 0 0 0 0 0 22 0 9 0 668465676 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 7 0 0 0
[pid=13272/tid=13294] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13294/stat : 13294 (python) S 13270 13272 12176 0 -1 4202560 22 931 0 0 0 0 0 0 20 0 9 0 668465679 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
[pid=13272/tid=13297] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13297/stat : 13297 (python) S 13270 13272 12176 0 -1 4202560 23 931 0 0 0 0 0 0 22 0 9 0 668465682 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4.38
Current children cumulated vsize (KiB) 6833436

[startup+3.10174 s]
/proc/loadavg: 8.56 9.22 9.38 10/416 13301
/proc/meminfo: memFree=23059668/32951124 swapFree=44485784/67111528
[pid=13272] ppid=13270 vsize=361336 CPUtime=0.89 cores=0-7
/proc/13272/stat : 13272 (python) S 13270 13272 12176 0 -1 4202496 16186 931 1 0 79 10 0 0 24 0 9 0 668465584 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13272/statm: 90334 7301 1891 364 0 26231 0
[pid=13278] ppid=13272 vsize=278700 CPUtime=0 cores=0-7
/proc/13278/stat : 13278 (python) S 13272 13272 12176 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 668465663 285388800 5614 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965263 0 0 16781312 514 9364414369103839494 0 0 17 1 0 0 0
/proc/13278/statm: 69675 5614 354 364 0 5593 0
[pid=13280] ppid=13278 vsize=1017932 CPUtime=1.3 cores=0-7
/proc/13280/stat : 13280 (gnovelty+2) R 13278 13280 13280 0 -1 4202496 510 0 0 0 130 0 0 0 25 0 1 0 668465664 1042362368 247 33554432000 134512640 135663704 4290388992 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/13280/statm: 254483 247 113 282 0 254199 0
[pid=13281] ppid=13272 vsize=289352 CPUtime=0 cores=0-7
/proc/13281/stat : 13281 (python) S 13272 13272 12176 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 668465666 296296448 5696 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 6989362875357692168 0 0 17 5 0 0 0
/proc/13281/statm: 72338 5696 348 364 0 8253 0
[pid=13283] ppid=13281 vsize=1017932 CPUtime=2.26 cores=0-7
/proc/13283/stat : 13283 (gnovelty+2) R 13281 13283 13283 0 -1 4202496 512 0 0 0 226 0 0 0 25 0 1 0 668465667 1042362368 248 33554432000 134512640 135663704 4294289008 18446744073709551615 134525218 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/13283/statm: 254483 248 113 282 0 254199 0
[pid=13284] ppid=13272 vsize=299300 CPUtime=0 cores=0-7
/proc/13284/stat : 13284 (python) S 13272 13272 12176 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 668465669 306483200 5610 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 16763370610280595719 0 0 17 7 0 0 0
/proc/13284/statm: 74825 5610 348 364 0 10737 0
[pid=13286] ppid=13284 vsize=416788 CPUtime=2.23 cores=0-7
/proc/13286/stat : 13286 (adaptg2wsat2009) R 13284 13286 13286 0 -1 4202496 629 0 0 0 223 0 0 0 25 0 1 0 668465670 426790912 365 33554432000 134512640 135107411 4290392896 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/13286/statm: 104197 365 59 146 0 103073 0
[pid=13287] ppid=13272 vsize=310000 CPUtime=0 cores=0-7
/proc/13287/stat : 13287 (python) S 13272 13272 12176 0 -1 4202560 747 0 0 0 0 0 0 0 18 0 1 0 668465673 317440000 5721 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 17300709914234028293 0 0 17 3 0 0 0
/proc/13287/statm: 77500 5721 348 364 0 13409 0
[pid=13289] ppid=13287 vsize=416788 CPUtime=2.2 cores=0-7
/proc/13289/stat : 13289 (adaptg2wsat2009) R 13287 13289 13289 0 -1 4202496 630 0 0 0 220 0 0 0 25 0 1 0 668465673 426790912 363 33554432000 134512640 135107411 4291046608 18446744073709551615 134532036 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/13289/statm: 104197 363 59 146 0 103073 0
[pid=13290] ppid=13272 vsize=320256 CPUtime=0 cores=0-7
/proc/13290/stat : 13290 (python) S 13272 13272 12176 0 -1 4202560 759 0 0 0 0 0 0 0 18 0 1 0 668465676 327942144 5742 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 14175838219588829445 0 0 17 1 0 0 0
/proc/13290/statm: 80064 5742 348 364 0 15970 0
[pid=13292] ppid=13290 vsize=416788 CPUtime=2.14 cores=0-7
/proc/13292/stat : 13292 (adaptg2wsat2009) R 13290 13292 13292 0 -1 4202496 629 0 0 0 214 0 0 0 25 0 1 0 668465676 426790912 362 33554432000 134512640 135107411 4288174720 18446744073709551615 134531817 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/13292/statm: 104197 362 59 146 0 103073 0
[pid=13293] ppid=13272 vsize=330512 CPUtime=0 cores=0-7
/proc/13293/stat : 13293 (python) S 13272 13272 12176 0 -1 4202560 767 0 0 0 0 0 0 0 18 0 1 0 668465679 338444288 5746 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 15453910260837744902 0 0 17 3 0 0 0
/proc/13293/statm: 82628 5746 348 364 0 18531 0
[pid=13295] ppid=13293 vsize=1017932 CPUtime=2.14 cores=0-7
/proc/13295/stat : 13295 (gnovelty+2) R 13293 13295 13295 0 -1 4202496 514 0 0 0 214 0 0 0 25 0 1 0 668465679 1042362368 247 33554432000 134512640 135663704 4289520736 18446744073709551615 134525247 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/13295/statm: 254483 247 113 282 0 254199 0
[pid=13296] ppid=13272 vsize=340228 CPUtime=0 cores=0-7
/proc/13296/stat : 13296 (python) S 13272 13272 12176 0 -1 4202560 773 0 0 0 0 0 0 0 18 0 1 0 668465682 348393472 5630 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 14175849764460953599 0 0 17 1 0 0 0
/proc/13296/statm: 85057 5630 348 364 0 20957 0
[pid=13298] ppid=13296 vsize=246936 CPUtime=0.99 cores=0-7
/proc/13298/stat : 13298 (FH) R 13296 13298 13298 0 -1 4202496 595 0 0 0 99 0 0 0 25 0 1 0 668465685 252862464 327 33554432000 134512640 134936988 4291687392 18446744073709551615 134553311 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/13298/statm: 61734 327 41 104 0 61238 0
[pid=13299] ppid=13272 vsize=351092 CPUtime=0 cores=0-7
/proc/13299/stat : 13299 (python) S 13272 13272 12176 0 -1 4202560 809 0 0 0 0 0 0 0 18 0 1 0 668465685 359518208 5760 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 18176307923158794502 0 0 17 1 0 0 0
/proc/13299/statm: 87773 5760 354 364 0 23670 0
[pid=13301] ppid=13299 vsize=416788 CPUtime=2.08 cores=0-7
/proc/13301/stat : 13301 (adaptg2wsat2009) R 13299 13301 13301 0 -1 4202496 638 0 0 0 208 0 0 0 25 0 1 0 668465686 426790912 363 33554432000 134512640 135107411 4291171440 18446744073709551615 134531935 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/13301/statm: 104197 363 59 146 0 103073 0
[pid=13272/tid=13279] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13279/stat : 13279 (python) S 13270 13272 12176 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 9 0 668465663 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 3 0 0 0
[pid=13272/tid=13282] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13282/stat : 13282 (python) S 13270 13272 12176 0 -1 4202560 21 931 0 0 0 0 0 0 22 0 9 0 668465667 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 5 0 0 0
[pid=13272/tid=13285] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13285/stat : 13285 (python) S 13270 13272 12176 0 -1 4202560 23 931 0 0 0 0 0 0 20 0 9 0 668465670 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 7 0 0 0
[pid=13272/tid=13288] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13288/stat : 13288 (python) S 13270 13272 12176 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 9 0 668465673 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
[pid=13272/tid=13291] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13291/stat : 13291 (python) S 13270 13272 12176 0 -1 4202560 26 931 0 0 0 0 0 0 22 0 9 0 668465676 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 7 0 0 0
[pid=13272/tid=13294] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13294/stat : 13294 (python) S 13270 13272 12176 0 -1 4202560 22 931 0 0 0 0 0 0 20 0 9 0 668465679 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
[pid=13272/tid=13297] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13297/stat : 13297 (python) S 13270 13272 12176 0 -1 4202560 23 931 0 0 0 0 0 0 22 0 9 0 668465682 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
[pid=13272/tid=13300] ppid=13270 vsize=361336 CPUtime=0 cores=0-7
/proc/13272/task/13300/stat : 13300 (python) S 13270 13272 12176 0 -1 4202560 31 931 0 0 0 0 0 0 24 0 9 0 668465686 370008064 7301 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 16.23
Current children cumulated vsize (KiB) 7848660

[startup+6.30114 s]

################
# More data... #
################

/proc/loadavg: 8.27 8.63 9.05 11/451 13362
/proc/meminfo: memFree=23002480/32951124 swapFree=44485784/67111528
[pid=13272] ppid=13270 vsize=519240 CPUtime=1.38 cores=0-7
/proc/13272/stat : 13272 (python) S 13270 13272 12176 0 -1 4202496 25027 931 1 0 125 13 0 0 19 0 18 0 668465584 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/13272/statm: 129810 7404 1910 364 0 65680 0
[pid=13278] ppid=13272 vsize=288944 CPUtime=0.32 cores=0-7
/proc/13278/stat : 13278 (python) S 13272 13272 12176 0 -1 4202560 1091 0 0 0 16 16 0 0 19 0 2 0 668465663 295878656 5675 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/13278/statm: 72236 5675 410 364 0 8154 0
[pid=13280] ppid=13278 vsize=1017932 CPUtime=100.8 cores=0-7
/proc/13280/stat : 13280 (gnovelty+2) T 13278 13280 13280 0 -1 4202496 510 0 0 0 10080 0 0 0 25 0 1 0 668465664 1042362368 247 33554432000 134512640 135663704 4290388992 18446744073709551615 134524916 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/13280/statm: 254483 247 113 282 0 254199 0
[pid=13278/tid=13322] ppid=13272 vsize=288944 CPUtime=0 cores=0-7
/proc/13278/task/13322/stat : 13322 (python) S 13272 13272 12176 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 668476895 295878656 5675 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 514 18446604459387983168 0 0 -1 1 0 0 0
[pid=13281] ppid=13272 vsize=289352 CPUtime=0.28 cores=0-7
/proc/13281/stat : 13281 (python) S 13272 13272 12176 0 -1 4202560 1087 0 0 0 15 13 0 0 19 0 2 0 668465666 296296448 5749 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/13281/statm: 72338 5749 400 364 0 8253 0
[pid=13283] ppid=13281 vsize=1017932 CPUtime=99.73 cores=0-7
/proc/13283/stat : 13283 (gnovelty+2) T 13281 13283 13283 0 -1 4202496 512 0 0 0 9973 0 0 0 25 0 1 0 668465667 1042362368 248 33554432000 134512640 135663704 4294289008 18446744073709551615 134524916 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/13283/statm: 254483 248 113 282 0 254199 0
[pid=13281/tid=13305] ppid=13272 vsize=289352 CPUtime=0 cores=0-7
/proc/13281/task/13305/stat : 13305 (python) S 13272 13272 12176 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 668475695 296296448 5749 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 514 18446604467424932992 0 0 -1 5 0 0 0
[pid=13284] ppid=13272 vsize=299300 CPUtime=0.33 cores=0-7
/proc/13284/stat : 13284 (python) S 13272 13272 12176 0 -1 4202560 1092 0 0 0 18 15 0 0 19 0 2 0 668465669 306483200 5663 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/13284/statm: 74825 5663 400 364 0 10737 0
[pid=13286] ppid=13284 vsize=416788 CPUtime=98.42 cores=0-7
/proc/13286/stat : 13286 (adaptg2wsat2009) T 13284 13286 13286 0 -1 4202496 629 0 0 0 9842 0 0 0 25 0 1 0 668465670 426790912 365 33554432000 134512640 135107411 4290392896 18446744073709551615 134531935 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/13286/statm: 104197 365 59 146 0 103073 0
[pid=13284/tid=13323] ppid=13272 vsize=299300 CPUtime=0 cores=0-7
/proc/13284/task/13323/stat : 13323 (python) S 13272 13272 12176 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 668477115 306483200 5663 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 514 18446604465405654208 0 0 -1 1 0 0 0
[pid=13287] ppid=13272 vsize=310000 CPUtime=0.56 cores=0-7
/proc/13287/stat : 13287 (python) S 13272 13272 12176 0 -1 4202560 1146 0 0 0 29 27 0 0 18 0 2 0 668465673 317440000 5774 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/13287/statm: 77500 5774 400 364 0 13409 0
[pid=13289] ppid=13287 vsize=416788 CPUtime=194.42 cores=0-7
/proc/13289/stat : 13289 (adaptg2wsat2009) T 13287 13289 13289 0 -1 4202496 630 0 0 0 19442 0 0 0 25 0 1 0 668465673 426790912 363 33554432000 134512640 135107411 4291046608 18446744073709551615 134531246 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/13289/statm: 104197 363 59 146 0 103073 0
[pid=13287/tid=13309] ppid=13272 vsize=310000 CPUtime=0 cores=0-7
/proc/13287/task/13309/stat : 13309 (python) S 13272 13272 12176 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 668475700 317440000 5774 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 514 18446604461235795968 0 0 -1 3 0 0 0
[pid=13290] ppid=13272 vsize=385792 CPUtime=0.75 cores=0-7
/proc/13290/stat : 13290 (python) S 13272 13272 12176 0 -1 4202560 1139 0 0 0 40 35 0 0 18 0 2 0 668465676 395051008 5803 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/13290/statm: 96448 5803 400 364 0 32354 0
[pid=13292] ppid=13290 vsize=416788 CPUtime=199.5 cores=0-7
/proc/13292/stat : 13292 (adaptg2wsat2009) T 13290 13292 13292 0 -1 4202496 629 0 0 0 19950 0 0 0 25 0 1 0 668465676 426790912 362 33554432000 134512640 135107411 4288174720 18446744073709551615 134531848 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/13292/statm: 104197 362 59 146 0 103073 0
[pid=13290/tid=13310] ppid=13272 vsize=385792 CPUtime=0 cores=0-7
/proc/13290/task/13310/stat : 13310 (python) S 13272 13272 12176 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 668475703 395051008 5803 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 514 18446604456213262784 0 0 -1 0 0 0 0
[pid=13293] ppid=13272 vsize=396048 CPUtime=0.28 cores=0-7
/proc/13293/stat : 13293 (python) S 13272 13272 12176 0 -1 4202560 1132 0 0 0 14 14 0 0 19 0 2 0 668465679 405553152 5800 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/13293/statm: 99012 5800 400 364 0 34915 0
[pid=13295] ppid=13293 vsize=1017932 CPUtime=99.99 cores=0-7
/proc/13295/stat : 13295 (gnovelty+2) T 13293 13295 13295 0 -1 4202496 514 0 0 0 9999 0 0 0 25 0 1 0 668465679 1042362368 247 33554432000 134512640 135663704 4289520736 18446744073709551615 134524874 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/13295/statm: 254483 247 113 282 0 254199 0
[pid=13293/tid=13313] ppid=13272 vsize=396048 CPUtime=0 cores=0-7
/proc/13293/task/13313/stat : 13313 (python) S 13272 13272 12176 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 668475707 405553152 5800 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 514 18446604456510837120 0 0 -1 0 0 0 0
[pid=13296] ppid=13272 vsize=405764 CPUtime=0.43 cores=0-7
/proc/13296/stat : 13296 (python) S 13272 13272 12176 0 -1 4202560 1165 0 0 0 24 19 0 0 19 0 2 0 668465682 415502336 5684 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/13296/statm: 101441 5684 400 364 0 37341 0
[pid=13298] ppid=13296 vsize=246936 CPUtime=98.39 cores=0-7
/proc/13298/stat : 13298 (FH) T 13296 13298 13298 0 -1 4202496 595 0 0 0 9839 0 0 0 25 0 1 0 668465685 252862464 327 33554432000 134512640 134936988 4291687392 18446744073709551615 134554603 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/13298/statm: 61734 327 41 104 0 61238 0
[pid=13296/tid=13325] ppid=13272 vsize=405764 CPUtime=0 cores=0-7
/proc/13296/task/13325/stat : 13325 (python) S 13272 13272 12176 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 668480535 415502336 5684 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 514 18446604456213265472 0 0 -1 6 0 0 0
[pid=13299] ppid=13272 vsize=351092 CPUtime=0.58 cores=0-7
/proc/13299/stat : 13299 (python) S 13272 13272 12176 0 -1 4202560 1223 0 0 0 32 26 0 0 18 0 2 0 668465685 359518208 5813 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/13299/statm: 87773 5813 406 364 0 23670 0
[pid=13301] ppid=13299 vsize=416788 CPUtime=195.86 cores=0-7
/proc/13301/stat : 13301 (adaptg2wsat2009) T 13299 13301 13301 0 -1 4202496 638 0 0 0 19586 0 0 0 25 0 1 0 668465686 426790912 363 33554432000 134512640 135107411 4291171440 18446744073709551615 134532376 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/13301/statm: 104197 363 59 146 0 103073 0
[pid=13299/tid=13321] ppid=13272 vsize=351092 CPUtime=0 cores=0-7
/proc/13299/task/13321/stat : 13321 (python) S 13272 13272 12176 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 668475715 359518208 5813 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 514 18446604470029596608 0 0 -1 1 0 0 0
[pid=13306] ppid=13272 vsize=361348 CPUtime=1.6 cores=0-7
/proc/13306/stat : 13306 (python) R 13272 13272 12176 0 -1 4202560 1063 0 0 0 95 65 0 0 16 0 1 0 668475698 370020352 5781 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458775359 0 0 16781312 514 0 0 0 17 4 0 0 0
/proc/13306/statm: 90337 5781 371 364 0 26231 0
[pid=13308] ppid=13306 vsize=0 CPUtime=368.93 cores=0-7
/proc/13308/stat : 13308 (march_hi) R 13306 13308 13308 0 -1 4202500 1768 0 0 0 36892 1 0 0 25 0 1 0 668475698 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/13308/statm: 0 0 0 0 0 0 0
[pid=13311] ppid=13272 vsize=371296 CPUtime=1.25 cores=0-7
/proc/13311/stat : 13311 (python) S 13272 13272 12176 0 -1 4202560 1060 0 0 0 67 58 0 0 15 0 1 0 668475705 380207104 5725 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 18308561854672109831 0 0 17 5 0 0 0
/proc/13311/statm: 92824 5725 371 364 0 28715 0
[pid=13314] ppid=13311 vsize=4080 CPUtime=356.18 cores=0-7
/proc/13314/stat : 13314 (march_hi) R 13311 13314 13314 0 -1 4202496 1741 0 0 0 35618 0 0 0 25 0 1 0 668475708 4177920 794 33554432000 4194304 4955518 140735742195712 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/13314/statm: 1020 794 106 186 0 833 0
[pid=13315] ppid=13272 vsize=382104 CPUtime=1.25 cores=0-7
/proc/13315/stat : 13315 (python) S 13272 13272 12176 0 -1 4202560 1049 0 0 0 70 55 0 0 15 0 1 0 668475709 391274496 5850 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 3666928457532539142 0 0 17 3 0 0 0
/proc/13315/statm: 95526 5850 371 364 0 31414 0
[pid=13317] ppid=13315 vsize=4080 CPUtime=340.38 cores=0-7
/proc/13317/stat : 13317 (march_hi) R 13315 13317 13317 0 -1 4202496 1711 0 0 0 34038 0 0 0 25 0 1 0 668475712 4177920 763 33554432000 4194304 4955518 140733424777312 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/13317/statm: 1020 763 106 186 0 833 0
[pid=13318] ppid=13272 vsize=392360 CPUtime=3.45 cores=0-7
/proc/13318/stat : 13318 (python) R 13272 13272 12176 0 -1 4202560 1051 0 0 0 264 81 0 0 18 0 1 0 668475713 401776640 5854 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 0 0 0 17 0 0 0 0
/proc/13318/statm: 98090 5854 371 364 0 33975 0
[pid=13320] ppid=13318 vsize=0 CPUtime=368.8 cores=0-7
/proc/13320/stat : 13320 (march_hi) R 13318 13320 13320 0 -1 4202500 1767 0 0 0 36878 2 0 0 25 0 1 0 668475714 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/13320/statm: 0 0 0 0 0 0 0
[pid=13326] ppid=13272 vsize=402552 CPUtime=0.3 cores=0-7
/proc/13326/stat : 13326 (python) S 13272 13272 12176 0 -1 4202560 1180 0 0 0 16 14 0 0 19 0 2 0 668480539 412213248 5872 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/13326/statm: 100638 5872 400 364 0 36520 0
[pid=13328] ppid=13326 vsize=246940 CPUtime=100.26 cores=0-7
/proc/13328/stat : 13328 (FH) T 13326 13328 13328 0 -1 4202496 595 0 0 0 10025 1 0 0 25 0 1 0 668480540 252866560 327 33554432000 134512640 134936988 4288911536 18446744073709551615 134553427 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/13328/statm: 61735 327 41 104 0 61239 0
[pid=13326/tid=13347] ppid=13272 vsize=402552 CPUtime=0 cores=0-7
/proc/13326/task/13347/stat : 13347 (python) S 13272 13272 12176 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 668490569 412213248 5872 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 514 18446604453795933120 0 0 -1 0 0 0 0
[pid=13330] ppid=13272 vsize=412808 CPUtime=0.95 cores=0-7
/proc/13330/stat : 13330 (python) S 13272 13272 12176 0 -1 4202560 1077 0 0 0 52 43 0 0 15 0 1 0 668485152 422715392 5846 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 8149329500719513857 0 0 17 2 0 0 0
/proc/13330/statm: 103202 5846 371 364 0 39081 0
[pid=13332] ppid=13330 vsize=4080 CPUtime=281.02 cores=0-7
/proc/13332/stat : 13332 (march_hi) R 13330 13332 13332 0 -1 4202496 1650 0 0 0 28102 0 0 0 25 0 1 0 668485154 4177920 695 33554432000 4194304 4955518 140734690604992 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/13332/statm: 1020 695 106 186 0 833 0
[pid=13343] ppid=13272 vsize=422756 CPUtime=0.89 cores=0-7
/proc/13343/stat : 13343 (python) S 13272 13272 12176 0 -1 4202560 1107 0 0 0 50 39 0 0 15 0 1 0 668486852 432902144 5752 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 5658359519713919236 0 0 17 1 0 0 0
/proc/13343/statm: 105689 5752 381 364 0 41565 0
[pid=13345] ppid=13343 vsize=3568 CPUtime=263.11 cores=0-7
/proc/13345/stat : 13345 (march_hi) R 13343 13345 13345 0 -1 4202496 1627 0 0 0 26311 0 0 0 25 0 1 0 668486852 3653632 674 33554432000 4194304 4955518 140735873594368 18446744073709551615 4328186 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/13345/statm: 892 674 106 186 0 705 0
[pid=13348] ppid=13272 vsize=433296 CPUtime=0.77 cores=0-7
/proc/13348/stat : 13348 (python) S 13272 13272 12176 0 -1 4202560 1088 0 0 0 40 37 0 0 15 0 1 0 668490573 443695104 5872 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 2578499906964521217 0 0 17 3 0 0 0
/proc/13348/statm: 108324 5872 378 364 0 44197 0
[pid=13350] ppid=13348 vsize=3568 CPUtime=227.49 cores=0-7
/proc/13350/stat : 13350 (march_hi) R 13348 13350 13350 0 -1 4202496 1594 0 0 0 22749 0 0 0 25 0 1 0 668490574 3653632 638 33554432000 4194304 4955518 140736462927648 18446744073709551615 4235624 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/13350/statm: 892 638 106 186 0 705 0
[pid=13351] ppid=13272 vsize=443664 CPUtime=0.71 cores=0-7
/proc/13351/stat : 13351 (python) S 13272 13272 12176 0 -1 4202560 1080 0 0 0 37 34 0 0 15 0 1 0 668491951 454311936 5864 33554432000 4194304 5683644 140735270722480 18446744073709551615 244446965318 0 0 16781312 514 2478972114418237699 0 0 17 6 0 0 0
/proc/13351/statm: 110916 5864 374 364 0 46786 0
[pid=13353] ppid=13351 vsize=3568 CPUtime=212.72 cores=0-7
/proc/13353/stat : 13353 (march_hi) R 13351 13353 13353 0 -1 4202496 1575 0 0 0 21272 0 0 0 25 0 1 0 668491951 3653632 623 33554432000 4194304 4955518 140735707425280 18446744073709551615 4285295 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/13353/statm: 892 623 106 186 0 705 0
[pid=13272/tid=13279] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13279/stat : 13279 (python) S 13270 13272 12176 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 18 0 668465663 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 3 0 0 0
[pid=13272/tid=13282] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13282/stat : 13282 (python) S 13270 13272 12176 0 -1 4202560 21 931 0 0 0 0 0 0 22 0 18 0 668465667 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 5 0 0 0
[pid=13272/tid=13285] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13285/stat : 13285 (python) S 13270 13272 12176 0 -1 4202560 23 931 0 0 0 0 0 0 20 0 18 0 668465670 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 7 0 0 0
[pid=13272/tid=13288] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13288/stat : 13288 (python) S 13270 13272 12176 0 -1 4202560 31 931 0 0 0 0 0 0 18 0 18 0 668465673 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
[pid=13272/tid=13291] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13291/stat : 13291 (python) S 13270 13272 12176 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 18 0 668465676 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 7 0 0 0
[pid=13272/tid=13294] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13294/stat : 13294 (python) S 13270 13272 12176 0 -1 4202560 22 931 0 0 0 0 0 0 20 0 18 0 668465679 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
[pid=13272/tid=13297] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13297/stat : 13297 (python) S 13270 13272 12176 0 -1 4202560 23 931 0 0 0 0 0 0 22 0 18 0 668465682 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
[pid=13272/tid=13300] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13300/stat : 13300 (python) S 13270 13272 12176 0 -1 4202560 35 931 0 0 0 0 0 0 18 0 18 0 668465686 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
[pid=13272/tid=13307] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13307/stat : 13307 (python) S 13270 13272 12176 0 -1 4202560 33 931 0 0 0 0 0 0 20 0 18 0 668475698 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
[pid=13272/tid=13312] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13312/stat : 13312 (python) S 13270 13272 12176 0 -1 4202560 28 931 0 0 0 0 0 0 21 0 18 0 668475705 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 5 0 0 0
[pid=13272/tid=13316] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13316/stat : 13316 (python) S 13270 13272 12176 0 -1 4202560 20 931 0 0 0 0 0 0 23 0 18 0 668475710 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 7 0 0 0
[pid=13272/tid=13319] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13319/stat : 13319 (python) S 13270 13272 12176 0 -1 4202560 26 931 0 0 0 0 0 0 25 0 18 0 668475714 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 7 0 0 0
[pid=13272/tid=13327] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13327/stat : 13327 (python) S 13270 13272 12176 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 18 0 668480540 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 6 0 0 0
[pid=13272/tid=13331] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13331/stat : 13331 (python) S 13270 13272 12176 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 18 0 668485152 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 6 0 0 0
[pid=13272/tid=13344] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13344/stat : 13344 (python) S 13270 13272 12176 0 -1 4202560 26 931 0 0 0 0 0 0 19 0 18 0 668486852 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 6 0 0 0
[pid=13272/tid=13349] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13349/stat : 13349 (python) S 13270 13272 12176 0 -1 4202560 29 931 0 0 0 0 0 0 20 0 18 0 668490574 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 6 0 0 0
[pid=13272/tid=13352] ppid=13270 vsize=519240 CPUtime=0 cores=0-7
/proc/13272/task/13352/stat : 13352 (python) S 13270 13272 12176 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 18 0 668491951 531701760 7404 33554432000 4194304 5683644 140735270722480 18446744073709551615 244458768817 0 0 16781312 2 18446604453985322816 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3622.08
Current children cumulated vsize (KiB) 12105484

[startup+478.702 s]
/proc/loadavg: 8.27 8.63 9.05 12/451 13362
/proc/meminfo: memFree=23004836/32951124 swapFree=44485784/67111528
[pid=13272] ppid=13270 vsize=0 CPUtime=3625.37 cores=0-7
/proc/13272/stat : 13272 (python) R 13270 13272 12176 0 -1 4202500 29507 39531 1 0 127 13 361777 620 17 0 1 0 668465584 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 4 0 0 0
/proc/13272/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 3625.37
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 478.703
CPU time (s): 3625.38
CPU user time (s): 3619.04
CPU system time (s): 6.34204
CPU usage (%): 757.335
Max. virtual memory (cumulated for all children) (KiB): 12114408

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3619.04
system time used= 6.34204
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 69038
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8536
involuntary context switches= 21198

runsolver used 3.16552 second user time and 6.74397 second system time

The end

Launcher Data

Begin job on node105 at 2011-05-16 19:57:31
IDJOB=3385575
IDBENCH=82840
IDSOLVER=1870
FILE ID=node105/3385575-1305568651
RUNJOBID= node105-1305564966-12190
PBS_JOBID= 13350145
Free space on /tmp= 73528 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k7-r89-v60-c5340-S614849838-039.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385575-1305568651/watcher-3385575-1305568651 -o /tmp/evaluation-result-3385575-1305568651/solver-3385575-1305568651 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385575-1305568651.cnf -seed 1769660859 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= c6bf5481c82f3a24100e294aa3a73c9c
RANDOM SEED=1769660859

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23123636 kB
Buffers:        323784 kB
Cached:        7167160 kB
SwapCached:      39636 kB
Active:        2446772 kB
Inactive:      7088596 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23123636 kB
SwapTotal:    67111528 kB
SwapFree:     44485784 kB
Dirty:           31564 kB
Writeback:           8 kB
AnonPages:     2012604 kB
Mapped:          16776 kB
Slab:           144908 kB
PageTables:      75780 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 103868552 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73504 MiB
End job on node105 at 2011-05-16 20:05:30