Trace number 3321794

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 17938.1 2259.52

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v35000-c147000-S950666065-093-UNKNOWN.cnf
MD5SUMe27af9a147b2d7c0283d090128805575
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark262.183
Satisfiable
(Un)Satisfiability was proved
Number of variables34999
Number of clauses147000
Sum of the clauses size441000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3147000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.33/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.33/0.46	c INFO: solving HOME/instance-3321794-1304367494.cnf
0.33/0.46	c INFO: computing task features
0.82/0.97	c INFO: computed variable-clause graph statistics
0.82/0.99	c INFO: computed clause balance statistics
3.52/3.69	c INFO: computed variable balance statistics
5.81/5.90	c INFO: computed small-clause counts
5.81/5.91	c INFO: computed Horn-clause counts
7.31/7.48	c INFO: computed variable graph statistics
7.31/7.48	c INFO: collected features for HOME/instance-3321794-1304367494.cnf in 7.00 s
7.41/7.51	c INFO: running hybridGM3@0 for 97 with 39992 remaining (b = 0.34)
7.41/7.55	c INFO: running hybridGM3@0 for 97 with 39992 remaining (b = 0.21)
7.41/7.59	c INFO: running hybridGM3@0 for 97 with 39992 remaining (b = 0.14)
7.64/7.63	c INFO: running hybridGM3@0 for 194 with 39992 remaining (b = 0.18)
7.64/7.67	c INFO: running hybridGM3@0 for 194 with 39992 remaining (b = 0.14)
8.02/7.71	c INFO: running hybridGM3@0 for 194 with 39992 remaining (b = 0.10)
8.02/7.75	c INFO: running TNM@0 for 97 with 39992 remaining (b = 0.04)
8.02/7.79	c INFO: running hybridGM3@0 for 194 with 39992 remaining (b = 0.07)
807.02/107.80	c INFO: running hybridGM3@0 for 97 with 39892 remaining (b = 0.03)
807.81/107.84	c INFO: running hybridGM3@0 for 97 with 39892 remaining (b = 0.03)
807.81/107.88	c INFO: running hybridGM3@0 for 97 with 39892 remaining (b = 0.03)
808.53/107.96	c INFO: running hybridGM3@0 for 194 with 39892 remaining (b = 0.06)
1566.95/202.97	c INFO: running hybridGM3@100 for 97 with 39797 remaining (b = 0.03)
1567.76/203.02	c INFO: running hybridGM3@100 for 97 with 39797 remaining (b = 0.03)
1567.76/203.06	c INFO: running hybridGM3@99 for 97 with 39797 remaining (b = 0.02)
1575.75/204.04	c INFO: running hybridGM3@0 for 97 with 39796 remaining (b = 0.03)
1576.52/204.11	c INFO: running hybridGM3@0 for 97 with 39796 remaining (b = 0.02)
1577.29/204.24	c INFO: running hybridGM3@100 for 97 with 39796 remaining (b = 0.03)
1623.62/210.09	c INFO: running hybridGM3@0 for 97 with 39790 remaining (b = 0.03)
2335.72/299.22	c INFO: running hybridGM3@0 for 194 with 39701 remaining (b = 0.04)
2374.77/304.16	c INFO: running TNM@0 for 97 with 39696 remaining (b = 0.02)
2375.52/304.21	c INFO: running hybridGM3@0 for 194 with 39696 remaining (b = 0.03)
2375.52/304.27	c INFO: running hybridGM3@296 for 97 with 39696 remaining (b = 0.02)
2376.71/304.43	c INFO: running hybridGM3@95 for 97 with 39696 remaining (b = 0.02)
2383.48/305.27	c INFO: running hybridGM3@95 for 97 with 39695 remaining (b = 0.02)
2384.20/305.32	c INFO: running TNM@0 for 1940 with 39695 remaining (b = 0.22)
2384.99/305.43	c INFO: running hybridGM3@300 for 97 with 39695 remaining (b = 0.02)
3127.36/398.48	c INFO: running hybridGM3@0 for 194 with 39602 remaining (b = 0.03)
3144.93/400.62	c INFO: running TNM@0 for 97 with 39599 remaining (b = 0.01)
3174.44/404.38	c INFO: running hybridGM3@394 for 97 with 39596 remaining (b = 0.01)
3184.00/405.50	c INFO: running hybridGM3@0 for 194 with 39595 remaining (b = 0.02)
3184.70/405.64	c INFO: running hybridGM3@188 for 97 with 39594 remaining (b = 0.01)
3903.48/495.72	c INFO: running hybridGM3@100 for 97 with 39504 remaining (b = 0.01)
3943.31/500.71	c INFO: running hybridGM3@100 for 97 with 39499 remaining (b = 0.01)
3944.09/500.86	c INFO: running hybridGM3@384 for 97 with 39499 remaining (b = 0.01)
3944.87/500.92	c INFO: running TNM@0 for 97 with 39499 remaining (b = 0.01)
3957.62/502.60	c INFO: running adaptg2wsat2009++@0 for 194 with 39497 remaining (b = 0.02)
4694.38/594.99	c INFO: running hybridGM3@94 for 97 with 39405 remaining (b = 0.01)
4703.07/596.09	c INFO: running hybridGM3@0 for 194 with 39404 remaining (b = 0.02)
4710.23/596.95	c INFO: running hybridGM3@296 for 97 with 39403 remaining (b = 0.01)
4735.74/600.17	c INFO: running TNM@0 for 97 with 39400 remaining (b = 0.01)
4750.06/601.94	c INFO: running TNM@0 for 97 with 39398 remaining (b = 0.01)
4799.45/608.16	c INFO: running hybridGM3@99 for 97 with 39392 remaining (b = 0.01)
5454.03/690.21	c INFO: running hybridGM3@189 for 97 with 39310 remaining (b = 0.01)
5469.16/692.17	c INFO: running hybridGM3@395 for 97 with 39308 remaining (b = 0.01)
5523.36/698.99	c INFO: running TNM@0 for 97 with 39301 remaining (b = 0.01)
5535.30/700.42	c INFO: running TNM@0 for 97 with 39300 remaining (b = 0.01)
5548.84/702.19	c INFO: running TNM@197 for 1843 with 39298 remaining (b = 0.13)
5559.16/703.42	c INFO: running hybridGM3@0 for 194 with 39297 remaining (b = 0.01)
6228.05/787.42	c INFO: running adaptg2wsat2009++@0 for 194 with 39213 remaining (b = 0.01)
6259.92/791.48	c INFO: running hybridGM3@0 for 194 with 39209 remaining (b = 0.01)
6317.26/798.67	c INFO: running hybridGM3@100 for 97 with 39201 remaining (b = 0.01)
6322.00/799.26	c INFO: running adaptg2wsat2009++@0 for 194 with 39201 remaining (b = 0.01)
6325.99/799.79	c INFO: running FH@0 for 97 with 39200 remaining (b = 0.01)
7076.02/893.95	c INFO: running hybridGM3@195 for 291 with 39106 remaining (b = 0.02)
7116.61/899.08	c INFO: running hybridGM3@194 for 291 with 39101 remaining (b = 0.02)
7124.54/900.02	c INFO: running hybridGM3@95 for 97 with 39100 remaining (b = 0.01)
7792.63/983.91	c INFO: running hybridGM3@195 for 291 with 39016 remaining (b = 0.02)
7825.29/988.09	c INFO: running adaptg2wsat2009++@101 for 97 with 39012 remaining (b = 0.01)
7885.78/995.70	c INFO: running adaptg2wsat2009++@98 for 97 with 39004 remaining (b = 0.01)
7930.35/1001.29	c INFO: running hybridGM3@291 for 194 with 38999 remaining (b = 0.01)
8600.02/1085.36	c INFO: running adaptg2wsat2009++@297 for 291 with 38915 remaining (b = 0.02)
8692.37/1096.97	c INFO: running TNM@0 for 97 with 38903 remaining (b = 0.01)
9422.50/1188.68	c INFO: running hybridGM3@390 for 97 with 38811 remaining (b = 0.01)
9455.13/1192.72	c INFO: running hybridGM3@388 for 97 with 38807 remaining (b = 0.01)
9477.43/1195.57	c INFO: running hybridGM3@293 for 194 with 38804 remaining (b = 0.01)
9490.94/1197.26	c INFO: running TNM@0 for 97 with 38803 remaining (b = 0.00)
10098.30/1273.51	c INFO: running hybridGM3@391 for 97 with 38727 remaining (b = 0.01)
10181.10/1283.94	c INFO: running TNM@0 for 97 with 38716 remaining (b = 0.00)
10212.88/1287.99	c INFO: running TNM@0 for 97 with 38712 remaining (b = 0.00)
10289.22/1297.56	c INFO: running hybridGM3@196 for 291 with 38703 remaining (b = 0.01)
10855.45/1368.80	c INFO: running TNM@289 for 1843 with 38631 remaining (b = 0.09)
10921.51/1377.05	c INFO: running adaptg2wsat2009++@397 for 194 with 38623 remaining (b = 0.01)
10971.58/1383.36	c INFO: running hybridGM3@196 for 291 with 38617 remaining (b = 0.01)
11004.17/1387.42	c INFO: running hybridGM3@195 for 291 with 38613 remaining (b = 0.01)
11048.71/1393.01	c INFO: running hybridGM3@393 for 97 with 38607 remaining (b = 0.01)
11853.54/1494.30	c INFO: running NCVWr@0 for 485 with 38506 remaining (b = 0.02)
12484.17/1573.56	c INFO: running adaptg2wsat2009++@497 for 97 with 38427 remaining (b = 0.01)
12592.34/1587.17	c INFO: running hybridGM3@291 for 194 with 38413 remaining (b = 0.01)
13242.06/1668.84	c INFO: running FH@0 for 97 with 38331 remaining (b = 0.00)
13274.63/1673.01	c INFO: running hybridGM3@295 for 194 with 38327 remaining (b = 0.01)
13307.27/1677.05	c INFO: running hybridGM3@389 for 97 with 38323 remaining (b = 0.01)
14039.67/1769.15	c INFO: running TNM@288 for 1358 with 38231 remaining (b = 0.06)
14065.08/1772.35	c INFO: running hybridGM3@194 for 291 with 38228 remaining (b = 0.01)
14162.92/1784.65	c INFO: running hybridGM3@386 for 194 with 38215 remaining (b = 0.01)
14845.29/1870.49	c INFO: running hybridGM3@284 for 291 with 38130 remaining (b = 0.01)
15685.90/1976.13	c INFO: running hybridGM3@0 for 194 with 38024 remaining (b = 0.01)
15759.87/1985.44	c INFO: running NCVWr@196 for 291 with 38015 remaining (b = 0.02)
16416.75/2068.02	c INFO: running hybridGM3@390 for 97 with 37932 remaining (b = 0.01)
17149.16/2160.14	c INFO: running hybridGM3@475 for 97 with 37840 remaining (b = 0.01)
17174.58/2163.32	c INFO: running hybridGM3@200 for 291 with 37837 remaining (b = 0.01)
17297.02/2178.80	c INFO: running hybridGM3@196 for 291 with 37821 remaining (b = 0.01)
17906.96/2255.44	c INFO: running TNM@101 for 1358 with 37745 remaining (b = 0.06)
17934.01/2258.82	c INFO: running hybridGM3@0 for 194 with 37741 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321794-1304367494/watcher-3321794-1304367494 -o /tmp/evaluation-result-3321794-1304367494/solver-3321794-1304367494 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321794-1304367494.cnf -seed 2123509085 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.58 7.68 5.32 1/202 29054
/proc/meminfo: memFree=16786556/32950928 swapFree=67111404/67111528
[pid=29054] ppid=29052 vsize=15380 CPUtime=0 cores=0-7
/proc/29054/stat : 29054 (python) S 29052 29054 28873 0 -1 4202496 820 0 0 0 0 0 0 0 20 0 1 0 548348167 15749120 704 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594864640 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/29054/statm: 3845 704 334 364 0 332 0

[startup+0.0854931 s]
/proc/loadavg: 7.58 7.68 5.32 1/202 29054
/proc/meminfo: memFree=16786556/32950928 swapFree=67111404/67111528
[pid=29054] ppid=29052 vsize=93956 CPUtime=0.06 cores=0-7
/proc/29054/stat : 29054 (python) S 29052 29054 28873 0 -1 4202496 2694 0 0 0 4 2 0 0 20 0 1 0 548348167 96210944 2406 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594864640 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/29054/statm: 23490 2407 764 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 93956

[startup+0.100461 s]
/proc/loadavg: 7.58 7.68 5.32 1/202 29054
/proc/meminfo: memFree=16786556/32950928 swapFree=67111404/67111528
[pid=29054] ppid=29052 vsize=104220 CPUtime=0.07 cores=0-7
/proc/29054/stat : 29054 (python) R 29052 29054 28873 0 -1 4202496 3058 0 0 0 5 2 0 0 20 0 1 0 548348167 106721280 2740 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594864640 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29054/statm: 26055 2740 847 364 0 1803 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104220

[startup+0.300351 s]
/proc/loadavg: 7.58 7.68 5.32 1/202 29054
/proc/meminfo: memFree=16786556/32950928 swapFree=67111404/67111528
[pid=29054] ppid=29052 vsize=170748 CPUtime=0.24 cores=0-7
/proc/29054/stat : 29054 (python) R 29052 29054 28873 0 -1 4202496 6743 934 1 0 18 6 0 0 17 0 1 0 548348167 174845952 4808 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594862437 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29054/statm: 42687 4808 1336 364 0 3452 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 170748

[startup+0.700278 s]
/proc/loadavg: 7.58 7.68 5.32 1/202 29054
/proc/meminfo: memFree=16786556/32950928 swapFree=67111404/67111528
[pid=29054] ppid=29052 vsize=295584 CPUtime=0.62 cores=0-7
/proc/29054/stat : 29054 (python) R 29052 29054 28873 0 -1 4202496 13523 934 1 0 54 8 0 0 17 0 1 0 548348167 302678016 11205 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594527429 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29054/statm: 73896 11205 1761 364 0 9820 0
Current children cumulated CPU time (s) 0.62
Current children cumulated vsize (KiB) 295584

[startup+1.50014 s]
/proc/loadavg: 7.58 7.68 5.32 2/203 29059
/proc/meminfo: memFree=16730500/32950928 swapFree=67111404/67111528
[pid=29054] ppid=29052 vsize=312972 CPUtime=1.41 cores=0-7
/proc/29054/stat : 29054 (python) R 29052 29054 28873 0 -1 4202496 21967 934 1 0 132 9 0 0 19 0 1 0 548348167 320483328 15628 33554432000 4194304 5683644 140736399307360 18446744073709551615 47804536658312 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29054/statm: 78243 15628 1826 364 0 14167 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 312972

[startup+3.10093 s]
/proc/loadavg: 7.05 7.57 5.30 2/203 29059
/proc/meminfo: memFree=16730128/32950928 swapFree=67111404/67111528
[pid=29054] ppid=29052 vsize=312972 CPUtime=3.02 cores=0-7
/proc/29054/stat : 29054 (python) R 29052 29054 28873 0 -1 4202496 21967 934 1 0 293 9 0 0 22 0 1 0 548348167 320483328 15628 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594526131 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29054/statm: 78243 15628 1826 364 0 14167 0
Current children cumulated CPU time (s) 3.02
Current children cumulated vsize (KiB) 312972

[startup+6.30029 s]
/proc/loadavg: 7.05 7.57 5.30 2/203 29059
/proc/meminfo: memFree=16731376/32950928 swapFree=67111404/67111528
[pid=29054] ppid=29052 vsize=312972 CPUtime=6.21 cores=0-7
/proc/29054/stat : 29054 (python) R 29052 29054 28873 0 -1 4202496 21974 934 1 0 612 9 0 0 25 0 1 0 548348167 320483328 15635 33554432000 4194304 5683644 140736399307360 18446744073709551615 47804536719500 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29054/statm: 78243 15635 1833 364 0 14167 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 312972

[startup+12.7012 s]
/proc/loadavg: 6.68 7.46 5.29 9/227 29083
/proc/meminfo: memFree=16462684/32950928 swapFree=67111404/67111528
[pid=29054] ppid=29052 vsize=457836 CPUtime=7.71 cores=0-7
/proc/29054/stat : 29054 (python) S 29052 29054 28873 0 -1 4202496 27917 934 1 0 759 12 0 0 25 0 9 0 548348167 468824064 15216 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29054/statm: 114459 15216 1889 364 0 50356 0
[pid=29060] ppid=29054 vsize=310264 CPUtime=0 cores=0-7
/proc/29060/stat : 29060 (python) S 29054 29054 28873 0 -1 4202560 898 0 0 0 0 0 0 0 15 0 1 0 548348919 317710336 13494 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886671 0 0 16781312 514 4070739495996064004 0 0 17 1 0 0 0
/proc/29060/statm: 77566 13494 375 364 0 13484 0
[pid=29062] ppid=29060 vsize=268420 CPUtime=5.17 cores=0-7
/proc/29062/stat : 29062 (hybridGM3) R 29060 29062 29062 0 -1 4202496 8082 0 0 0 516 1 0 0 25 0 1 0 548348919 274862080 7818 33554432000 134512640 135204385 4294849280 18446744073709551615 134537435 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29062/statm: 67105 7818 64 169 0 66935 0
[pid=29063] ppid=29054 vsize=320520 CPUtime=0 cores=0-7
/proc/29063/stat : 29063 (python) S 29054 29054 28873 0 -1 4202560 910 0 0 0 0 0 0 0 15 0 1 0 548348923 328212480 13493 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 1771112300892094724 0 0 17 1 0 0 0
/proc/29063/statm: 80130 13493 370 364 0 16045 0
[pid=29065] ppid=29063 vsize=268420 CPUtime=5.14 cores=0-7
/proc/29065/stat : 29065 (hybridGM3) R 29063 29065 29065 0 -1 4202496 8080 0 0 0 513 1 0 0 25 0 1 0 548348923 274862080 7820 33554432000 134512640 135204385 4288233360 18446744073709551615 134536698 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29065/statm: 67105 7820 64 169 0 66935 0
[pid=29066] ppid=29054 vsize=396312 CPUtime=0 cores=0-7
/proc/29066/stat : 29066 (python) S 29054 29054 28873 0 -1 4202560 781 0 0 0 0 0 0 0 15 0 1 0 548348926 405823488 13671 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 4598070220479758596 0 0 17 1 0 0 0
/proc/29066/statm: 99078 13671 371 364 0 34990 0
[pid=29068] ppid=29066 vsize=268420 CPUtime=5.1 cores=0-7
/proc/29068/stat : 29068 (hybridGM3) R 29066 29068 29068 0 -1 4202496 8074 0 0 0 509 1 0 0 25 0 1 0 548348927 274862080 7820 33554432000 134512640 135204385 4286918224 18446744073709551615 134545859 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29068/statm: 67105 7820 64 169 0 66935 0
[pid=29069] ppid=29054 vsize=406568 CPUtime=0 cores=0-7
/proc/29069/stat : 29069 (python) S 29054 29054 28873 0 -1 4202560 791 0 0 0 0 0 0 0 15 0 1 0 548348930 416325632 13628 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 1771116149182791940 0 0 17 4 0 0 0
/proc/29069/statm: 101642 13628 371 364 0 37551 0
[pid=29071] ppid=29069 vsize=268420 CPUtime=5.04 cores=0-7
/proc/29071/stat : 29071 (hybridGM3) R 29069 29071 29071 0 -1 4202496 8075 0 0 0 504 0 0 0 25 0 1 0 548348931 274862080 7820 33554432000 134512640 135204385 4293156976 18446744073709551615 134536676 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29071/statm: 67105 7820 64 169 0 66935 0
[pid=29072] ppid=29054 vsize=416824 CPUtime=0 cores=0-7
/proc/29072/stat : 29072 (python) S 29054 29054 28873 0 -1 4202560 802 0 0 0 0 0 0 0 16 0 1 0 548348934 426827776 13751 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 4274998519867080964 0 0 17 1 0 0 0
/proc/29072/statm: 104206 13751 371 364 0 40112 0
[pid=29074] ppid=29072 vsize=268420 CPUtime=4.98 cores=0-7
/proc/29074/stat : 29074 (hybridGM3) R 29072 29074 29074 0 -1 4202496 8074 0 0 0 497 1 0 0 25 0 1 0 548348935 274862080 7819 33554432000 134512640 135204385 4287130384 18446744073709551615 134537565 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29074/statm: 67105 7819 64 169 0 66935 0
[pid=29075] ppid=29054 vsize=427080 CPUtime=0 cores=0-7
/proc/29075/stat : 29075 (python) S 29054 29054 28873 0 -1 4202560 809 0 0 0 0 0 0 0 15 0 1 0 548348938 437329920 13755 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 4257524256444743940 0 0 17 6 0 0 0
/proc/29075/statm: 106770 13755 371 364 0 42673 0
[pid=29077] ppid=29075 vsize=268424 CPUtime=4.94 cores=0-7
/proc/29077/stat : 29077 (hybridGM3) R 29075 29077 29077 0 -1 4202496 8083 0 0 0 493 1 0 0 25 0 1 0 548348938 274866176 7824 33554432000 134512640 135204385 4291551296 18446744073709551615 134537435 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29077/statm: 67106 7824 64 169 0 66936 0
[pid=29078] ppid=29054 vsize=437336 CPUtime=0 cores=0-7
/proc/29078/stat : 29078 (python) S 29054 29054 28873 0 -1 4202560 821 0 0 0 0 0 0 0 18 0 1 0 548348942 447832064 13673 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 4186467217988092163 0 0 17 0 0 0 0
/proc/29078/statm: 109334 13673 371 364 0 45234 0
[pid=29080] ppid=29078 vsize=465044 CPUtime=4.91 cores=0-7
/proc/29080/stat : 29080 (TNM) R 29078 29080 29080 0 -1 4202496 6006 0 0 0 490 1 0 0 25 0 1 0 548348943 476205056 5749 33554432000 134512640 135008748 4288179232 18446744073709551615 134529367 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29080/statm: 116261 5749 46 122 0 115161 0
[pid=29081] ppid=29054 vsize=447592 CPUtime=0 cores=0-7
/proc/29081/stat : 29081 (python) S 29054 29054 28873 0 -1 4202560 860 0 0 0 0 0 0 0 15 0 1 0 548348946 458334208 13700 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 4257520408154079231 0 0 17 6 0 0 0
/proc/29081/statm: 111898 13700 377 364 0 47795 0
[pid=29083] ppid=29081 vsize=268424 CPUtime=4.84 cores=0-7
/proc/29083/stat : 29083 (hybridGM3) R 29081 29083 29083 0 -1 4202496 8081 0 0 0 484 0 0 0 25 0 1 0 548348947 274866176 7817 33554432000 134512640 135204385 4287246400 18446744073709551615 134536605 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29083/statm: 67106 7817 64 169 0 66936 0
[pid=29054/tid=29061] ppid=29052 vsize=457836 CPUtime=0 cores=0-7
/proc/29054/task/29061/stat : 29061 (python) S 29052 29054 28873 0 -1 4202560 27 934 0 0 0 0 0 0 25 0 9 0 548348919 468824064 15216 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 0 0 0 0
[pid=29054/tid=29064] ppid=29052 vsize=457836 CPUtime=0 cores=0-7
/proc/29054/task/29064/stat : 29064 (python) S 29052 29054 28873 0 -1 4202560 28 934 0 0 0 0 0 0 18 0 9 0 548348923 468824064 15216 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 3 0 0 0
[pid=29054/tid=29067] ppid=29052 vsize=457836 CPUtime=0 cores=0-7
/proc/29054/task/29067/stat : 29067 (python) S 29052 29054 28873 0 -1 4202560 89 934 0 0 0 0 0 0 20 0 9 0 548348927 468824064 15216 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29070] ppid=29052 vsize=457836 CPUtime=0 cores=0-7
/proc/29054/task/29070/stat : 29070 (python) S 29052 29054 28873 0 -1 4202560 32 934 0 0 0 0 0 0 22 0 9 0 548348930 468824064 15216 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29073] ppid=29052 vsize=457836 CPUtime=0 cores=0-7
/proc/29054/task/29073/stat : 29073 (python) S 29052 29054 28873 0 -1 4202560 35 934 0 0 0 0 0 0 19 0 9 0 548348934 468824064 15216 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 0 0 0 0
[pid=29054/tid=29076] ppid=29052 vsize=457836 CPUtime=0 cores=0-7
/proc/29054/task/29076/stat : 29076 (python) S 29052 29054 28873 0 -1 4202560 33 934 0 0 0 0 0 0 21 0 9 0 548348938 468824064 15216 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 6 0 0 0
[pid=29054/tid=29079] ppid=29052 vsize=457836 CPUtime=0 cores=0-7
/proc/29054/task/29079/stat : 29079 (python) S 29052 29054 28873 0 -1 4202560 35 934 0 0 0 0 0 0 23 0 9 0 548348942 468824064 15216 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 0 0 0 0
[pid=29054/tid=29082] ppid=29052 vsize=457836 CPUtime=0 cores=0-7
/proc/29054/task/29082/stat : 29082 (python) S 29052 29054 28873 0 -1 4202560 33 934 0 0 0 0 0 0 25 0 9 0 548348947 468824064 15216 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 47.83
Current children cumulated vsize (KiB) 5964324

[startup+25.5019 s]
/proc/loadavg: 6.95 7.50 5.32 9/227 29083
/proc/meminfo: memFree=16464836/32950928 swapFree=67111404/67111528
[pid=29054] ppid=29052 vsize=457836 CPUtime=7.71 cores=0-7
/proc/29054/stat : 29054 (python) S 29052 29054 28873 0 -1 4202496 27917 934 1 0 759 12 0 0 25 0 9 0 548348167 468824064 15216 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606693323 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29054/statm: 114459 15216 1889 364 0 50356 0
[pid=29060] ppid=29054 vsize=310264 CPUtime=0.02 cores=0-7
/proc/29060/stat : 29060 (python) S 29054 29054 28873 0 -1 4202560 904 0 0 0 1 1 0 0 15 0 1 0 548348919 317710336 13495 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886671 0 0 16781312 514 6441431696721019140 0 0 17 1 0 0 0
/proc/29060/statm: 77566 13495 376 364 0 13484 0
[pid=29062] ppid=29060 vsize=268420 CPUtime=17.97 cores=0-7
/proc/29062/stat : 29062 (hybridGM3) R 29060 29062 29062 0 -1 4202496 8084 0 0 0 1796 1 0 0 25 0 1 0 548348919 274862080 7820 33554432000 134512640 135204385 4294849280 18446744073709551615 134537608 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29062/statm: 67105 7820 64 169 0 66935 0
[pid=29063] ppid=29054 vsize=320520 CPUtime=0.02 cores=0-7
/proc/29063/stat : 29063 (python) S 29054 29054 28873 0 -1 4202560 915 0 0 0 1 1 0 0 15 0 1 0 548348923 328212480 13493 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 6441431696721019140 0 0 17 1 0 0 0
/proc/29063/statm: 80130 13493 370 364 0 16045 0
[pid=29065] ppid=29063 vsize=268420 CPUtime=17.94 cores=0-7
/proc/29065/stat : 29065 (hybridGM3) R 29063 29065 29065 0 -1 4202496 8080 0 0 0 1793 1 0 0 25 0 1 0 548348923 274862080 7820 33554432000 134512640 135204385 4288233360 18446744073709551615 134536676 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29065/statm: 67105 7820 64 169 0 66935 0
[pid=29066] ppid=29054 vsize=396312 CPUtime=0.02 cores=0-7
/proc/29066/stat : 29066 (python) S 29054 29054 28873 0 -1 4202560 783 0 0 0 1 1 0 0 15 0 1 0 548348926 405823488 13671 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 6441431696721019140 0 0 17 1 0 0 0
/proc/29066/statm: 99078 13671 371 364 0 34990 0
[pid=29068] ppid=29066 vsize=268420 CPUtime=17.89 cores=0-7
/proc/29068/stat : 29068 (hybridGM3) R 29066 29068 29068 0 -1 4202496 8079 0 0 0 1788 1 0 0 25 0 1 0 548348927 274862080 7825 33554432000 134512640 135204385 4286918224 18446744073709551615 134545837 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29068/statm: 67105 7825 64 169 0 66935 0
[pid=29069] ppid=29054 vsize=406568 CPUtime=0.02 cores=0-7
/proc/29069/stat : 29069 (python) S 29054 29054 28873 0 -1 4202560 792 0 0 0 1 1 0 0 15 0 1 0 548348930 416325632 13628 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 6441431696721019140 0 0 17 4 0 0 0
/proc/29069/statm: 101642 13628 371 364 0 37551 0
[pid=29071] ppid=29069 vsize=268420 CPUtime=17.82 cores=0-7
/proc/29071/stat : 29071 (hybridGM3) R 29069 29071 29071 0 -1 4202496 8076 0 0 0 1782 0 0 0 25 0 1 0 548348931 274862080 7821 33554432000 134512640 135204385 4293156976 18446744073709551615 134547392 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29071/statm: 67105 7821 64 169 0 66935 0
[pid=29072] ppid=29054 vsize=416824 CPUtime=0.02 cores=0-7
/proc/29072/stat : 29072 (python) S 29054 29054 28873 0 -1 4202560 805 0 0 0 1 1 0 0 15 0 1 0 548348934 426827776 13751 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 6441431696721019140 0 0 17 1 0 0 0
/proc/29072/statm: 104206 13751 371 364 0 40112 0
[pid=29074] ppid=29072 vsize=268420 CPUtime=17.66 cores=0-7
/proc/29074/stat : 29074 (hybridGM3) R 29072 29074 29074 0 -1 4202496 8074 0 0 0 1765 1 0 0 25 0 1 0 548348935 274862080 7819 33554432000 134512640 135204385 4287130384 18446744073709551615 134536922 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29074/statm: 67105 7819 64 169 0 66935 0

################
# More data... #
################

/proc/29172/statm: 155486 14074 400 364 0 91332 0
[pid=29174] ppid=29172 vsize=268420 CPUtime=277 cores=0-7
/proc/29174/stat : 29174 (hybridGM3) R 29172 29174 29174 0 -1 4202496 8109 0 0 0 27698 2 0 0 25 0 1 0 548427317 274862080 7827 33554432000 134512640 135204385 4292445056 18446744073709551615 134537249 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29174/statm: 67105 7827 64 169 0 66935 0
[pid=29172/tid=29192] ppid=29054 vsize=621944 CPUtime=0 cores=0-7
/proc/29172/task/29192/stat : 29192 (python) S 29054 29054 28873 0 -1 4202560 83 0 0 0 0 0 0 0 16 0 2 0 548446966 636870656 14074 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 514 18446604453922012160 0 0 -1 4 0 0 0
[pid=29177] ppid=29054 vsize=632200 CPUtime=0.55 cores=0-7
/proc/29177/stat : 29177 (python) S 29054 29054 28873 0 -1 4202560 1190 0 0 0 27 28 0 0 18 0 2 0 548428093 647372800 14069 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29177/statm: 158050 14069 400 364 0 93893 0
[pid=29179] ppid=29177 vsize=431704 CPUtime=296.74 cores=0-7
/proc/29179/stat : 29179 (adaptg2wsat2009) T 29177 29179 29179 0 -1 4202496 6269 0 0 0 29672 2 0 0 25 0 1 0 548428094 442064896 5983 33554432000 134512640 135107411 4292873680 18446744073709551615 134532156 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29179/statm: 107926 5983 59 146 0 106802 0
[pid=29177/tid=29193] ppid=29054 vsize=632200 CPUtime=0 cores=0-7
/proc/29177/task/29193/stat : 29193 (python) S 29054 29054 28873 0 -1 4202560 86 0 0 0 0 0 0 0 18 0 2 0 548447727 647372800 14069 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 514 18446604449565517056 0 0 -1 1 0 0 0
[pid=29181] ppid=29054 vsize=642456 CPUtime=0.18 cores=0-7
/proc/29181/stat : 29181 (python) S 29054 29054 28873 0 -1 4202560 1195 0 0 0 8 10 0 0 19 0 2 0 548428146 657874944 14075 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29181/statm: 160614 14075 400 364 0 96454 0
[pid=29183] ppid=29181 vsize=260400 CPUtime=98.14 cores=0-7
/proc/29183/stat : 29183 (FH) T 29181 29183 29183 0 -1 4202496 6181 0 0 0 9813 1 0 0 25 0 1 0 548428147 266649600 5898 33554432000 134512640 134936988 4294768320 18446744073709551615 134552455 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29183/statm: 65100 5898 41 104 0 64604 0
[pid=29181/tid=29187] ppid=29054 vsize=642456 CPUtime=0 cores=0-7
/proc/29181/task/29187/stat : 29187 (python) S 29054 29054 28873 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 548438065 657874944 14075 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 514 18446604453887433792 0 0 -1 5 0 0 0
[pid=29197] ppid=29054 vsize=652712 CPUtime=1.93 cores=0-7
/proc/29197/stat : 29197 (python) S 29054 29054 28873 0 -1 4202560 1218 0 0 0 98 95 0 0 18 0 2 0 548457865 668377088 14085 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29197/statm: 163178 14085 401 364 0 99015 0
[pid=29199] ppid=29197 vsize=465044 CPUtime=971.41 cores=0-7
/proc/29199/stat : 29199 (TNM) R 29197 29199 29199 0 -1 4202496 6031 0 0 0 97141 0 0 0 25 0 1 0 548457865 476205056 5749 33554432000 134512640 135008748 4290197264 18446744073709551615 134527091 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29199/statm: 116261 5749 46 122 0 115161 0
[pid=29197/tid=29203] ppid=29054 vsize=652712 CPUtime=0 cores=0-7
/proc/29197/task/29203/stat : 29203 (python) S 29054 29054 28873 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 548467883 668377088 14085 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 514 18446604453887432896 0 0 -1 1 0 0 0
[pid=29204] ppid=29054 vsize=662968 CPUtime=1.14 cores=0-7
/proc/29204/stat : 29204 (python) S 29054 29054 28873 0 -1 4202560 1249 0 0 0 56 58 0 0 18 0 2 0 548467893 678879232 14098 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29204/statm: 165742 14098 406 364 0 101576 0
[pid=29206] ppid=29204 vsize=465044 CPUtime=569.48 cores=0-7
/proc/29206/stat : 29206 (TNM) R 29204 29206 29206 0 -1 4202496 6041 0 0 0 56946 2 0 0 25 0 1 0 548467894 476205056 5749 33554432000 134512640 135008748 4287183744 18446744073709551615 134527542 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29206/statm: 116261 5749 46 122 0 115161 0
[pid=29204/tid=29215] ppid=29054 vsize=662968 CPUtime=0 cores=0-7
/proc/29204/task/29215/stat : 29215 (python) S 29054 29054 28873 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 548477912 678879232 14098 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 514 18446604453985309760 0 0 -1 7 0 0 0
[pid=29209] ppid=29054 vsize=673224 CPUtime=0.18 cores=0-7
/proc/29209/stat : 29209 (python) S 29054 29054 28873 0 -1 4202560 1248 0 0 0 8 10 0 0 19 0 2 0 548476562 689381376 14162 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29209/statm: 168306 14162 406 364 0 104137 0
[pid=29211] ppid=29209 vsize=465044 CPUtime=99.21 cores=0-7
/proc/29211/stat : 29211 (TNM) T 29209 29211 29211 0 -1 4202496 6040 0 0 0 9920 1 0 0 25 0 1 0 548476563 476205056 5749 33554432000 134512640 135008748 4292405408 18446744073709551615 134528967 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29211/statm: 116261 5749 46 122 0 115161 0
[pid=29209/tid=29219] ppid=29054 vsize=673224 CPUtime=0 cores=0-7
/proc/29209/task/29219/stat : 29219 (python) S 29054 29054 28873 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 548486492 689381376 14162 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 514 18446604453984904320 0 0 -1 4 0 0 0
[pid=29212] ppid=29054 vsize=683480 CPUtime=0.19 cores=0-7
/proc/29212/stat : 29212 (python) S 29054 29054 28873 0 -1 4202560 1248 0 0 0 9 10 0 0 19 0 2 0 548476966 699883520 14227 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29212/statm: 170870 14227 407 364 0 106698 0
[pid=29214] ppid=29212 vsize=465044 CPUtime=99.12 cores=0-7
/proc/29214/stat : 29214 (TNM) T 29212 29214 29214 0 -1 4202496 6042 0 0 0 9912 0 0 0 25 0 1 0 548476968 476205056 5750 33554432000 134512640 135008748 4287062736 18446744073709551615 134527795 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/29214/statm: 116261 5750 46 122 0 115161 0
[pid=29212/tid=29220] ppid=29054 vsize=683480 CPUtime=0 cores=0-7
/proc/29212/task/29220/stat : 29220 (python) S 29054 29054 28873 0 -1 4202560 87 0 0 0 0 0 0 0 19 0 2 0 548486898 699883520 14227 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 514 18446604453816753152 0 0 -1 6 0 0 0
[pid=29224] ppid=29054 vsize=693736 CPUtime=1.49 cores=0-7
/proc/29224/stat : 29224 (python) S 29054 29054 28873 0 -1 4202560 1272 0 0 0 81 68 0 0 18 0 2 0 548497597 710385664 14122 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/29224/statm: 173434 14122 407 364 0 109259 0
[pid=29226] ppid=29224 vsize=433188 CPUtime=763.82 cores=0-7
/proc/29226/stat : 29226 (NCVWr) R 29224 29226 29226 0 -1 4202496 6437 0 0 0 76380 2 0 0 25 0 1 0 548497598 443584512 6150 33554432000 134512640 135113558 4293059184 18446744073709551615 134531726 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29226/statm: 108297 6150 58 147 0 107172 0
[pid=29224/tid=29247] ppid=29054 vsize=693736 CPUtime=0 cores=0-7
/proc/29224/task/29247/stat : 29247 (python) S 29054 29054 28873 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 548546699 710385664 14122 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 514 18446604452722811328 0 0 -1 2 0 0 0
[pid=29231] ppid=29054 vsize=703992 CPUtime=0.19 cores=0-7
/proc/29231/stat : 29231 (python) S 29054 29054 28873 0 -1 4202560 1261 0 0 0 11 8 0 0 19 0 2 0 548515051 720887808 14188 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29231/statm: 175998 14188 401 364 0 111820 0
[pid=29233] ppid=29231 vsize=260396 CPUtime=99.95 cores=0-7
/proc/29233/stat : 29233 (FH) T 29231 29233 29233 0 -1 4202496 6188 0 0 0 9994 1 0 0 25 0 1 0 548515052 266645504 5897 33554432000 134512640 134936988 4293309104 18446744073709551615 134552382 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29233/statm: 65099 5897 41 104 0 64603 0
[pid=29231/tid=29237] ppid=29054 vsize=703992 CPUtime=0 cores=0-7
/proc/29231/task/29237/stat : 29237 (python) S 29054 29054 28873 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 548525070 720887808 14188 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 514 18446604449437560896 0 0 -1 0 0 0 0
[pid=29243] ppid=29054 vsize=714248 CPUtime=0.4 cores=0-7
/proc/29243/stat : 29243 (python) S 29054 29054 28873 0 -1 4202560 1269 0 0 0 20 20 0 0 16 0 2 0 548545780 731389952 14132 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606693323 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/29243/statm: 178562 14132 401 364 0 114381 0
[pid=29245] ppid=29243 vsize=268424 CPUtime=197.59 cores=0-7
/proc/29245/stat : 29245 (hybridGM3) T 29243 29245 29245 0 -1 4202496 8116 0 0 0 19757 2 0 0 25 0 1 0 548545781 274866176 7825 33554432000 134512640 135204385 4290079968 18446744073709551615 134536993 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29245/statm: 67106 7825 64 169 0 66936 0
[pid=29243/tid=29253] ppid=29054 vsize=714248 CPUtime=0 cores=0-7
/proc/29243/task/29253/stat : 29253 (python) S 29054 29054 28873 0 -1 4202560 94 0 0 0 0 0 0 0 16 0 2 0 548566035 731389952 14132 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 514 18446604449437561792 0 0 -1 1 0 0 0
[pid=29256] ppid=29054 vsize=724504 CPUtime=0 cores=0-7
/proc/29256/stat : 29256 (python) S 29054 29054 28873 0 -1 4202560 933 0 0 0 0 0 0 0 19 0 1 0 548574050 741892096 14119 33554432000 4194304 5683644 140736399307360 18446744073709551615 235594886726 0 0 16781312 514 17631211289793527807 0 0 17 0 0 0 0
/proc/29256/statm: 181126 14119 346 364 0 116942 0
[pid=29258] ppid=29256 vsize=268416 CPUtime=0.49 cores=0-7
/proc/29258/stat : 29258 (hybridGM3) R 29256 29258 29258 0 -1 4202496 3808 0 0 0 48 1 0 0 21 0 1 0 548574050 274857984 3517 33554432000 134512640 135204385 4289101200 18446744073709551615 134543968 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29258/statm: 67104 3517 57 169 0 66934 0
[pid=29054/tid=29061] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29061/stat : 29061 (python) S 29052 29054 28873 0 -1 4202560 46 934 0 0 0 0 0 0 15 0 36 0 548348919 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 0 0 0 0
[pid=29054/tid=29064] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29064/stat : 29064 (python) S 29052 29054 28873 0 -1 4202560 50 934 0 0 0 0 0 0 16 0 36 0 548348923 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 6 0 0 0
[pid=29054/tid=29067] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29067/stat : 29067 (python) S 29052 29054 28873 0 -1 4202560 104 934 0 0 0 0 0 0 18 0 36 0 548348927 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29070] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29070/stat : 29070 (python) S 29052 29054 28873 0 -1 4202560 49 934 0 0 0 0 0 0 18 0 36 0 548348930 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29073] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29073/stat : 29073 (python) S 29052 29054 28873 0 -1 4202560 54 934 0 0 0 0 0 0 15 0 36 0 548348934 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 0 0 0 0
[pid=29054/tid=29076] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29076/stat : 29076 (python) S 29052 29054 28873 0 -1 4202560 53 934 0 0 0 0 0 0 18 0 36 0 548348938 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29079] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29079/stat : 29079 (python) S 29052 29054 28873 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 36 0 548348942 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 0 0 0 0
[pid=29054/tid=29082] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29082/stat : 29082 (python) S 29052 29054 28873 0 -1 4202560 49 934 0 0 0 0 0 0 18 0 36 0 548348947 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 6 0 0 0
[pid=29054/tid=29092] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29092/stat : 29092 (python) S 29052 29054 28873 0 -1 4202560 58 934 0 0 0 0 0 0 15 0 36 0 548358964 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29104] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29104/stat : 29104 (python) S 29052 29054 28873 0 -1 4202560 63 934 0 0 0 0 0 0 18 0 36 0 548378089 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29107] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29107/stat : 29107 (python) S 29052 29054 28873 0 -1 4202560 39 934 0 0 0 0 0 0 18 0 36 0 548378583 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29110] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29110/stat : 29110 (python) S 29052 29054 28873 0 -1 4202560 53 934 0 0 0 0 0 0 18 0 36 0 548378589 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 6 0 0 0
[pid=29054/tid=29116] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29116/stat : 29116 (python) S 29052 29054 28873 0 -1 4202560 68 934 0 0 0 0 0 0 18 0 36 0 548388015 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29119] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29119/stat : 29119 (python) S 29052 29054 28873 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 36 0 548388230 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29124] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29124/stat : 29124 (python) S 29052 29054 28873 0 -1 4202560 55 934 0 0 0 0 0 0 18 0 36 0 548388718 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29132] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29132/stat : 29132 (python) S 29052 29054 28873 0 -1 4202560 96 934 0 0 0 0 0 0 20 0 36 0 548398260 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29135] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29135/stat : 29135 (python) S 29052 29054 28873 0 -1 4202560 34 934 0 0 0 0 0 0 20 0 36 0 548398428 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29142] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29142/stat : 29142 (python) S 29052 29054 28873 0 -1 4202560 50 934 0 0 0 0 0 0 18 0 36 0 548407776 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29146] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29146/stat : 29146 (python) S 29052 29054 28873 0 -1 4202560 38 934 0 0 0 0 0 0 19 0 36 0 548408185 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29149] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29149/stat : 29149 (python) S 29052 29054 28873 0 -1 4202560 40 934 0 0 0 0 0 0 18 0 36 0 548408362 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29156] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29156/stat : 29156 (python) S 29052 29054 28873 0 -1 4202560 42 934 0 0 0 0 0 0 20 0 36 0 548418067 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29160] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29160/stat : 29160 (python) S 29052 29054 28873 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 36 0 548418210 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29165] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29165/stat : 29165 (python) S 29052 29054 28873 0 -1 4202560 50 934 0 0 0 0 0 0 18 0 36 0 548418510 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29170] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29170/stat : 29170 (python) S 29052 29054 28873 0 -1 4202560 47 934 0 0 0 0 0 0 18 0 36 0 548426910 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29173] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29173/stat : 29173 (python) S 29052 29054 28873 0 -1 4202560 40 934 0 0 0 0 0 0 18 0 36 0 548427315 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29178] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29178/stat : 29178 (python) S 29052 29054 28873 0 -1 4202560 35 934 0 0 0 0 0 0 18 0 36 0 548428094 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29182] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29182/stat : 29182 (python) S 29052 29054 28873 0 -1 4202560 33 934 0 0 0 0 0 0 20 0 36 0 548428147 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29198] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29198/stat : 29198 (python) S 29052 29054 28873 0 -1 4202560 45 934 0 0 0 0 0 0 18 0 36 0 548457865 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29205] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29205/stat : 29205 (python) S 29052 29054 28873 0 -1 4202560 45 934 0 0 0 0 0 0 18 0 36 0 548467894 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29210] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29210/stat : 29210 (python) S 29052 29054 28873 0 -1 4202560 35 934 0 0 0 0 0 0 20 0 36 0 548476562 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29213] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29213/stat : 29213 (python) S 29052 29054 28873 0 -1 4202560 31 934 0 0 0 0 0 0 19 0 36 0 548476967 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29225] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29225/stat : 29225 (python) S 29052 29054 28873 0 -1 4202560 49 934 0 0 0 0 0 0 18 0 36 0 548497597 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 4 0 0 0
[pid=29054/tid=29232] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29232/stat : 29232 (python) S 29052 29054 28873 0 -1 4202560 40 934 0 0 0 0 0 0 20 0 36 0 548515052 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29244] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29244/stat : 29244 (python) S 29052 29054 28873 0 -1 4202560 37 934 0 0 0 0 0 0 20 0 36 0 548545780 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
[pid=29054/tid=29257] ppid=29052 vsize=734748 CPUtime=0 cores=0-7
/proc/29054/task/29257/stat : 29257 (python) S 29052 29054 28873 0 -1 4202560 37 934 0 0 0 0 0 0 20 0 36 0 548574050 752381952 15721 33554432000 4194304 5683644 140736399307360 18446744073709551615 235606690225 0 0 16781312 2 18446604453984906112 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 17938.1
Current children cumulated vsize (KiB) 32262036

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29054 and gives
#  childrusage.ru_utime.tv_sec=15
#  childrusage.ru_utime.tv_usec=70708
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=307953
# CPU time returned by wait4() is 15.3787
# while last known CPU time is 17938.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 2259.52
CPU time (s): 17938.1
CPU user time (s): 17921.6
CPU system time (s): 16.49
CPU usage (%): 793.893
Max. virtual memory (cumulated for all children) (KiB): 32262036

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 15.0707
system time used= 0.307953
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 106352
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1832
involuntary context switches= 122

runsolver used 22.0077 second user time and 59.365 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-02 22:18:14
IDJOB=3321794
IDBENCH=82572
IDSOLVER=1712
FILE ID=node120/3321794-1304367494
RUNJOBID= node120-1304366467-28887
PBS_JOBID= 13181751
Free space on /tmp= 73568 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v35000-c147000-S950666065-093-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321794-1304367494/watcher-3321794-1304367494 -o /tmp/evaluation-result-3321794-1304367494/solver-3321794-1304367494 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321794-1304367494.cnf -seed 2123509085 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e27af9a147b2d7c0283d090128805575
RANDOM SEED=2123509085

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      16786968 kB
Buffers:        603924 kB
Cached:        2596608 kB
SwapCached:          8 kB
Active:       13626332 kB
Inactive:      2132672 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      16786968 kB
SwapTotal:    67111528 kB
SwapFree:     67111404 kB
Dirty:           35012 kB
Writeback:           0 kB
AnonPages:    12559128 kB
Mapped:          18816 kB
Slab:           310804 kB
PageTables:      30664 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 13427300 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73532 MiB
End job on node120 at 2011-05-02 22:55:56