Trace number 3385254

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 17181.8 2168.27

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v35000-c147000-S419010076-063-UNKNOWN.cnf
MD5SUM07407a86c8d0f1e46c34022f68908549
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark235.041
Satisfiable
(Un)Satisfiability was proved
Number of variables35000
Number of clauses147000
Sum of the clauses size441000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3147000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.39/2.42	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.39/2.42	c INFO: solving HOME/instance-3385254-1305564963.cnf
0.39/2.42	c INFO: computing task features
0.88/2.94	c INFO: computed variable-clause graph statistics
0.88/2.96	c INFO: computed clause balance statistics
3.49/5.57	c INFO: computed variable balance statistics
5.59/7.70	c INFO: computed small-clause counts
5.69/7.71	c INFO: computed Horn-clause counts
7.18/9.28	c INFO: computed variable graph statistics
7.18/9.28	c INFO: collected features for HOME/instance-3385254-1305564963.cnf in 6.84 s
7.28/9.31	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.36)
7.28/9.34	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.21)
7.28/9.37	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.14)
7.38/9.40	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.10)
7.38/9.44	c INFO: running hybridGM3@0 for 97 with 4993 remaining (b = 0.07)
7.38/9.47	c INFO: running hybridGM3@0 for 97 with 4992 remaining (b = 0.05)
7.47/9.50	c INFO: running hybridGM3@0 for 194 with 4992 remaining (b = 0.08)
7.47/9.54	c INFO: running hybridGM3@0 for 194 with 4992 remaining (b = 0.06)
808.12/109.73	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
808.12/109.77	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
808.79/109.80	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
808.79/109.83	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
808.79/109.86	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
808.79/109.89	c INFO: running hybridGM3@0 for 97 with 4892 remaining (b = 0.03)
1567.52/204.99	c INFO: running hybridGM3@99 for 97 with 4797 remaining (b = 0.03)
1568.33/205.02	c INFO: running hybridGM3@98 for 97 with 4797 remaining (b = 0.03)
1568.33/205.09	c INFO: running hybridGM3@100 for 97 with 4797 remaining (b = 0.03)
1569.09/205.15	c INFO: running TNM@0 for 97 with 4797 remaining (b = 0.03)
1569.09/205.19	c INFO: running hybridGM3@100 for 97 with 4797 remaining (b = 0.03)
1576.19/206.09	c INFO: running hybridGM3@100 for 97 with 4796 remaining (b = 0.03)
1615.95/211.08	c INFO: running hybridGM3@0 for 97 with 4791 remaining (b = 0.03)
1616.82/211.18	c INFO: running hybridGM3@100 for 97 with 4791 remaining (b = 0.03)
2360.39/304.38	c INFO: running hybridGM3@95 for 97 with 4698 remaining (b = 0.03)
2369.13/305.47	c INFO: running hybridGM3@294 for 97 with 4696 remaining (b = 0.02)
2375.49/306.26	c INFO: running TNM@0 for 97 with 4696 remaining (b = 0.02)
2375.49/306.30	c INFO: running hybridGM3@193 for 97 with 4696 remaining (b = 0.02)
2376.97/306.45	c INFO: running hybridGM3@0 for 194 with 4695 remaining (b = 0.04)
2376.97/306.49	c INFO: running hybridGM3@296 for 97 with 4695 remaining (b = 0.02)
2384.17/307.37	c INFO: running TNM@0 for 97 with 4695 remaining (b = 0.02)
2392.11/308.36	c INFO: running hybridGM3@99 for 97 with 4694 remaining (b = 0.02)
3135.77/401.57	c INFO: running TNM@0 for 97 with 4600 remaining (b = 0.02)
3136.45/401.67	c INFO: running hybridGM3@192 for 97 with 4600 remaining (b = 0.02)
3137.17/401.77	c INFO: running hybridGM3@398 for 97 with 4600 remaining (b = 0.01)
3152.48/403.64	c INFO: running TNM@0 for 97 with 4598 remaining (b = 0.01)
3153.21/403.77	c INFO: running hybridGM3@395 for 97 with 4598 remaining (b = 0.01)
3175.48/406.57	c INFO: running TNM@0 for 97 with 4595 remaining (b = 0.01)
3176.25/406.69	c INFO: running TNM@0 for 97 with 4595 remaining (b = 0.01)
3895.82/496.96	c INFO: running TNM@0 for 97 with 4505 remaining (b = 0.01)
3912.54/499.06	c INFO: running TNM@0 for 2037 with 4503 remaining (b = 0.22)
3934.81/501.89	c INFO: running hybridGM3@0 for 194 with 4500 remaining (b = 0.03)
3944.36/503.08	c INFO: running hybridGM3@0 for 194 with 4499 remaining (b = 0.02)
3945.85/503.22	c INFO: running hybridGM3@100 for 97 with 4499 remaining (b = 0.01)
3968.32/506.05	c INFO: running hybridGM3@0 for 194 with 4496 remaining (b = 0.02)
3973.88/506.90	c INFO: running adaptg2wsat2009++@0 for 194 with 4495 remaining (b = 0.02)
3991.27/508.99	c INFO: running hybridGM3@0 for 194 with 4493 remaining (b = 0.02)
4693.78/597.30	c INFO: running TNM@0 for 97 with 4405 remaining (b = 0.01)
4704.00/598.54	c INFO: running TNM@0 for 97 with 4403 remaining (b = 0.01)
5500.66/698.68	c INFO: running hybridGM3@101 for 97 with 4303 remaining (b = 0.01)
5502.26/698.88	c INFO: running adaptg2wsat2009++@0 for 194 with 4303 remaining (b = 0.01)
5510.18/699.87	c INFO: running TNM@195 for 1843 with 4302 remaining (b = 0.11)
5534.12/702.83	c INFO: running hybridGM3@100 for 97 with 4299 remaining (b = 0.01)
5540.39/703.66	c INFO: running hybridGM3@0 for 194 with 4298 remaining (b = 0.01)
5557.07/705.77	c INFO: running hybridGM3@100 for 97 with 4296 remaining (b = 0.01)
5586.61/709.51	c INFO: running adaptg2wsat2009++@102 for 97 with 4292 remaining (b = 0.01)
6258.92/793.99	c INFO: running hybridGM3@194 for 291 with 4208 remaining (b = 0.02)
6315.39/801.09	c INFO: running hybridGM3@299 for 194 with 4201 remaining (b = 0.01)
6340.15/804.16	c INFO: running adaptg2wsat2009++@0 for 194 with 4198 remaining (b = 0.01)
6344.99/804.83	c INFO: running hybridGM3@0 for 194 with 4197 remaining (b = 0.01)
7066.61/895.49	c INFO: running FH@0 for 97 with 4106 remaining (b = 0.01)
7106.24/900.43	c INFO: running hybridGM3@198 for 291 with 4102 remaining (b = 0.01)
7864.96/995.85	c INFO: running hybridGM3@201 for 291 with 4006 remaining (b = 0.01)
7887.23/998.68	c INFO: running hybridGM3@399 for 97 with 4003 remaining (b = 0.01)
7903.92/1000.80	c INFO: running adaptg2wsat2009++@94 for 97 with 4001 remaining (b = 0.00)
7911.07/1001.61	c INFO: running adaptg2wsat2009++@0 for 194 with 4000 remaining (b = 0.01)
8564.45/1083.84	c INFO: running hybridGM3@289 for 291 with 3918 remaining (b = 0.01)
8645.50/1094.02	c INFO: running TNM@94 for 1940 with 3908 remaining (b = 0.09)
8710.00/1102.15	c INFO: running hybridGM3@194 for 291 with 3900 remaining (b = 0.01)
9410.95/1190.32	c INFO: running hybridGM3@297 for 194 with 3812 remaining (b = 0.01)
9473.75/1198.23	c INFO: running hybridGM3@287 for 291 with 3804 remaining (b = 0.01)
10169.27/1285.72	c INFO: running hybridGM3@398 for 97 with 3716 remaining (b = 0.01)
10868.73/1373.71	c INFO: running hybridGM3@384 for 194 with 3628 remaining (b = 0.01)
10926.76/1381.04	c INFO: running hybridGM3@198 for 291 with 3621 remaining (b = 0.01)
10981.58/1387.93	c INFO: running hybridGM3@0 for 194 with 3614 remaining (b = 0.01)
11061.92/1398.06	c INFO: running hybridGM3@483 for 97 with 3604 remaining (b = 0.01)
11777.15/1488.10	c INFO: running NCVWr@0 for 485 with 3514 remaining (b = 0.02)
11819.26/1493.39	c INFO: running adaptg2wsat2009++@0 for 194 with 3509 remaining (b = 0.01)
12439.24/1571.32	c INFO: running hybridGM3@478 for 97 with 3431 remaining (b = 0.01)
12545.72/1584.71	c INFO: running hybridGM3@295 for 194 with 3417 remaining (b = 0.01)
13196.66/1666.65	c INFO: running FH@0 for 97 with 3335 remaining (b = 0.00)
13278.53/1676.95	c INFO: running hybridGM3@395 for 97 with 3325 remaining (b = 0.01)
13414.49/1694.09	c INFO: running hybridGM3@196 for 291 with 3308 remaining (b = 0.01)
13994.55/1767.02	c INFO: running FH@295 for 97 with 3235 remaining (b = 0.00)
14035.88/1772.28	c INFO: running TNM@100 for 1455 with 3230 remaining (b = 0.06)
14116.17/1782.32	c INFO: running hybridGM3@390 for 97 with 3220 remaining (b = 0.01)
14752.07/1862.35	c INFO: running hybridGM3@200 for 291 with 3140 remaining (b = 0.01)
14873.65/1877.65	c INFO: running hybridGM3@202 for 291 with 3124 remaining (b = 0.01)
15684.29/1979.60	c INFO: running NCVWr@94 for 388 with 3022 remaining (b = 0.02)
15718.45/1983.97	c INFO: running hybridGM3@296 for 194 with 3018 remaining (b = 0.01)
17103.83/2158.24	c INFO: running hybridGM3@294 for 194 with 2844 remaining (b = 0.01)
17177.66/2167.52	c INFO: running NCVWr@0 for 485 with 2834 remaining (b = 0.02)
17181.81/2168.13	c INFO: running TNM@97 for 1455 with 2834 remaining (b = 0.06)
17181.81/2168.22	c INFO: running hybridGM3@0 for 194 with 2834 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385254-1305564963/watcher-3385254-1305564963 -o /tmp/evaluation-result-3385254-1305564963/solver-3385254-1305564963 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385254-1305564963.cnf -seed 1805731023 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 1/327 25128
/proc/meminfo: memFree=24006660/32951124 swapFree=65173164/67111528
[pid=25128] ppid=25126 vsize=15184 CPUtime=0 cores=0-7
/proc/25128/stat : 25128 (python) S 25126 25128 25102 0 -1 4202496 711 0 0 0 0 0 0 0 20 0 1 0 668094547 15548416 603 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 6 0 0 0
/proc/25128/statm: 3796 603 319 364 0 283 0

[startup+0.0983819 s]
/proc/loadavg: 0.00 0.00 0.00 1/327 25128
/proc/meminfo: memFree=24006660/32951124 swapFree=65173164/67111528
[pid=25128] ppid=25126 vsize=16236 CPUtime=0 cores=0-7
/proc/25128/stat : 25128 (python) S 25126 25128 25102 0 -1 4202496 1049 0 0 0 0 0 0 0 20 0 1 0 668094547 16625664 921 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 6 0 0 0
/proc/25128/statm: 4059 921 381 364 0 546 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16236

[startup+0.100383 s]
/proc/loadavg: 0.00 0.00 0.00 1/327 25128
/proc/meminfo: memFree=24006660/32951124 swapFree=65173164/67111528
[pid=25128] ppid=25126 vsize=16236 CPUtime=0 cores=0-7
/proc/25128/stat : 25128 (python) S 25126 25128 25102 0 -1 4202496 1049 0 0 0 0 0 0 0 20 0 1 0 668094547 16625664 921 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 6 0 0 0
/proc/25128/statm: 4059 921 381 364 0 546 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16236

[startup+0.300358 s]
/proc/loadavg: 0.00 0.00 0.00 1/327 25128
/proc/meminfo: memFree=24006660/32951124 swapFree=65173164/67111528
[pid=25128] ppid=25126 vsize=18880 CPUtime=0.01 cores=0-7
/proc/25128/stat : 25128 (python) S 25126 25128 25102 0 -1 4202496 1249 0 0 0 1 0 0 0 18 0 1 0 668094547 19333120 1104 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 6 0 0 0
/proc/25128/statm: 4720 1104 421 364 0 689 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18880

[startup+0.700289 s]
/proc/loadavg: 0.00 0.00 0.00 1/327 25128
/proc/meminfo: memFree=24006660/32951124 swapFree=65173164/67111528
[pid=25128] ppid=25126 vsize=104612 CPUtime=0.08 cores=0-7
/proc/25128/stat : 25128 (python) S 25126 25128 25102 0 -1 4202496 3143 0 0 0 5 3 0 0 15 0 1 0 668094547 107122688 2821 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 6 0 0 0
/proc/25128/statm: 26153 2821 847 364 0 1901 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 104612

[startup+1.50018 s]
/proc/loadavg: 0.00 0.00 0.00 1/328 25129
/proc/meminfo: memFree=23995836/32951124 swapFree=65173164/67111528
[pid=25128] ppid=25126 vsize=135744 CPUtime=0.18 cores=0-7
/proc/25128/stat : 25128 (python) S 25126 25128 25102 0 -1 4202496 5959 932 1 0 13 5 0 0 15 0 1 0 668094547 139001856 4150 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335890432 0 2147483391 16781312 2 18446744071699453118 0 0 17 6 0 0 0
/proc/25128/statm: 33936 4150 1032 364 0 3122 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135744

[startup+3.10084 s]
/proc/loadavg: 0.00 0.00 0.00 1/328 25133
/proc/meminfo: memFree=23993108/32951124 swapFree=65173164/67111528
[pid=25128] ppid=25126 vsize=312972 CPUtime=1.08 cores=0-7
/proc/25128/stat : 25128 (python) R 25126 25128 25102 0 -1 4202496 21963 932 1 0 96 12 0 0 16 0 1 0 668094547 320483328 15628 33554432000 4194304 5683644 140736696021184 18446744073709551615 4662178 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/25128/statm: 78243 15628 1826 364 0 14167 0
Current children cumulated CPU time (s) 1.08
Current children cumulated vsize (KiB) 312972
heavy processes:

[startup+6.30029 s]
/proc/loadavg: 0.00 0.00 0.00 2/328 25133
/proc/meminfo: memFree=23950192/32951124 swapFree=65173164/67111528
[pid=25128] ppid=25126 vsize=312972 CPUtime=4.28 cores=0-7
/proc/25128/stat : 25128 (python) R 25126 25128 25102 0 -1 4202496 21964 932 1 0 416 12 0 0 21 0 1 0 668094547 320483328 15629 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335551713 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/25128/statm: 78243 15629 1827 364 0 14167 0
Current children cumulated CPU time (s) 4.28
Current children cumulated vsize (KiB) 312972
heavy processes:

[startup+12.7011 s]
/proc/loadavg: 0.71 0.15 0.05 9/352 25157
/proc/meminfo: memFree=23666412/32951124 swapFree=65173164/67111528
[pid=25128] ppid=25126 vsize=392300 CPUtime=7.51 cores=0-7
/proc/25128/stat : 25128 (python) S 25126 25128 25102 0 -1 4202496 28518 932 1 0 736 15 0 0 22 0 9 0 668094547 401715200 15040 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25128/statm: 98075 15040 1889 364 0 33972 0
[pid=25134] ppid=25128 vsize=310264 CPUtime=0 cores=0-7
/proc/25134/stat : 25134 (python) S 25128 25128 25102 0 -1 4202560 739 0 0 0 0 0 0 0 15 0 1 0 668095479 317710336 13472 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912463 0 0 16781312 514 15724612772375265540 0 0 17 1 0 0 0
/proc/25134/statm: 77566 13472 353 364 0 13484 0
[pid=25136] ppid=25134 vsize=268424 CPUtime=3.36 cores=0-7
/proc/25136/stat : 25136 (hybridGM3) R 25134 25136 25136 0 -1 4202496 8083 0 0 0 336 0 0 0 25 0 1 0 668095479 274866176 7822 33554432000 134512640 135204385 4293570336 18446744073709551615 134546073 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/25136/statm: 67106 7822 64 169 0 66936 0
[pid=25137] ppid=25128 vsize=320520 CPUtime=0 cores=0-7
/proc/25137/stat : 25137 (python) S 25128 25128 25102 0 -1 4202560 740 0 0 0 0 0 0 0 15 0 1 0 668095482 328212480 13470 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 11397612304611639556 0 0 17 6 0 0 0
/proc/25137/statm: 80130 13470 347 364 0 16045 0
[pid=25139] ppid=25137 vsize=268424 CPUtime=3.34 cores=0-7
/proc/25139/stat : 25139 (hybridGM3) R 25137 25139 25139 0 -1 4202496 8080 0 0 0 333 1 0 0 25 0 1 0 668095482 274866176 7820 33554432000 134512640 135204385 4294889856 18446744073709551615 134536744 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/25139/statm: 67106 7820 64 169 0 66936 0
[pid=25140] ppid=25128 vsize=330776 CPUtime=0 cores=0-7
/proc/25140/stat : 25140 (python) S 25128 25128 25102 0 -1 4202560 743 0 0 0 0 0 0 0 15 0 1 0 668095485 338714624 13474 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 8820225107709362436 0 0 17 2 0 0 0
/proc/25140/statm: 82694 13474 347 364 0 18606 0
[pid=25142] ppid=25140 vsize=268420 CPUtime=3.27 cores=0-7
/proc/25142/stat : 25142 (hybridGM3) R 25140 25142 25142 0 -1 4202496 8079 0 0 0 326 1 0 0 25 0 1 0 668095485 274862080 7816 33554432000 134512640 135204385 4292399760 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/25142/statm: 67105 7816 64 169 0 66935 0
[pid=25143] ppid=25128 vsize=341032 CPUtime=0 cores=0-7
/proc/25143/stat : 25143 (python) S 25128 25128 25102 0 -1 4202560 752 0 0 0 0 0 0 0 15 0 1 0 668095488 349216768 13478 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 14083116678896386308 0 0 17 2 0 0 0
/proc/25143/statm: 85258 13478 347 364 0 21167 0
[pid=25145] ppid=25143 vsize=268424 CPUtime=3.28 cores=0-7
/proc/25145/stat : 25145 (hybridGM3) R 25143 25145 25145 0 -1 4202496 8080 0 0 0 327 1 0 0 25 0 1 0 668095489 274866176 7817 33554432000 134512640 135204385 4288539760 18446744073709551615 134537583 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25145/statm: 67106 7817 64 169 0 66936 0
[pid=25146] ppid=25128 vsize=351288 CPUtime=0 cores=0-7
/proc/25146/stat : 25146 (python) S 25128 25128 25102 0 -1 4202560 751 0 0 0 0 0 0 0 15 0 1 0 668095491 359718912 13482 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 10325966699529994498 0 0 17 6 0 0 0
/proc/25146/statm: 87822 13482 347 364 0 23728 0
[pid=25148] ppid=25146 vsize=268428 CPUtime=3.25 cores=0-7
/proc/25148/stat : 25148 (hybridGM3) R 25146 25148 25148 0 -1 4202496 8086 0 0 0 324 1 0 0 25 0 1 0 668095492 274870272 7822 33554432000 134512640 135204385 4289714608 18446744073709551615 134537290 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/25148/statm: 67107 7822 64 169 0 66937 0
[pid=25149] ppid=25128 vsize=361544 CPUtime=0 cores=0-7
/proc/25149/stat : 25149 (python) S 25128 25128 25102 0 -1 4202560 765 0 0 0 0 0 0 0 15 0 1 0 668095495 370221056 13486 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 10325975495623016708 0 0 17 6 0 0 0
/proc/25149/statm: 90386 13486 347 364 0 26289 0
[pid=25151] ppid=25149 vsize=268420 CPUtime=3.21 cores=0-7
/proc/25151/stat : 25151 (hybridGM3) R 25149 25151 25151 0 -1 4202496 8088 0 0 0 320 1 0 0 25 0 1 0 668095495 274862080 7822 33554432000 134512640 135204385 4290481680 18446744073709551615 134537401 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/25151/statm: 67105 7822 64 169 0 66935 0
[pid=25152] ppid=25128 vsize=371800 CPUtime=0 cores=0-7
/proc/25152/stat : 25152 (python) S 25128 25128 25102 0 -1 4202560 772 0 0 0 0 0 0 0 15 0 1 0 668095498 380723200 13490 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 16315186855932821762 0 0 17 2 0 0 0
/proc/25152/statm: 92950 13490 347 364 0 28850 0
[pid=25154] ppid=25152 vsize=268428 CPUtime=3.18 cores=0-7
/proc/25154/stat : 25154 (hybridGM3) R 25152 25154 25154 0 -1 4202496 8089 0 0 0 317 1 0 0 25 0 1 0 668095499 274870272 7823 33554432000 134512640 135204385 4287292784 18446744073709551615 134546082 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/25154/statm: 67107 7823 64 169 0 66937 0
[pid=25155] ppid=25128 vsize=382056 CPUtime=0 cores=0-7
/proc/25155/stat : 25155 (python) S 25128 25128 25102 0 -1 4202560 804 0 0 0 0 0 0 0 15 0 1 0 668095502 391225344 13500 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 7357967001744015618 0 0 17 6 0 0 0
/proc/25155/statm: 95514 13500 353 364 0 31411 0
[pid=25157] ppid=25155 vsize=268424 CPUtime=3.14 cores=0-7
/proc/25157/stat : 25157 (hybridGM3) R 25155 25157 25157 0 -1 4202496 8092 0 0 0 313 1 0 0 25 0 1 0 668095502 274866176 7820 33554432000 134512640 135204385 4292890944 18446744073709551615 134537613 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/25157/statm: 67106 7820 64 169 0 66936 0
[pid=25128/tid=25135] ppid=25126 vsize=392300 CPUtime=0 cores=0-7
/proc/25128/task/25135/stat : 25135 (python) S 25126 25128 25102 0 -1 4202560 26 932 0 0 0 0 0 0 25 0 9 0 668095479 401715200 15040 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 2 0 0 0
[pid=25128/tid=25138] ppid=25126 vsize=392300 CPUtime=0 cores=0-7
/proc/25128/task/25138/stat : 25138 (python) S 25126 25128 25102 0 -1 4202560 24 932 0 0 0 0 0 0 20 0 9 0 668095482 401715200 15040 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
[pid=25128/tid=25141] ppid=25126 vsize=392300 CPUtime=0 cores=0-7
/proc/25128/task/25141/stat : 25141 (python) S 25126 25128 25102 0 -1 4202560 21 932 0 0 0 0 0 0 22 0 9 0 668095485 401715200 15040 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
[pid=25128/tid=25144] ppid=25126 vsize=392300 CPUtime=0 cores=0-7
/proc/25128/task/25144/stat : 25144 (python) S 25126 25128 25102 0 -1 4202560 21 932 0 0 0 0 0 0 24 0 9 0 668095489 401715200 15040 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 2 0 0 0
[pid=25128/tid=25147] ppid=25126 vsize=392300 CPUtime=0 cores=0-7
/proc/25128/task/25147/stat : 25147 (python) S 25126 25128 25102 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 668095492 401715200 15040 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
[pid=25128/tid=25150] ppid=25126 vsize=392300 CPUtime=0 cores=0-7
/proc/25128/task/25150/stat : 25150 (python) S 25126 25128 25102 0 -1 4202560 27 932 0 0 0 0 0 0 22 0 9 0 668095495 401715200 15040 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
[pid=25128/tid=25153] ppid=25126 vsize=392300 CPUtime=0 cores=0-7
/proc/25128/task/25153/stat : 25153 (python) S 25126 25128 25102 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 9 0 668095498 401715200 15040 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 2 0 0 0
[pid=25128/tid=25156] ppid=25126 vsize=392300 CPUtime=0 cores=0-7
/proc/25128/task/25156/stat : 25156 (python) S 25126 25128 25102 0 -1 4202560 32 932 0 0 0 0 0 0 22 0 9 0 668095502 401715200 15040 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 33.54
Current children cumulated vsize (KiB) 5308972

[startup+25.5018 s]
/proc/loadavg: 1.83 0.41 0.13 9/352 25157
/proc/meminfo: memFree=23666512/32951124 swapFree=65173164/67111528
[pid=25128] ppid=25126 vsize=392300 CPUtime=7.51 cores=0-7
/proc/25128/stat : 25128 (python) S 25126 25128 25102 0 -1 4202496 28518 932 1 0 736 15 0 0 22 0 9 0 668094547 401715200 15040 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347719115 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25128/statm: 98075 15040 1889 364 0 33972 0
[pid=25134] ppid=25128 vsize=310264 CPUtime=0.04 cores=0-7
/proc/25134/stat : 25134 (python) S 25128 25128 25102 0 -1 4202560 903 0 0 0 1 3 0 0 16 0 1 0 668095479 317710336 13495 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912463 0 0 16781312 514 9562391054116684036 0 0 17 1 0 0 0
/proc/25134/statm: 77566 13495 376 364 0 13484 0
[pid=25136] ppid=25134 vsize=268424 CPUtime=16.07 cores=0-7
/proc/25136/stat : 25136 (hybridGM3) R 25134 25136 25136 0 -1 4202496 8084 0 0 0 1607 0 0 0 25 0 1 0 668095479 274866176 7823 33554432000 134512640 135204385 4293570336 18446744073709551615 134537292 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/25136/statm: 67106 7823 64 169 0 66936 0
[pid=25137] ppid=25128 vsize=320520 CPUtime=0.04 cores=0-7
/proc/25137/stat : 25137 (python) S 25128 25128 25102 0 -1 4202560 914 0 0 0 3 1 0 0 16 0 1 0 668095482 328212480 13493 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 9562391054116684036 0 0 17 6 0 0 0
/proc/25137/statm: 80130 13493 370 364 0 16045 0
[pid=25139] ppid=25137 vsize=268424 CPUtime=16.14 cores=0-7
/proc/25139/stat : 25139 (hybridGM3) R 25137 25139 25139 0 -1 4202496 8080 0 0 0 1613 1 0 0 25 0 1 0 668095482 274866176 7820 33554432000 134512640 135204385 4294889856 18446744073709551615 134537249 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/25139/statm: 67106 7820 64 169 0 66936 0
[pid=25140] ppid=25128 vsize=330776 CPUtime=0.03 cores=0-7
/proc/25140/stat : 25140 (python) S 25128 25128 25102 0 -1 4202560 910 0 0 0 1 2 0 0 15 0 1 0 668095485 338714624 13497 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 9562391054116684036 0 0 17 2 0 0 0
/proc/25140/statm: 82694 13497 370 364 0 18606 0
[pid=25142] ppid=25140 vsize=268420 CPUtime=15.89 cores=0-7
/proc/25142/stat : 25142 (hybridGM3) R 25140 25142 25142 0 -1 4202496 8084 0 0 0 1588 1 0 0 25 0 1 0 668095485 274862080 7821 33554432000 134512640 135204385 4292399760 18446744073709551615 134536698 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/25142/statm: 67105 7821 64 169 0 66935 0
[pid=25143] ppid=25128 vsize=341032 CPUtime=0.02 cores=0-7
/proc/25143/stat : 25143 (python) S 25128 25128 25102 0 -1 4202560 918 0 0 0 1 1 0 0 15 0 1 0 668095488 349216768 13501 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 9562391054116684036 0 0 17 2 0 0 0
/proc/25143/statm: 85258 13501 370 364 0 21167 0
[pid=25145] ppid=25143 vsize=268424 CPUtime=16.03 cores=0-7
/proc/25145/stat : 25145 (hybridGM3) R 25143 25145 25145 0 -1 4202496 8084 0 0 0 1602 1 0 0 25 0 1 0 668095489 274866176 7821 33554432000 134512640 135204385 4288539760 18446744073709551615 134545968 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25145/statm: 67106 7821 64 169 0 66936 0
[pid=25146] ppid=25128 vsize=351288 CPUtime=0.02 cores=0-7
/proc/25146/stat : 25146 (python) S 25128 25128 25102 0 -1 4202560 931 0 0 0 1 1 0 0 15 0 1 0 668095491 359718912 13505 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 9562391054116684034 0 0 17 6 0 0 0
/proc/25146/statm: 87822 13505 370 364 0 23728 0
[pid=25148] ppid=25146 vsize=268428 CPUtime=16.05 cores=0-7

################
# More data... #
################

/proc/25264/stat : 25264 (python) S 25128 25128 25102 0 -1 4202560 1315 0 0 0 30 26 0 0 16 0 2 0 668164914 657874944 13857 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/25264/statm: 160614 13857 400 364 0 96454 0
[pid=25266] ppid=25264 vsize=268420 CPUtime=196.07 cores=0-7
/proc/25266/stat : 25266 (hybridGM3) T 25264 25266 25266 0 -1 4202496 8110 0 0 0 19604 3 0 0 25 0 1 0 668164915 274862080 7825 33554432000 134512640 135204385 4291885936 18446744073709551615 134537483 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/25266/statm: 67105 7825 64 169 0 66935 0
[pid=25264/tid=25285] ppid=25128 vsize=642456 CPUtime=0 cores=0-7
/proc/25264/task/25285/stat : 25285 (python) S 25128 25128 25102 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 668184584 657874944 13857 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 514 18446604460383922240 0 0 -1 1 0 0 0
[pid=25272] ppid=25128 vsize=652712 CPUtime=0.9 cores=0-7
/proc/25272/stat : 25272 (python) S 25128 25128 25102 0 -1 4202560 1296 0 0 0 41 49 0 0 18 0 2 0 668174964 668377088 13862 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/25272/statm: 163178 13862 401 364 0 99015 0
[pid=25274] ppid=25272 vsize=431704 CPUtime=292.84 cores=0-7
/proc/25274/stat : 25274 (adaptg2wsat2009) T 25272 25274 25274 0 -1 4202496 6270 0 0 0 29283 1 0 0 25 0 1 0 668174965 442064896 5983 33554432000 134512640 135107411 4294186880 18446744073709551615 134531970 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/25274/statm: 107926 5983 59 146 0 106802 0
[pid=25272/tid=25289] ppid=25128 vsize=652712 CPUtime=0 cores=0-7
/proc/25272/task/25289/stat : 25289 (python) S 25128 25128 25102 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 668194621 668377088 13862 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 514 18446604455939790144 0 0 -1 6 0 0 0
[pid=25275] ppid=25128 vsize=662968 CPUtime=0.58 cores=0-7
/proc/25275/stat : 25275 (python) S 25128 25128 25102 0 -1 4202560 1363 0 0 0 27 31 0 0 16 0 2 0 668175031 678879232 13983 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/25275/statm: 165742 13983 406 364 0 101576 0
[pid=25277] ppid=25275 vsize=268424 CPUtime=195.59 cores=0-7
/proc/25277/stat : 25277 (hybridGM3) T 25275 25277 25277 0 -1 4202496 8117 0 0 0 19558 1 0 0 25 0 1 0 668175032 274866176 7826 33554432000 134512640 135204385 4292052704 18446744073709551615 134537483 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/25277/statm: 67106 7826 64 169 0 66936 0
[pid=25275/tid=25290] ppid=25128 vsize=662968 CPUtime=0 cores=0-7
/proc/25275/task/25290/stat : 25290 (python) S 25128 25128 25102 0 -1 4202560 220 0 0 0 0 0 0 0 16 0 2 0 668194703 678879232 13983 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 514 18446604457982491328 0 0 -1 2 0 0 0
[pid=25282] ppid=25128 vsize=673224 CPUtime=0.29 cores=0-7
/proc/25282/stat : 25282 (python) S 25128 25128 25102 0 -1 4202560 1259 0 0 0 15 14 0 0 19 0 2 0 668184097 689381376 14072 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/25282/statm: 168306 14072 406 364 0 104137 0
[pid=25284] ppid=25282 vsize=260404 CPUtime=98.77 cores=0-7
/proc/25284/stat : 25284 (FH) T 25282 25284 25284 0 -1 4202496 6182 0 0 0 9875 2 0 0 25 0 1 0 668184098 266653696 5896 33554432000 134512640 134936988 4288772736 18446744073709551615 134554295 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/25284/statm: 65101 5896 41 104 0 64605 0
[pid=25282/tid=25288] ppid=25128 vsize=673224 CPUtime=0 cores=0-7
/proc/25282/task/25288/stat : 25288 (python) S 25128 25128 25102 0 -1 4202560 123 0 0 0 0 0 0 0 19 0 2 0 668194127 689381376 14072 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 514 18446604457982489536 0 0 -1 0 0 0 0
[pid=25291] ppid=25128 vsize=683480 CPUtime=0.56 cores=0-7
/proc/25291/stat : 25291 (python) S 25128 25128 25102 0 -1 4202560 1285 0 0 0 27 29 0 0 19 0 2 0 668194709 699883520 14065 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/25291/statm: 170870 14065 407 364 0 106698 0
[pid=25293] ppid=25291 vsize=431704 CPUtime=195.26 cores=0-7
/proc/25293/stat : 25293 (adaptg2wsat2009) T 25291 25293 25293 0 -1 4202496 6276 0 0 0 19525 1 0 0 25 0 1 0 668194710 442064896 5984 33554432000 134512640 135107411 4286897200 18446744073709551615 134532277 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/25293/statm: 107926 5984 59 146 0 106802 0
[pid=25291/tid=25300] ppid=25128 vsize=683480 CPUtime=0 cores=0-7
/proc/25291/task/25300/stat : 25300 (python) S 25128 25128 25102 0 -1 4202560 124 0 0 0 0 0 0 0 19 0 2 0 668214364 699883520 14065 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 514 18446604458868551808 0 0 -1 5 0 0 0
[pid=25306] ppid=25128 vsize=693736 CPUtime=1.47 cores=0-7
/proc/25306/stat : 25306 (python) S 25128 25128 25102 0 -1 4202560 1288 0 0 0 70 77 0 0 15 0 2 0 668233341 710385664 14047 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/25306/statm: 173434 14047 407 364 0 109259 0
[pid=25308] ppid=25306 vsize=268424 CPUtime=486.93 cores=0-7
/proc/25308/stat : 25308 (hybridGM3) T 25306 25308 25308 0 -1 4202496 8116 0 0 0 48690 3 0 0 25 0 1 0 668233342 274866176 7827 33554432000 134512640 135204385 4293011040 18446744073709551615 134547471 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/25308/statm: 67106 7827 64 169 0 66936 0
[pid=25306/tid=25320] ppid=25128 vsize=693736 CPUtime=0 cores=0-7
/proc/25306/task/25320/stat : 25320 (python) S 25128 25128 25102 0 -1 4202560 124 0 0 0 0 0 0 0 15 0 2 0 668253013 710385664 14047 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 514 18446604458868552704 0 0 -1 0 0 0 0
[pid=25311] ppid=25128 vsize=703992 CPUtime=2.03 cores=0-7
/proc/25311/stat : 25311 (python) S 25128 25128 25102 0 -1 4202560 1290 0 0 0 88 115 0 0 18 0 2 0 668243357 720887808 14052 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/25311/statm: 175998 14052 406 364 0 111820 0
[pid=25313] ppid=25311 vsize=433188 CPUtime=678.16 cores=0-7
/proc/25313/stat : 25313 (NCVWr) R 25311 25313 25313 0 -1 4202496 6438 0 0 0 67815 1 0 0 25 0 1 0 668243358 443584512 6149 33554432000 134512640 135113558 4286689792 18446744073709551615 134531127 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/25313/statm: 108297 6149 58 147 0 107172 0
[pid=25311/tid=25336] ppid=25128 vsize=703992 CPUtime=0 cores=0-7
/proc/25311/task/25336/stat : 25336 (python) S 25128 25128 25102 0 -1 4202560 123 0 0 0 0 0 0 0 19 0 2 0 668292503 720887808 14052 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 514 18446604458311991488 0 0 -1 5 0 0 0
[pid=25315] ppid=25128 vsize=714248 CPUtime=0.61 cores=0-7
/proc/25315/stat : 25315 (python) S 25128 25128 25102 0 -1 4202560 1302 0 0 0 26 35 0 0 19 0 2 0 668243887 731389952 13887 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/25315/statm: 178562 13887 401 364 0 114381 0
[pid=25317] ppid=25315 vsize=431704 CPUtime=199.33 cores=0-7
/proc/25317/stat : 25317 (adaptg2wsat2009) T 25315 25317 25317 0 -1 4202496 6273 0 0 0 19933 0 0 0 25 0 1 0 668243887 442064896 5982 33554432000 134512640 135107411 4291197680 18446744073709551615 134535374 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/25317/statm: 107926 5982 59 146 0 106802 0
[pid=25315/tid=25327] ppid=25128 vsize=714248 CPUtime=0 cores=0-7
/proc/25315/task/25327/stat : 25327 (python) S 25128 25128 25102 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 668263951 731389952 13887 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 514 18446604458311992384 0 0 -1 5 0 0 0
[pid=25323] ppid=25128 vsize=724504 CPUtime=0.59 cores=0-7
/proc/25323/stat : 25323 (python) S 25128 25128 25102 0 -1 4202560 1320 0 0 0 31 28 0 0 18 0 2 0 668261213 741892096 13892 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347719115 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/25323/statm: 181126 13892 401 364 0 116942 0
[pid=25325] ppid=25323 vsize=260400 CPUtime=195.08 cores=0-7
/proc/25325/stat : 25325 (FH) T 25323 25325 25325 0 -1 4202496 6191 0 0 0 19507 1 0 0 25 0 1 0 668261215 266649600 5899 33554432000 134512640 134936988 4290633888 18446744073709551615 134552493 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/25325/statm: 65100 5899 41 104 0 64604 0
[pid=25323/tid=25330] ppid=25128 vsize=724504 CPUtime=0 cores=0-7
/proc/25323/task/25330/stat : 25330 (python) S 25128 25128 25102 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 668271245 741892096 13892 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 514 18446604468362621184 0 0 -1 0 0 0 0
[pid=25343] ppid=25128 vsize=734760 CPUtime=0 cores=0-7
/proc/25343/stat : 25343 (python) S 25128 25128 25102 0 -1 4202560 960 0 0 0 0 0 0 0 19 0 1 0 668311300 752394240 13836 33554432000 4194304 5683644 140736696021184 18446744073709551615 232335912518 0 0 16781312 514 11016714538715185151 0 0 17 5 0 0 0
/proc/25343/statm: 183690 13836 344 364 0 119503 0
[pid=25345] ppid=25343 vsize=424496 CPUtime=0.49 cores=0-7
/proc/25345/stat : 25345 (NCVWr) R 25343 25345 25345 0 -1 4202496 4390 0 0 0 49 0 0 0 21 0 1 0 668311301 434683904 4099 33554432000 134512640 135113558 4292826256 18446744073709551615 134619510 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/25345/statm: 106124 4099 55 147 0 104999 0
[pid=25128/tid=25135] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25135/stat : 25135 (python) S 25126 25128 25102 0 -1 4202560 43 932 0 0 0 0 0 0 15 0 37 0 668095479 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
[pid=25128/tid=25138] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25138/stat : 25138 (python) S 25126 25128 25102 0 -1 4202560 32 932 0 0 0 0 0 0 15 0 37 0 668095482 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
[pid=25128/tid=25141] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25141/stat : 25141 (python) S 25126 25128 25102 0 -1 4202560 37 932 0 0 0 0 0 0 15 0 37 0 668095485 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 4 0 0 0
[pid=25128/tid=25144] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25144/stat : 25144 (python) S 25126 25128 25102 0 -1 4202560 36 932 0 0 0 0 0 0 15 0 37 0 668095489 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 7 0 0 0
[pid=25128/tid=25147] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25147/stat : 25147 (python) S 25126 25128 25102 0 -1 4202560 41 932 0 0 0 0 0 0 18 0 37 0 668095492 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
[pid=25128/tid=25150] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25150/stat : 25150 (python) S 25126 25128 25102 0 -1 4202560 47 932 0 0 0 0 0 0 18 0 37 0 668095495 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
[pid=25128/tid=25153] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25153/stat : 25153 (python) S 25126 25128 25102 0 -1 4202560 43 932 0 0 0 0 0 0 18 0 37 0 668095498 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 2 0 0 0
[pid=25128/tid=25156] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25156/stat : 25156 (python) S 25126 25128 25102 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 37 0 668095502 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
[pid=25128/tid=25171] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25171/stat : 25171 (python) S 25126 25128 25102 0 -1 4202560 27 932 0 0 0 0 0 0 18 0 37 0 668115063 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 7 0 0 0
[pid=25128/tid=25188] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25188/stat : 25188 (python) S 25126 25128 25102 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 37 0 668125174 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 7 0 0 0
[pid=25128/tid=25191] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25191/stat : 25191 (python) S 25126 25128 25102 0 -1 4202560 42 932 0 0 0 0 0 0 18 0 37 0 668125194 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 6 0 0 0
[pid=25128/tid=25194] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25194/stat : 25194 (python) S 25126 25128 25102 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 37 0 668125285 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25199] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25199/stat : 25199 (python) S 25126 25128 25102 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 37 0 668134706 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 0 0 0 0
[pid=25128/tid=25202] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25202/stat : 25202 (python) S 25126 25128 25102 0 -1 4202560 95 932 0 0 0 0 0 0 20 0 37 0 668134912 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25207] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25207/stat : 25207 (python) S 25126 25128 25102 0 -1 4202560 36 932 0 0 0 0 0 0 20 0 37 0 668135206 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25211] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25211/stat : 25211 (python) S 25126 25128 25102 0 -1 4202560 34 932 0 0 0 0 0 0 21 0 37 0 668135217 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25216] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25216/stat : 25216 (python) S 25126 25128 25102 0 -1 4202560 28 932 0 0 0 0 0 0 19 0 37 0 668144244 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25219] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25219/stat : 25219 (python) S 25126 25128 25102 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 37 0 668144454 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25225] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25225/stat : 25225 (python) S 25126 25128 25102 0 -1 4202560 39 932 0 0 0 0 0 0 18 0 37 0 668144738 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 2 0 0 0
[pid=25128/tid=25228] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25228/stat : 25228 (python) S 25126 25128 25102 0 -1 4202560 148 932 0 0 0 0 0 0 18 0 37 0 668144856 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25233] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25233/stat : 25233 (python) S 25126 25128 25102 0 -1 4202560 50 932 0 0 0 0 0 0 18 0 37 0 668145153 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 0 0 0 0
[pid=25128/tid=25237] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25237/stat : 25237 (python) S 25126 25128 25102 0 -1 4202560 39 932 0 0 0 0 0 0 18 0 37 0 668145238 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25242] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25242/stat : 25242 (python) S 25126 25128 25102 0 -1 4202560 51 932 0 0 0 0 0 0 18 0 37 0 668145447 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 0 0 0 0
[pid=25128/tid=25249] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25249/stat : 25249 (python) S 25126 25128 25102 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 37 0 668154278 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25252] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25252/stat : 25252 (python) S 25126 25128 25102 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 37 0 668154402 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25259] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25259/stat : 25259 (python) S 25126 25128 25102 0 -1 4202560 28 932 0 0 0 0 0 0 19 0 37 0 668164437 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25265] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25265/stat : 25265 (python) S 25126 25128 25102 0 -1 4202560 28 932 0 0 0 0 0 0 19 0 37 0 668164915 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25273] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25273/stat : 25273 (python) S 25126 25128 25102 0 -1 4202560 33 932 0 0 0 0 0 0 18 0 37 0 668174965 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 0 0 0 0
[pid=25128/tid=25276] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25276/stat : 25276 (python) S 25126 25128 25102 0 -1 4202560 166 932 0 0 0 0 0 0 20 0 37 0 668175032 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25283] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25283/stat : 25283 (python) S 25126 25128 25102 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 37 0 668184098 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25292] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25292/stat : 25292 (python) S 25126 25128 25102 0 -1 4202560 37 932 0 0 0 0 0 0 20 0 37 0 668194709 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 0 0 0 0
[pid=25128/tid=25307] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25307/stat : 25307 (python) S 25126 25128 25102 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 37 0 668233342 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25312] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25312/stat : 25312 (python) S 25126 25128 25102 0 -1 4202560 41 932 0 0 0 0 0 0 18 0 37 0 668243358 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 0 0 0 0
[pid=25128/tid=25316] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25316/stat : 25316 (python) S 25126 25128 25102 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 37 0 668243887 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25324] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25324/stat : 25324 (python) S 25126 25128 25102 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 37 0 668261213 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
[pid=25128/tid=25344] ppid=25126 vsize=745004 CPUtime=0 cores=0-7
/proc/25128/task/25344/stat : 25344 (python) S 25126 25128 25102 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 37 0 668311301 762884096 15442 33554432000 4194304 5683644 140736696021184 18446744073709551615 232347716017 0 0 16781312 2 18446604449460672640 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 17181.8
Current children cumulated vsize (KiB) 32840624

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25128 and gives
#  childrusage.ru_utime.tv_sec=4464
#  childrusage.ru_utime.tv_usec=187340
#  childrusage.ru_stime.tv_sec=21
#  childrusage.ru_stime.tv_usec=812683
# CPU time returned by wait4() is 4486
# while last known CPU time is 17181.8
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 2168.27
CPU time (s): 17181.8
CPU user time (s): 17156
CPU system time (s): 25.83
CPU usage (%): 792.42
Max. virtual memory (cumulated for all children) (KiB): 32840624

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4464.19
system time used= 21.8127
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 136557
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21402
involuntary context switches= 55862

runsolver used 26.006 second user time and 65.865 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-16 18:56:03
IDJOB=3385254
IDBENCH=82519
IDSOLVER=1870
FILE ID=node132/3385254-1305564963
RUNJOBID= node132-1305564963-25116
PBS_JOBID= 13350118
Free space on /tmp= 73312 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v35000-c147000-S419010076-063-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385254-1305564963/watcher-3385254-1305564963 -o /tmp/evaluation-result-3385254-1305564963/solver-3385254-1305564963 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385254-1305564963.cnf -seed 1805731023 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 07407a86c8d0f1e46c34022f68908549
RANDOM SEED=1805731023

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24006940 kB
Buffers:        312412 kB
Cached:        3521844 kB
SwapCached:       9908 kB
Active:        2503436 kB
Inactive:      6124004 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24006940 kB
SwapTotal:    67111528 kB
SwapFree:     65173164 kB
Dirty:           34532 kB
Writeback:           0 kB
AnonPages:     4790376 kB
Mapped:          20856 kB
Slab:           219820 kB
PageTables:      31076 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 58152836 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73280 MiB
End job on node132 at 2011-05-16 19:32:14