Trace number 3321738

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 7932.97 997.805

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1500-c30000-S976428817-077-UNKNOWN.cnf
MD5SUM4d2cfd51677809bb15d90c916352e4e2
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark566.818
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of clauses30000
Sum of the clauses size150000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530000
Number of clauses of size over 50

Solver Data 

0.34/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.34/0.67	c INFO: solving HOME/instance-3321738-1304366543.cnf
0.34/0.67	c INFO: computing task features
0.52/0.82	c INFO: computed variable-clause graph statistics
0.52/0.83	c INFO: computed clause balance statistics
1.22/1.58	c INFO: computed variable balance statistics
1.62/1.98	c INFO: computed small-clause counts
1.62/1.98	c INFO: computed Horn-clause counts
1.72/2.02	c INFO: computed variable graph statistics
1.72/2.02	c INFO: collected features for HOME/instance-3321738-1304366543.cnf in 1.34 s
1.72/2.05	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
1.72/2.09	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.14)
1.86/2.13	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.09)
1.86/2.17	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
2.17/2.21	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.06)
2.17/2.24	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.05)
2.17/2.28	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.04)
2.43/2.32	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
801.82/102.32	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.03)
801.82/102.38	c INFO: running FH@0 for 97 with 39898 remaining (b = 0.02)
802.38/102.42	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
802.38/102.48	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
802.73/102.53	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
802.73/102.59	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
802.92/102.65	c INFO: running TNM@0 for 1552 with 39898 remaining (b = 0.21)
803.02/102.71	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.02)
1600.45/202.59	c INFO: running FH@0 for 97 with 39798 remaining (b = 0.01)
1601.23/202.66	c INFO: running hybridGM3@0 for 194 with 39798 remaining (b = 0.02)
1601.87/202.79	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
1603.67/203.00	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
2369.64/299.10	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2370.45/299.17	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2377.55/300.06	c INFO: running adaptg2wsat2009++@0 for 97 with 39700 remaining (b = 0.01)
2386.30/301.11	c INFO: running hybridGM3@99 for 97 with 39699 remaining (b = 0.01)
2392.67/301.96	c INFO: running adaptg2wsat2009++@100 for 97 with 39698 remaining (b = 0.01)
2426.97/306.29	c INFO: running gnovelty+2@0 for 97 with 39694 remaining (b = 0.01)
3129.19/394.36	c INFO: running hybridGM3@295 for 97 with 39606 remaining (b = 0.01)
3153.08/397.33	c INFO: running hybridGM3@0 for 194 with 39603 remaining (b = 0.02)
3160.99/398.32	c INFO: running hybridGM3@100 for 97 with 39602 remaining (b = 0.01)
3177.79/400.44	c INFO: running hybridGM3@0 for 194 with 39600 remaining (b = 0.02)
3185.74/401.42	c INFO: running TNM@0 for 1552 with 39599 remaining (b = 0.14)
3215.95/405.26	c INFO: running adaptg2wsat2009++@100 for 97 with 39595 remaining (b = 0.01)
3227.08/406.62	c INFO: running FH@0 for 291 with 39594 remaining (b = 0.03)
3936.46/495.65	c INFO: running hybridGM3@393 for 97 with 39505 remaining (b = 0.01)
3967.50/499.60	c INFO: running iPAWS@0 for 97 with 39501 remaining (b = 0.01)
3991.40/502.55	c INFO: running adaptg2wsat2009++@100 for 97 with 39498 remaining (b = 0.01)
4687.72/589.93	c INFO: running FH@100 for 291 with 39410 remaining (b = 0.03)
4743.51/596.99	c INFO: running iPAWS@0 for 97 with 39403 remaining (b = 0.01)
4744.26/597.08	c INFO: running hybridGM3@100 for 97 with 39403 remaining (b = 0.01)
4766.52/599.84	c INFO: running hybridGM3@0 for 194 with 39400 remaining (b = 0.02)
4767.24/599.93	c INFO: running hybridGM3@0 for 194 with 39400 remaining (b = 0.01)
5502.79/692.38	c INFO: running TNM@0 for 1552 with 39308 remaining (b = 0.11)
5541.81/697.31	c INFO: running adaptg2wsat2009++@99 for 97 with 39303 remaining (b = 0.01)
5582.37/702.33	c INFO: running gnovelty+2@0 for 97 with 39298 remaining (b = 0.01)
6317.13/794.63	c INFO: running adaptg2wsat2009++@394 for 194 with 39206 remaining (b = 0.02)
6323.48/795.46	c INFO: running hybridGM3@100 for 97 with 39205 remaining (b = 0.01)
6324.30/795.56	c INFO: running hybridGM3@94 for 97 with 39205 remaining (b = 0.01)
6373.63/801.76	c INFO: running hybridGM3@0 for 194 with 39198 remaining (b = 0.01)
6994.58/879.75	c INFO: running FH@299 for 97 with 39121 remaining (b = 0.01)
7129.86/896.78	c INFO: running hybridGM3@294 for 194 with 39103 remaining (b = 0.02)
7130.62/896.88	c INFO: running FH@0 for 97 with 39103 remaining (b = 0.01)
7753.11/975.07	c INFO: running iPAWS@0 for 97 with 39025 remaining (b = 0.01)
7841.41/986.16	c INFO: running hybridGM3@0 for 194 with 39014 remaining (b = 0.01)
7929.65/997.24	c INFO: running NCVWr@0 for 485 with 39003 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321738-1304366543/watcher-3321738-1304366543 -o /tmp/evaluation-result-3321738-1304366543/solver-3321738-1304366543 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321738-1304366543.cnf -seed 1397071266 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.40 4.33 6.21 2/260 29614
/proc/meminfo: memFree=26308304/32950928 swapFree=65762296/67111528
[pid=29614] ppid=29612 vsize=15380 CPUtime=0 cores=0-7
/proc/29614/stat : 29614 (python) S 29612 29614 29518 0 -1 4202496 819 0 0 0 0 0 0 0 20 0 1 0 626885036 15749120 704 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905392128 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/29614/statm: 3845 704 334 364 0 332 0

[startup+0.025696 s]
/proc/loadavg: 5.40 4.33 6.21 2/260 29614
/proc/meminfo: memFree=26308304/32950928 swapFree=65762296/67111528
[pid=29614] ppid=29612 vsize=16400 CPUtime=0.01 cores=0-7
/proc/29614/stat : 29614 (python) R 29612 29614 29518 0 -1 4202496 1111 0 0 0 1 0 0 0 20 0 1 0 626885036 16793600 980 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905054917 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29614/statm: 4100 983 407 364 0 587 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16400

[startup+0.100756 s]
/proc/loadavg: 5.40 4.33 6.21 2/260 29614
/proc/meminfo: memFree=26308304/32950928 swapFree=65762296/67111528
[pid=29614] ppid=29612 vsize=89768 CPUtime=0.06 cores=0-7
/proc/29614/stat : 29614 (python) S 29612 29614 29518 0 -1 4202496 2672 0 0 0 5 1 0 0 17 0 1 0 626885036 91922432 2388 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905392128 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/29614/statm: 22442 2388 750 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 89768

[startup+0.300744 s]
/proc/loadavg: 5.40 4.33 6.21 2/260 29614
/proc/meminfo: memFree=26308304/32950928 swapFree=65762296/67111528
[pid=29614] ppid=29612 vsize=135748 CPUtime=0.18 cores=0-7
/proc/29614/stat : 29614 (python) R 29612 29614 29518 0 -1 4202496 5961 933 1 0 14 4 0 0 18 0 1 0 626885036 139005952 4151 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905086672 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29614/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700574 s]
/proc/loadavg: 5.40 4.33 6.21 2/260 29614
/proc/meminfo: memFree=26308304/32950928 swapFree=65762296/67111528
[pid=29614] ppid=29612 vsize=280496 CPUtime=0.42 cores=0-7
/proc/29614/stat : 29614 (python) R 29612 29614 29518 0 -1 4202496 9768 933 1 0 31 11 0 0 17 0 1 0 626885036 287227904 7452 33554432000 4194304 5683644 140733737768672 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29614/statm: 70124 7452 1761 364 0 6048 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 280496

[startup+1.50043 s]
/proc/loadavg: 5.40 4.33 6.21 2/261 29619
/proc/meminfo: memFree=26277048/32950928 swapFree=65762296/67111528
[pid=29614] ppid=29612 vsize=287584 CPUtime=1.22 cores=0-7
/proc/29614/stat : 29614 (python) R 29612 29614 29518 0 -1 4202496 12679 933 1 0 111 11 0 0 18 0 1 0 626885036 294486016 9281 33554432000 4194304 5683644 140733737768672 18446744073709551615 46953220200734 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29614/statm: 71896 9281 1826 364 0 7820 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 287584

[startup+3.10114 s]
/proc/loadavg: 5.40 4.33 6.21 4/267 29625
/proc/meminfo: memFree=26272112/32950928 swapFree=65762296/67111528
[pid=29614] ppid=29612 vsize=365064 CPUtime=2.04 cores=0-7
/proc/29614/stat : 29614 (python) S 29612 29614 29518 0 -1 4202496 19352 933 1 0 191 13 0 0 25 0 9 0 626885036 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917220811 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29614/statm: 91266 8233 1891 364 0 27163 0
[pid=29620] ppid=29614 vsize=283512 CPUtime=0 cores=0-7
/proc/29620/stat : 29620 (python) S 29614 29614 29518 0 -1 4202560 738 0 0 0 0 0 0 0 20 0 1 0 626885242 290316288 6583 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414159 0 0 16781312 514 6091563802522812415 0 0 17 6 0 0 0
/proc/29620/statm: 70878 6583 355 364 0 6796 0
[pid=29622] ppid=29620 vsize=1018996 CPUtime=1.03 cores=0-7
/proc/29622/stat : 29622 (gnovelty+2) R 29620 29622 29622 0 -1 4202496 959 0 0 0 103 0 0 0 25 0 1 0 626885242 1043451904 697 33554432000 134512640 135663704 4289639312 18446744073709551615 134524688 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29622/statm: 254749 697 113 282 0 254465 0
[pid=29623] ppid=29614 vsize=293700 CPUtime=0 cores=0-7
/proc/29623/stat : 29623 (python) S 29614 29614 29518 0 -1 4202560 743 0 0 0 0 0 0 0 19 0 1 0 626885246 300748800 6664 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 5522509635421995007 0 0 17 6 0 0 0
/proc/29623/statm: 73425 6664 349 364 0 9340 0
[pid=29625] ppid=29623 vsize=1018996 CPUtime=0.99 cores=0-7
/proc/29625/stat : 29625 (gnovelty+2) R 29623 29625 29625 0 -1 4202496 960 0 0 0 99 0 0 0 23 0 1 0 626885246 1043451904 697 33554432000 134512640 135663704 4290699584 18446744073709551615 134525699 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29625/statm: 254749 697 113 282 0 254465 0
[pid=29614/tid=29621] ppid=29612 vsize=365064 CPUtime=0 cores=0-7
/proc/29614/task/29621/stat : 29621 (python) S 29612 29614 29518 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 9 0 626885242 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 4 0 0 0
[pid=29614/tid=29624] ppid=29612 vsize=365064 CPUtime=0 cores=0-7
/proc/29614/task/29624/stat : 29624 (python) S 29612 29614 29518 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 9 0 626885246 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.06
Current children cumulated vsize (KiB) 2980268

[startup+6.30155 s]
/proc/loadavg: 5.61 4.40 6.22 9/285 29644
/proc/meminfo: memFree=26204268/32950928 swapFree=65762296/67111528
[pid=29614] ppid=29612 vsize=365064 CPUtime=2.04 cores=0-7
/proc/29614/stat : 29614 (python) S 29612 29614 29518 0 -1 4202496 19352 933 1 0 191 13 0 0 25 0 9 0 626885036 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917220811 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29614/statm: 91266 8233 1891 364 0 27163 0
[pid=29620] ppid=29614 vsize=283512 CPUtime=0 cores=0-7
/proc/29620/stat : 29620 (python) S 29614 29614 29518 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 626885242 290316288 6606 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414159 0 0 16781312 514 6091563802522779908 0 0 17 6 0 0 0
/proc/29620/statm: 70878 6606 378 364 0 6796 0
[pid=29622] ppid=29620 vsize=1018996 CPUtime=4.23 cores=0-7
/proc/29622/stat : 29622 (gnovelty+2) R 29620 29622 29622 0 -1 4202496 959 0 0 0 423 0 0 0 25 0 1 0 626885242 1043451904 697 33554432000 134512640 135663704 4289639312 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29622/statm: 254749 697 113 282 0 254465 0
[pid=29623] ppid=29614 vsize=293700 CPUtime=0 cores=0-7
/proc/29623/stat : 29623 (python) S 29614 29614 29518 0 -1 4202560 906 0 0 0 0 0 0 0 18 0 1 0 626885246 300748800 6687 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 5522509635421962500 0 0 17 6 0 0 0
/proc/29623/statm: 73425 6687 372 364 0 9340 0
[pid=29625] ppid=29623 vsize=1018996 CPUtime=4.2 cores=0-7
/proc/29625/stat : 29625 (gnovelty+2) R 29623 29625 29625 0 -1 4202496 960 0 0 0 420 0 0 0 25 0 1 0 626885246 1043451904 697 33554432000 134512640 135663704 4290699584 18446744073709551615 134524888 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29625/statm: 254749 697 113 282 0 254465 0
[pid=29626] ppid=29614 vsize=303956 CPUtime=0 cores=0-7
/proc/29626/stat : 29626 (python) S 29614 29614 29518 0 -1 4202560 914 0 0 0 0 0 0 0 18 0 1 0 626885250 311250944 6690 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 4038833042947539204 0 0 17 0 0 0 0
/proc/29626/statm: 75989 6690 371 364 0 11901 0
[pid=29628] ppid=29626 vsize=421428 CPUtime=4.15 cores=0-7
/proc/29628/stat : 29628 (adaptg2wsat2009) R 29626 29628 29628 0 -1 4202496 2052 0 0 0 415 0 0 0 25 0 1 0 626885250 431542272 1782 33554432000 134512640 135107411 4287952960 18446744073709551615 134531232 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29628/statm: 105357 1782 59 146 0 104233 0
[pid=29629] ppid=29614 vsize=314212 CPUtime=0 cores=0-7
/proc/29629/stat : 29629 (python) S 29614 29614 29518 0 -1 4202560 930 0 0 0 0 0 0 0 18 0 1 0 626885253 321753088 6695 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 15181804497585275139 0 0 17 6 0 0 0
/proc/29629/statm: 78553 6695 372 364 0 14462 0
[pid=29631] ppid=29629 vsize=421428 CPUtime=4.08 cores=0-7
/proc/29631/stat : 29631 (adaptg2wsat2009) R 29629 29631 29631 0 -1 4202496 2047 0 0 0 408 0 0 0 25 0 1 0 626885254 431542272 1782 33554432000 134512640 135107411 4291048512 18446744073709551615 134531781 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29631/statm: 105357 1782 59 146 0 104233 0
[pid=29632] ppid=29614 vsize=324468 CPUtime=0 cores=0-7
/proc/29632/stat : 29632 (python) S 29614 29614 29518 0 -1 4202560 942 0 0 0 0 0 0 0 18 0 1 0 626885257 332255232 6699 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 4051973856166904066 0 0 17 0 0 0 0
/proc/29632/statm: 81117 6699 372 364 0 17023 0
[pid=29634] ppid=29632 vsize=421428 CPUtime=4.08 cores=0-7
/proc/29634/stat : 29634 (adaptg2wsat2009) R 29632 29634 29634 0 -1 4202496 2051 0 0 0 408 0 0 0 25 0 1 0 626885258 431542272 1783 33554432000 134512640 135107411 4288884736 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29634/statm: 105357 1783 59 146 0 104233 0
[pid=29635] ppid=29614 vsize=334724 CPUtime=0 cores=0-7
/proc/29635/stat : 29635 (python) R 29614 29614 29518 0 -1 4202560 942 0 0 0 0 0 0 0 16 0 1 0 626885261 342757376 6697 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905437319 0 0 16781312 514 0 0 0 17 6 0 0 0
/proc/29635/statm: 83681 6697 366 364 0 19584 0
[pid=29637] ppid=29635 vsize=1018996 CPUtime=4.04 cores=0-7
/proc/29637/stat : 29637 (gnovelty+2) R 29635 29637 29637 0 -1 4202496 963 0 0 0 404 0 0 0 25 0 1 0 626885262 1043451904 698 33554432000 134512640 135663704 4290267248 18446744073709551615 134524507 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29637/statm: 254749 698 113 282 0 254465 0
[pid=29638] ppid=29614 vsize=344980 CPUtime=0 cores=0-7
/proc/29638/stat : 29638 (python) S 29614 29614 29518 0 -1 4202560 766 0 0 0 0 0 0 0 18 0 1 0 626885265 353259520 6684 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 6077265203559366914 0 0 17 0 0 0 0
/proc/29638/statm: 86245 6684 349 364 0 22145 0
[pid=29640] ppid=29638 vsize=251292 CPUtime=3.97 cores=0-7
/proc/29640/stat : 29640 (FH) R 29638 29640 29640 0 -1 4202496 1949 0 0 0 397 0 0 0 25 0 1 0 626885266 257323008 1682 33554432000 134512640 134936988 4287466032 18446744073709551615 134553536 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29640/statm: 62823 1682 41 104 0 62327 0
[pid=29641] ppid=29614 vsize=355236 CPUtime=0 cores=0-7
/proc/29641/stat : 29641 (python) S 29614 29614 29518 0 -1 4202560 801 0 0 0 0 0 0 0 18 0 1 0 626885269 363761664 6694 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 117053462432153858 0 0 17 6 0 0 0
/proc/29641/statm: 88809 6694 355 364 0 24706 0
[pid=29643] ppid=29641 vsize=421428 CPUtime=3.88 cores=0-7
/proc/29643/stat : 29643 (adaptg2wsat2009) R 29641 29643 29643 0 -1 4202496 2054 0 0 0 388 0 0 0 25 0 1 0 626885269 431542272 1783 33554432000 134512640 135107411 4294054496 18446744073709551615 134537856 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29643/statm: 105357 1783 59 146 0 104233 0
[pid=29614/tid=29621] ppid=29612 vsize=365064 CPUtime=0 cores=0-7
/proc/29614/task/29621/stat : 29621 (python) S 29612 29614 29518 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 9 0 626885242 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 4 0 0 0
[pid=29614/tid=29624] ppid=29612 vsize=365064 CPUtime=0 cores=0-7
/proc/29614/task/29624/stat : 29624 (python) S 29612 29614 29518 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 9 0 626885246 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 2 0 0 0
[pid=29614/tid=29627] ppid=29612 vsize=365064 CPUtime=0 cores=0-7
/proc/29614/task/29627/stat : 29627 (python) S 29612 29614 29518 0 -1 4202560 22 933 0 0 0 0 0 0 22 0 9 0 626885250 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 6 0 0 0
[pid=29614/tid=29630] ppid=29612 vsize=365064 CPUtime=0 cores=0-7
/proc/29614/task/29630/stat : 29630 (python) S 29612 29614 29518 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 9 0 626885254 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 6 0 0 0
[pid=29614/tid=29633] ppid=29612 vsize=365064 CPUtime=0 cores=0-7
/proc/29614/task/29633/stat : 29633 (python) S 29612 29614 29518 0 -1 4202560 24 933 0 0 0 0 0 0 25 0 9 0 626885258 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29636] ppid=29612 vsize=365064 CPUtime=0 cores=0-7
/proc/29614/task/29636/stat : 29636 (python) S 29612 29614 29518 0 -1 4202560 29 933 0 0 0 0 0 0 25 0 9 0 626885261 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29639] ppid=29612 vsize=365064 CPUtime=0 cores=0-7
/proc/29614/task/29639/stat : 29639 (python) S 29612 29614 29518 0 -1 4202560 29 933 0 0 0 0 0 0 25 0 9 0 626885265 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29642] ppid=29612 vsize=365064 CPUtime=0 cores=0-7
/proc/29614/task/29642/stat : 29642 (python) S 29612 29614 29518 0 -1 4202560 85 933 0 0 0 0 0 0 25 0 9 0 626885269 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 34.67
Current children cumulated vsize (KiB) 7913844

[startup+12.7014 s]
/proc/loadavg: 5.80 4.45 6.22 9/285 29644
/proc/meminfo: memFree=26202144/32950928 swapFree=65762296/67111528
[pid=29614] ppid=29612 vsize=365064 CPUtime=2.04 cores=0-7
/proc/29614/stat : 29614 (python) S 29612 29614 29518 0 -1 4202496 19352 933 1 0 191 13 0 0 25 0 9 0 626885036 373825536 8233 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917220811 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/29614/statm: 91266 8233 1891 364 0 27163 0
[pid=29620] ppid=29614 vsize=283512 CPUtime=0.01 cores=0-7
/proc/29620/stat : 29620 (python) S 29614 29614 29518 0 -1 4202560 904 0 0 0 1 0 0 0 18 0 1 0 626885242 290316288 6606 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414159 0 0 16781312 514 2508223517468623108 0 0 17 6 0 0 0
/proc/29620/statm: 70878 6606 378 364 0 6796 0
[pid=29622] ppid=29620 vsize=1018996 CPUtime=10.63 cores=0-7
/proc/29622/stat : 29622 (gnovelty+2) R 29620 29622 29622 0 -1 4202496 959 0 0 0 1063 0 0 0 25 0 1 0 626885242 1043451904 697 33554432000 134512640 135663704 4289639312 18446744073709551615 135008500 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29622/statm: 254749 697 113 282 0 254465 0
[pid=29623] ppid=29614 vsize=293700 CPUtime=0.02 cores=0-7
/proc/29623/stat : 29623 (python) S 29614 29614 29518 0 -1 4202560 909 0 0 0 1 1 0 0 18 0 1 0 626885246 300748800 6687 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 2508223517468623108 0 0 17 6 0 0 0
/proc/29623/statm: 73425 6687 372 364 0 9340 0
[pid=29625] ppid=29623 vsize=1018996 CPUtime=10.6 cores=0-7
/proc/29625/stat : 29625 (gnovelty+2) R 29623 29625 29625 0 -1 4202496 960 0 0 0 1060 0 0 0 25 0 1 0 626885246 1043451904 697 33554432000 134512640 135663704 4290699584 18446744073709551615 134544196 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29625/statm: 254749 697 113 282 0 254465 0
[pid=29626] ppid=29614 vsize=303956 CPUtime=0.02 cores=0-7
/proc/29626/stat : 29626 (python) S 29614 29614 29518 0 -1 4202560 916 0 0 0 1 1 0 0 18 0 1 0 626885250 311250944 6691 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 2508223517468623108 0 0 17 0 0 0 0
/proc/29626/statm: 75989 6691 372 364 0 11901 0
[pid=29628] ppid=29626 vsize=421428 CPUtime=10.55 cores=0-7
/proc/29628/stat : 29628 (adaptg2wsat2009) R 29626 29628 29628 0 -1 4202496 2052 0 0 0 1055 0 0 0 25 0 1 0 626885250 431542272 1782 33554432000 134512640 135107411 4287952960 18446744073709551615 134532313 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29628/statm: 105357 1782 59 146 0 104233 0
[pid=29629] ppid=29614 vsize=314212 CPUtime=0.02 cores=0-7
/proc/29629/stat : 29629 (python) S 29614 29614 29518 0 -1 4202560 932 0 0 0 1 1 0 0 18 0 1 0 626885253 321753088 6695 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 2508223517468623107 0 0 17 6 0 0 0
/proc/29629/statm: 78553 6695 372 364 0 14462 0
[pid=29631] ppid=29629 vsize=421428 CPUtime=10.42 cores=0-7
/proc/29631/stat : 29631 (adaptg2wsat2009) R 29629 29631 29631 0 -1 4202496 2047 0 0 0 1042 0 0 0 25 0 1 0 626885254 431542272 1782 33554432000 134512640 135107411 4291048512 18446744073709551615 134532277 0 0 16781312 0 0 0 0 17 7 0 0 0

################
# More data... #
################

/proc/29711/stat : 29711 (python) S 29614 29614 29518 0 -1 4202560 986 0 0 0 67 68 0 0 18 0 1 0 626925179 578527232 7328 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 2508223517468623108 0 0 17 3 0 0 0
/proc/29711/statm: 141242 7328 379 364 0 77097 0
[pid=29713] ppid=29711 vsize=459764 CPUtime=584.64 cores=0-7
/proc/29713/stat : 29713 (TNM) R 29711 29713 29713 0 -1 4202496 1935 0 0 0 58459 5 0 0 25 0 1 0 626925179 470798336 1653 33554432000 134512640 135008748 4287025952 18446744073709551615 134527524 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29713/statm: 114941 1653 46 122 0 113841 0
[pid=29718] ppid=29614 vsize=575224 CPUtime=0.22 cores=0-7
/proc/29718/stat : 29718 (python) S 29614 29614 29518 0 -1 4202560 1190 0 0 0 11 11 0 0 19 0 2 0 626934997 589029376 7325 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917220811 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/29718/statm: 143806 7325 407 364 0 79658 0
[pid=29720] ppid=29718 vsize=335996 CPUtime=100.15 cores=0-7
/proc/29720/stat : 29720 (iPAWS) T 29718 29720 29720 0 -1 4202496 1822 0 0 0 10015 0 0 0 25 0 1 0 626934997 344059904 1546 33554432000 134512640 135114423 4287285920 18446744073709551615 134516708 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/29720/statm: 83999 1546 59 147 0 83851 0
[pid=29718/tid=29728] ppid=29614 vsize=575224 CPUtime=0 cores=0-7
/proc/29718/task/29728/stat : 29728 (python) S 29614 29614 29518 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 626945018 589029376 7325 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 514 18446604469564438592 0 0 -1 2 0 0 0
[pid=29725] ppid=29614 vsize=585480 CPUtime=0.22 cores=0-7
/proc/29725/stat : 29725 (python) S 29614 29614 29518 0 -1 4202560 1196 0 0 0 12 10 0 0 19 0 2 0 626944736 599531520 7306 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917220811 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29725/statm: 146370 7306 406 364 0 82219 0
[pid=29727] ppid=29725 vsize=335996 CPUtime=99.96 cores=0-7
/proc/29727/stat : 29727 (iPAWS) T 29725 29727 29727 0 -1 4202496 1830 0 0 0 9996 0 0 0 25 0 1 0 626944737 344059904 1547 33554432000 134512640 135114423 4290282944 18446744073709551615 134516669 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/29727/statm: 83999 1547 59 147 0 83851 0
[pid=29725/tid=29741] ppid=29614 vsize=585480 CPUtime=0 cores=0-7
/proc/29725/task/29741/stat : 29741 (python) S 29614 29614 29518 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 626954758 599531520 7306 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 514 18446604469564437696 0 0 -1 2 0 0 0
[pid=29729] ppid=29614 vsize=596024 CPUtime=0.92 cores=0-7
/proc/29729/stat : 29729 (python) S 29614 29614 29518 0 -1 4202560 1308 0 0 0 48 44 0 0 18 0 2 0 626945021 610328576 7194 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/29729/statm: 149006 7194 401 364 0 84852 0
[pid=29731] ppid=29729 vsize=268420 CPUtime=396.63 cores=0-7
/proc/29731/stat : 29731 (hybridGM3) R 29729 29731 29731 0 -1 4202496 5831 0 0 0 39663 0 0 0 25 0 1 0 626945021 274862080 5543 33554432000 134512640 135204385 4292559408 18446744073709551615 134538282 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29731/statm: 67105 5543 63 169 0 66935 0
[pid=29729/tid=29748] ppid=29614 vsize=596024 CPUtime=0 cores=0-7
/proc/29729/task/29748/stat : 29748 (python) S 29614 29614 29518 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 626964573 610328576 7194 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 514 18446604471070619840 0 0 -1 1 0 0 0
[pid=29732] ppid=29614 vsize=606484 CPUtime=0.69 cores=0-7
/proc/29732/stat : 29732 (python) S 29614 29614 29518 0 -1 4202560 1309 0 0 0 37 32 0 0 18 0 2 0 626945030 621039616 7215 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917220811 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29732/statm: 151621 7215 402 364 0 87464 0
[pid=29734] ppid=29732 vsize=268424 CPUtime=295.81 cores=0-7
/proc/29734/stat : 29734 (hybridGM3) T 29732 29734 29734 0 -1 4202496 5834 0 0 0 29581 0 0 0 25 0 1 0 626945031 274866176 5543 33554432000 134512640 135204385 4291931488 18446744073709551615 134537711 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/29734/statm: 67106 5543 63 169 0 66936 0
[pid=29732/tid=29749] ppid=29614 vsize=606484 CPUtime=0 cores=0-7
/proc/29732/task/29749/stat : 29749 (python) S 29614 29614 29518 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 626964582 621039616 7215 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 514 18446604462099132608 0 0 -1 1 0 0 0
[pid=29738] ppid=29614 vsize=616616 CPUtime=0.72 cores=0-7
/proc/29738/stat : 29738 (python) S 29614 29614 29518 0 -1 4202560 1135 0 0 0 37 35 0 0 18 0 1 0 626954274 631414784 7189 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 2508223517468623109 0 0 17 5 0 0 0
/proc/29738/statm: 154154 7189 373 364 0 89994 0
[pid=29740] ppid=29738 vsize=459768 CPUtime=293.24 cores=0-7
/proc/29740/stat : 29740 (TNM) R 29738 29740 29740 0 -1 4202496 1939 0 0 0 29324 0 0 0 25 0 1 0 626954275 470802432 1653 33554432000 134512640 135008748 4289387504 18446744073709551615 134527773 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29740/statm: 114942 1653 46 122 0 113842 0
[pid=29742] ppid=29614 vsize=626504 CPUtime=0.24 cores=0-7
/proc/29742/stat : 29742 (python) S 29614 29614 29518 0 -1 4202560 1321 0 0 0 12 12 0 0 19 0 2 0 626955269 641540096 7482 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917220811 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29742/statm: 156626 7482 401 364 0 92463 0
[pid=29744] ppid=29742 vsize=1018996 CPUtime=99.08 cores=0-7
/proc/29744/stat : 29744 (gnovelty+2) T 29742 29744 29744 0 -1 4202496 982 0 0 0 9908 0 0 0 25 0 1 0 626955270 1043451904 698 33554432000 134512640 135663704 4292186304 18446744073709551615 134545793 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29744/statm: 254749 698 113 282 0 254465 0
[pid=29742/tid=29750] ppid=29614 vsize=626504 CPUtime=0 cores=0-7
/proc/29742/task/29750/stat : 29750 (python) S 29614 29614 29518 0 -1 4202560 217 0 0 0 0 0 0 0 19 0 2 0 626965203 641540096 7482 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 514 18446604468323063936 0 0 -1 0 0 0 0
[pid=29751] ppid=29614 vsize=636760 CPUtime=0.44 cores=0-7
/proc/29751/stat : 29751 (python) S 29614 29614 29518 0 -1 4202560 1030 0 0 0 23 21 0 0 18 0 1 0 626965213 652042240 7470 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 2508223517468623110 0 0 17 5 0 0 0
/proc/29751/statm: 159190 7470 378 364 0 95024 0
[pid=29753] ppid=29751 vsize=268428 CPUtime=195.13 cores=0-7
/proc/29753/stat : 29753 (hybridGM3) R 29751 29753 29753 0 -1 4202496 5833 0 0 0 19513 0 0 0 25 0 1 0 626965213 274870272 5544 33554432000 134512640 135204385 4292249040 18446744073709551615 134538427 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29753/statm: 67107 5544 63 169 0 66937 0
[pid=29756] ppid=29614 vsize=647016 CPUtime=0.23 cores=0-7
/proc/29756/stat : 29756 (python) S 29614 29614 29518 0 -1 4202560 1256 0 0 0 12 11 0 0 19 0 2 0 626974725 662544384 7533 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917220811 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/29756/statm: 161754 7533 407 364 0 97585 0
[pid=29758] ppid=29756 vsize=251296 CPUtime=99.85 cores=0-7
/proc/29758/stat : 29758 (FH) T 29756 29758 29758 0 -1 4202496 1969 0 0 0 9985 0 0 0 25 0 1 0 626974726 257327104 1682 33554432000 134512640 134936988 4292975792 18446744073709551615 134545063 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/29758/statm: 62824 1682 41 104 0 62328 0
[pid=29756/tid=29768] ppid=29614 vsize=647016 CPUtime=0 cores=0-7
/proc/29756/task/29768/stat : 29768 (python) S 29614 29614 29518 0 -1 4202560 111 0 0 0 0 0 0 0 19 0 2 0 626984748 662544384 7533 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 514 18446604455588731840 0 0 -1 0 0 0 0
[pid=29761] ppid=29614 vsize=657272 CPUtime=0.05 cores=0-7
/proc/29761/stat : 29761 (python) S 29614 29614 29518 0 -1 4202560 1047 0 0 0 2 3 0 0 18 0 1 0 626982544 673046528 7502 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 2508223517468623110 0 0 17 5 0 0 0
/proc/29761/statm: 164318 7502 378 364 0 100146 0
[pid=29763] ppid=29761 vsize=335996 CPUtime=22.45 cores=0-7
/proc/29763/stat : 29763 (iPAWS) R 29761 29763 29763 0 -1 4202496 1833 0 0 0 2245 0 0 0 25 0 1 0 626982544 344059904 1546 33554432000 134512640 135114423 4294617376 18446744073709551615 134547183 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29763/statm: 83999 1546 59 147 0 83851 0
[pid=29765] ppid=29614 vsize=667528 CPUtime=0.02 cores=0-7
/proc/29765/stat : 29765 (python) S 29614 29614 29518 0 -1 4202560 1055 0 0 0 2 0 0 0 18 0 1 0 626983652 683548672 7391 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 2508223517468623108 0 0 17 0 0 0 0
/proc/29765/statm: 166882 7391 379 364 0 102707 0
[pid=29767] ppid=29765 vsize=268424 CPUtime=11.36 cores=0-7
/proc/29767/stat : 29767 (hybridGM3) R 29765 29767 29767 0 -1 4202496 5836 0 0 0 1136 0 0 0 25 0 1 0 626983653 274866176 5544 33554432000 134512640 135204385 4290507024 18446744073709551615 134537792 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29767/statm: 67106 5544 63 169 0 66936 0
[pid=29769] ppid=29614 vsize=677784 CPUtime=0 cores=0-7
/proc/29769/stat : 29769 (python) S 29614 29614 29518 0 -1 4202560 921 0 0 0 0 0 0 0 19 0 1 0 626984761 694050816 7546 33554432000 4194304 5683644 140733737768672 18446744073709551615 260905414214 0 0 16781312 514 14645160909614350335 0 0 17 5 0 0 0
/proc/29769/statm: 169446 7546 346 364 0 105268 0
[pid=29771] ppid=29769 vsize=414860 CPUtime=0.37 cores=0-7
/proc/29771/stat : 29771 (NCVWr) R 29769 29771 29771 0 -1 4202496 1236 0 0 0 37 0 0 0 21 0 1 0 626984761 424816640 946 33554432000 134512640 135113558 4290014368 18446744073709551615 134526480 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29771/statm: 103715 946 55 147 0 102590 0
[pid=29614/tid=29621] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29621/stat : 29621 (python) S 29612 29614 29518 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 34 0 626885242 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 4 0 0 0
[pid=29614/tid=29624] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29624/stat : 29624 (python) S 29612 29614 29518 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 34 0 626885246 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 2 0 0 0
[pid=29614/tid=29627] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29627/stat : 29627 (python) S 29612 29614 29518 0 -1 4202560 38 933 0 0 0 0 0 0 18 0 34 0 626885250 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 6 0 0 0
[pid=29614/tid=29630] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29630/stat : 29630 (python) S 29612 29614 29518 0 -1 4202560 30 933 0 0 0 0 0 0 18 0 34 0 626885254 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 6 0 0 0
[pid=29614/tid=29633] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29633/stat : 29633 (python) S 29612 29614 29518 0 -1 4202560 27 933 0 0 0 0 0 0 18 0 34 0 626885258 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29636] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29636/stat : 29636 (python) S 29612 29614 29518 0 -1 4202560 29 933 0 0 0 0 0 0 25 0 34 0 626885261 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29639] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29639/stat : 29639 (python) S 29612 29614 29518 0 -1 4202560 37 933 0 0 0 0 0 0 18 0 34 0 626885265 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29642] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29642/stat : 29642 (python) S 29612 29614 29518 0 -1 4202560 89 933 0 0 0 0 0 0 18 0 34 0 626885269 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 6 0 0 0
[pid=29614/tid=29650] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29650/stat : 29650 (python) S 29612 29614 29518 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 34 0 626895269 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 1 0 0 0
[pid=29614/tid=29655] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29655/stat : 29655 (python) S 29612 29614 29518 0 -1 4202560 114 933 0 0 0 0 0 0 18 0 34 0 626895275 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 5 0 0 0
[pid=29614/tid=29659] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29659/stat : 29659 (python) S 29612 29614 29518 0 -1 4202560 37 933 0 0 0 0 0 0 18 0 34 0 626895279 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 7 0 0 0
[pid=29614/tid=29663] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29663/stat : 29663 (python) S 29612 29614 29518 0 -1 4202560 32 933 0 0 0 0 0 0 25 0 34 0 626895285 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 5 0 0 0
[pid=29614/tid=29667] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29667/stat : 29667 (python) S 29612 29614 29518 0 -1 4202560 40 933 0 0 0 0 0 0 15 0 34 0 626895290 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 1 0 0 0
[pid=29614/tid=29671] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29671/stat : 29671 (python) S 29612 29614 29518 0 -1 4202560 29 933 0 0 0 0 0 0 18 0 34 0 626895296 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 5 0 0 0
[pid=29614/tid=29674] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29674/stat : 29674 (python) S 29612 29614 29518 0 -1 4202560 21 933 0 0 0 0 0 0 21 0 34 0 626895302 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 6 0 0 0
[pid=29614/tid=29677] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29677/stat : 29677 (python) S 29612 29614 29518 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 34 0 626895309 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 3 0 0 0
[pid=29614/tid=29685] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29685/stat : 29685 (python) S 29612 29614 29518 0 -1 4202560 24 933 0 0 0 0 0 0 19 0 34 0 626905296 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 4 0 0 0
[pid=29614/tid=29688] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29688/stat : 29688 (python) S 29612 29614 29518 0 -1 4202560 35 933 0 0 0 0 0 0 18 0 34 0 626905303 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 3 0 0 0
[pid=29614/tid=29700] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29700/stat : 29700 (python) S 29612 29614 29518 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 34 0 626915666 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29705] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29705/stat : 29705 (python) S 29612 29614 29518 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 34 0 626924770 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29709] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29709/stat : 29709 (python) S 29612 29614 29518 0 -1 4202560 113 933 0 0 0 0 0 0 18 0 34 0 626925081 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 3 0 0 0
[pid=29614/tid=29712] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29712/stat : 29712 (python) S 29612 29614 29518 0 -1 4202560 37 933 0 0 0 0 0 0 20 0 34 0 626925179 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 3 0 0 0
[pid=29614/tid=29719] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29719/stat : 29719 (python) S 29612 29614 29518 0 -1 4202560 43 933 0 0 0 0 0 0 20 0 34 0 626934997 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29726] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29726/stat : 29726 (python) S 29612 29614 29518 0 -1 4202560 34 933 0 0 0 0 0 0 20 0 34 0 626944736 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 1 0 0 0
[pid=29614/tid=29730] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29730/stat : 29730 (python) S 29612 29614 29518 0 -1 4202560 34 933 0 0 0 0 0 0 15 0 34 0 626945021 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 2 0 0 0
[pid=29614/tid=29733] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29733/stat : 29733 (python) S 29612 29614 29518 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 34 0 626945031 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 5 0 0 0
[pid=29614/tid=29739] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29739/stat : 29739 (python) S 29612 29614 29518 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 34 0 626954275 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29743] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29743/stat : 29743 (python) S 29612 29614 29518 0 -1 4202560 170 933 0 0 0 0 0 0 20 0 34 0 626955270 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29752] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29752/stat : 29752 (python) S 29612 29614 29518 0 -1 4202560 41 933 0 0 0 0 0 0 20 0 34 0 626965213 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 0 0 0 0
[pid=29614/tid=29757] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29757/stat : 29757 (python) S 29612 29614 29518 0 -1 4202560 40 933 0 0 0 0 0 0 19 0 34 0 626974725 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 5 0 0 0
[pid=29614/tid=29762] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29762/stat : 29762 (python) S 29612 29614 29518 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 34 0 626982544 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 5 0 0 0
[pid=29614/tid=29766] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29766/stat : 29766 (python) S 29612 29614 29518 0 -1 4202560 37 933 0 0 0 0 0 0 19 0 34 0 626983653 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 2 0 0 0
[pid=29614/tid=29770] ppid=29612 vsize=688028 CPUtime=0 cores=0-7
/proc/29614/task/29770/stat : 29770 (python) S 29612 29614 29518 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 34 0 626984761 704540672 9146 33554432000 4194304 5683644 140733737768672 18446744073709551615 260917217713 0 0 16781312 2 18446604447436441792 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7932.97
Current children cumulated vsize (KiB) 32381896

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29614 and gives
#  childrusage.ru_utime.tv_sec=5
#  childrusage.ru_utime.tv_usec=611146
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=233964
# CPU time returned by wait4() is 5.84511
# while last known CPU time is 7932.97
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 997.805
CPU time (s): 7932.97
CPU user time (s): 7924.19
CPU system time (s): 8.78
CPU usage (%): 795.042
Max. virtual memory (cumulated for all children) (KiB): 32381896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5.61115
system time used= 0.233964
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 60377
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5134
involuntary context switches= 111

runsolver used 9.44556 second user time and 21.4137 second system time

The end

Launcher Data 

Begin job on node116 at 2011-05-02 22:02:23
IDJOB=3321738
IDBENCH=82516
IDSOLVER=1712
FILE ID=node116/3321738-1304366543
RUNJOBID= node116-1304366467-29532
PBS_JOBID= 13181755
Free space on /tmp= 73752 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k5-r20-v1500-c30000-S976428817-077-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321738-1304366543/watcher-3321738-1304366543 -o /tmp/evaluation-result-3321738-1304366543/solver-3321738-1304366543 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321738-1304366543.cnf -seed 1397071266 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4d2cfd51677809bb15d90c916352e4e2
RANDOM SEED=1397071266

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      26308708 kB
Buffers:         62600 kB
Cached:         853780 kB
SwapCached:      25672 kB
Active:        5770048 kB
Inactive:       695172 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      26308708 kB
SwapTotal:    67111528 kB
SwapFree:     65762296 kB
Dirty:           32600 kB
Writeback:           0 kB
AnonPages:     5533112 kB
Mapped:          10620 kB
Slab:            87524 kB
PageTables:      26004 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 40819608 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73720 MiB
End job on node116 at 2011-05-02 22:19:03