Trace number 3385370

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 9527.11 1199.11

General information on the benchmark

Namerandom/large/
unif-k5-r20-v2000-c40000-S61914820-087-UNKNOWN.cnf
MD5SUM1b9b43753c02a2c226adda648a956e92
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2120.06
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of clauses40000
Sum of the clauses size200000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 540000
Number of clauses of size over 50

Solver Data 

0.30/0.49	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.30/0.49	c INFO: solving HOME/instance-3385370-1305565933.cnf
0.30/0.49	c INFO: computing task features
0.59/0.70	c INFO: computed variable-clause graph statistics
0.59/0.70	c INFO: computed clause balance statistics
1.59/1.79	c INFO: computed variable balance statistics
2.19/2.39	c INFO: computed small-clause counts
2.19/2.39	c INFO: computed Horn-clause counts
2.29/2.44	c INFO: computed variable graph statistics
2.29/2.44	c INFO: collected features for HOME/instance-3385370-1305565933.cnf in 1.94 s
2.29/2.47	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.38)
2.29/2.50	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
2.39/2.53	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.08)
2.39/2.56	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.07)
2.39/2.59	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.05)
2.49/2.63	c INFO: running gnovelty+2@0 for 97 with 4997 remaining (b = 0.05)
2.49/2.66	c INFO: running FH@0 for 97 with 4997 remaining (b = 0.03)
2.49/2.69	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.03)
787.42/100.90	c INFO: running adaptg2wsat2009++@0 for 97 with 4899 remaining (b = 0.02)
802.55/102.88	c INFO: running FH@0 for 97 with 4897 remaining (b = 0.02)
803.27/102.92	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.04)
803.27/102.96	c INFO: running gnovelty+2@0 for 97 with 4897 remaining (b = 0.02)
803.78/103.00	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
803.78/103.07	c INFO: running adaptg2wsat2009++@0 for 97 with 4897 remaining (b = 0.01)
804.19/103.12	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
804.19/103.17	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.02)
1586.42/201.28	c INFO: running TNM@0 for 1552 with 4799 remaining (b = 0.19)
1602.17/203.26	c INFO: running FH@0 for 97 with 4797 remaining (b = 0.01)
1603.86/203.42	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
1603.86/203.49	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
2370.00/299.70	c INFO: running hybridGM3@99 for 97 with 4700 remaining (b = 0.01)
2371.59/299.83	c INFO: running hybridGM3@99 for 97 with 4700 remaining (b = 0.01)
2372.38/299.91	c INFO: running hybridGM3@100 for 97 with 4700 remaining (b = 0.01)
2373.16/300.01	c INFO: running hybridGM3@97 for 97 with 4700 remaining (b = 0.01)
2379.50/300.88	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.01)
2393.81/302.67	c INFO: running adaptg2wsat2009++@98 for 97 with 4697 remaining (b = 0.01)
2420.07/305.94	c INFO: running hybridGM3@0 for 194 with 4694 remaining (b = 0.02)
3129.81/395.06	c INFO: running hybridGM3@296 for 97 with 4605 remaining (b = 0.01)
3155.37/398.27	c INFO: running TNM@0 for 1455 with 4602 remaining (b = 0.14)
3169.59/400.06	c INFO: running adaptg2wsat2009++@98 for 97 with 4600 remaining (b = 0.01)
3173.56/400.56	c INFO: running hybridGM3@193 for 97 with 4599 remaining (b = 0.01)
3179.13/401.22	c INFO: running hybridGM3@295 for 97 with 4599 remaining (b = 0.01)
3179.92/401.30	c INFO: running hybridGM3@295 for 97 with 4599 remaining (b = 0.01)
3933.42/495.93	c INFO: running gnovelty+2@0 for 97 with 4504 remaining (b = 0.01)
3937.38/496.45	c INFO: running hybridGM3@291 for 97 with 4504 remaining (b = 0.01)
3938.17/496.59	c INFO: running hybridGM3@393 for 97 with 4503 remaining (b = 0.01)
3938.99/496.68	c INFO: running hybridGM3@395 for 97 with 4503 remaining (b = 0.01)
3979.56/501.80	c INFO: running iPAWS@0 for 97 with 4498 remaining (b = 0.01)
3993.09/503.48	c INFO: running hybridGM3@94 for 97 with 4497 remaining (b = 0.01)
4697.91/591.97	c INFO: running hybridGM3@390 for 97 with 4408 remaining (b = 0.01)
4721.02/594.87	c INFO: running hybridGM3@385 for 97 with 4405 remaining (b = 0.01)
4748.09/598.21	c INFO: running FH@0 for 291 with 4402 remaining (b = 0.02)
4779.13/602.20	c INFO: running adaptg2wsat2009++@99 for 97 with 4398 remaining (b = 0.01)
4780.72/602.40	c INFO: running FH@100 for 291 with 4398 remaining (b = 0.02)
4784.78/602.89	c INFO: running hybridGM3@190 for 97 with 4397 remaining (b = 0.01)
5472.65/689.25	c INFO: running hybridGM3@484 for 97 with 4311 remaining (b = 0.01)
5473.40/689.36	c INFO: running TNM@0 for 1552 with 4311 remaining (b = 0.12)
5554.61/699.59	c INFO: running iPAWS@0 for 97 with 4300 remaining (b = 0.01)
5591.87/704.30	c INFO: running adaptg2wsat2009++@100 for 97 with 4296 remaining (b = 0.01)
6271.32/789.65	c INFO: running gnovelty+2@0 for 97 with 4210 remaining (b = 0.01)
6353.21/800.00	c INFO: running hybridGM3@0 for 194 with 4200 remaining (b = 0.01)
6415.21/807.71	c INFO: running adaptg2wsat2009++@98 for 97 with 4192 remaining (b = 0.01)
7055.62/888.24	c INFO: running FH@0 for 97 with 4112 remaining (b = 0.01)
7070.72/890.14	c INFO: running hybridGM3@0 for 194 with 4110 remaining (b = 0.01)
7089.00/892.44	c INFO: running FH@199 for 194 with 4108 remaining (b = 0.01)
7190.02/905.12	c INFO: running adaptg2wsat2009++@388 for 194 with 4095 remaining (b = 0.01)
7854.30/988.67	c INFO: running NCVWr@0 for 485 with 4011 remaining (b = 0.03)
7911.53/995.88	c INFO: running hybridGM3@99 for 97 with 4004 remaining (b = 0.01)
8636.22/1086.99	c INFO: running iPAWS@0 for 97 with 3913 remaining (b = 0.01)
8662.49/1090.20	c INFO: running FH@296 for 97 with 3910 remaining (b = 0.01)
8711.01/1096.31	c INFO: running hybridGM3@296 for 194 with 3904 remaining (b = 0.01)
8762.67/1102.87	c INFO: running adaptg2wsat2009++@488 for 97 with 3897 remaining (b = 0.01)
9420.48/1185.60	c INFO: running FH@99 for 291 with 3814 remaining (b = 0.02)
9435.52/1187.41	c INFO: running hybridGM3@0 for 194 with 3813 remaining (b = 0.01)
9521.29/1198.27	c INFO: running TNM@0 for 1552 with 3802 remaining (b = 0.08)
9527.11/1199.09	c INFO: running NCVWr@0 for 485 with 3801 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385370-1305565933/watcher-3385370-1305565933 -o /tmp/evaluation-result-3385370-1305565933/solver-3385370-1305565933 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385370-1305565933.cnf -seed 1266908400 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.42 8.12 5.38 1/422 32297
/proc/meminfo: memFree=13523464/32950928 swapFree=67111200/67111528
[pid=32297] ppid=32295 vsize=16236 CPUtime=0 cores=0-7
/proc/32297/stat : 32297 (python) R 32295 32297 32013 0 -1 4202496 1044 0 0 0 0 0 0 0 21 0 1 0 746823985 16625664 916 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415085524 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/32297/statm: 4059 916 381 364 0 546 0

[startup+0.0953851 s]
/proc/loadavg: 8.42 8.12 5.38 1/422 32297
/proc/meminfo: memFree=13523464/32950928 swapFree=67111200/67111528
[pid=32297] ppid=32295 vsize=85360 CPUtime=0.05 cores=0-7
/proc/32297/stat : 32297 (python) D 32295 32297 32013 0 -1 4202496 2583 0 0 0 3 2 0 0 22 0 1 0 746823985 87408640 2308 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415397431 0 0 16781312 2 18446744071562154983 0 0 17 2 0 0 0
/proc/32297/statm: 21340 2308 707 364 0 1557 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85360

[startup+0.100407 s]
/proc/loadavg: 8.42 8.12 5.38 1/422 32297
/proc/meminfo: memFree=13523464/32950928 swapFree=67111200/67111528
[pid=32297] ppid=32295 vsize=85620 CPUtime=0.06 cores=0-7
/proc/32297/stat : 32297 (python) R 32295 32297 32013 0 -1 4202496 2628 0 0 0 4 2 0 0 21 0 1 0 746823985 87674880 2348 33554432000 4194304 5683644 140733351455744 18446744073709551615 4619232 0 0 16781312 2 0 0 0 17 4 0 0 1
/proc/32297/statm: 21405 2348 713 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85620

[startup+0.300379 s]
/proc/loadavg: 8.42 8.12 5.38 1/422 32297
/proc/meminfo: memFree=13523464/32950928 swapFree=67111200/67111528
[pid=32297] ppid=32295 vsize=135900 CPUtime=0.22 cores=0-7
/proc/32297/stat : 32297 (python) R 32295 32297 32013 0 -1 4202496 6046 933 1 0 16 6 0 0 22 0 1 0 746823985 139161600 4191 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415391488 0 0 16781312 2 0 0 0 17 2 0 0 1
/proc/32297/statm: 33975 4191 1032 364 0 3161 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 135900

[startup+0.700278 s]
/proc/loadavg: 8.42 8.12 5.38 1/422 32297
/proc/meminfo: memFree=13523464/32950928 swapFree=67111200/67111528
[pid=32297] ppid=32295 vsize=290484 CPUtime=0.59 cores=0-7
/proc/32297/stat : 32297 (python) R 32295 32297 32013 0 -1 4202496 13907 933 1 0 50 9 0 0 22 0 1 0 746823985 297455616 9992 33554432000 4194304 5683644 140733351455744 18446744073709551615 47056154027642 0 0 16781312 2 0 0 0 17 2 0 0 1
/proc/32297/statm: 72621 9992 1812 364 0 8545 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 290484

[startup+1.50113 s]
/proc/loadavg: 8.42 8.12 5.38 2/423 32302
/proc/meminfo: memFree=13489108/32950928 swapFree=67111200/67111528
[pid=32297] ppid=32295 vsize=290800 CPUtime=1.39 cores=0-7
/proc/32297/stat : 32297 (python) R 32295 32297 32013 0 -1 4202496 14005 933 1 0 130 9 0 0 25 0 1 0 746823985 297779200 10085 33554432000 4194304 5683644 140733351455744 18446744073709551615 4531497 0 0 16781312 2 0 0 0 17 2 0 0 1
/proc/32297/statm: 72700 10085 1826 364 0 8624 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 290800

[startup+3.10074 s]
/proc/loadavg: 8.42 8.12 5.38 2/423 32302
/proc/meminfo: memFree=13488736/32950928 swapFree=67111200/67111528
[pid=32297] ppid=32295 vsize=432068 CPUtime=2.59 cores=0-7
/proc/32297/stat : 32297 (python) S 32295 32297 32013 0 -1 4202496 20466 933 1 0 247 12 0 0 21 0 9 0 746823985 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427218379 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 1
/proc/32297/statm: 108017 8602 1891 364 0 43914 0
Current children cumulated CPU time (s) 2.59
Current children cumulated vsize (KiB) 432068

[startup+6.30113 s]
/proc/loadavg: 7.82 8.00 5.35 9/447 32326
/proc/meminfo: memFree=13406828/32950928 swapFree=67111200/67111528
[pid=32297] ppid=32295 vsize=432068 CPUtime=2.59 cores=0-7
/proc/32297/stat : 32297 (python) S 32295 32297 32013 0 -1 4202496 20466 933 1 0 247 12 0 0 21 0 9 0 746823985 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427218379 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 1
/proc/32297/statm: 108017 8602 1891 364 0 43914 0
[pid=32303] ppid=32297 vsize=284980 CPUtime=0 cores=0-7
/proc/32303/stat : 32303 (python) S 32297 32297 32013 0 -1 4202560 730 0 0 0 0 0 0 0 18 0 1 0 746824232 291819520 6898 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411727 0 0 16781312 514 5554952925022748931 0 0 17 7 0 0 0
/proc/32303/statm: 71245 6898 355 364 0 7163 0
[pid=32305] ppid=32303 vsize=1020308 CPUtime=3.82 cores=0-7
/proc/32305/stat : 32305 (gnovelty+2) R 32303 32305 32305 0 -1 4202496 1155 0 0 0 382 0 0 0 25 0 1 0 746824232 1044795392 892 33554432000 134512640 135663704 4292710080 18446744073709551615 134544204 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32305/statm: 255077 892 113 282 0 254793 0
[pid=32306] ppid=32297 vsize=295000 CPUtime=0 cores=0-7
/proc/32306/stat : 32306 (python) S 32297 32297 32013 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 746824235 302080000 7031 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 5554949076732051714 0 0 17 4 0 0 0
/proc/32306/statm: 73750 7031 349 364 0 9665 0
[pid=32308] ppid=32306 vsize=1020308 CPUtime=3.79 cores=0-7
/proc/32308/stat : 32308 (gnovelty+2) R 32306 32308 32308 0 -1 4202496 1158 0 0 0 379 0 0 0 25 0 1 0 746824235 1044795392 891 33554432000 134512640 135663704 4291207408 18446744073709551615 134545646 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32308/statm: 255077 891 113 282 0 254793 0
[pid=32309] ppid=32297 vsize=305220 CPUtime=0 cores=0-7
/proc/32309/stat : 32309 (python) S 32297 32297 32013 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 746824238 312545280 7035 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 3095191756937855235 0 0 17 2 0 0 0
/proc/32309/statm: 76305 7035 349 364 0 12217 0
[pid=32311] ppid=32309 vsize=423400 CPUtime=3.71 cores=0-7
/proc/32311/stat : 32311 (adaptg2wsat2009) R 32309 32311 32311 0 -1 4202496 2622 0 0 0 371 0 0 0 25 0 1 0 746824238 433561600 2357 33554432000 134512640 135107411 4294087056 18446744073709551615 134532326 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32311/statm: 105850 2357 59 146 0 104726 0
[pid=32312] ppid=32297 vsize=315544 CPUtime=0 cores=0-7
/proc/32312/stat : 32312 (python) S 32297 32297 32013 0 -1 4202560 745 0 0 0 0 0 0 0 18 0 1 0 746824241 323117056 7039 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 18120093467043397891 0 0 17 6 0 0 0
/proc/32312/statm: 78886 7039 349 364 0 14795 0
[pid=32314] ppid=32312 vsize=423400 CPUtime=3.73 cores=0-7
/proc/32314/stat : 32314 (adaptg2wsat2009) R 32312 32314 32314 0 -1 4202496 2622 0 0 0 373 0 0 0 25 0 1 0 746824241 433561600 2356 33554432000 134512640 135107411 4291425440 18446744073709551615 134531474 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32314/statm: 105850 2356 59 146 0 104726 0
[pid=32315] ppid=32297 vsize=325768 CPUtime=0 cores=0-7
/proc/32315/stat : 32315 (python) S 32297 32297 32013 0 -1 4202560 760 0 0 0 0 0 0 0 18 0 1 0 746824245 333586432 7043 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 18120101163624792324 0 0 17 1 0 0 0
/proc/32315/statm: 81442 7043 349 364 0 17348 0
[pid=32317] ppid=32315 vsize=423400 CPUtime=3.69 cores=0-7
/proc/32317/stat : 32317 (adaptg2wsat2009) R 32315 32317 32317 0 -1 4202496 2626 0 0 0 369 0 0 0 25 0 1 0 746824245 433561600 2357 33554432000 134512640 135107411 4294377760 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32317/statm: 105850 2357 59 146 0 104726 0
[pid=32318] ppid=32297 vsize=336092 CPUtime=0 cores=0-7
/proc/32318/stat : 32318 (python) S 32297 32297 32013 0 -1 4202560 760 0 0 0 0 0 0 0 18 0 1 0 746824248 344158208 7047 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 8607688685426540801 0 0 17 0 0 0 0
/proc/32318/statm: 84023 7047 349 364 0 19926 0
[pid=32320] ppid=32318 vsize=1020308 CPUtime=3.64 cores=0-7
/proc/32320/stat : 32320 (gnovelty+2) R 32318 32320 32320 0 -1 4202496 1155 0 0 0 364 0 0 0 25 0 1 0 746824248 1044795392 891 33554432000 134512640 135663704 4290402944 18446744073709551615 134545187 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32320/statm: 255077 891 113 282 0 254793 0
[pid=32321] ppid=32297 vsize=411952 CPUtime=0 cores=0-7
/proc/32321/stat : 32321 (python) S 32297 32297 32013 0 -1 4202560 766 0 0 0 0 0 0 0 18 0 1 0 746824251 421838848 7053 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 14659023827095224577 0 0 17 1 0 0 0
/proc/32321/statm: 102988 7053 349 364 0 38888 0
[pid=32323] ppid=32321 vsize=253032 CPUtime=3.6 cores=0-7
/proc/32323/stat : 32323 (FH) R 32321 32323 32323 0 -1 4202496 2502 0 0 0 360 0 0 0 25 0 1 0 746824252 259104768 2233 33554432000 134512640 134936988 4291756400 18446744073709551615 134545312 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32323/statm: 63258 2233 41 104 0 62762 0
[pid=32324] ppid=32297 vsize=422076 CPUtime=0 cores=0-7
/proc/32324/stat : 32324 (python) S 32297 32297 32013 0 -1 4202560 801 0 0 0 0 0 0 0 18 0 1 0 746824255 432205824 7063 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 2876979105876640003 0 0 17 0 0 0 0
/proc/32324/statm: 105519 7063 355 364 0 41416 0
[pid=32326] ppid=32324 vsize=423400 CPUtime=3.58 cores=0-7
/proc/32326/stat : 32326 (adaptg2wsat2009) R 32324 32326 32326 0 -1 4202496 2632 0 0 0 358 0 0 0 25 0 1 0 746824255 433561600 2358 33554432000 134512640 135107411 4291862624 18446744073709551615 134531781 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32326/statm: 105850 2358 59 146 0 104726 0
[pid=32297/tid=32304] ppid=32295 vsize=432068 CPUtime=0 cores=0-7
/proc/32297/task/32304/stat : 32304 (python) S 32295 32297 32013 0 -1 4202560 24 933 0 0 0 0 0 0 25 0 9 0 746824232 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 6 0 0 0
[pid=32297/tid=32307] ppid=32295 vsize=432068 CPUtime=0 cores=0-7
/proc/32297/task/32307/stat : 32307 (python) S 32295 32297 32013 0 -1 4202560 23 933 0 0 0 0 0 0 25 0 9 0 746824235 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32310] ppid=32295 vsize=432068 CPUtime=0 cores=0-7
/proc/32297/task/32310/stat : 32310 (python) S 32295 32297 32013 0 -1 4202560 21 933 0 0 0 0 0 0 20 0 9 0 746824238 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32313] ppid=32295 vsize=432068 CPUtime=0 cores=0-7
/proc/32297/task/32313/stat : 32313 (python) S 32295 32297 32013 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 9 0 746824241 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32316] ppid=32295 vsize=432068 CPUtime=0 cores=0-7
/proc/32297/task/32316/stat : 32316 (python) S 32295 32297 32013 0 -1 4202560 25 933 0 0 0 0 0 0 19 0 9 0 746824245 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32319] ppid=32295 vsize=432068 CPUtime=0 cores=0-7
/proc/32297/task/32319/stat : 32319 (python) S 32295 32297 32013 0 -1 4202560 20 933 0 0 0 0 0 0 19 0 9 0 746824248 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 3 0 0 0
[pid=32297/tid=32322] ppid=32295 vsize=432068 CPUtime=0 cores=0-7
/proc/32297/task/32322/stat : 32322 (python) S 32295 32297 32013 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 746824251 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32325] ppid=32295 vsize=432068 CPUtime=0 cores=0-7
/proc/32297/task/32325/stat : 32325 (python) S 32295 32297 32013 0 -1 4202560 32 933 0 0 0 0 0 0 21 0 9 0 746824255 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 32.15
Current children cumulated vsize (KiB) 8136256

[startup+12.7019 s]
/proc/loadavg: 7.84 8.00 5.37 9/447 32327
/proc/meminfo: memFree=13405460/32950928 swapFree=67111200/67111528
[pid=32297] ppid=32295 vsize=432068 CPUtime=2.59 cores=0-7
/proc/32297/stat : 32297 (python) S 32295 32297 32013 0 -1 4202496 20466 933 1 0 247 12 0 0 21 0 9 0 746823985 442437632 8602 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427218379 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 1
/proc/32297/statm: 108017 8602 1891 364 0 43914 0
[pid=32303] ppid=32297 vsize=284980 CPUtime=0.04 cores=0-7
/proc/32303/stat : 32303 (python) S 32297 32297 32013 0 -1 4202560 899 0 0 0 2 2 0 0 18 0 1 0 746824232 291819520 6921 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411727 0 0 16781312 514 1893939565169705219 0 0 17 7 0 0 0
/proc/32303/statm: 71245 6921 378 364 0 7163 0
[pid=32305] ppid=32303 vsize=1020308 CPUtime=10.18 cores=0-7
/proc/32305/stat : 32305 (gnovelty+2) R 32303 32305 32305 0 -1 4202496 1155 0 0 0 1018 0 0 0 25 0 1 0 746824232 1044795392 892 33554432000 134512640 135663704 4292710080 18446744073709551615 134525347 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32305/statm: 255077 892 113 282 0 254793 0
[pid=32306] ppid=32297 vsize=295000 CPUtime=0.04 cores=0-7
/proc/32306/stat : 32306 (python) S 32297 32297 32013 0 -1 4202560 904 0 0 0 2 2 0 0 18 0 1 0 746824235 302080000 7054 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 1893939565169705218 0 0 17 4 0 0 0
/proc/32306/statm: 73750 7054 372 364 0 9665 0
[pid=32308] ppid=32306 vsize=1020308 CPUtime=10.19 cores=0-7
/proc/32308/stat : 32308 (gnovelty+2) R 32306 32308 32308 0 -1 4202496 1158 0 0 0 1019 0 0 0 25 0 1 0 746824235 1044795392 891 33554432000 134512640 135663704 4291207408 18446744073709551615 134524878 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32308/statm: 255077 891 113 282 0 254793 0
[pid=32309] ppid=32297 vsize=305220 CPUtime=0.03 cores=0-7
/proc/32309/stat : 32309 (python) S 32297 32297 32013 0 -1 4202560 896 0 0 0 1 2 0 0 18 0 1 0 746824238 312545280 7058 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 1893939565169705219 0 0 17 2 0 0 0
/proc/32309/statm: 76305 7058 372 364 0 12217 0
[pid=32311] ppid=32309 vsize=423400 CPUtime=9.96 cores=0-7
/proc/32311/stat : 32311 (adaptg2wsat2009) R 32309 32311 32311 0 -1 4202496 2622 0 0 0 996 0 0 0 25 0 1 0 746824238 433561600 2357 33554432000 134512640 135107411 4294087056 18446744073709551615 134532313 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32311/statm: 105850 2357 59 146 0 104726 0
[pid=32312] ppid=32297 vsize=315544 CPUtime=0.03 cores=0-7
/proc/32312/stat : 32312 (python) S 32297 32297 32013 0 -1 4202560 913 0 0 0 2 1 0 0 18 0 1 0 746824241 323117056 7061 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 1893939565169705219 0 0 17 6 0 0 0
/proc/32312/statm: 78886 7061 371 364 0 14795 0
[pid=32314] ppid=32312 vsize=423400 CPUtime=10.1 cores=0-7
/proc/32314/stat : 32314 (adaptg2wsat2009) R 32312 32314 32314 0 -1 4202496 2622 0 0 0 1010 0 0 0 25 0 1 0 746824241 433561600 2356 33554432000 134512640 135107411 4291425440 18446744073709551615 134532128 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32314/statm: 105850 2356 59 146 0 104726 0
[pid=32315] ppid=32297 vsize=325768 CPUtime=0.04 cores=0-7
/proc/32315/stat : 32315 (python) S 32297 32297 32013 0 -1 4202560 951 0 0 0 2 2 0 0 18 0 1 0 746824245 333586432 7066 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 1893939565169705220 0 0 17 1 0 0 0
/proc/32315/statm: 81442 7066 372 364 0 17348 0
[pid=32317] ppid=32315 vsize=423400 CPUtime=10.04 cores=0-7
/proc/32317/stat : 32317 (adaptg2wsat2009) R 32315 32317 32317 0 -1 4202496 2626 0 0 0 1004 0 0 0 25 0 1 0 746824245 433561600 2357 33554432000 134512640 135107411 4294377760 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/32317/statm: 105850 2357 59 146 0 104726 0
[pid=32318] ppid=32297 vsize=336092 CPUtime=0.01 cores=0-7
/proc/32318/stat : 32318 (python) S 32297 32297 32013 0 -1 4202560 953 0 0 0 0 1 0 0 18 0 1 0 746824248 344158208 7070 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 8607688685426540801 0 0 17 0 0 0 0
/proc/32318/statm: 84023 7070 372 364 0 19926 0
[pid=32320] ppid=32318 vsize=1020308 CPUtime=10.04 cores=0-7
/proc/32320/stat : 32320 (gnovelty+2) R 32318 32320 32320 0 -1 4202496 1155 0 0 0 1004 0 0 0 25 0 1 0 746824248 1044795392 891 33554432000 134512640 135663704 4290402944 18446744073709551615 134544212 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/32320/statm: 255077 891 113 282 0 254793 0
[pid=32321] ppid=32297 vsize=411952 CPUtime=0.02 cores=0-7
/proc/32321/stat : 32321 (python) S 32297 32297 32013 0 -1 4202560 957 0 0 0 1 1 0 0 18 0 1 0 746824251 421838848 7076 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 14659023827095224577 0 0 17 1 0 0 0
/proc/32321/statm: 102988 7076 372 364 0 38888 0

################
# More data... #
################

/proc/32390/stat : 32390 (TNM) R 32388 32390 32390 0 -1 4202496 2467 0 0 0 80026 1 0 0 25 0 1 0 746863813 472584192 2194 33554432000 134512640 135008748 4293232288 18446744073709551615 134527526 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/32390/statm: 115377 2194 46 122 0 114277 0
[pid=32393] ppid=32297 vsize=555636 CPUtime=0.37 cores=0-7
/proc/32393/stat : 32393 (python) S 32297 32297 32013 0 -1 4202560 1150 0 0 0 18 19 0 0 19 0 2 0 746873578 568971264 7582 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32393/statm: 138909 7582 400 364 0 74767 0
[pid=32395] ppid=32393 vsize=1020308 CPUtime=102.62 cores=0-7
/proc/32395/stat : 32395 (gnovelty+2) T 32393 32395 32395 0 -1 4202496 1165 0 0 0 10262 0 0 0 25 0 1 0 746873579 1044795392 892 33554432000 134512640 135663704 4287264576 18446744073709551615 134525678 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/32395/statm: 255077 892 113 282 0 254793 0
[pid=32393/tid=32404] ppid=32297 vsize=555636 CPUtime=0 cores=0-7
/proc/32393/task/32404/stat : 32404 (python) S 32297 32297 32013 0 -1 4202560 101 0 0 0 0 0 0 0 19 0 2 0 746884220 568971264 7582 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 514 18446604453862807552 0 0 -1 7 0 0 0
[pid=32398] ppid=32297 vsize=565892 CPUtime=0.35 cores=0-7
/proc/32398/stat : 32398 (python) S 32297 32297 32013 0 -1 4202560 1180 0 0 0 19 16 0 0 19 0 2 0 746874165 579473408 7636 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32398/statm: 141473 7636 407 364 0 77328 0
[pid=32400] ppid=32398 vsize=335996 CPUtime=100 cores=0-7
/proc/32400/stat : 32400 (iPAWS) T 32398 32400 32400 0 -1 4202496 2053 0 0 0 10000 0 0 0 25 0 1 0 746874165 344059904 1774 33554432000 134512640 135114423 4291977376 18446744073709551615 134549802 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/32400/statm: 83999 1774 59 147 0 83851 0
[pid=32398/tid=32403] ppid=32297 vsize=565892 CPUtime=0 cores=0-7
/proc/32398/task/32403/stat : 32403 (python) S 32297 32297 32013 0 -1 4202560 105 0 0 0 0 0 0 0 19 0 2 0 746884200 579473408 7636 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 514 18446604452030796800 0 0 -1 0 0 0 0
[pid=32408] ppid=32297 vsize=576148 CPUtime=1.8 cores=0-7
/proc/32408/stat : 32408 (python) S 32297 32297 32013 0 -1 4202560 977 0 0 0 89 91 0 0 18 0 1 0 746892921 589975552 7568 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 1893939565169705217 0 0 17 4 0 0 0
/proc/32408/statm: 144037 7568 379 364 0 79889 0
[pid=32410] ppid=32408 vsize=461504 CPUtime=502.98 cores=0-7
/proc/32410/stat : 32410 (TNM) R 32408 32410 32410 0 -1 4202496 2477 0 0 0 50298 0 0 0 25 0 1 0 746892922 472580096 2194 33554432000 134512640 135008748 4289522736 18446744073709551615 134528960 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/32410/statm: 115376 2194 46 122 0 114276 0
[pid=32411] ppid=32297 vsize=586404 CPUtime=0.35 cores=0-7
/proc/32411/stat : 32411 (python) S 32297 32297 32013 0 -1 4202560 1193 0 0 0 18 17 0 0 19 0 2 0 746893945 600477696 7662 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32411/statm: 146601 7662 406 364 0 82450 0
[pid=32413] ppid=32411 vsize=335996 CPUtime=100.34 cores=0-7
/proc/32413/stat : 32413 (iPAWS) T 32411 32413 32413 0 -1 4202496 2057 0 0 0 10034 0 0 0 25 0 1 0 746893945 344059904 1774 33554432000 134512640 135114423 4293371600 18446744073709551615 134517054 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/32413/statm: 83999 1774 59 147 0 83851 0
[pid=32411/tid=32420] ppid=32297 vsize=586404 CPUtime=0 cores=0-7
/proc/32411/task/32420/stat : 32420 (python) S 32297 32297 32013 0 -1 4202560 97 0 0 0 0 0 0 0 19 0 2 0 746903979 600477696 7662 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 514 18446604450759066816 0 0 -1 3 0 0 0
[pid=32416] ppid=32297 vsize=597376 CPUtime=0.35 cores=0-7
/proc/32416/stat : 32416 (python) S 32297 32297 32013 0 -1 4202560 1293 0 0 0 15 20 0 0 19 0 2 0 746902950 611713024 7600 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32416/statm: 149344 7600 401 364 0 85190 0
[pid=32418] ppid=32416 vsize=1020308 CPUtime=100.15 cores=0-7
/proc/32418/stat : 32418 (gnovelty+2) T 32416 32418 32418 0 -1 4202496 1178 0 0 0 10015 0 0 0 25 0 1 0 746902951 1044795392 892 33554432000 134512640 135663704 4294874592 18446744073709551615 134544196 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/32418/statm: 255077 892 113 282 0 254793 0
[pid=32416/tid=32429] ppid=32297 vsize=597376 CPUtime=0 cores=0-7
/proc/32416/task/32429/stat : 32429 (python) S 32297 32297 32013 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 746912993 611713024 7600 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 514 18446604447564056512 0 0 -1 3 0 0 0
[pid=32421] ppid=32297 vsize=607392 CPUtime=1.45 cores=0-7
/proc/32421/stat : 32421 (python) S 32297 32297 32013 0 -1 4202560 1277 0 0 0 77 68 0 0 18 0 2 0 746903985 621969408 7663 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32421/statm: 151848 7663 402 364 0 87691 0
[pid=32423] ppid=32421 vsize=268424 CPUtime=395.52 cores=0-7
/proc/32423/stat : 32423 (hybridGM3) R 32421 32423 32423 0 -1 4202496 6206 0 0 0 39552 0 0 0 25 0 1 0 746903986 274866176 5920 33554432000 134512640 135204385 4294559232 18446744073709551615 134538041 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32423/statm: 67106 5920 63 169 0 66936 0
[pid=32421/tid=32440] ppid=32297 vsize=607392 CPUtime=0 cores=0-7
/proc/32421/task/32440/stat : 32440 (python) S 32297 32297 32013 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 746923567 621969408 7663 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 514 18446604447564054720 0 0 -1 1 0 0 0
[pid=32426] ppid=32297 vsize=617768 CPUtime=0.37 cores=0-7
/proc/32426/stat : 32426 (python) S 32297 32297 32013 0 -1 4202560 1266 0 0 0 18 19 0 0 19 0 2 0 746912810 632594432 7711 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32426/statm: 154442 7711 401 364 0 90282 0
[pid=32428] ppid=32426 vsize=253028 CPUtime=100.17 cores=0-7
/proc/32428/stat : 32428 (FH) T 32426 32428 32428 0 -1 4202496 2520 0 0 0 10017 0 0 0 25 0 1 0 746912810 259100672 2232 33554432000 134512640 134936988 4290769216 18446744073709551615 134554083 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/32428/statm: 63257 2232 41 104 0 62761 0
[pid=32426/tid=32436] ppid=32297 vsize=617768 CPUtime=0 cores=0-7
/proc/32426/task/32436/stat : 32436 (python) S 32297 32297 32013 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 746922846 632594432 7711 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 514 18446604443968919616 0 0 -1 2 0 0 0
[pid=32430] ppid=32297 vsize=627840 CPUtime=0.72 cores=0-7
/proc/32430/stat : 32430 (python) S 32297 32297 32013 0 -1 4202560 1306 0 0 0 34 38 0 0 19 0 2 0 746912999 642908160 7769 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32430/statm: 156960 7769 401 364 0 92797 0
[pid=32432] ppid=32430 vsize=268424 CPUtime=196.78 cores=0-7
/proc/32432/stat : 32432 (hybridGM3) T 32430 32432 32432 0 -1 4202496 6204 0 0 0 19678 0 0 0 25 0 1 0 746913000 274866176 5920 33554432000 134512640 135204385 4286624688 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/32432/statm: 67106 5920 63 169 0 66936 0
[pid=32430/tid=32443] ppid=32297 vsize=627840 CPUtime=0 cores=0-7
/proc/32430/task/32443/stat : 32443 (python) S 32297 32297 32013 0 -1 4202560 208 0 0 0 0 0 0 0 19 0 2 0 746932678 642908160 7769 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 514 18446604449734307904 0 0 -1 3 0 0 0
[pid=32437] ppid=32297 vsize=638096 CPUtime=0.76 cores=0-7
/proc/32437/stat : 32437 (python) S 32297 32297 32013 0 -1 4202560 1055 0 0 0 38 38 0 0 18 0 1 0 746922852 653410304 7807 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 1893939565169705217 0 0 17 4 0 0 0
/proc/32437/statm: 159524 7807 378 364 0 95358 0
[pid=32439] ppid=32437 vsize=423312 CPUtime=209.31 cores=0-7
/proc/32439/stat : 32439 (NCVWr) R 32437 32439 32439 0 -1 4202496 2556 0 0 0 20931 0 0 0 25 0 1 0 746922853 433471488 2265 33554432000 134512640 135113558 4289206592 18446744073709551615 134531797 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/32439/statm: 105828 2265 58 147 0 104703 0
[pid=32444] ppid=32297 vsize=648352 CPUtime=0.37 cores=0-7
/proc/32444/stat : 32444 (python) S 32297 32297 32013 0 -1 4202560 1253 0 0 0 20 17 0 0 19 0 2 0 746932684 663912448 7813 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427218379 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/32444/statm: 162088 7813 407 364 0 97919 0
[pid=32446] ppid=32444 vsize=335996 CPUtime=99.82 cores=0-7
/proc/32446/stat : 32446 (iPAWS) T 32444 32446 32446 0 -1 4202496 2064 0 0 0 9982 0 0 0 25 0 1 0 746932684 344059904 1774 33554432000 134512640 135114423 4287763712 18446744073709551615 134546153 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/32446/statm: 83999 1774 59 147 0 83851 0
[pid=32444/tid=32450] ppid=32297 vsize=648352 CPUtime=0 cores=0-7
/proc/32444/task/32450/stat : 32450 (python) S 32297 32297 32013 0 -1 4202560 98 0 0 0 0 0 0 0 19 0 2 0 746942720 663912448 7813 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 514 18446604446326893248 0 0 -1 1 0 0 0
[pid=32451] ppid=32297 vsize=658608 CPUtime=0.03 cores=0-7
/proc/32451/stat : 32451 (python) S 32297 32297 32013 0 -1 4202560 1048 0 0 0 2 1 0 0 18 0 1 0 746942726 674414592 7823 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 1893939565169705218 0 0 17 1 0 0 0
/proc/32451/statm: 164652 7823 379 364 0 100480 0
[pid=32453] ppid=32451 vsize=268428 CPUtime=11.2 cores=0-7
/proc/32453/stat : 32453 (hybridGM3) R 32451 32453 32453 0 -1 4202496 6210 0 0 0 1120 0 0 0 25 0 1 0 746942727 274870272 5919 33554432000 134512640 135204385 4294715328 18446744073709551615 134537946 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/32453/statm: 67107 5919 63 169 0 66937 0
[pid=32454] ppid=32297 vsize=668864 CPUtime=0 cores=0-7
/proc/32454/stat : 32454 (python) S 32297 32297 32013 0 -1 4202560 942 0 0 0 0 0 0 0 19 0 1 0 746943812 684916736 7891 33554432000 4194304 5683644 140733351455744 18446744073709551615 256415411782 0 0 16781312 514 3859105497881772031 0 0 17 4 0 0 0
/proc/32454/statm: 167216 7891 351 364 0 103041 0
[pid=32456] ppid=32454 vsize=454748 CPUtime=0.64 cores=0-7
/proc/32456/stat : 32456 (TNM) R 32454 32456 32456 0 -1 4202496 1512 0 0 0 64 0 0 0 22 0 1 0 746943812 465661952 1223 33554432000 134512640 135008748 4288956880 18446744073709551615 134523393 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/32456/statm: 113687 1223 45 122 0 112587 0
[pid=32297/tid=32304] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32304/stat : 32304 (python) S 32295 32297 32013 0 -1 4202560 24 933 0 0 0 0 0 0 25 0 33 0 746824232 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 6 0 0 0
[pid=32297/tid=32307] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32307/stat : 32307 (python) S 32295 32297 32013 0 -1 4202560 23 933 0 0 0 0 0 0 25 0 33 0 746824235 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32310] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32310/stat : 32310 (python) S 32295 32297 32013 0 -1 4202560 27 933 0 0 0 0 0 0 18 0 33 0 746824238 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32313] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32313/stat : 32313 (python) S 32295 32297 32013 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 33 0 746824241 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32316] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32316/stat : 32316 (python) S 32295 32297 32013 0 -1 4202560 45 933 0 0 0 0 0 0 18 0 33 0 746824245 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32319] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32319/stat : 32319 (python) S 32295 32297 32013 0 -1 4202560 20 933 0 0 0 0 0 0 19 0 33 0 746824248 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 3 0 0 0
[pid=32297/tid=32322] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32322/stat : 32322 (python) S 32295 32297 32013 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 33 0 746824251 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32325] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32325/stat : 32325 (python) S 32295 32297 32013 0 -1 4202560 35 933 0 0 0 0 0 0 18 0 33 0 746824255 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 0 0 0 0
[pid=32297/tid=32332] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32332/stat : 32332 (python) S 32295 32297 32013 0 -1 4202560 38 933 0 0 0 0 0 0 18 0 33 0 746834076 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32338] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32338/stat : 32338 (python) S 32295 32297 32013 0 -1 4202560 109 933 0 0 0 0 0 0 18 0 33 0 746834273 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 0 0 0 0
[pid=32297/tid=32341] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32341/stat : 32341 (python) S 32295 32297 32013 0 -1 4202560 45 933 0 0 0 0 0 0 18 0 33 0 746834277 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 6 0 0 0
[pid=32297/tid=32345] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32345/stat : 32345 (python) S 32295 32297 32013 0 -1 4202560 31 933 0 0 0 0 0 0 24 0 33 0 746834281 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 6 0 0 0
[pid=32297/tid=32348] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32348/stat : 32348 (python) S 32295 32297 32013 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 33 0 746834286 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32353] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32353/stat : 32353 (python) S 32295 32297 32013 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 33 0 746834292 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 0 0 0 0
[pid=32297/tid=32357] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32357/stat : 32357 (python) S 32295 32297 32013 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 33 0 746834297 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 0 0 0 0
[pid=32297/tid=32360] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32360/stat : 32360 (python) S 32295 32297 32013 0 -1 4202560 52 933 0 0 0 0 0 0 18 0 33 0 746834303 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32367] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32367/stat : 32367 (python) S 32295 32297 32013 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 33 0 746844114 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32371] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32371/stat : 32371 (python) S 32295 32297 32013 0 -1 4202560 30 933 0 0 0 0 0 0 18 0 33 0 746844311 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32383] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32383/stat : 32383 (python) S 32295 32297 32013 0 -1 4202560 37 933 0 0 0 0 0 0 18 0 33 0 746854579 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32389] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32389/stat : 32389 (python) S 32295 32297 32013 0 -1 4202560 140 933 0 0 0 0 0 0 18 0 33 0 746863813 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32394] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32394/stat : 32394 (python) S 32295 32297 32013 0 -1 4202560 43 933 0 0 0 0 0 0 20 0 33 0 746873578 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32399] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32399/stat : 32399 (python) S 32295 32297 32013 0 -1 4202560 43 933 0 0 0 0 0 0 20 0 33 0 746874165 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32409] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32409/stat : 32409 (python) S 32295 32297 32013 0 -1 4202560 49 933 0 0 0 0 0 0 20 0 33 0 746892922 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32412] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32412/stat : 32412 (python) S 32295 32297 32013 0 -1 4202560 34 933 0 0 0 0 0 0 20 0 33 0 746893945 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32417] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32417/stat : 32417 (python) S 32295 32297 32013 0 -1 4202560 53 933 0 0 0 0 0 0 20 0 33 0 746902951 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32422] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32422/stat : 32422 (python) S 32295 32297 32013 0 -1 4202560 42 933 0 0 0 0 0 0 18 0 33 0 746903986 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32427] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32427/stat : 32427 (python) S 32295 32297 32013 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 33 0 746912810 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32431] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32431/stat : 32431 (python) S 32295 32297 32013 0 -1 4202560 167 933 0 0 0 0 0 0 20 0 33 0 746912999 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32438] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32438/stat : 32438 (python) S 32295 32297 32013 0 -1 4202560 42 933 0 0 0 0 0 0 20 0 33 0 746922852 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32445] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32445/stat : 32445 (python) S 32295 32297 32013 0 -1 4202560 38 933 0 0 0 0 0 0 20 0 33 0 746932684 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 1 0 0 0
[pid=32297/tid=32452] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32452/stat : 32452 (python) S 32295 32297 32013 0 -1 4202560 44 933 0 0 0 0 0 0 19 0 33 0 746942726 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
[pid=32297/tid=32455] ppid=32295 vsize=679108 CPUtime=0 cores=0-7
/proc/32297/task/32455/stat : 32455 (python) S 32295 32297 32013 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 33 0 746943812 695406592 9484 33554432000 4194304 5683644 140733351455744 18446744073709551615 256427215281 0 0 16781312 2 18446604446326891456 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9527.11
Current children cumulated vsize (KiB) 31760532

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32297 and gives
#  childrusage.ru_utime.tv_sec=3024
#  childrusage.ru_utime.tv_usec=688177
#  childrusage.ru_stime.tv_sec=16
#  childrusage.ru_stime.tv_usec=567481
# CPU time returned by wait4() is 3041.26
# while last known CPU time is 9527.11
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1199.11
CPU time (s): 9527.11
CPU user time (s): 9510.55
CPU system time (s): 16.56
CPU usage (%): 794.514
Max. virtual memory (cumulated for all children) (KiB): 31760532

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3024.69
system time used= 16.5675
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 108144
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14953
involuntary context switches= 29979

runsolver used 13.311 second user time and 31.6472 second system time

The end

Launcher Data 

Begin job on node115 at 2011-05-16 19:12:13
IDJOB=3385370
IDBENCH=82635
IDSOLVER=1870
FILE ID=node115/3385370-1305565933
RUNJOBID= node115-1305564965-32027
PBS_JOBID= 13350135
Free space on /tmp= 73284 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k5-r20-v2000-c40000-S61914820-087-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385370-1305565933/watcher-3385370-1305565933 -o /tmp/evaluation-result-3385370-1305565933/solver-3385370-1305565933 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385370-1305565933.cnf -seed 1266908400 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1b9b43753c02a2c226adda648a956e92
RANDOM SEED=1266908400

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13523744 kB
Buffers:        280172 kB
Cached:        3257736 kB
SwapCached:          0 kB
Active:       15977236 kB
Inactive:      3119452 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13523744 kB
SwapTotal:    67111528 kB
SwapFree:     67111200 kB
Dirty:           32616 kB
Writeback:           0 kB
AnonPages:    15558628 kB
Mapped:          34584 kB
Slab:           197432 kB
PageTables:      62456 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 110137648 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73252 MiB
End job on node115 at 2011-05-16 19:32:14