Trace number 3321900

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 11049.7 1389.41

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S1859210562-077-UNKNOWN.cnf
MD5SUM3d96bca49fe954bb59442ef617e689bb
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.47	c INFO: solving HOME/instance-3321900-1304369222.cnf
0.32/0.47	c INFO: computing task features
0.50/0.65	c INFO: computed variable-clause graph statistics
0.50/0.65	c INFO: computed clause balance statistics
1.41/1.55	c INFO: computed variable balance statistics
1.81/1.91	c INFO: computed small-clause counts
1.81/1.91	c INFO: computed Horn-clause counts
1.81/1.94	c INFO: computed variable graph statistics
1.81/1.94	c INFO: collected features for HOME/instance-3321900-1304369222.cnf in 1.47 s
1.81/1.98	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.37)
1.91/2.01	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
1.91/2.06	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.08)
1.91/2.09	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
2.24/2.13	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.05)
2.24/2.17	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.04)
2.64/2.21	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.03)
2.64/2.25	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
787.28/100.47	c INFO: running adaptg2wsat2009++@0 for 97 with 39900 remaining (b = 0.02)
793.80/101.26	c INFO: running FH@0 for 97 with 39899 remaining (b = 0.02)
801.67/102.29	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
802.36/102.34	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
802.36/102.40	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
802.84/102.46	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.01)
803.22/102.51	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
803.22/102.58	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.02)
1586.99/200.74	c INFO: running TNM@0 for 1552 with 39799 remaining (b = 0.19)
1593.29/201.54	c INFO: running FH@0 for 97 with 39798 remaining (b = 0.01)
1602.06/202.66	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
1602.86/202.75	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
2368.86/298.83	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2369.62/298.94	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2370.42/299.10	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2371.26/299.17	c INFO: running hybridGM3@98 for 97 with 39701 remaining (b = 0.01)
2377.49/299.93	c INFO: running adaptg2wsat2009++@0 for 97 with 39700 remaining (b = 0.01)
2378.27/300.02	c INFO: running adaptg2wsat2009++@97 for 97 with 39700 remaining (b = 0.01)
2392.57/301.82	c INFO: running hybridGM3@0 for 194 with 39698 remaining (b = 0.02)
3127.46/394.09	c INFO: running hybridGM3@296 for 97 with 39606 remaining (b = 0.01)
3129.02/394.22	c INFO: running hybridGM3@295 for 97 with 39606 remaining (b = 0.01)
3145.76/396.30	c INFO: running TNM@0 for 1552 with 39604 remaining (b = 0.15)
3152.94/397.21	c INFO: running adaptg2wsat2009++@99 for 97 with 39603 remaining (b = 0.01)
3178.45/400.43	c INFO: running hybridGM3@295 for 97 with 39600 remaining (b = 0.01)
3179.12/400.51	c INFO: running FH@0 for 291 with 39600 remaining (b = 0.03)
3934.81/495.37	c INFO: running gnovelty+2@0 for 97 with 39505 remaining (b = 0.01)
3936.29/495.50	c INFO: running hybridGM3@391 for 97 with 39505 remaining (b = 0.01)
3937.67/495.71	c INFO: running hybridGM3@391 for 97 with 39504 remaining (b = 0.01)
3950.69/497.38	c INFO: running hybridGM3@95 for 97 with 39503 remaining (b = 0.01)
3975.41/500.51	c INFO: running hybridGM3@395 for 97 with 39500 remaining (b = 0.01)
4695.19/590.77	c INFO: running iPAWS@0 for 97 with 39409 remaining (b = 0.01)
4697.99/591.12	c INFO: running adaptg2wsat2009++@99 for 97 with 39409 remaining (b = 0.01)
4719.83/593.87	c INFO: running hybridGM3@0 for 194 with 39406 remaining (b = 0.02)
4750.83/597.73	c INFO: running FH@100 for 291 with 39402 remaining (b = 0.02)
4751.63/597.82	c INFO: running hybridGM3@0 for 194 with 39402 remaining (b = 0.01)
5472.93/688.43	c INFO: running TNM@0 for 1552 with 39312 remaining (b = 0.11)
5493.63/691.09	c INFO: running iPAWS@0 for 97 with 39309 remaining (b = 0.01)
5527.07/695.24	c INFO: running adaptg2wsat2009++@100 for 97 with 39305 remaining (b = 0.01)
6284.89/790.45	c INFO: running hybridGM3@97 for 97 with 39210 remaining (b = 0.01)
6292.81/791.42	c INFO: running adaptg2wsat2009++@96 for 97 with 39209 remaining (b = 0.01)
6301.55/792.55	c INFO: running adaptg2wsat2009++@296 for 291 with 39207 remaining (b = 0.02)
6356.43/799.43	c INFO: running hybridGM3@96 for 97 with 39201 remaining (b = 0.01)
7056.96/887.45	c INFO: running FH@196 for 194 with 39113 remaining (b = 0.02)
7067.38/888.73	c INFO: running gnovelty+2@0 for 97 with 39111 remaining (b = 0.01)
7083.24/890.80	c INFO: running hybridGM3@0 for 194 with 39109 remaining (b = 0.01)
7115.05/894.73	c INFO: running hybridGM3@385 for 194 with 39105 remaining (b = 0.02)
7914.29/995.14	c INFO: running NCVWr@0 for 485 with 39005 remaining (b = 0.03)
8629.18/1084.98	c INFO: running FH@294 for 97 with 38915 remaining (b = 0.01)
8639.50/1086.29	c INFO: running adaptg2wsat2009++@493 for 97 with 38914 remaining (b = 0.01)
8641.08/1086.45	c INFO: running hybridGM3@94 for 97 with 38914 remaining (b = 0.01)
8735.00/1098.27	c INFO: running FH@0 for 97 with 38902 remaining (b = 0.01)
9387.79/1180.29	c INFO: running hybridGM3@0 for 194 with 38820 remaining (b = 0.01)
9446.58/1187.61	c INFO: running adaptg2wsat2009++@688 for 97 with 38812 remaining (b = 0.01)
9447.38/1187.77	c INFO: running hybridGM3@293 for 194 with 38812 remaining (b = 0.01)
9534.08/1198.61	c INFO: running TNM@0 for 1552 with 38801 remaining (b = 0.08)
10204.39/1282.93	c INFO: running FH@100 for 291 with 38717 remaining (b = 0.02)
10970.11/1379.30	c INFO: running hybridGM3@392 for 97 with 38621 remaining (b = 0.01)
11047.21/1388.93	c INFO: running iPAWS@0 for 97 with 38611 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321900-1304369222/watcher-3321900-1304369222 -o /tmp/evaluation-result-3321900-1304369222/solver-3321900-1304369222 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321900-1304369222.cnf -seed 548430009 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.82 8.60 7.94 2/267 29108
/proc/meminfo: memFree=20789100/32950928 swapFree=67111356/67111528
[pid=29108] ppid=29106 vsize=15780 CPUtime=0 cores=0-7
/proc/29108/stat : 29108 (python) R 29106 29108 28307 0 -1 4202496 900 0 0 0 0 0 0 0 25 0 1 0 627152925 16158720 780 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895151301 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29108/statm: 3945 782 345 364 0 432 0

[startup+0.090489 s]
/proc/loadavg: 8.82 8.60 7.94 2/267 29108
/proc/meminfo: memFree=20789100/32950928 swapFree=67111356/67111528
[pid=29108] ppid=29106 vsize=99352 CPUtime=0.07 cores=0-7
/proc/29108/stat : 29108 (python) S 29106 29108 28307 0 -1 4202496 2858 0 0 0 5 2 0 0 17 0 1 0 627152925 101736448 2558 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895488512 0 2147483391 16781312 2 18446744071699215550 0 0 17 6 0 0 0
/proc/29108/statm: 24838 2558 818 364 0 1689 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 99352

[startup+0.100504 s]
/proc/loadavg: 8.82 8.60 7.94 2/267 29108
/proc/meminfo: memFree=20789100/32950928 swapFree=67111356/67111528
[pid=29108] ppid=29106 vsize=104224 CPUtime=0.07 cores=0-7
/proc/29108/stat : 29108 (python) R 29106 29108 28307 0 -1 4202496 3058 0 0 0 5 2 0 0 17 0 1 0 627152925 106725376 2740 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895488512 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29108/statm: 26056 2740 847 364 0 1804 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104224

[startup+0.300441 s]
/proc/loadavg: 8.82 8.60 7.94 2/267 29108
/proc/meminfo: memFree=20789100/32950928 swapFree=67111356/67111528
[pid=29108] ppid=29106 vsize=170756 CPUtime=0.23 cores=0-7
/proc/29108/stat : 29108 (python) R 29106 29108 28307 0 -1 4202496 6732 935 1 0 16 7 0 0 17 0 1 0 627152925 174854144 4805 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895490192 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29108/statm: 42689 4805 1336 364 0 3454 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 170756

[startup+0.700358 s]
/proc/loadavg: 8.82 8.60 7.94 2/267 29108
/proc/meminfo: memFree=20789100/32950928 swapFree=67111356/67111528
[pid=29108] ppid=29106 vsize=285676 CPUtime=0.61 cores=0-7
/proc/29108/stat : 29108 (python) R 29106 29108 28307 0 -1 4202496 12375 935 1 0 51 10 0 0 17 0 1 0 627152925 292532224 8803 33554432000 4194304 5683644 140735235151904 18446744073709551615 4579961 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29108/statm: 71419 8803 1826 364 0 7343 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 285676

[startup+1.50021 s]
/proc/loadavg: 8.82 8.60 7.94 2/268 29113
/proc/meminfo: memFree=20760512/32950928 swapFree=67111356/67111528
[pid=29108] ppid=29106 vsize=285676 CPUtime=1.41 cores=0-7
/proc/29108/stat : 29108 (python) R 29106 29108 28307 0 -1 4202496 12375 935 1 0 131 10 0 0 19 0 1 0 627152925 292532224 8803 33554432000 4194304 5683644 140735235151904 18446744073709551615 47436893441199 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29108/statm: 71419 8803 1826 364 0 7343 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 285676

[startup+3.10082 s]
/proc/loadavg: 8.82 8.60 7.94 6/279 29124
/proc/meminfo: memFree=20745048/32950928 swapFree=67111356/67111528
[pid=29108] ppid=29106 vsize=362384 CPUtime=2.15 cores=0-7
/proc/29108/stat : 29108 (python) S 29106 29108 28307 0 -1 4202496 18693 935 1 0 204 11 0 0 20 0 9 0 627152925 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/29108/statm: 90596 7562 1891 364 0 26493 0
[pid=29114] ppid=29108 vsize=280696 CPUtime=0 cores=0-7
/proc/29114/stat : 29114 (python) S 29108 29108 28307 0 -1 4202560 737 0 0 0 0 0 0 0 15 0 1 0 627153123 287432704 5961 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510543 0 0 16781312 514 14582347184709009668 0 0 17 7 0 0 0
/proc/29114/statm: 70174 5961 355 364 0 6092 0
[pid=29116] ppid=29114 vsize=1019708 CPUtime=1.11 cores=0-7
/proc/29116/stat : 29116 (gnovelty+2) R 29114 29116 29116 0 -1 4202496 957 0 0 0 111 0 0 0 22 0 1 0 627153123 1044180992 689 33554432000 134512640 135663704 4290046784 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29116/statm: 254927 689 113 282 0 254643 0
[pid=29117] ppid=29108 vsize=291560 CPUtime=0 cores=0-7
/proc/29117/stat : 29117 (python) S 29108 29108 28307 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 627153126 298557440 5976 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 9170090257423499523 0 0 17 6 0 0 0
/proc/29117/statm: 72890 5976 349 364 0 8805 0
[pid=29119] ppid=29117 vsize=1019708 CPUtime=1.07 cores=0-7
/proc/29119/stat : 29119 (gnovelty+2) R 29117 29119 29119 0 -1 4202496 952 0 0 0 107 0 0 0 24 0 1 0 627153127 1044180992 689 33554432000 134512640 135663704 4287086144 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29119/statm: 254927 689 113 282 0 254643 0
[pid=29120] ppid=29108 vsize=301276 CPUtime=0 cores=0-7
/proc/29120/stat : 29120 (python) S 29108 29108 28307 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 627153131 308506624 5980 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 4242532415400050687 0 0 17 0 0 0 0
/proc/29120/statm: 75319 5980 349 364 0 11231 0
[pid=29122] ppid=29120 vsize=419820 CPUtime=1.02 cores=0-7
/proc/29122/stat : 29122 (adaptg2wsat2009) R 29120 29122 29122 0 -1 4202496 1438 0 0 0 102 0 0 0 25 0 1 0 627153131 429895680 1172 33554432000 134512640 135107411 4289767456 18446744073709551615 134523472 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29122/statm: 104955 1172 49 146 0 103831 0
[pid=29123] ppid=29108 vsize=311464 CPUtime=0 cores=0-7
/proc/29123/stat : 29123 (python) S 29108 29108 28307 0 -1 4202560 735 0 0 0 0 0 0 0 19 0 1 0 627153135 318939136 5980 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 11254447369460121599 0 0 17 4 0 0 0
/proc/29123/statm: 77866 5980 345 364 0 13775 0
[pid=29108/tid=29115] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29115/stat : 29115 (python) S 29106 29108 28307 0 -1 4202560 26 935 0 0 0 0 0 0 21 0 9 0 627153123 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 4 0 0 0
[pid=29108/tid=29118] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29118/stat : 29118 (python) S 29106 29108 28307 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 9 0 627153127 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 0 0 0 0
[pid=29108/tid=29121] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29121/stat : 29121 (python) S 29106 29108 28307 0 -1 4202560 23 935 0 0 0 0 0 0 22 0 9 0 627153131 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29124] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29124/stat : 29124 (python) S 29106 29108 28307 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 9 0 627153135 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.35
Current children cumulated vsize (KiB) 4006616

[startup+6.30123 s]
/proc/loadavg: 8.75 8.59 7.94 9/292 29137
/proc/meminfo: memFree=20703528/32950928 swapFree=67111356/67111528
[pid=29108] ppid=29106 vsize=362384 CPUtime=2.15 cores=0-7
/proc/29108/stat : 29108 (python) S 29106 29108 28307 0 -1 4202496 18693 935 1 0 204 11 0 0 20 0 9 0 627152925 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/29108/statm: 90596 7562 1891 364 0 26493 0
[pid=29114] ppid=29108 vsize=280696 CPUtime=0 cores=0-7
/proc/29114/stat : 29114 (python) S 29108 29108 28307 0 -1 4202560 901 0 0 0 0 0 0 0 16 0 1 0 627153123 287432704 5984 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510543 0 0 16781312 514 14582347184709009668 0 0 17 7 0 0 0
/proc/29114/statm: 70174 5984 378 364 0 6092 0
[pid=29116] ppid=29114 vsize=1019708 CPUtime=4.31 cores=0-7
/proc/29116/stat : 29116 (gnovelty+2) R 29114 29116 29116 0 -1 4202496 957 0 0 0 431 0 0 0 25 0 1 0 627153123 1044180992 689 33554432000 134512640 135663704 4290046784 18446744073709551615 134524894 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29116/statm: 254927 689 113 282 0 254643 0
[pid=29117] ppid=29108 vsize=291560 CPUtime=0 cores=0-7
/proc/29117/stat : 29117 (python) S 29108 29108 28307 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 627153126 298557440 5999 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 9170090257423499523 0 0 17 6 0 0 0
/proc/29117/statm: 72890 5999 372 364 0 8805 0
[pid=29119] ppid=29117 vsize=1019708 CPUtime=4.27 cores=0-7
/proc/29119/stat : 29119 (gnovelty+2) R 29117 29119 29119 0 -1 4202496 952 0 0 0 427 0 0 0 25 0 1 0 627153127 1044180992 689 33554432000 134512640 135663704 4287086144 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29119/statm: 254927 689 113 282 0 254643 0
[pid=29120] ppid=29108 vsize=301276 CPUtime=0 cores=0-7
/proc/29120/stat : 29120 (python) S 29108 29108 28307 0 -1 4202560 920 0 0 0 0 0 0 0 18 0 1 0 627153131 308506624 6003 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 4242532415400018178 0 0 17 0 0 0 0
/proc/29120/statm: 75319 6003 372 364 0 11231 0
[pid=29122] ppid=29120 vsize=420220 CPUtime=4.23 cores=0-7
/proc/29122/stat : 29122 (adaptg2wsat2009) R 29120 29122 29122 0 -1 4202496 1666 0 0 0 422 1 0 0 25 0 1 0 627153131 430305280 1400 33554432000 134512640 135107411 4289767456 18446744073709551615 134531797 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29122/statm: 105055 1400 59 146 0 103931 0
[pid=29123] ppid=29108 vsize=311464 CPUtime=0.01 cores=0-7
/proc/29123/stat : 29123 (python) S 29108 29108 28307 0 -1 4202560 938 0 0 0 1 0 0 0 18 0 1 0 627153135 318939136 6007 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 11254447369460089091 0 0 17 4 0 0 0
/proc/29123/statm: 77866 6007 372 364 0 13775 0
[pid=29125] ppid=29123 vsize=420220 CPUtime=4.13 cores=0-7
/proc/29125/stat : 29125 (adaptg2wsat2009) R 29123 29125 29125 0 -1 4202496 1665 0 0 0 413 0 0 0 25 0 1 0 627153135 430305280 1401 33554432000 134512640 135107411 4289331408 18446744073709551615 134532376 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/29125/statm: 105055 1401 59 146 0 103931 0
[pid=29126] ppid=29108 vsize=322328 CPUtime=0 cores=0-7
/proc/29126/stat : 29126 (python) S 29108 29108 28307 0 -1 4202560 950 0 0 0 0 0 0 0 18 0 1 0 627153138 330063872 6011 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 4208160582404112641 0 0 17 6 0 0 0
/proc/29126/statm: 80582 6011 372 364 0 16488 0
[pid=29128] ppid=29126 vsize=420220 CPUtime=4.13 cores=0-7
/proc/29128/stat : 29128 (adaptg2wsat2009) R 29126 29128 29128 0 -1 4202496 1667 0 0 0 413 0 0 0 25 0 1 0 627153139 430305280 1399 33554432000 134512640 135107411 4290965232 18446744073709551615 134532364 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29128/statm: 105055 1399 59 146 0 103931 0
[pid=29129] ppid=29108 vsize=332652 CPUtime=0 cores=0-7
/proc/29129/stat : 29129 (python) S 29108 29108 28307 0 -1 4202560 958 0 0 0 0 0 0 0 18 0 1 0 627153142 340635648 6032 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 14582339488127615235 0 0 17 4 0 0 0
/proc/29129/statm: 83163 6032 372 364 0 19066 0
[pid=29131] ppid=29129 vsize=1019708 CPUtime=4.08 cores=0-7
/proc/29131/stat : 29131 (gnovelty+2) R 29129 29131 29131 0 -1 4202496 955 0 0 0 408 0 0 0 25 0 1 0 627153143 1044180992 689 33554432000 134512640 135663704 4288371872 18446744073709551615 134524894 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29131/statm: 254927 689 113 282 0 254643 0
[pid=29132] ppid=29108 vsize=342368 CPUtime=0.01 cores=0-7
/proc/29132/stat : 29132 (python) S 29108 29108 28307 0 -1 4202560 972 0 0 0 0 1 0 0 18 0 1 0 627153146 350584832 6036 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 4394691630544683266 0 0 17 7 0 0 0
/proc/29132/statm: 85592 6036 372 364 0 21492 0
[pid=29134] ppid=29132 vsize=247956 CPUtime=4.04 cores=0-7
/proc/29134/stat : 29134 (FH) R 29132 29134 29134 0 -1 4202496 1250 0 0 0 404 0 0 0 25 0 1 0 627153148 253906944 987 33554432000 134512640 134936988 4294805408 18446744073709551615 134523476 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29134/statm: 61989 987 37 104 0 61493 0
[pid=29135] ppid=29108 vsize=352488 CPUtime=0 cores=0-7
/proc/29135/stat : 29135 (python) S 29108 29108 28307 0 -1 4202560 1000 0 0 0 0 0 0 0 18 0 1 0 627153150 360947712 6046 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 4293047445586179 0 0 17 2 0 0 0
/proc/29135/statm: 88122 6046 378 364 0 24019 0
[pid=29137] ppid=29135 vsize=420220 CPUtime=4.03 cores=0-7
/proc/29137/stat : 29137 (adaptg2wsat2009) R 29135 29137 29137 0 -1 4202496 1670 0 0 0 403 0 0 0 25 0 1 0 627153150 430305280 1399 33554432000 134512640 135107411 4287338704 18446744073709551615 134531935 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29137/statm: 105055 1399 59 146 0 103931 0
[pid=29108/tid=29115] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29115/stat : 29115 (python) S 29106 29108 28307 0 -1 4202560 26 935 0 0 0 0 0 0 21 0 9 0 627153123 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 4 0 0 0
[pid=29108/tid=29118] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29118/stat : 29118 (python) S 29106 29108 28307 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 9 0 627153127 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 0 0 0 0
[pid=29108/tid=29121] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29121/stat : 29121 (python) S 29106 29108 28307 0 -1 4202560 23 935 0 0 0 0 0 0 22 0 9 0 627153131 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29124] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29124/stat : 29124 (python) S 29106 29108 28307 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 9 0 627153135 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29127] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29127/stat : 29127 (python) S 29106 29108 28307 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 9 0 627153139 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29130] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29130/stat : 29130 (python) S 29106 29108 28307 0 -1 4202560 27 935 0 0 0 0 0 0 22 0 9 0 627153142 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 4 0 0 0
[pid=29108/tid=29133] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29133/stat : 29133 (python) S 29106 29108 28307 0 -1 4202560 25 935 0 0 0 0 0 0 19 0 9 0 627153146 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29136] ppid=29106 vsize=362384 CPUtime=0 cores=0-7
/proc/29108/task/29136/stat : 29136 (python) S 29106 29108 28307 0 -1 4202560 81 935 0 0 0 0 0 0 21 0 9 0 627153150 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 35.39
Current children cumulated vsize (KiB) 7885176

[startup+12.701 s]
/proc/loadavg: 8.69 8.58 7.94 9/292 29137
/proc/meminfo: memFree=20698016/32950928 swapFree=67111356/67111528
[pid=29108] ppid=29106 vsize=362384 CPUtime=2.15 cores=0-7
/proc/29108/stat : 29108 (python) S 29106 29108 28307 0 -1 4202496 18693 935 1 0 204 11 0 0 20 0 9 0 627152925 371081216 7562 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907317195 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/29108/statm: 90596 7562 1891 364 0 26493 0
[pid=29114] ppid=29108 vsize=280696 CPUtime=0.02 cores=0-7
/proc/29114/stat : 29114 (python) S 29108 29108 28307 0 -1 4202560 904 0 0 0 1 1 0 0 15 0 1 0 627153123 287432704 5984 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510543 0 0 16781312 514 13705315683204563204 0 0 17 7 0 0 0
/proc/29114/statm: 70174 5984 378 364 0 6092 0
[pid=29116] ppid=29114 vsize=1019708 CPUtime=10.71 cores=0-7
/proc/29116/stat : 29116 (gnovelty+2) R 29114 29116 29116 0 -1 4202496 957 0 0 0 1071 0 0 0 25 0 1 0 627153123 1044180992 689 33554432000 134512640 135663704 4290046784 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29116/statm: 254927 689 113 282 0 254643 0
[pid=29117] ppid=29108 vsize=291560 CPUtime=0.01 cores=0-7
/proc/29117/stat : 29117 (python) S 29108 29108 28307 0 -1 4202560 905 0 0 0 0 1 0 0 18 0 1 0 627153126 298557440 5999 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 13705315683204563203 0 0 17 6 0 0 0
/proc/29117/statm: 72890 5999 372 364 0 8805 0
[pid=29119] ppid=29117 vsize=1019708 CPUtime=10.67 cores=0-7

################
# More data... #
################

/proc/29212/statm: 83999 1535 59 147 0 83851 0
[pid=29210/tid=29226] ppid=29108 vsize=562480 CPUtime=0 cores=0-7
/proc/29210/task/29226/stat : 29226 (python) S 29108 29108 28307 0 -1 4202560 116 0 0 0 0 0 0 0 19 0 2 0 627222025 575979520 6822 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 514 18446604452012944128 0 0 -1 0 0 0 0
[pid=29214] ppid=29108 vsize=572736 CPUtime=0.68 cores=0-7
/proc/29214/stat : 29214 (python) S 29108 29108 28307 0 -1 4202560 1195 0 0 0 34 34 0 0 18 0 2 0 627212312 586481664 6807 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29214/statm: 143184 6807 407 364 0 79036 0
[pid=29216] ppid=29214 vsize=268428 CPUtime=296.01 cores=0-7
/proc/29216/stat : 29216 (hybridGM3) T 29214 29216 29216 0 -1 4202496 5409 0 0 0 29601 0 0 0 25 0 1 0 627212312 274870272 5127 33554432000 134512640 135204385 4292744736 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/29216/statm: 67107 5127 63 169 0 66937 0
[pid=29214/tid=29233] ppid=29108 vsize=572736 CPUtime=0 cores=0-7
/proc/29214/task/29233/stat : 29233 (python) S 29108 29108 28307 0 -1 4202560 105 0 0 0 0 0 0 0 18 0 2 0 627231960 586481664 6807 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 514 18446604448378033472 0 0 -1 5 0 0 0
[pid=29218] ppid=29108 vsize=582992 CPUtime=1.16 cores=0-7
/proc/29218/stat : 29218 (python) S 29108 29108 28307 0 -1 4202560 1214 0 0 0 58 58 0 0 18 0 2 0 627212708 596983808 6742 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29218/statm: 145748 6742 406 364 0 81597 0
[pid=29220] ppid=29218 vsize=268424 CPUtime=490.07 cores=0-7
/proc/29220/stat : 29220 (hybridGM3) T 29218 29220 29220 0 -1 4202496 5407 0 0 0 49007 0 0 0 25 0 1 0 627212708 274866176 5125 33554432000 134512640 135204385 4287380832 18446744073709551615 134538375 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29220/statm: 67106 5125 63 169 0 66936 0
[pid=29218/tid=29235] ppid=29108 vsize=582992 CPUtime=0 cores=0-7
/proc/29218/task/29235/stat : 29235 (python) S 29108 29108 28307 0 -1 4202560 106 0 0 0 0 0 0 0 18 0 2 0 627232859 596983808 6742 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 514 18446604453885412544 0 0 -1 7 0 0 0
[pid=29223] ppid=29108 vsize=593248 CPUtime=1.61 cores=0-7
/proc/29223/stat : 29223 (python) S 29108 29108 28307 0 -1 4202560 1091 0 0 0 85 76 0 0 18 0 1 0 627221768 607485952 6603 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 13705315683204563203 0 0 17 2 0 0 0
/proc/29223/statm: 148312 6603 371 364 0 84158 0
[pid=29225] ppid=29223 vsize=458348 CPUtime=695.66 cores=0-7
/proc/29225/stat : 29225 (TNM) R 29223 29225 29225 0 -1 4202496 1525 0 0 0 69566 0 0 0 25 0 1 0 627221769 469348352 1239 33554432000 134512640 135008748 4292999584 18446744073709551615 134527503 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29225/statm: 114587 1239 46 122 0 113487 0
[pid=29227] ppid=29108 vsize=603832 CPUtime=0.23 cores=0-7
/proc/29227/stat : 29227 (python) S 29108 29108 28307 0 -1 4202560 1227 0 0 0 11 12 0 0 19 0 2 0 627222034 618323968 6638 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29227/statm: 150958 6638 401 364 0 86801 0
[pid=29229] ppid=29227 vsize=335996 CPUtime=100.19 cores=0-7
/proc/29229/stat : 29229 (iPAWS) T 29227 29229 29229 0 -1 4202496 1825 0 0 0 10019 0 0 0 25 0 1 0 627222036 344059904 1540 33554432000 134512640 135114423 4287189280 18446744073709551615 134516818 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/29229/statm: 83999 1540 59 147 0 83851 0
[pid=29227/tid=29234] ppid=29108 vsize=603832 CPUtime=0 cores=0-7
/proc/29227/task/29234/stat : 29234 (python) S 29108 29108 28307 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 627232058 618323968 6638 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 514 18446604445345978432 0 0 -1 4 0 0 0
[pid=29247] ppid=29108 vsize=614332 CPUtime=0.24 cores=0-7
/proc/29247/stat : 29247 (python) S 29108 29108 28307 0 -1 4202560 1271 0 0 0 13 11 0 0 19 0 2 0 627241798 629075968 6678 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29247/statm: 153583 6678 401 364 0 89423 0
[pid=29249] ppid=29247 vsize=1019708 CPUtime=102.18 cores=0-7
/proc/29249/stat : 29249 (gnovelty+2) T 29247 29249 29249 0 -1 4202496 979 0 0 0 10218 0 0 0 25 0 1 0 627241799 1044180992 689 33554432000 134512640 135663704 4287905024 18446744073709551615 134525302 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29249/statm: 254927 689 113 282 0 254643 0
[pid=29247/tid=29256] ppid=29108 vsize=614332 CPUtime=0 cores=0-7
/proc/29247/task/29256/stat : 29256 (python) S 29108 29108 28307 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 627252429 629075968 6678 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 514 18446604442482502336 0 0 -1 7 0 0 0
[pid=29250] ppid=29108 vsize=624152 CPUtime=1.15 cores=0-7
/proc/29250/stat : 29250 (python) S 29108 29108 28307 0 -1 4202560 1313 0 0 0 56 59 0 0 18 0 2 0 627242005 639131648 6789 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29250/statm: 156038 6789 401 364 0 91875 0
[pid=29252] ppid=29250 vsize=268424 CPUtime=497.16 cores=0-7
/proc/29252/stat : 29252 (hybridGM3) R 29250 29252 29252 0 -1 4202496 5408 0 0 0 49712 4 0 0 25 0 1 0 627242006 274866176 5127 33554432000 134512640 135204385 4293330144 18446744073709551615 134537914 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29252/statm: 67106 5127 63 169 0 66936 0
[pid=29250/tid=29263] ppid=29108 vsize=624152 CPUtime=0 cores=0-7
/proc/29250/task/29263/stat : 29263 (python) S 29108 29108 28307 0 -1 4202560 223 0 0 0 0 0 0 0 18 0 2 0 627261560 639131648 6789 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 514 18446604442482500544 0 0 -1 6 0 0 0
[pid=29257] ppid=29108 vsize=634408 CPUtime=0.92 cores=0-7
/proc/29257/stat : 29257 (python) S 29108 29108 28307 0 -1 4202560 1061 0 0 0 45 47 0 0 18 0 1 0 627252439 649633792 6773 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 13705315683204563203 0 0 17 6 0 0 0
/proc/29257/statm: 158602 6773 378 364 0 94436 0
[pid=29259] ppid=29257 vsize=419772 CPUtime=389.25 cores=0-7
/proc/29259/stat : 29259 (NCVWr) R 29257 29259 29259 0 -1 4202496 1571 0 0 0 38925 0 0 0 25 0 1 0 627252439 429846528 1281 33554432000 134512640 135113558 4290948928 18446744073709551615 134531486 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/29259/statm: 104943 1281 58 147 0 103818 0
[pid=29264] ppid=29108 vsize=644664 CPUtime=0.23 cores=0-7
/proc/29264/stat : 29264 (python) S 29108 29108 28307 0 -1 4202560 1261 0 0 0 12 11 0 0 19 0 2 0 627262753 660135936 6895 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29264/statm: 161166 6895 407 364 0 96997 0
[pid=29266] ppid=29264 vsize=249872 CPUtime=99.65 cores=0-7
/proc/29266/stat : 29266 (FH) T 29264 29266 29266 0 -1 4202496 1551 0 0 0 9965 0 0 0 25 0 1 0 627262753 255868928 1263 33554432000 134512640 134936988 4293815856 18446744073709551615 134553238 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/29266/statm: 62468 1263 41 104 0 61972 0
[pid=29264/tid=29273] ppid=29108 vsize=644664 CPUtime=0 cores=0-7
/proc/29264/task/29273/stat : 29273 (python) S 29108 29108 28307 0 -1 4202560 94 0 0 0 0 0 0 0 19 0 2 0 627272775 660135936 6895 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 514 18446604441729872128 0 0 -1 7 0 0 0
[pid=29269] ppid=29108 vsize=654920 CPUtime=0.48 cores=0-7
/proc/29269/stat : 29269 (python) S 29108 29108 28307 0 -1 4202560 1264 0 0 0 26 22 0 0 18 0 2 0 627270954 670638080 6833 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907317195 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29269/statm: 163730 6833 406 364 0 99558 0
[pid=29271] ppid=29269 vsize=268424 CPUtime=199.05 cores=0-7
/proc/29271/stat : 29271 (hybridGM3) T 29269 29271 29271 0 -1 4202496 5419 0 0 0 19905 0 0 0 25 0 1 0 627270955 274866176 5126 33554432000 134512640 135204385 4292385504 18446744073709551615 134538375 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29271/statm: 67106 5126 63 169 0 66936 0
[pid=29269/tid=29282] ppid=29108 vsize=654920 CPUtime=0 cores=0-7
/proc/29269/task/29282/stat : 29282 (python) S 29108 29108 28307 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 627291807 670638080 6833 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 514 18446604441729873024 0 0 -1 7 0 0 0
[pid=29274] ppid=29108 vsize=665176 CPUtime=0.44 cores=0-7
/proc/29274/stat : 29274 (python) S 29108 29108 28307 0 -1 4202560 1066 0 0 0 23 21 0 0 18 0 1 0 627272786 681140224 6858 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 13705315683204563202 0 0 17 6 0 0 0
/proc/29274/statm: 166294 6858 378 364 0 102119 0
[pid=29276] ppid=29274 vsize=458344 CPUtime=189.82 cores=0-7
/proc/29276/stat : 29276 (TNM) R 29274 29276 29276 0 -1 4202496 1528 0 0 0 18982 0 0 0 25 0 1 0 627272787 469344256 1238 33554432000 134512640 135008748 4289414128 18446744073709551615 134527526 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29276/statm: 114586 1238 46 122 0 113486 0
[pid=29283] ppid=29108 vsize=675432 CPUtime=0 cores=0-7
/proc/29283/stat : 29283 (python) S 29108 29108 28307 0 -1 4202560 912 0 0 0 0 0 0 0 19 0 1 0 627291818 691642368 6914 33554432000 4194304 5683644 140735235151904 18446744073709551615 231895510598 0 0 16781312 514 3577675326269947903 0 0 17 6 0 0 0
/proc/29283/statm: 168858 6914 345 364 0 104680 0
[pid=29285] ppid=29283 vsize=335996 CPUtime=0.25 cores=0-7
/proc/29285/stat : 29285 (iPAWS) R 29283 29285 29285 0 -1 4202496 1824 0 0 0 25 0 0 0 21 0 1 0 627291819 344059904 1534 33554432000 134512640 135114423 4292421152 18446744073709551615 134519574 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29285/statm: 83999 1534 59 147 0 83851 0
[pid=29108/tid=29115] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29115/stat : 29115 (python) S 29106 29108 28307 0 -1 4202560 26 935 0 0 0 0 0 0 21 0 34 0 627153123 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 4 0 0 0
[pid=29108/tid=29118] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29118/stat : 29118 (python) S 29106 29108 28307 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 34 0 627153127 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 0 0 0 0
[pid=29108/tid=29121] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29121/stat : 29121 (python) S 29106 29108 28307 0 -1 4202560 45 935 0 0 0 0 0 0 18 0 34 0 627153131 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29124] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29124/stat : 29124 (python) S 29106 29108 28307 0 -1 4202560 32 935 0 0 0 0 0 0 18 0 34 0 627153135 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29127] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29127/stat : 29127 (python) S 29106 29108 28307 0 -1 4202560 33 935 0 0 0 0 0 0 18 0 34 0 627153139 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29130] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29130/stat : 29130 (python) S 29106 29108 28307 0 -1 4202560 27 935 0 0 0 0 0 0 22 0 34 0 627153142 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 4 0 0 0
[pid=29108/tid=29133] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29133/stat : 29133 (python) S 29106 29108 28307 0 -1 4202560 34 935 0 0 0 0 0 0 18 0 34 0 627153146 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29136] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29136/stat : 29136 (python) S 29106 29108 28307 0 -1 4202560 85 935 0 0 0 0 0 0 18 0 34 0 627153150 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29142] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29142/stat : 29142 (python) S 29106 29108 28307 0 -1 4202560 33 935 0 0 0 0 0 0 18 0 34 0 627162972 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 1 0 0 0
[pid=29108/tid=29146] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29146/stat : 29146 (python) S 29106 29108 28307 0 -1 4202560 118 935 0 0 0 0 0 0 18 0 34 0 627163052 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29152] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29152/stat : 29152 (python) S 29106 29108 28307 0 -1 4202560 48 935 0 0 0 0 0 0 18 0 34 0 627163155 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 5 0 0 0
[pid=29108/tid=29156] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29156/stat : 29156 (python) S 29106 29108 28307 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 34 0 627163160 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29159] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29159/stat : 29159 (python) S 29106 29108 28307 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 34 0 627163165 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29164] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29164/stat : 29164 (python) S 29106 29108 28307 0 -1 4202560 32 935 0 0 0 0 0 0 18 0 34 0 627163171 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29167] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29167/stat : 29167 (python) S 29106 29108 28307 0 -1 4202560 34 935 0 0 0 0 0 0 15 0 34 0 627163177 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29170] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29170/stat : 29170 (python) S 29106 29108 28307 0 -1 4202560 33 935 0 0 0 0 0 0 18 0 34 0 627163183 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29177] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29177/stat : 29177 (python) S 29106 29108 28307 0 -1 4202560 26 935 0 0 0 0 0 0 20 0 34 0 627173000 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29181] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29181/stat : 29181 (python) S 29106 29108 28307 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 34 0 627173080 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29194] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29194/stat : 29194 (python) S 29106 29108 28307 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 34 0 627183107 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 2 0 0 0
[pid=29108/tid=29199] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29199/stat : 29199 (python) S 29106 29108 28307 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 34 0 627192556 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 1 0 0 0
[pid=29108/tid=29205] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29205/stat : 29205 (python) S 29106 29108 28307 0 -1 4202560 42 935 0 0 0 0 0 0 18 0 34 0 627202462 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 1 0 0 0
[pid=29108/tid=29211] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29211/stat : 29211 (python) S 29106 29108 28307 0 -1 4202560 42 935 0 0 0 0 0 0 19 0 34 0 627212002 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29215] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29215/stat : 29215 (python) S 29106 29108 28307 0 -1 4202560 49 935 0 0 0 0 0 0 18 0 34 0 627212312 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29219] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29219/stat : 29219 (python) S 29106 29108 28307 0 -1 4202560 45 935 0 0 0 0 0 0 18 0 34 0 627212708 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29224] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29224/stat : 29224 (python) S 29106 29108 28307 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 34 0 627221768 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29228] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29228/stat : 29228 (python) S 29106 29108 28307 0 -1 4202560 24 935 0 0 0 0 0 0 19 0 34 0 627222034 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29248] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29248/stat : 29248 (python) S 29106 29108 28307 0 -1 4202560 29 935 0 0 0 0 0 0 20 0 34 0 627241798 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 1 0 0 0
[pid=29108/tid=29251] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29251/stat : 29251 (python) S 29106 29108 28307 0 -1 4202560 192 935 0 0 0 0 0 0 18 0 34 0 627242006 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 1 0 0 0
[pid=29108/tid=29258] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29258/stat : 29258 (python) S 29106 29108 28307 0 -1 4202560 35 935 0 0 0 0 0 0 19 0 34 0 627252439 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29265] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29265/stat : 29265 (python) S 29106 29108 28307 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 34 0 627262753 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 1 0 0 0
[pid=29108/tid=29270] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29270/stat : 29270 (python) S 29106 29108 28307 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 34 0 627270954 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 1 0 0 0
[pid=29108/tid=29275] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29275/stat : 29275 (python) S 29106 29108 28307 0 -1 4202560 38 935 0 0 0 0 0 0 20 0 34 0 627272787 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 6 0 0 0
[pid=29108/tid=29284] ppid=29106 vsize=685676 CPUtime=0 cores=0-7
/proc/29108/task/29284/stat : 29284 (python) S 29106 29108 28307 0 -1 4202560 42 935 0 0 0 0 0 0 20 0 34 0 627291818 702132224 8515 33554432000 4194304 5683644 140735235151904 18446744073709551615 231907314097 0 0 16781312 2 18446604453840868288 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11049.7
Current children cumulated vsize (KiB) 32414364

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29108 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=747974
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=225965
# CPU time returned by wait4() is 6.97394
# while last known CPU time is 11049.7
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1389.41
CPU time (s): 11049.7
CPU user time (s): 11037.5
CPU system time (s): 12.27
CPU usage (%): 795.284
Max. virtual memory (cumulated for all children) (KiB): 32414364

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.74797
system time used= 0.225965
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 66484
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1566
involuntary context switches= 78

runsolver used 14.5158 second user time and 32.982 second system time

The end

Launcher Data 

Begin job on node114 at 2011-05-02 22:47:02
IDJOB=3321900
IDBENCH=82678
IDSOLVER=1712
FILE ID=node114/3321900-1304369222
RUNJOBID= node114-1304366468-28321
PBS_JOBID= 13181756
Free space on /tmp= 73684 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S1859210562-077-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321900-1304369222/watcher-3321900-1304369222 -o /tmp/evaluation-result-3321900-1304369222/solver-3321900-1304369222 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321900-1304369222.cnf -seed 548430009 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3d96bca49fe954bb59442ef617e689bb
RANDOM SEED=548430009

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20789380 kB
Buffers:       1159512 kB
Cached:        2540348 kB
SwapCached:        168 kB
Active:        8383916 kB
Inactive:      3232104 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20789380 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           32948 kB
Writeback:           0 kB
AnonPages:     7915704 kB
Mapped:          24720 kB
Slab:           450052 kB
PageTables:      28156 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 32577420 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73652 MiB
End job on node114 at 2011-05-02 23:10:14