Trace number 3321764

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 9991.3 1436.71

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S942666749-061-UNKNOWN.cnf
MD5SUM456ae67a44e812130272597099547869
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.34/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.34/0.67	c INFO: solving HOME/instance-3321764-1304366736.cnf
0.34/0.67	c INFO: computing task features
0.51/0.84	c INFO: computed variable-clause graph statistics
0.51/0.85	c INFO: computed clause balance statistics
1.42/1.74	c INFO: computed variable balance statistics
1.72/2.10	c INFO: computed small-clause counts
1.72/2.10	c INFO: computed Horn-clause counts
1.83/2.13	c INFO: computed variable graph statistics
1.83/2.13	c INFO: collected features for HOME/instance-3321764-1304366736.cnf in 1.45 s
1.83/2.16	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.37)
1.83/2.20	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
1.92/2.24	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.08)
1.92/2.28	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
2.02/2.32	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.05)
2.02/2.36	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.04)
2.02/2.39	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.03)
2.12/2.44	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
701.71/102.44	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.02)
701.71/102.48	c INFO: running FH@0 for 97 with 39898 remaining (b = 0.02)
702.35/102.53	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
702.90/102.69	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
786.13/114.51	c INFO: running hybridGM3@0 for 194 with 39886 remaining (b = 0.03)
829.33/120.71	c INFO: running adaptg2wsat2009++@0 for 97 with 39880 remaining (b = 0.01)
955.00/138.76	c INFO: running hybridGM3@0 for 194 with 39861 remaining (b = 0.03)
1079.94/156.68	c INFO: running hybridGM3@0 for 194 with 39844 remaining (b = 0.02)
1401.48/202.71	c INFO: running TNM@0 for 1552 with 39798 remaining (b = 0.19)
1437.09/207.85	c INFO: running FH@0 for 97 with 39792 remaining (b = 0.01)
1570.84/227.06	c INFO: running adaptg2wsat2009++@0 for 97 with 39773 remaining (b = 0.01)
1612.68/233.01	c INFO: running adaptg2wsat2009++@0 for 97 with 39767 remaining (b = 0.01)
2178.05/314.16	c INFO: running adaptg2wsat2009++@99 for 97 with 39686 remaining (b = 0.01)
2277.03/328.36	c INFO: running hybridGM3@99 for 97 with 39672 remaining (b = 0.01)
2366.27/341.17	c INFO: running hybridGM3@102 for 97 with 39659 remaining (b = 0.01)
2374.60/342.30	c INFO: running hybridGM3@0 for 194 with 39658 remaining (b = 0.02)
2374.60/342.38	c INFO: running hybridGM3@0 for 194 with 39658 remaining (b = 0.02)
2478.47/357.25	c INFO: running hybridGM3@99 for 97 with 39643 remaining (b = 0.01)
2661.07/383.42	c INFO: running hybridGM3@100 for 97 with 39617 remaining (b = 0.01)
2974.76/428.50	c INFO: running TNM@0 for 1552 with 39572 remaining (b = 0.15)
3114.14/448.46	c INFO: running adaptg2wsat2009++@0 for 97 with 39552 remaining (b = 0.01)
3135.73/451.56	c INFO: running hybridGM3@294 for 97 with 39549 remaining (b = 0.01)
3151.10/453.70	c INFO: running hybridGM3@296 for 97 with 39547 remaining (b = 0.01)
3792.40/545.75	c INFO: running adaptg2wsat2009++@99 for 97 with 39454 remaining (b = 0.01)
3834.93/551.85	c INFO: running FH@0 for 291 with 39448 remaining (b = 0.03)
3863.52/555.97	c INFO: running gnovelty+2@0 for 97 with 39444 remaining (b = 0.01)
3869.77/556.84	c INFO: running hybridGM3@392 for 97 with 39443 remaining (b = 0.01)
3905.29/561.96	c INFO: running hybridGM3@99 for 97 with 39438 remaining (b = 0.01)
4401.54/633.15	c INFO: running hybridGM3@390 for 97 with 39367 remaining (b = 0.01)
4470.55/643.03	c INFO: running adaptg2wsat2009++@97 for 97 with 39357 remaining (b = 0.01)
4563.96/656.45	c INFO: running iPAWS@0 for 97 with 39344 remaining (b = 0.01)
4631.47/666.16	c INFO: running adaptg2wsat2009++@293 for 291 with 39334 remaining (b = 0.02)
4904.37/705.35	c INFO: running FH@100 for 291 with 39295 remaining (b = 0.02)
5106.95/734.44	c INFO: running hybridGM3@0 for 194 with 39266 remaining (b = 0.01)
5148.07/740.37	c INFO: running TNM@0 for 1552 with 39260 remaining (b = 0.12)
5764.72/828.95	c INFO: running iPAWS@0 for 97 with 39171 remaining (b = 0.01)
5977.70/859.59	c INFO: running FH@196 for 194 with 39141 remaining (b = 0.01)
6505.34/935.34	c INFO: running gnovelty+2@0 for 97 with 39065 remaining (b = 0.01)
6857.55/985.95	c INFO: running adaptg2wsat2009++@391 for 194 with 39014 remaining (b = 0.01)
6998.16/1006.14	c INFO: running hybridGM3@0 for 194 with 38994 remaining (b = 0.01)
7204.17/1035.71	c INFO: running FH@0 for 97 with 38965 remaining (b = 0.01)
7353.23/1057.12	c INFO: running FH@297 for 97 with 38943 remaining (b = 0.01)
7396.26/1063.34	c INFO: running hybridGM3@97 for 97 with 38937 remaining (b = 0.01)
7902.32/1136.04	c INFO: running hybridGM3@0 for 194 with 38864 remaining (b = 0.01)
8016.45/1152.43	c INFO: running NCVWr@0 for 485 with 38848 remaining (b = 0.03)
8059.50/1158.66	c INFO: running hybridGM3@0 for 194 with 38842 remaining (b = 0.01)
8231.88/1183.48	c INFO: running adaptg2wsat2009++@681 for 97 with 38817 remaining (b = 0.01)
8909.60/1280.97	c INFO: running hybridGM3@99 for 97 with 38719 remaining (b = 0.01)
8978.42/1290.83	c INFO: running adaptg2wsat2009++@879 for 97 with 38709 remaining (b = 0.01)
9352.40/1344.68	c INFO: running hybridGM3@94 for 97 with 38656 remaining (b = 0.01)
9640.87/1386.14	c INFO: running FH@195 for 194 with 38614 remaining (b = 0.01)
9761.11/1403.42	c INFO: running FH@196 for 194 with 38597 remaining (b = 0.01)
9990.49/1436.42	c INFO: running iPAWS@0 for 97 with 38564 remaining (b = 0.01)
9991.30/1436.69	c INFO: running hybridGM3@0 for 194 with 38564 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321764-1304366736/watcher-3321764-1304366736 -o /tmp/evaluation-result-3321764-1304366736/solver-3321764-1304366736 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321764-1304366736.cnf -seed 1719099220 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.66 4.80 2.50 2/265 28973
/proc/meminfo: memFree=22738408/32951124 swapFree=67111356/67111528
[pid=28973] ppid=28971 vsize=15380 CPUtime=0 cores=0-7
/proc/28973/stat : 28973 (python) S 28971 28973 28735 0 -1 4202496 819 0 0 0 0 0 0 0 25 0 1 0 548271340 15749120 703 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905729024 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/28973/statm: 3845 703 334 364 0 332 0

[startup+0.0984201 s]
/proc/loadavg: 8.66 4.80 2.50 2/265 28973
/proc/meminfo: memFree=22738408/32951124 swapFree=67111356/67111528
[pid=28973] ppid=28971 vsize=85616 CPUtime=0.06 cores=0-7
/proc/28973/stat : 28973 (python) R 28971 28973 28735 0 -1 4202496 2628 0 0 0 5 1 0 0 25 0 1 0 548271340 87670784 2347 33554432000 4194304 5683644 140736304177936 18446744073709551615 5009085 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/28973/statm: 21404 2347 713 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85616

[startup+0.100429 s]
/proc/loadavg: 8.66 4.80 2.50 2/265 28973
/proc/meminfo: memFree=22738408/32951124 swapFree=67111356/67111528
[pid=28973] ppid=28971 vsize=87700 CPUtime=0.06 cores=0-7
/proc/28973/stat : 28973 (python) S 28971 28973 28735 0 -1 4202496 2637 0 0 0 5 1 0 0 25 0 1 0 548271340 89804800 2353 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905729024 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/28973/statm: 21925 2353 717 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87700

[startup+0.30038 s]
/proc/loadavg: 8.66 4.80 2.50 2/265 28973
/proc/meminfo: memFree=22738408/32951124 swapFree=67111356/67111528
[pid=28973] ppid=28971 vsize=135744 CPUtime=0.18 cores=0-7
/proc/28973/stat : 28973 (python) R 28971 28973 28735 0 -1 4202496 5965 931 1 0 14 4 0 0 17 0 1 0 548271340 139001856 4150 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905726981 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/28973/statm: 33936 4150 1032 364 0 3122 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135744

[startup+0.700311 s]
/proc/loadavg: 8.66 4.80 2.50 2/265 28973
/proc/meminfo: memFree=22738408/32951124 swapFree=67111356/67111528
[pid=28973] ppid=28971 vsize=279800 CPUtime=0.42 cores=0-7
/proc/28973/stat : 28973 (python) R 28971 28973 28735 0 -1 4202496 9601 931 1 0 33 9 0 0 16 0 1 0 548271340 286515200 7282 33554432000 4194304 5683644 140736304177936 18446744073709551615 47427272850285 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/28973/statm: 69950 7283 1761 364 0 5874 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 279800

[startup+1.50017 s]
/proc/loadavg: 8.66 4.80 2.50 3/266 28978
/proc/meminfo: memFree=22709508/32951124 swapFree=67111356/67111528
[pid=28973] ppid=28971 vsize=285636 CPUtime=1.22 cores=0-7
/proc/28973/stat : 28973 (python) R 28971 28973 28735 0 -1 4202496 12499 931 1 0 112 10 0 0 17 0 1 0 548271340 292491264 8794 33554432000 4194304 5683644 140736304177936 18446744073709551615 4539725 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/28973/statm: 71409 8794 1826 364 0 7333 0
Current children cumulated CPU time (s) 1.22
Current children cumulated vsize (KiB) 285636

[startup+3.10085 s]
/proc/loadavg: 8.66 4.80 2.50 3/266 28978
/proc/meminfo: memFree=22709076/32951124 swapFree=67111356/67111528
[pid=28973] ppid=28971 vsize=427848 CPUtime=2.16 cores=0-7
/proc/28973/stat : 28973 (python) S 28971 28973 28735 0 -1 4202496 18711 931 1 0 204 12 0 0 22 0 9 0 548271340 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28973/statm: 106962 7673 1891 364 0 42859 0
Current children cumulated CPU time (s) 2.16
Current children cumulated vsize (KiB) 427848
heavy processes:

[startup+6.30127 s]
/proc/loadavg: 8.61 4.85 2.53 10/290 29002
/proc/meminfo: memFree=22651976/32951124 swapFree=67111356/67111528
[pid=28973] ppid=28971 vsize=427848 CPUtime=2.16 cores=0-7
/proc/28973/stat : 28973 (python) S 28971 28973 28735 0 -1 4202496 18711 931 1 0 204 12 0 0 22 0 9 0 548271340 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28973/statm: 106962 7673 1891 364 0 42859 0
[pid=28979] ppid=28973 vsize=280760 CPUtime=0 cores=0-7
/proc/28979/stat : 28979 (python) S 28973 28973 28735 0 -1 4202560 892 0 0 0 0 0 0 0 18 0 1 0 548271556 287498240 6001 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751055 0 0 16781312 514 4183593094593085697 0 0 17 6 0 0 0
/proc/28979/statm: 70190 6001 378 364 0 6108 0
[pid=28981] ppid=28979 vsize=1019708 CPUtime=4.1 cores=0-7
/proc/28981/stat : 28981 (gnovelty+2) R 28979 28981 28981 0 -1 4202496 950 0 0 0 410 0 0 0 25 0 1 0 548271557 1044180992 689 33554432000 134512640 135663704 4292664048 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/28981/statm: 254927 689 113 282 0 254643 0
[pid=28982] ppid=28973 vsize=291084 CPUtime=0 cores=0-7
/proc/28982/stat : 28982 (python) S 28973 28973 28735 0 -1 4202560 900 0 0 0 0 0 0 0 18 0 1 0 548271560 298070016 5999 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 18327886046408179969 0 0 17 6 0 0 0
/proc/28982/statm: 72771 5999 372 364 0 8686 0
[pid=28984] ppid=28982 vsize=1019708 CPUtime=4.04 cores=0-7
/proc/28984/stat : 28984 (gnovelty+2) R 28982 28984 28984 0 -1 4202496 949 0 0 0 404 0 0 0 25 0 1 0 548271560 1044180992 689 33554432000 134512640 135663704 4287712544 18446744073709551615 134525408 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/28984/statm: 254927 689 113 282 0 254643 0
[pid=28985] ppid=28973 vsize=301272 CPUtime=0 cores=0-7
/proc/28985/stat : 28985 (python) S 28973 28973 28735 0 -1 4202560 900 0 0 0 0 0 0 0 18 0 1 0 548271564 308502528 6020 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 4183589246302388484 0 0 17 4 0 0 0
/proc/28985/statm: 75318 6020 372 364 0 11230 0
[pid=28987] ppid=28985 vsize=420220 CPUtime=4.03 cores=0-7
/proc/28987/stat : 28987 (adaptg2wsat2009) R 28985 28987 28987 0 -1 4202496 1668 0 0 0 403 0 0 0 25 0 1 0 548271564 430305280 1400 33554432000 134512640 135107411 4292064640 18446744073709551615 134532288 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/28987/statm: 105055 1400 59 146 0 103931 0
[pid=28988] ppid=28973 vsize=311596 CPUtime=0 cores=0-7
/proc/28988/stat : 28988 (python) R 28973 28973 28735 0 -1 4202560 891 0 0 0 0 0 0 0 18 0 1 0 548271568 319074304 6018 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905774215 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/28988/statm: 77900 6018 366 364 0 13809 0
[pid=28990] ppid=28988 vsize=420220 CPUtime=4 cores=0-7
/proc/28990/stat : 28990 (adaptg2wsat2009) R 28988 28990 28990 0 -1 4202496 1664 0 0 0 400 0 0 0 25 0 1 0 548271568 430305280 1399 33554432000 134512640 135107411 4292810960 18446744073709551615 134531604 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/28990/statm: 105055 1399 59 146 0 103931 0
[pid=28991] ppid=28973 vsize=321920 CPUtime=0 cores=0-7
/proc/28991/stat : 28991 (python) S 28973 28973 28735 0 -1 4202560 754 0 0 0 0 0 0 0 18 0 1 0 548271572 329646080 6005 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 4341673179853324547 0 0 17 1 0 0 0
/proc/28991/statm: 80480 6005 349 364 0 16386 0
[pid=28993] ppid=28991 vsize=419820 CPUtime=2.05 cores=0-7
/proc/28993/stat : 28993 (adaptg2wsat2009) R 28991 28993 28993 0 -1 4202496 1438 0 0 0 205 0 0 0 25 0 1 0 548271572 429895680 1172 33554432000 134512640 135107411 4289273376 18446744073709551615 134523296 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28993/statm: 104955 1172 49 146 0 103831 0
[pid=28994] ppid=28973 vsize=397092 CPUtime=0 cores=0-7
/proc/28994/stat : 28994 (python) S 28973 28973 28735 0 -1 4202560 730 0 0 0 0 0 0 0 18 0 1 0 548271576 406622208 6180 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 1078758624974569732 0 0 17 1 0 0 0
/proc/28994/statm: 99273 6180 348 364 0 35176 0
[pid=28996] ppid=28994 vsize=1019708 CPUtime=3.9 cores=0-7
/proc/28996/stat : 28996 (gnovelty+2) R 28994 28996 28996 0 -1 4202496 943 0 0 0 390 0 0 0 25 0 1 0 548271577 1044180992 689 33554432000 134512640 135663704 4291022416 18446744073709551615 134525309 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/28996/statm: 254927 689 113 282 0 254643 0
[pid=28997] ppid=28973 vsize=407348 CPUtime=0 cores=0-7
/proc/28997/stat : 28997 (python) S 28973 28973 28735 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 548271580 417124352 6156 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 1078766321555964163 0 0 17 0 0 0 0
/proc/28997/statm: 101837 6156 348 364 0 37737 0
[pid=28999] ppid=28997 vsize=247956 CPUtime=3.85 cores=0-7
/proc/28999/stat : 28999 (FH) R 28997 28999 28999 0 -1 4202496 1242 0 0 0 385 0 0 0 25 0 1 0 548271582 253906944 986 33554432000 134512640 134936988 4287984112 18446744073709551615 134523640 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/28999/statm: 61989 986 37 104 0 61493 0
[pid=29000] ppid=28973 vsize=417604 CPUtime=0 cores=0-7
/proc/29000/stat : 29000 (python) S 28973 28973 28735 0 -1 4202560 770 0 0 0 0 0 0 0 18 0 1 0 548271584 427626496 6132 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 4631059967359549697 0 0 17 0 0 0 0
/proc/29000/statm: 104401 6132 354 364 0 40298 0
[pid=29002] ppid=29000 vsize=419820 CPUtime=1.91 cores=0-7
/proc/29002/stat : 29002 (adaptg2wsat2009) R 29000 29002 29002 0 -1 4202496 1435 0 0 0 191 0 0 0 25 0 1 0 548271584 429895680 1172 33554432000 134512640 135107411 4290684912 18446744073709551615 134523455 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29002/statm: 104955 1172 49 146 0 103831 0
[pid=28973/tid=28980] ppid=28971 vsize=427848 CPUtime=0 cores=0-7
/proc/28973/task/28980/stat : 28980 (python) S 28971 28973 28735 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 9 0 548271557 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=28983] ppid=28971 vsize=427848 CPUtime=0 cores=0-7
/proc/28973/task/28983/stat : 28983 (python) S 28971 28973 28735 0 -1 4202560 22 931 0 0 0 0 0 0 20 0 9 0 548271560 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=28986] ppid=28971 vsize=427848 CPUtime=0 cores=0-7
/proc/28973/task/28986/stat : 28986 (python) S 28971 28973 28735 0 -1 4202560 19 931 0 0 0 0 0 0 18 0 9 0 548271564 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 4 0 0 0
[pid=28973/tid=28989] ppid=28971 vsize=427848 CPUtime=0 cores=0-7
/proc/28973/task/28989/stat : 28989 (python) S 28971 28973 28735 0 -1 4202560 23 931 0 0 0 0 0 0 21 0 9 0 548271568 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=28992] ppid=28971 vsize=427848 CPUtime=0 cores=0-7
/proc/28973/task/28992/stat : 28992 (python) S 28971 28973 28735 0 -1 4202560 27 931 0 0 0 0 0 0 22 0 9 0 548271572 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 3 0 0 0
[pid=28973/tid=28995] ppid=28971 vsize=427848 CPUtime=0 cores=0-7
/proc/28973/task/28995/stat : 28995 (python) S 28971 28973 28735 0 -1 4202560 94 931 0 0 0 0 0 0 19 0 9 0 548271576 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 1 0 0 0
[pid=28973/tid=28998] ppid=28971 vsize=427848 CPUtime=0 cores=0-7
/proc/28973/task/28998/stat : 28998 (python) S 28971 28973 28735 0 -1 4202560 33 931 0 0 0 0 0 0 21 0 9 0 548271580 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29001] ppid=28971 vsize=427848 CPUtime=0 cores=0-7
/proc/28973/task/29001/stat : 29001 (python) S 28971 28973 28735 0 -1 4202560 86 931 0 0 0 0 0 0 24 0 9 0 548271584 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 30.04
Current children cumulated vsize (KiB) 8143684

[startup+12.7011 s]
/proc/loadavg: 8.64 4.92 2.56 10/290 29002
/proc/meminfo: memFree=22647156/32951124 swapFree=67111356/67111528
[pid=28973] ppid=28971 vsize=427848 CPUtime=2.16 cores=0-7
/proc/28973/stat : 28973 (python) S 28971 28973 28735 0 -1 4202496 18711 931 1 0 204 12 0 0 22 0 9 0 548271340 438116352 7673 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917557707 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/28973/statm: 106962 7673 1891 364 0 42859 0
[pid=28979] ppid=28973 vsize=280760 CPUtime=0.02 cores=0-7
/proc/28979/stat : 28979 (python) S 28973 28973 28735 0 -1 4202560 894 0 0 0 1 1 0 0 18 0 1 0 548271556 287498240 6001 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751055 0 0 16781312 514 8685086328267702529 0 0 17 6 0 0 0
/proc/28979/statm: 70190 6001 378 364 0 6108 0
[pid=28981] ppid=28979 vsize=1019708 CPUtime=10.47 cores=0-7
/proc/28981/stat : 28981 (gnovelty+2) R 28979 28981 28981 0 -1 4202496 950 0 0 0 1047 0 0 0 25 0 1 0 548271557 1044180992 689 33554432000 134512640 135663704 4292664048 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/28981/statm: 254927 689 113 282 0 254643 0
[pid=28982] ppid=28973 vsize=291084 CPUtime=0.02 cores=0-7
/proc/28982/stat : 28982 (python) S 28973 28973 28735 0 -1 4202560 907 0 0 0 1 1 0 0 18 0 1 0 548271560 298070016 5999 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 8685086328267702529 0 0 17 6 0 0 0
/proc/28982/statm: 72771 5999 372 364 0 8686 0
[pid=28984] ppid=28982 vsize=1019708 CPUtime=10.38 cores=0-7
/proc/28984/stat : 28984 (gnovelty+2) R 28982 28984 28984 0 -1 4202496 949 0 0 0 1038 0 0 0 25 0 1 0 548271560 1044180992 689 33554432000 134512640 135663704 4287712544 18446744073709551615 134525260 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/28984/statm: 254927 689 113 282 0 254643 0
[pid=28985] ppid=28973 vsize=301272 CPUtime=0.02 cores=0-7
/proc/28985/stat : 28985 (python) S 28973 28973 28735 0 -1 4202560 902 0 0 0 1 1 0 0 18 0 1 0 548271564 308502528 6020 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 8685086328267702532 0 0 17 4 0 0 0
/proc/28985/statm: 75318 6020 372 364 0 11230 0
[pid=28987] ppid=28985 vsize=420220 CPUtime=10.42 cores=0-7
/proc/28987/stat : 28987 (adaptg2wsat2009) R 28985 28987 28987 0 -1 4202496 1668 0 0 0 1042 0 0 0 25 0 1 0 548271564 430305280 1400 33554432000 134512640 135107411 4292064640 18446744073709551615 134532277 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/28987/statm: 105055 1400 59 146 0 103931 0
[pid=28988] ppid=28973 vsize=311596 CPUtime=0.02 cores=0-7
/proc/28988/stat : 28988 (python) S 28973 28973 28735 0 -1 4202560 912 0 0 0 1 1 0 0 18 0 1 0 548271568 319074304 6023 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 8685086328267702532 0 0 17 1 0 0 0
/proc/28988/statm: 77899 6023 371 364 0 13808 0
[pid=28990] ppid=28988 vsize=420220 CPUtime=10.39 cores=0-7
/proc/28990/stat : 28990 (adaptg2wsat2009) R 28988 28990 28990 0 -1 4202496 1664 0 0 0 1039 0 0 0 25 0 1 0 548271568 430305280 1399 33554432000 134512640 135107411 4292810960 18446744073709551615 134532135 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/28990/statm: 105055 1399 59 146 0 103931 0
[pid=28991] ppid=28973 vsize=321920 CPUtime=0.02 cores=0-7
/proc/28991/stat : 28991 (python) S 28973 28973 28735 0 -1 4202560 935 0 0 0 1 1 0 0 18 0 1 0 548271572 329646080 6028 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 8685086328267702531 0 0 17 1 0 0 0
/proc/28991/statm: 80480 6028 372 364 0 16386 0
[pid=28993] ppid=28991 vsize=420220 CPUtime=5.25 cores=0-7
/proc/28993/stat : 28993 (adaptg2wsat2009) R 28991 28993 28993 0 -1 4202496 1665 0 0 0 525 0 0 0 25 0 1 0 548271572 430305280 1399 33554432000 134512640 135107411 4289273376 18446744073709551615 134531781 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/28993/statm: 105055 1399 59 146 0 103931 0
[pid=28994] ppid=28973 vsize=397092 CPUtime=0.02 cores=0-7
/proc/28994/stat : 28994 (python) S 28973 28973 28735 0 -1 4202560 803 0 0 0 1 1 0 0 18 0 1 0 548271576 406622208 6203 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 8685086328267702532 0 0 17 1 0 0 0
/proc/28994/statm: 99273 6203 371 364 0 35176 0
[pid=28996] ppid=28994 vsize=1019708 CPUtime=10.24 cores=0-7
/proc/28996/stat : 28996 (gnovelty+2) R 28994 28996 28996 0 -1 4202496 943 0 0 0 1024 0 0 0 25 0 1 0 548271577 1044180992 689 33554432000 134512640 135663704 4291022416 18446744073709551615 134525309 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/28996/statm: 254927 689 113 282 0 254643 0
[pid=28997] ppid=28973 vsize=407348 CPUtime=0.02 cores=0-7
/proc/28997/stat : 28997 (python) S 28973 28973 28735 0 -1 4202560 818 0 0 0 1 1 0 0 18 0 1 0 548271580 417124352 6179 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 8685086328267702531 0 0 17 0 0 0 0

################
# More data... #
################

/proc/29075/statm: 140297 6494 407 364 0 76152 0
[pid=29077] ppid=29075 vsize=1019708 CPUtime=98.93 cores=0-7
/proc/29077/stat : 29077 (gnovelty+2) T 29075 29077 29077 0 -1 4202496 968 0 0 0 9891 2 0 0 25 0 1 0 548326938 1044180992 690 33554432000 134512640 135663704 4288026832 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29077/statm: 254927 690 113 282 0 254643 0
[pid=29075/tid=29081] ppid=28973 vsize=561188 CPUtime=0 cores=0-7
/proc/29075/task/29081/stat : 29081 (python) S 28973 28973 28735 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 548336977 574656512 6494 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 514 18446604450101932352 0 0 -1 0 0 0 0
[pid=29082] ppid=28973 vsize=571444 CPUtime=0.39 cores=0-7
/proc/29082/stat : 29082 (python) S 28973 28973 28735 0 -1 4202560 1184 0 0 0 20 19 0 0 19 0 2 0 548336985 585158656 6489 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29082/statm: 142861 6489 407 364 0 78713 0
[pid=29084] ppid=29082 vsize=335996 CPUtime=99.65 cores=0-7
/proc/29084/stat : 29084 (iPAWS) T 29082 29084 29084 0 -1 4202496 1819 0 0 0 9965 0 0 0 25 0 1 0 548336989 344059904 1539 33554432000 134512640 135114423 4288798784 18446744073709551615 134515629 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/29084/statm: 83999 1539 59 147 0 83851 0
[pid=29082/tid=29096] ppid=28973 vsize=571444 CPUtime=0 cores=0-7
/proc/29082/task/29096/stat : 29096 (python) S 28973 28973 28735 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 548354225 585158656 6489 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 514 18446604452885016768 0 0 -1 0 0 0 0
[pid=29087] ppid=28973 vsize=581700 CPUtime=0.99 cores=0-7
/proc/29087/stat : 29087 (python) S 28973 28973 28735 0 -1 4202560 1204 0 0 0 53 46 0 0 18 0 2 0 548344784 595660800 6540 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29087/statm: 145425 6540 406 364 0 81274 0
[pid=29089] ppid=29087 vsize=268424 CPUtime=292.8 cores=0-7
/proc/29089/stat : 29089 (hybridGM3) T 29087 29089 29089 0 -1 4202496 5408 0 0 0 29280 0 0 0 25 0 1 0 548344785 274866176 5127 33554432000 134512640 135204385 4289516704 18446744073709551615 134537726 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29089/statm: 67106 5127 63 169 0 66936 0
[pid=29087/tid=29117] ppid=28973 vsize=581700 CPUtime=0 cores=0-7
/proc/29087/task/29117/stat : 29117 (python) S 28973 28973 28735 0 -1 4202560 89 0 0 0 0 0 0 0 18 0 2 0 548377664 595660800 6540 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 514 18446604446562372672 0 0 -1 6 0 0 0
[pid=29091] ppid=28973 vsize=591956 CPUtime=1.61 cores=0-7
/proc/29091/stat : 29091 (python) S 28973 28973 28735 0 -1 4202560 981 0 0 0 81 80 0 0 18 0 1 0 548345377 606162944 6558 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 8685086328267702531 0 0 17 2 0 0 0
/proc/29091/statm: 147989 6558 372 364 0 83835 0
[pid=29093] ppid=29091 vsize=458352 CPUtime=545.79 cores=0-7
/proc/29093/stat : 29093 (TNM) R 29091 29093 29093 0 -1 4202496 1523 0 0 0 54579 0 0 0 25 0 1 0 548345378 469352448 1240 33554432000 134512640 135008748 4293657936 18446744073709551615 134527771 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/29093/statm: 114588 1240 46 122 0 113488 0
[pid=29097] ppid=28973 vsize=602212 CPUtime=0.25 cores=0-7
/proc/29097/stat : 29097 (python) S 28973 28973 28735 0 -1 4202560 1182 0 0 0 14 11 0 0 19 0 2 0 548354235 616665088 6643 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29097/statm: 150553 6643 401 364 0 86396 0
[pid=29099] ppid=29097 vsize=335996 CPUtime=101.07 cores=0-7
/proc/29099/stat : 29099 (iPAWS) T 29097 29099 29099 0 -1 4202496 1819 0 0 0 10107 0 0 0 25 0 1 0 548354235 344059904 1536 33554432000 134512640 135114423 4288920144 18446744073709551615 134516061 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29099/statm: 83999 1536 59 147 0 83851 0
[pid=29097/tid=29103] ppid=28973 vsize=602212 CPUtime=0 cores=0-7
/proc/29097/task/29103/stat : 29103 (python) S 28973 28973 28735 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 548364865 616665088 6643 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 514 18446604453886760128 0 0 -1 0 0 0 0
[pid=29104] ppid=28973 vsize=612468 CPUtime=0.23 cores=0-7
/proc/29104/stat : 29104 (python) S 28973 28973 28735 0 -1 4202560 1193 0 0 0 11 12 0 0 19 0 2 0 548364874 627167232 6751 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/29104/statm: 153117 6751 400 364 0 88957 0
[pid=29106] ppid=29104 vsize=1019708 CPUtime=99.79 cores=0-7
/proc/29106/stat : 29106 (gnovelty+2) T 29104 29106 29106 0 -1 4202496 970 0 0 0 9979 0 0 0 25 0 1 0 548364875 1044180992 689 33554432000 134512640 135663704 4288340048 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/29106/statm: 254927 689 113 282 0 254643 0
[pid=29104/tid=29112] ppid=28973 vsize=612468 CPUtime=0 cores=0-7
/proc/29104/task/29112/stat : 29112 (python) S 28973 28973 28735 0 -1 4202560 83 0 0 0 0 0 0 0 19 0 2 0 548374901 627167232 6751 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 514 18446604453392963584 0 0 -1 6 0 0 0
[pid=29109] ppid=28973 vsize=622724 CPUtime=1.01 cores=0-7
/proc/29109/stat : 29109 (python) S 28973 28973 28735 0 -1 4202560 1211 0 0 0 51 50 0 0 18 0 2 0 548371954 637669376 6615 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29109/statm: 155681 6615 401 364 0 91518 0
[pid=29111] ppid=29109 vsize=268428 CPUtime=291.95 cores=0-7
/proc/29111/stat : 29111 (hybridGM3) T 29109 29111 29111 0 -1 4202496 5410 0 0 0 29195 0 0 0 25 0 1 0 548371954 274870272 5127 33554432000 134512640 135204385 4292892272 18446744073709551615 134538377 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/29111/statm: 67107 5127 63 169 0 66937 0
[pid=29109/tid=29134] ppid=28973 vsize=622724 CPUtime=0 cores=0-7
/proc/29109/task/29134/stat : 29134 (python) S 28973 28973 28735 0 -1 4202560 90 0 0 0 0 0 0 0 18 0 2 0 548399426 637669376 6615 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 514 18446604453906229248 0 0 -1 1 0 0 0
[pid=29113] ppid=28973 vsize=632980 CPUtime=0.31 cores=0-7
/proc/29113/stat : 29113 (python) S 28973 28973 28735 0 -1 4202560 1242 0 0 0 16 15 0 0 18 0 2 0 548374911 648171520 6706 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/29113/statm: 158245 6706 407 364 0 94079 0
[pid=29115] ppid=29113 vsize=249872 CPUtime=121.77 cores=0-7
/proc/29115/stat : 29115 (FH) R 29113 29115 29115 0 -1 4202496 1554 0 0 0 12177 0 0 0 25 0 1 0 548374912 255868928 1264 33554432000 134512640 134936988 4287579152 18446744073709551615 134544756 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29115/statm: 62468 1264 41 104 0 61972 0
[pid=29113/tid=29120] ppid=28973 vsize=632980 CPUtime=0 cores=0-7
/proc/29113/task/29120/stat : 29120 (python) S 28973 28973 28735 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 548384934 648171520 6706 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 514 18446604453913051520 0 0 -1 4 0 0 0
[pid=29121] ppid=28973 vsize=643236 CPUtime=0.7 cores=0-7
/proc/29121/stat : 29121 (python) S 28973 28973 28735 0 -1 4202560 1257 0 0 0 36 34 0 0 18 0 2 0 548384944 658673664 6663 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29121/statm: 160809 6663 407 364 0 96640 0
[pid=29123] ppid=29121 vsize=268424 CPUtime=287.92 cores=0-7
/proc/29123/stat : 29123 (hybridGM3) R 29121 29123 29123 0 -1 4202496 5418 0 0 0 28792 0 0 0 25 0 1 0 548384945 274866176 5127 33554432000 134512640 135204385 4294566448 18446744073709551615 134538257 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29123/statm: 67106 5127 63 169 0 66936 0
[pid=29121/tid=29137] ppid=28973 vsize=643236 CPUtime=0 cores=0-7
/proc/29121/task/29137/stat : 29137 (python) S 28973 28973 28735 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 548405797 658673664 6663 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 514 18446604453970395456 0 0 -1 6 0 0 0
[pid=29125] ppid=28973 vsize=653492 CPUtime=0.65 cores=0-7
/proc/29125/stat : 29125 (python) S 28973 28973 28735 0 -1 4202560 1058 0 0 0 35 30 0 0 18 0 1 0 548386583 669175808 6730 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 8685086328267702529 0 0 17 2 0 0 0
/proc/29125/statm: 163373 6730 379 364 0 99201 0
[pid=29127] ppid=29125 vsize=419780 CPUtime=283.4 cores=0-7
/proc/29127/stat : 29127 (NCVWr) R 29125 29127 29127 0 -1 4202496 1566 0 0 0 28340 0 0 0 25 0 1 0 548386584 429854720 1281 33554432000 134512640 135113558 4288661264 18446744073709551615 134533476 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29127/statm: 104945 1281 58 147 0 103820 0
[pid=29128] ppid=28973 vsize=663748 CPUtime=0.57 cores=0-7
/proc/29128/stat : 29128 (python) S 28973 28973 28735 0 -1 4202560 1269 0 0 0 28 29 0 0 19 0 2 0 548387206 679677952 6712 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917557707 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/29128/statm: 165937 6712 407 364 0 101762 0
[pid=29130] ppid=29128 vsize=268420 CPUtime=198.1 cores=0-7
/proc/29130/stat : 29130 (hybridGM3) T 29128 29130 29130 0 -1 4202496 5416 0 0 0 19810 0 0 0 25 0 1 0 548387206 274862080 5125 33554432000 134512640 135204385 4290891168 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/29130/statm: 67105 5125 63 169 0 66935 0
[pid=29128/tid=29139] ppid=28973 vsize=663748 CPUtime=0 cores=0-7
/proc/29128/task/29139/stat : 29139 (python) S 28973 28973 28735 0 -1 4202560 87 0 0 0 0 0 0 0 19 0 2 0 548411671 679677952 6712 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 514 18446604442849270848 0 0 -1 7 0 0 0
[pid=29141] ppid=28973 vsize=674004 CPUtime=0 cores=0-7
/proc/29141/stat : 29141 (python) S 28973 28973 28735 0 -1 4202560 921 0 0 0 0 0 0 0 19 0 1 0 548414982 690180096 6662 33554432000 4194304 5683644 140736304177936 18446744073709551615 218905751110 0 0 16781312 514 1171999410033262591 0 0 17 1 0 0 0
/proc/29141/statm: 168501 6662 346 364 0 104323 0
[pid=29143] ppid=29141 vsize=335996 CPUtime=0.07 cores=0-7
/proc/29143/stat : 29143 (iPAWS) R 29141 29143 29143 0 -1 4202496 1825 0 0 0 7 0 0 0 21 0 1 0 548414982 344059904 1533 33554432000 134512640 135114423 4291472624 18446744073709551615 134520304 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/29143/statm: 83999 1533 59 147 0 83851 0
[pid=28973/tid=28980] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/28980/stat : 28980 (python) S 28971 28973 28735 0 -1 4202560 26 931 0 0 0 0 0 0 20 0 34 0 548271557 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=28983] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/28983/stat : 28983 (python) S 28971 28973 28735 0 -1 4202560 22 931 0 0 0 0 0 0 20 0 34 0 548271560 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=28986] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/28986/stat : 28986 (python) S 28971 28973 28735 0 -1 4202560 25 931 0 0 0 0 0 0 18 0 34 0 548271564 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 4 0 0 0
[pid=28973/tid=28989] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/28989/stat : 28989 (python) S 28971 28973 28735 0 -1 4202560 29 931 0 0 0 0 0 0 18 0 34 0 548271568 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=28992] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/28992/stat : 28992 (python) S 28971 28973 28735 0 -1 4202560 33 931 0 0 0 0 0 0 18 0 34 0 548271572 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 3 0 0 0
[pid=28973/tid=28995] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/28995/stat : 28995 (python) S 28971 28973 28735 0 -1 4202560 94 931 0 0 0 0 0 0 19 0 34 0 548271576 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 1 0 0 0
[pid=28973/tid=28998] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/28998/stat : 28998 (python) S 28971 28973 28735 0 -1 4202560 49 931 0 0 0 0 0 0 18 0 34 0 548271580 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29001] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29001/stat : 29001 (python) S 28971 28973 28735 0 -1 4202560 108 931 0 0 0 0 0 0 18 0 34 0 548271584 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29009] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29009/stat : 29009 (python) S 28971 28973 28735 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 34 0 548281584 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 6 0 0 0
[pid=28973/tid=29013] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29013/stat : 29013 (python) S 28971 28973 28735 0 -1 4202560 45 931 0 0 0 0 0 0 18 0 34 0 548281589 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29016] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29016/stat : 29016 (python) S 28971 28973 28735 0 -1 4202560 50 931 0 0 0 0 0 0 18 0 34 0 548281594 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29020] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29020/stat : 29020 (python) S 28971 28973 28735 0 -1 4202560 33 931 0 0 0 0 0 0 25 0 34 0 548281609 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29024] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29024/stat : 29024 (python) S 28971 28973 28735 0 -1 4202560 41 931 0 0 0 0 0 0 18 0 34 0 548282791 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29028] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29028/stat : 29028 (python) S 28971 28973 28735 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 34 0 548283411 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29033] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29033/stat : 29033 (python) S 28971 28973 28735 0 -1 4202560 38 931 0 0 0 0 0 0 18 0 34 0 548285216 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 3 0 0 0
[pid=28973/tid=29037] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29037/stat : 29037 (python) S 28971 28973 28735 0 -1 4202560 46 931 0 0 0 0 0 0 18 0 34 0 548287008 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29042] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29042/stat : 29042 (python) S 28971 28973 28735 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 34 0 548291611 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29046] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29046/stat : 29046 (python) S 28971 28973 28735 0 -1 4202560 32 931 0 0 0 0 0 0 20 0 34 0 548292126 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29058] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29058/stat : 29058 (python) S 28971 28973 28735 0 -1 4202560 42 931 0 0 0 0 0 0 18 0 34 0 548305571 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 1 0 0 0
[pid=28973/tid=29061] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29061/stat : 29061 (python) S 28971 28973 28735 0 -1 4202560 33 931 0 0 0 0 0 0 22 0 34 0 548305579 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29068] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29068/stat : 29068 (python) S 28971 28973 28735 0 -1 4202560 41 931 0 0 0 0 0 0 20 0 34 0 548314190 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29076] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29076/stat : 29076 (python) S 28971 28973 28735 0 -1 4202560 41 931 0 0 0 0 0 0 19 0 34 0 548326937 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 0 0 0 0
[pid=28973/tid=29083] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29083/stat : 29083 (python) S 28971 28973 28735 0 -1 4202560 37 931 0 0 0 0 0 0 19 0 34 0 548336985 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=29088] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29088/stat : 29088 (python) S 28971 28973 28735 0 -1 4202560 41 931 0 0 0 0 0 0 18 0 34 0 548344785 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 3 0 0 0
[pid=28973/tid=29092] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29092/stat : 29092 (python) S 28971 28973 28735 0 -1 4202560 34 931 0 0 0 0 0 0 20 0 34 0 548345378 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=29098] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29098/stat : 29098 (python) S 28971 28973 28735 0 -1 4202560 33 931 0 0 0 0 0 0 19 0 34 0 548354235 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=29105] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29105/stat : 29105 (python) S 28971 28973 28735 0 -1 4202560 35 931 0 0 0 0 0 0 20 0 34 0 548364875 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=29110] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29110/stat : 29110 (python) S 28971 28973 28735 0 -1 4202560 41 931 0 0 0 0 0 0 18 0 34 0 548371954 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=29114] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29114/stat : 29114 (python) S 28971 28973 28735 0 -1 4202560 38 931 0 0 0 0 0 0 18 0 34 0 548374912 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=29122] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29122/stat : 29122 (python) S 28971 28973 28735 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 34 0 548384944 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=29126] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29126/stat : 29126 (python) S 28971 28973 28735 0 -1 4202560 33 931 0 0 0 0 0 0 20 0 34 0 548386583 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=29129] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29129/stat : 29129 (python) S 28971 28973 28735 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 34 0 548387206 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
[pid=28973/tid=29142] ppid=28971 vsize=684248 CPUtime=0 cores=0-7
/proc/28973/task/29142/stat : 29142 (python) S 28971 28973 28735 0 -1 4202560 36 931 0 0 0 0 0 0 19 0 34 0 548414982 700669952 8262 33554432000 4194304 5683644 140736304177936 18446744073709551615 218917554609 0 0 16781312 2 18446604453879800256 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 9991.3
Current children cumulated vsize (KiB) 32519180

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28973 and gives
#  childrusage.ru_utime.tv_sec=3704
#  childrusage.ru_utime.tv_usec=406844
#  childrusage.ru_stime.tv_sec=12
#  childrusage.ru_stime.tv_usec=505098
# CPU time returned by wait4() is 3716.91
# while last known CPU time is 9991.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1436.71
CPU time (s): 9991.3
CPU user time (s): 9978.65
CPU system time (s): 12.65
CPU usage (%): 695.43
Max. virtual memory (cumulated for all children) (KiB): 32519180

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3704.41
system time used= 12.5051
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 126472
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16155
involuntary context switches= 31124

runsolver used 14.9067 second user time and 34.8207 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-02 22:05:36
IDJOB=3321764
IDBENCH=82542
IDSOLVER=1712
FILE ID=node137/3321764-1304366736
RUNJOBID= node137-1304366465-28749
PBS_JOBID= 13181736
Free space on /tmp= 73636 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S942666749-061-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321764-1304366736/watcher-3321764-1304366736 -o /tmp/evaluation-result-3321764-1304366736/solver-3321764-1304366736 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321764-1304366736.cnf -seed 1719099220 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 456ae67a44e812130272597099547869
RANDOM SEED=1719099220

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22738448 kB
Buffers:        961336 kB
Cached:        2686944 kB
SwapCached:         48 kB
Active:        6614624 kB
Inactive:      3108860 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22738448 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           32640 kB
Writeback:           0 kB
AnonPages:     6075244 kB
Mapped:          23776 kB
Slab:           399248 kB
PageTables:      24928 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 38672256 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73604 MiB
End job on node137 at 2011-05-02 22:29:35