Trace number 3385402

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 11323.8 1605.02

General information on the benchmark

Namerandom/large/
unif-k7-r85-v250-c21250-S1274193329-021-UNKNOWN.cnf
MD5SUM3c4691c1028b5642345f341166405cb7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables250
Number of clauses21250
Sum of the clauses size148750
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521250

Solver Data 

0.36/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.36/0.67	c INFO: solving HOME/instance-3385402-1305566261.cnf
0.36/0.67	c INFO: computing task features
0.54/0.82	c INFO: computed variable-clause graph statistics
0.54/0.82	c INFO: computed clause balance statistics
1.25/1.55	c INFO: computed variable balance statistics
1.55/1.85	c INFO: computed small-clause counts
1.55/1.85	c INFO: computed Horn-clause counts
1.55/1.87	c INFO: computed variable graph statistics
1.55/1.87	c INFO: collected features for HOME/instance-3385402-1305566261.cnf in 1.20 s
1.65/1.90	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.36)
1.65/1.93	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
1.65/1.96	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.08)
1.65/1.99	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
1.75/2.02	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.05)
1.75/2.05	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.04)
1.75/2.09	c INFO: running FH@0 for 97 with 4998 remaining (b = 0.03)
2.48/2.12	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.03)
702.80/102.41	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.02)
703.46/102.51	c INFO: running FH@0 for 97 with 4898 remaining (b = 0.02)
786.65/114.46	c INFO: running hybridGM3@0 for 194 with 4886 remaining (b = 0.04)
828.37/120.42	c INFO: running gnovelty+2@0 for 97 with 4880 remaining (b = 0.02)
828.98/120.60	c INFO: running hybridGM3@0 for 194 with 4880 remaining (b = 0.03)
829.62/120.64	c INFO: running hybridGM3@0 for 194 with 4880 remaining (b = 0.03)
869.46/126.41	c INFO: running TNM@0 for 1552 with 4874 remaining (b = 0.20)
871.36/126.69	c INFO: running adaptg2wsat2009++@0 for 97 with 4874 remaining (b = 0.01)
1403.07/202.82	c INFO: running FH@0 for 97 with 4797 remaining (b = 0.01)
1528.42/220.85	c INFO: running hybridGM3@0 for 194 with 4779 remaining (b = 0.02)
1529.09/221.00	c INFO: running adaptg2wsat2009++@0 for 97 with 4779 remaining (b = 0.01)
1858.54/268.25	c INFO: running adaptg2wsat2009++@0 for 97 with 4732 remaining (b = 0.01)
2188.51/315.27	c INFO: running adaptg2wsat2009++@0 for 97 with 4685 remaining (b = 0.01)
2248.02/323.72	c INFO: running hybridGM3@101 for 97 with 4676 remaining (b = 0.01)
2387.60/342.50	c INFO: running adaptg2wsat2009++@100 for 97 with 4658 remaining (b = 0.01)
2424.63/347.51	c INFO: running hybridGM3@101 for 97 with 4653 remaining (b = 0.01)
2466.53/353.47	c INFO: running hybridGM3@99 for 97 with 4647 remaining (b = 0.01)
2593.45/371.68	c INFO: running hybridGM3@0 for 194 with 4629 remaining (b = 0.02)
2879.00/412.68	c INFO: running hybridGM3@0 for 194 with 4588 remaining (b = 0.02)
2927.54/419.15	c INFO: running TNM@0 for 1552 with 4581 remaining (b = 0.15)
3176.73/454.94	c INFO: running hybridGM3@295 for 97 with 4545 remaining (b = 0.01)
3210.99/459.87	c INFO: running gnovelty+2@0 for 97 with 4540 remaining (b = 0.01)
3217.86/460.90	c INFO: running hybridGM3@100 for 97 with 4539 remaining (b = 0.01)
3407.25/488.08	c INFO: running adaptg2wsat2009++@98 for 97 with 4512 remaining (b = 0.01)
3875.91/555.37	c INFO: running FH@0 for 291 with 4445 remaining (b = 0.03)
4079.64/584.47	c INFO: running iPAWS@0 for 97 with 4416 remaining (b = 0.01)
4087.87/585.54	c INFO: running hybridGM3@0 for 194 with 4415 remaining (b = 0.02)
4217.08/603.46	c INFO: running hybridGM3@193 for 97 with 4397 remaining (b = 0.01)
4267.26/610.67	c INFO: running hybridGM3@97 for 97 with 4390 remaining (b = 0.01)
4438.86/633.68	c INFO: running hybridGM3@94 for 97 with 4367 remaining (b = 0.01)
4862.84/690.91	c INFO: running adaptg2wsat2009++@297 for 291 with 4309 remaining (b = 0.02)
5094.17/724.12	c INFO: running hybridGM3@295 for 97 with 4276 remaining (b = 0.01)
5170.68/735.13	c INFO: running hybridGM3@191 for 97 with 4265 remaining (b = 0.01)
5253.42/747.02	c INFO: running hybridGM3@388 for 97 with 4253 remaining (b = 0.01)
5770.96/818.56	c INFO: running FH@101 for 291 with 4182 remaining (b = 0.02)
5937.91/842.57	c INFO: running iPAWS@0 for 97 with 4158 remaining (b = 0.01)
5989.97/849.60	c INFO: running hybridGM3@98 for 97 with 4151 remaining (b = 0.01)
5991.39/849.74	c INFO: running hybridGM3@389 for 97 with 4151 remaining (b = 0.01)
6066.05/860.47	c INFO: running TNM@0 for 1552 with 4140 remaining (b = 0.11)
6722.55/949.08	c INFO: running adaptg2wsat2009++@97 for 97 with 4051 remaining (b = 0.01)
6750.36/953.08	c INFO: running FH@0 for 97 with 4047 remaining (b = 0.01)
7024.29/992.44	c INFO: running hybridGM3@484 for 97 with 4008 remaining (b = 0.01)
7133.50/1008.17	c INFO: running adaptg2wsat2009++@396 for 194 with 3992 remaining (b = 0.02)
7400.55/1046.51	c INFO: running iPAWS@0 for 97 with 3954 remaining (b = 0.01)
7490.95/1059.54	c INFO: running hybridGM3@0 for 194 with 3941 remaining (b = 0.01)
7855.33/1111.94	c INFO: running NCVWr@0 for 485 with 3888 remaining (b = 0.03)
8042.47/1138.81	c INFO: running FH@200 for 194 with 3861 remaining (b = 0.01)
8140.55/1152.97	c INFO: running FH@98 for 291 with 3847 remaining (b = 0.02)
8636.77/1224.02	c INFO: running adaptg2wsat2009++@492 for 97 with 3776 remaining (b = 0.01)
9383.56/1331.47	c INFO: running gnovelty+2@0 for 97 with 3669 remaining (b = 0.01)
9406.49/1334.74	c INFO: running hybridGM3@100 for 97 with 3665 remaining (b = 0.01)
9670.61/1372.72	c INFO: running FH@300 for 97 with 3627 remaining (b = 0.01)
10253.51/1454.23	c INFO: running hybridGM3@295 for 194 with 3546 remaining (b = 0.01)
10266.63/1456.13	c INFO: running adaptg2wsat2009++@99 for 97 with 3544 remaining (b = 0.01)
10303.62/1461.17	c INFO: running FH@296 for 97 with 3539 remaining (b = 0.01)
10525.50/1492.21	c INFO: running hybridGM3@0 for 194 with 3508 remaining (b = 0.01)
11004.09/1559.58	c INFO: running adaptg2wsat2009++@388 for 194 with 3441 remaining (b = 0.01)
11322.89/1604.75	c INFO: running TNM@0 for 1552 with 3395 remaining (b = 0.08)
11323.82/1604.97	c INFO: running NCVWr@0 for 485 with 3395 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385402-1305566261/watcher-3385402-1305566261 -o /tmp/evaluation-result-3385402-1305566261/solver-3385402-1305566261 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385402-1305566261.cnf -seed 394335940 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.56 8.41 6.32 2/452 9276
/proc/meminfo: memFree=14539952/32951124 swapFree=67111348/67111528
[pid=9276] ppid=9274 vsize=15380 CPUtime=0 cores=0-7
/proc/9276/stat : 9276 (python) S 9274 9276 9036 0 -1 4202496 810 0 0 0 0 0 0 0 21 0 1 0 668223865 15749120 696 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687673344 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/9276/statm: 3845 696 334 364 0 332 0

[startup+0.059807 s]
/proc/loadavg: 8.56 8.41 6.32 2/452 9276
/proc/meminfo: memFree=14539952/32951124 swapFree=67111348/67111528
[pid=9276] ppid=9274 vsize=29784 CPUtime=0.03 cores=0-7
/proc/9276/stat : 9276 (python) S 9274 9276 9036 0 -1 4202496 1445 0 0 0 3 0 0 0 21 0 1 0 668223865 30498816 1287 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687673344 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/9276/statm: 7446 1287 443 364 0 816 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 29784

[startup+0.100807 s]
/proc/loadavg: 8.56 8.41 6.32 2/452 9276
/proc/meminfo: memFree=14539952/32951124 swapFree=67111348/67111528
[pid=9276] ppid=9274 vsize=89764 CPUtime=0.06 cores=0-7
/proc/9276/stat : 9276 (python) R 9274 9276 9036 0 -1 4202496 2639 0 0 0 5 1 0 0 17 0 1 0 668223865 91918336 2355 33554432000 4194304 5683644 140735754747632 18446744073709551615 212682753462 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/9276/statm: 22441 2355 718 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 89764

[startup+0.300758 s]
/proc/loadavg: 8.56 8.41 6.32 2/452 9276
/proc/meminfo: memFree=14539952/32951124 swapFree=67111348/67111528
[pid=9276] ppid=9274 vsize=135748 CPUtime=0.18 cores=0-7
/proc/9276/stat : 9276 (python) R 9274 9276 9036 0 -1 4202496 5960 933 1 0 13 5 0 0 17 0 1 0 668223865 139005952 4151 33554432000 4194304 5683644 140735754747632 18446744073709551615 4874244 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/9276/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700683 s]
/proc/loadavg: 8.56 8.41 6.32 2/452 9276
/proc/meminfo: memFree=14539952/32951124 swapFree=67111348/67111528
[pid=9276] ppid=9274 vsize=279508 CPUtime=0.44 cores=0-7
/proc/9276/stat : 9276 (python) R 9274 9276 9036 0 -1 4202496 9523 933 1 0 33 11 0 0 16 0 1 0 668223865 286216192 7208 33554432000 4194304 5683644 140735754747632 18446744073709551615 47465448661971 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/9276/statm: 69877 7208 1761 364 0 5801 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 279508

[startup+1.50054 s]
/proc/loadavg: 8.56 8.41 6.32 3/453 9281
/proc/meminfo: memFree=14512160/32951124 swapFree=67111348/67111528
[pid=9276] ppid=9274 vsize=283912 CPUtime=1.25 cores=0-7
/proc/9276/stat : 9276 (python) R 9274 9276 9036 0 -1 4202496 11839 933 1 0 113 12 0 0 17 0 1 0 668223865 290725888 8363 33554432000 4194304 5683644 140735754747632 18446744073709551615 47465277955680 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/9276/statm: 70978 8363 1826 364 0 6902 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 283912

[startup+3.10121 s]
/proc/loadavg: 8.11 8.32 6.31 12/473 9301
/proc/meminfo: memFree=14474916/32951124 swapFree=67111348/67111528
[pid=9276] ppid=9274 vsize=427664 CPUtime=1.87 cores=0-7
/proc/9276/stat : 9276 (python) S 9274 9276 9036 0 -1 4202496 17680 933 1 0 173 14 0 0 25 0 9 0 668223865 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/9276/statm: 106916 7749 1891 364 0 42813 0
[pid=9282] ppid=9276 vsize=279936 CPUtime=0 cores=0-7
/proc/9282/stat : 9282 (python) S 9276 9276 9036 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 668224056 286654464 5772 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695375 0 0 16781312 514 10882073017702121730 0 0 17 4 0 0 0
/proc/9282/statm: 69984 5772 355 364 0 5902 0
[pid=9284] ppid=9282 vsize=1018820 CPUtime=1.18 cores=0-7
/proc/9284/stat : 9284 (gnovelty+2) R 9282 9284 9284 0 -1 4202496 861 0 0 0 118 0 0 0 22 0 1 0 668224057 1043271680 595 33554432000 134512640 135663704 4287373920 18446744073709551615 134544212 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9284/statm: 254705 595 113 282 0 254421 0
[pid=9285] ppid=9276 vsize=290832 CPUtime=0 cores=0-7
/proc/9285/stat : 9285 (python) S 9276 9276 9036 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 668224059 297811968 5795 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 9053488973443203330 0 0 17 1 0 0 0
/proc/9285/statm: 72708 5795 349 364 0 8623 0
[pid=9287] ppid=9285 vsize=1018820 CPUtime=1.15 cores=0-7
/proc/9287/stat : 9287 (gnovelty+2) R 9285 9287 9287 0 -1 4202496 855 0 0 0 115 0 0 0 25 0 1 0 668224060 1043271680 595 33554432000 134512640 135663704 4286683728 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9287/statm: 254705 595 113 282 0 254421 0
[pid=9288] ppid=9276 vsize=300604 CPUtime=0 cores=0-7
/proc/9288/stat : 9288 (python) S 9276 9276 9036 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 668224062 307818496 5931 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 6730902326283862015 0 0 17 1 0 0 0
/proc/9288/statm: 75151 5931 347 364 0 11063 0
[pid=9290] ppid=9288 vsize=419160 CPUtime=1.12 cores=0-7
/proc/9290/stat : 9290 (adaptg2wsat2009) R 9288 9290 9290 0 -1 4202496 1253 0 0 0 112 0 0 0 25 0 1 0 668224062 429219840 991 33554432000 134512640 135107411 4291872032 18446744073709551615 134523455 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/9290/statm: 104790 991 49 146 0 103666 0
[pid=9291] ppid=9276 vsize=376396 CPUtime=0 cores=0-7
/proc/9291/stat : 9291 (python) S 9276 9276 9036 0 -1 4202560 717 0 0 0 0 0 0 0 18 0 1 0 668224065 385429504 6109 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 10882069169411457023 0 0 17 1 0 0 0
/proc/9291/statm: 94099 6109 348 364 0 30008 0
[pid=9293] ppid=9291 vsize=419160 CPUtime=0.67 cores=0-7
/proc/9293/stat : 9293 (adaptg2wsat2009) R 9291 9293 9293 0 -1 4202496 1241 0 0 0 67 0 0 0 22 0 1 0 668224066 429219840 990 33554432000 134512640 135107411 4294040736 18446744073709551615 134523300 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9293/statm: 104790 990 49 146 0 103666 0
[pid=9294] ppid=9276 vsize=386652 CPUtime=0 cores=0-7
/proc/9294/stat : 9294 (python) S 9276 9276 9036 0 -1 4202560 728 0 0 0 0 0 0 0 18 0 1 0 668224068 395931648 6069 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 634189515103141887 0 0 17 1 0 0 0
/proc/9294/statm: 96663 6069 348 364 0 32569 0
[pid=9296] ppid=9294 vsize=419160 CPUtime=1.04 cores=0-7
/proc/9296/stat : 9296 (adaptg2wsat2009) R 9294 9296 9296 0 -1 4202496 1248 0 0 0 104 0 0 0 25 0 1 0 668224068 429219840 991 33554432000 134512640 135107411 4292177616 18446744073709551615 134523331 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/9296/statm: 104790 991 49 146 0 103666 0
[pid=9297] ppid=9276 vsize=396908 CPUtime=0 cores=0-7
/proc/9297/stat : 9297 (python) S 9276 9276 9036 0 -1 4202560 730 0 0 0 0 0 0 0 21 0 1 0 668224071 406433792 6091 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 4606905071286878207 0 0 17 1 0 0 0
/proc/9297/statm: 99227 6091 348 364 0 35130 0
[pid=9299] ppid=9297 vsize=1018820 CPUtime=1.01 cores=0-7
/proc/9299/stat : 9299 (gnovelty+2) R 9297 9299 9299 0 -1 4202496 851 0 0 0 101 0 0 0 25 0 1 0 668224073 1043271680 595 33554432000 134512640 135663704 4290013616 18446744073709551615 134525278 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/9299/statm: 254705 595 113 282 0 254421 0
[pid=9300] ppid=9276 vsize=407164 CPUtime=0 cores=0-7
/proc/9300/stat : 9300 (python) S 9276 9276 9036 0 -1 4202560 721 0 0 0 0 0 0 0 21 0 1 0 668224074 416935936 6074 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 4390525306109165567 0 0 17 2 0 0 0
/proc/9300/statm: 101791 6074 344 364 0 37691 0
[pid=9276/tid=9283] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9283/stat : 9283 (python) S 9274 9276 9036 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 668224056 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 4 0 0 0
[pid=9276/tid=9286] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9286/stat : 9286 (python) S 9274 9276 9036 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 9 0 668224059 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9289] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9289/stat : 9289 (python) S 9274 9276 9036 0 -1 4202560 24 933 0 0 0 0 0 0 18 0 9 0 668224062 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 5 0 0 0
[pid=9276/tid=9292] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9292/stat : 9292 (python) S 9274 9276 9036 0 -1 4202560 86 933 0 0 0 0 0 0 19 0 9 0 668224065 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9295] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9295/stat : 9295 (python) S 9274 9276 9036 0 -1 4202560 35 933 0 0 0 0 0 0 20 0 9 0 668224068 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 7 0 0 0
[pid=9276/tid=9298] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9298/stat : 9298 (python) S 9274 9276 9036 0 -1 4202560 32 933 0 0 0 0 0 0 21 0 9 0 668224071 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 1 0 0 0
[pid=9276/tid=9301] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9301/stat : 9301 (python) S 9274 9276 9036 0 -1 4202560 34 933 0 0 0 0 0 0 23 0 9 0 668224075 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 8.04
Current children cumulated vsize (KiB) 7180096

[startup+6.30163 s]
/proc/loadavg: 8.11 8.32 6.31 10/477 9305
/proc/meminfo: memFree=14459880/32951124 swapFree=67111348/67111528
[pid=9276] ppid=9274 vsize=427664 CPUtime=1.87 cores=0-7
/proc/9276/stat : 9276 (python) S 9274 9276 9036 0 -1 4202496 17680 933 1 0 173 14 0 0 25 0 9 0 668223865 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699502027 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/9276/statm: 106916 7749 1891 364 0 42813 0
[pid=9282] ppid=9276 vsize=279936 CPUtime=0.01 cores=0-7
/proc/9282/stat : 9282 (python) S 9276 9276 9036 0 -1 4202560 893 0 0 0 1 0 0 0 18 0 1 0 668224056 286654464 5795 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695375 0 0 16781312 514 10882073017702121730 0 0 17 4 0 0 0
/proc/9282/statm: 69984 5795 378 364 0 5902 0
[pid=9284] ppid=9282 vsize=1018820 CPUtime=4.36 cores=0-7
/proc/9284/stat : 9284 (gnovelty+2) R 9282 9284 9284 0 -1 4202496 861 0 0 0 436 0 0 0 25 0 1 0 668224057 1043271680 595 33554432000 134512640 135663704 4287373920 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9284/statm: 254705 595 113 282 0 254421 0
[pid=9285] ppid=9276 vsize=290832 CPUtime=0.01 cores=0-7
/proc/9285/stat : 9285 (python) S 9276 9276 9036 0 -1 4202560 897 0 0 0 0 1 0 0 18 0 1 0 668224059 297811968 5818 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 9053488973443203330 0 0 17 1 0 0 0
/proc/9285/statm: 72708 5818 372 364 0 8623 0
[pid=9287] ppid=9285 vsize=1018820 CPUtime=4.35 cores=0-7
/proc/9287/stat : 9287 (gnovelty+2) R 9285 9287 9287 0 -1 4202496 855 0 0 0 435 0 0 0 25 0 1 0 668224060 1043271680 595 33554432000 134512640 135663704 4286683728 18446744073709551615 134545572 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/9287/statm: 254705 595 113 282 0 254421 0
[pid=9288] ppid=9276 vsize=300604 CPUtime=0.01 cores=0-7
/proc/9288/stat : 9288 (python) S 9276 9276 9036 0 -1 4202560 912 0 0 0 0 1 0 0 18 0 1 0 668224062 307818496 5953 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 6730902326283829506 0 0 17 1 0 0 0
/proc/9288/statm: 75151 5953 369 364 0 11063 0
[pid=9290] ppid=9288 vsize=419428 CPUtime=4.32 cores=0-7
/proc/9290/stat : 9290 (adaptg2wsat2009) R 9288 9290 9290 0 -1 4202496 1438 0 0 0 432 0 0 0 25 0 1 0 668224062 429494272 1176 33554432000 134512640 135107411 4291872032 18446744073709551615 134532224 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/9290/statm: 104857 1176 59 146 0 103733 0
[pid=9291] ppid=9276 vsize=376396 CPUtime=0.01 cores=0-7
/proc/9291/stat : 9291 (python) S 9276 9276 9036 0 -1 4202560 794 0 0 0 0 1 0 0 18 0 1 0 668224065 385429504 6132 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 10882069169411424516 0 0 17 1 0 0 0
/proc/9291/statm: 94099 6132 371 364 0 30008 0
[pid=9293] ppid=9291 vsize=419160 CPUtime=2.27 cores=0-7
/proc/9293/stat : 9293 (adaptg2wsat2009) R 9291 9293 9293 0 -1 4202496 1241 0 0 0 227 0 0 0 25 0 1 0 668224066 429219840 990 33554432000 134512640 135107411 4294040736 18446744073709551615 134523298 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9293/statm: 104790 990 49 146 0 103666 0
[pid=9294] ppid=9276 vsize=386652 CPUtime=0.02 cores=0-7
/proc/9294/stat : 9294 (python) S 9276 9276 9036 0 -1 4202560 804 0 0 0 1 1 0 0 18 0 1 0 668224068 395931648 6092 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 634189515103109380 0 0 17 1 0 0 0
/proc/9294/statm: 96663 6092 371 364 0 32569 0
[pid=9296] ppid=9294 vsize=419428 CPUtime=4.19 cores=0-7
/proc/9296/stat : 9296 (adaptg2wsat2009) R 9294 9296 9296 0 -1 4202496 1433 0 0 0 419 0 0 0 25 0 1 0 668224068 429494272 1176 33554432000 134512640 135107411 4292177616 18446744073709551615 134531935 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/9296/statm: 104857 1176 59 146 0 103733 0
[pid=9297] ppid=9276 vsize=396908 CPUtime=0.01 cores=0-7
/proc/9297/stat : 9297 (python) S 9276 9276 9036 0 -1 4202560 813 0 0 0 1 0 0 0 18 0 1 0 668224071 406433792 6114 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 4606905071286845698 0 0 17 1 0 0 0
/proc/9297/statm: 99227 6114 371 364 0 35130 0
[pid=9299] ppid=9297 vsize=1018820 CPUtime=4.1 cores=0-7
/proc/9299/stat : 9299 (gnovelty+2) R 9297 9299 9299 0 -1 4202496 851 0 0 0 410 0 0 0 25 0 1 0 668224073 1043271680 595 33554432000 134512640 135663704 4290013616 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/9299/statm: 254705 595 113 282 0 254421 0
[pid=9300] ppid=9276 vsize=407164 CPUtime=0.01 cores=0-7
/proc/9300/stat : 9300 (python) S 9276 9276 9036 0 -1 4202560 819 0 0 0 0 1 0 0 18 0 1 0 668224074 416935936 6100 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 4390525306109133059 0 0 17 2 0 0 0
/proc/9300/statm: 101791 6100 370 364 0 37691 0
[pid=9302] ppid=9300 vsize=247428 CPUtime=2.02 cores=0-7
/proc/9302/stat : 9302 (FH) R 9300 9302 9302 0 -1 4202496 1092 0 0 0 202 0 0 0 25 0 1 0 668224077 253366272 833 33554432000 134512640 134936988 4288054944 18446744073709551615 134523622 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9302/statm: 61857 833 37 104 0 61361 0
[pid=9303] ppid=9276 vsize=417420 CPUtime=0.01 cores=0-7
/proc/9303/stat : 9303 (python) S 9276 9276 9036 0 -1 4202560 863 0 0 0 0 1 0 0 18 0 1 0 668224078 427438080 6231 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 4272187893268578563 0 0 17 2 0 0 0
/proc/9303/statm: 104355 6231 377 364 0 40252 0
[pid=9305] ppid=9303 vsize=419428 CPUtime=4.12 cores=0-7
/proc/9305/stat : 9305 (adaptg2wsat2009) R 9303 9305 9305 0 -1 4202496 1442 0 0 0 412 0 0 0 25 0 1 0 668224078 429494272 1176 33554432000 134512640 135107411 4294286976 18446744073709551615 134532288 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9305/statm: 104857 1176 59 146 0 103733 0
[pid=9276/tid=9283] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9283/stat : 9283 (python) S 9274 9276 9036 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 9 0 668224056 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 4 0 0 0
[pid=9276/tid=9286] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9286/stat : 9286 (python) S 9274 9276 9036 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 9 0 668224059 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9289] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9289/stat : 9289 (python) S 9274 9276 9036 0 -1 4202560 24 933 0 0 0 0 0 0 18 0 9 0 668224062 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 5 0 0 0
[pid=9276/tid=9292] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9292/stat : 9292 (python) S 9274 9276 9036 0 -1 4202560 86 933 0 0 0 0 0 0 19 0 9 0 668224065 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9295] ppid=9274 vsize=427664 CPUtime=0 cores=0-7
/proc/9276/task/9295/stat : 9295 (python) S 9274 9276 9036 0 -1 4202560 35 933 0 0 0 0 0 0 20 0 9 0 668224068 437927936 7749 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 7 0 0 0
[pid=9276/tid=9298] ppid=9274 vsize=427664 CPUtime=0 cores=0-7

################
# More data... #
################

/proc/9376/statm: 254705 596 113 282 0 254421 0
[pid=9374/tid=9381] ppid=9276 vsize=561004 CPUtime=0 cores=0-7
/proc/9374/task/9381/stat : 9381 (python) S 9276 9276 9036 0 -1 4202560 83 0 0 0 0 0 0 0 19 0 2 0 668282308 574468096 6460 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 514 18446604440637462592 0 0 -1 1 0 0 0
[pid=9382] ppid=9276 vsize=571260 CPUtime=0.39 cores=0-7
/proc/9382/stat : 9382 (python) S 9276 9276 9036 0 -1 4202560 1180 0 0 0 18 21 0 0 18 0 2 0 668282313 584970240 6406 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/9382/statm: 142815 6406 406 364 0 78667 0
[pid=9384] ppid=9382 vsize=335996 CPUtime=97.51 cores=0-7
/proc/9384/stat : 9384 (iPAWS) T 9382 9384 9384 0 -1 4202496 1710 0 0 0 9751 0 0 0 25 0 1 0 668282313 344059904 1427 33554432000 134512640 135114423 4292679376 18446744073709551615 134517031 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/9384/statm: 83999 1427 59 147 0 83851 0
[pid=9382/tid=9392] ppid=9276 vsize=571260 CPUtime=0 cores=0-7
/proc/9382/task/9392/stat : 9392 (python) S 9276 9276 9036 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 668292952 584970240 6406 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 514 18446604450135869376 0 0 -1 3 0 0 0
[pid=9385] ppid=9276 vsize=581516 CPUtime=1.27 cores=0-7
/proc/9385/stat : 9385 (python) S 9276 9276 9036 0 -1 4202560 1202 0 0 0 65 62 0 0 18 0 2 0 668282420 595472384 6457 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/9385/statm: 145379 6457 406 364 0 81228 0
[pid=9387] ppid=9385 vsize=268428 CPUtime=295.2 cores=0-7
/proc/9387/stat : 9387 (hybridGM3) T 9385 9387 9387 0 -1 4202496 5293 0 0 0 29518 2 0 0 25 0 1 0 668282420 274870272 5010 33554432000 134512640 135204385 4290266992 18446744073709551615 134537792 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/9387/statm: 67107 5010 63 169 0 66937 0
[pid=9385/tid=9397] ppid=9276 vsize=581516 CPUtime=0 cores=0-7
/proc/9385/task/9397/stat : 9397 (python) S 9276 9276 9036 0 -1 4202560 83 0 0 0 0 0 0 0 18 0 2 0 668305717 595472384 6457 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 514 18446604441372448896 0 0 -1 1 0 0 0
[pid=9399] ppid=9276 vsize=591772 CPUtime=0.4 cores=0-7
/proc/9399/stat : 9399 (python) S 9276 9276 9036 0 -1 4202560 1179 0 0 0 20 20 0 0 19 0 2 0 668308123 605974528 6429 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/9399/statm: 147943 6429 400 364 0 83789 0
[pid=9401] ppid=9399 vsize=335996 CPUtime=102.93 cores=0-7
/proc/9401/stat : 9401 (iPAWS) T 9399 9401 9401 0 -1 4202496 1714 0 0 0 10293 0 0 0 25 0 1 0 668308124 344059904 1430 33554432000 134512640 135114423 4288690240 18446744073709551615 134516646 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/9401/statm: 83999 1430 59 147 0 83851 0
[pid=9399/tid=9407] ppid=9276 vsize=591772 CPUtime=0 cores=0-7
/proc/9399/task/9407/stat : 9407 (python) S 9276 9276 9036 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 668318769 605974528 6429 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 514 18446604441372447104 0 0 -1 1 0 0 0
[pid=9402] ppid=9276 vsize=602028 CPUtime=2.83 cores=0-7
/proc/9402/stat : 9402 (python) S 9276 9276 9036 0 -1 4202560 1000 0 0 0 141 142 0 0 18 0 1 0 668309913 616476672 6389 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 6628295896884805891 0 0 17 1 0 0 0
/proc/9402/statm: 150507 6389 372 364 0 86350 0
[pid=9404] ppid=9402 vsize=457668 CPUtime=687.36 cores=0-7
/proc/9404/stat : 9404 (TNM) R 9402 9404 9404 0 -1 4202496 1320 0 0 0 68736 0 0 0 25 0 1 0 668309913 468652032 1036 33554432000 134512640 135008748 4292963248 18446744073709551615 134527773 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/9404/statm: 114417 1036 46 122 0 113317 0
[pid=9408] ppid=9276 vsize=612284 CPUtime=0.41 cores=0-7
/proc/9408/stat : 9408 (python) S 9276 9276 9036 0 -1 4202560 1192 0 0 0 19 22 0 0 19 0 2 0 668319174 626978816 6425 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/9408/statm: 153071 6425 401 364 0 88911 0
[pid=9410] ppid=9408 vsize=249196 CPUtime=97.93 cores=0-7
/proc/9410/stat : 9410 (FH) T 9408 9410 9410 0 -1 4202496 1343 0 0 0 9793 0 0 0 25 0 1 0 668319174 255176704 1059 33554432000 134512640 134936988 4289669136 18446744073709551615 134553498 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/9410/statm: 62299 1059 41 104 0 61803 0
[pid=9408/tid=9417] ppid=9276 vsize=612284 CPUtime=0 cores=0-7
/proc/9408/task/9417/stat : 9417 (python) S 9276 9276 9036 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 668329814 626978816 6425 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 514 18446604445173454720 0 0 -1 0 0 0 0
[pid=9414] ppid=9276 vsize=622540 CPUtime=0.41 cores=0-7
/proc/9414/stat : 9414 (python) S 9276 9276 9036 0 -1 4202560 1203 0 0 0 20 21 0 0 19 0 2 0 668328517 637480960 6547 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/9414/statm: 155635 6547 401 364 0 91472 0
[pid=9416] ppid=9414 vsize=335996 CPUtime=99.93 cores=0-7
/proc/9416/stat : 9416 (iPAWS) T 9414 9416 9416 0 -1 4202496 1709 0 0 0 9993 0 0 0 25 0 1 0 668328518 344059904 1427 33554432000 134512640 135114423 4292633744 18446744073709551615 134517065 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/9416/statm: 83999 1427 59 147 0 83851 0
[pid=9414/tid=9427] ppid=9276 vsize=622540 CPUtime=0 cores=0-7
/proc/9414/task/9427/stat : 9427 (python) S 9276 9276 9036 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 668339157 637480960 6547 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 514 18446604445173452928 0 0 -1 1 0 0 0
[pid=9418] ppid=9276 vsize=632796 CPUtime=2.09 cores=0-7
/proc/9418/stat : 9418 (python) S 9276 9276 9036 0 -1 4202560 1247 0 0 0 103 106 0 0 18 0 2 0 668329820 647983104 6613 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/9418/statm: 158199 6613 407 364 0 94033 0
[pid=9420] ppid=9418 vsize=268420 CPUtime=431.51 cores=0-7
/proc/9420/stat : 9420 (hybridGM3) R 9418 9420 9420 0 -1 4202496 5307 0 0 0 43150 1 0 0 25 0 1 0 668329820 274862080 5009 33554432000 134512640 135204385 4290953776 18446744073709551615 134538395 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/9420/statm: 67105 5009 63 169 0 66935 0
[pid=9418/tid=9436] ppid=9276 vsize=632796 CPUtime=0 cores=0-7
/proc/9418/task/9436/stat : 9436 (python) S 9276 9276 9036 0 -1 4202560 89 0 0 0 0 0 0 0 18 0 2 0 668357334 647983104 6613 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 514 18446604445173453824 0 0 -1 1 0 0 0
[pid=9423] ppid=9276 vsize=643052 CPUtime=1.88 cores=0-7
/proc/9423/stat : 9423 (python) S 9276 9276 9036 0 -1 4202560 1048 0 0 0 95 93 0 0 18 0 1 0 668335060 658485248 6646 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 6628295896884805891 0 0 17 0 0 0 0
/proc/9423/statm: 160763 6646 379 364 0 96594 0
[pid=9425] ppid=9423 vsize=419076 CPUtime=452.49 cores=0-7
/proc/9425/stat : 9425 (NCVWr) R 9423 9425 9425 0 -1 4202496 1364 0 0 0 45247 2 0 0 25 0 1 0 668335060 429133824 1077 33554432000 134512640 135113558 4288960528 18446744073709551615 134531486 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/9425/statm: 104769 1077 58 147 0 103644 0
[pid=9433] ppid=9276 vsize=653308 CPUtime=0.48 cores=0-7
/proc/9433/stat : 9433 (python) S 9276 9276 9036 0 -1 4202560 1262 0 0 0 23 25 0 0 19 0 2 0 668357013 668987392 6603 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699502027 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/9433/statm: 163327 6603 407 364 0 99155 0
[pid=9435] ppid=9433 vsize=1018820 CPUtime=102.07 cores=0-7
/proc/9435/stat : 9435 (gnovelty+2) T 9433 9435 9435 0 -1 4202496 882 0 0 0 10207 0 0 0 25 0 1 0 668357013 1043271680 595 33554432000 134512640 135663704 4292353648 18446744073709551615 134525302 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/9435/statm: 254705 595 113 282 0 254421 0
[pid=9433/tid=9440] ppid=9276 vsize=653308 CPUtime=0 cores=0-7
/proc/9433/task/9440/stat : 9440 (python) S 9276 9276 9036 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 668369473 668987392 6603 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 514 18446604446430689216 0 0 -1 1 0 0 0
[pid=9442] ppid=9276 vsize=663564 CPUtime=0.43 cores=0-7
/proc/9442/stat : 9442 (python) S 9276 9276 9036 0 -1 4202560 1070 0 0 0 22 21 0 0 18 0 1 0 668373087 679489536 6584 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 6628295896884805889 0 0 17 7 0 0 0
/proc/9442/statm: 165891 6584 379 364 0 101716 0
[pid=9444] ppid=9442 vsize=268420 CPUtime=99.05 cores=0-7
/proc/9444/stat : 9444 (hybridGM3) R 9442 9444 9444 0 -1 4202496 5298 0 0 0 9904 1 0 0 25 0 1 0 668373088 274862080 5008 33554432000 134512640 135204385 4290272608 18446744073709551615 134538041 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/9444/statm: 67105 5008 63 169 0 66935 0
[pid=9448] ppid=9276 vsize=673820 CPUtime=0 cores=0-7
/proc/9448/stat : 9448 (python) S 9276 9276 9036 0 -1 4202560 938 0 0 0 0 0 0 0 19 0 1 0 668384341 689991680 6688 33554432000 4194304 5683644 140735754747632 18446744073709551615 212687695430 0 0 16781312 514 3602959420784377855 0 0 17 0 0 0 0
/proc/9448/statm: 168455 6688 352 364 0 104277 0
[pid=9450] ppid=9448 vsize=453560 CPUtime=0.04 cores=0-7
/proc/9450/stat : 9450 (TNM) R 9448 9450 9450 0 -1 4202496 1132 0 0 0 4 0 0 0 21 0 1 0 668384342 464445440 843 33554432000 134512640 135008748 4292755808 18446744073709551615 134523368 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/9450/statm: 113390 843 45 122 0 112290 0
[pid=9276/tid=9283] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9283/stat : 9283 (python) S 9274 9276 9036 0 -1 4202560 26 933 0 0 0 0 0 0 19 0 34 0 668224056 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 4 0 0 0
[pid=9276/tid=9286] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9286/stat : 9286 (python) S 9274 9276 9036 0 -1 4202560 23 933 0 0 0 0 0 0 20 0 34 0 668224059 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9289] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9289/stat : 9289 (python) S 9274 9276 9036 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 34 0 668224062 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 5 0 0 0
[pid=9276/tid=9292] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9292/stat : 9292 (python) S 9274 9276 9036 0 -1 4202560 91 933 0 0 0 0 0 0 18 0 34 0 668224065 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9295] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9295/stat : 9295 (python) S 9274 9276 9036 0 -1 4202560 51 933 0 0 0 0 0 0 18 0 34 0 668224068 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 5 0 0 0
[pid=9276/tid=9298] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9298/stat : 9298 (python) S 9274 9276 9036 0 -1 4202560 32 933 0 0 0 0 0 0 21 0 34 0 668224071 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 1 0 0 0
[pid=9276/tid=9301] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9301/stat : 9301 (python) S 9274 9276 9036 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 34 0 668224075 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9304] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9304/stat : 9304 (python) S 9274 9276 9036 0 -1 4202560 59 933 0 0 0 0 0 0 18 0 34 0 668224078 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9311] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9311/stat : 9311 (python) S 9274 9276 9036 0 -1 4202560 44 933 0 0 0 0 0 0 18 0 34 0 668234107 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 2 0 0 0
[pid=9276/tid=9315] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9315/stat : 9315 (python) S 9274 9276 9036 0 -1 4202560 52 933 0 0 0 0 0 0 18 0 34 0 668234117 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 3 0 0 0
[pid=9276/tid=9319] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9319/stat : 9319 (python) S 9274 9276 9036 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 34 0 668235312 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 2 0 0 0
[pid=9276/tid=9323] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9323/stat : 9323 (python) S 9274 9276 9036 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 34 0 668235908 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 2 0 0 0
[pid=9276/tid=9328] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9328/stat : 9328 (python) S 9274 9276 9036 0 -1 4202560 44 933 0 0 0 0 0 0 18 0 34 0 668235926 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9331] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9331/stat : 9331 (python) S 9274 9276 9036 0 -1 4202560 42 933 0 0 0 0 0 0 18 0 34 0 668235930 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9335] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9335/stat : 9335 (python) S 9274 9276 9036 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 34 0 668236507 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9339] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9339/stat : 9339 (python) S 9274 9276 9036 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 34 0 668236535 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9345] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9345/stat : 9345 (python) S 9274 9276 9036 0 -1 4202560 46 933 0 0 0 0 0 0 18 0 34 0 668244148 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9350] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9350/stat : 9350 (python) S 9274 9276 9036 0 -1 4202560 48 933 0 0 0 0 0 0 18 0 34 0 668245951 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9363] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9363/stat : 9363 (python) S 9274 9276 9036 0 -1 4202560 57 933 0 0 0 0 0 0 18 0 34 0 668261034 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9367] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9367/stat : 9367 (python) S 9274 9276 9036 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 34 0 668265134 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9370] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9370/stat : 9370 (python) S 9274 9276 9036 0 -1 4202560 34 933 0 0 0 0 0 0 19 0 34 0 668265780 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9375] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9375/stat : 9375 (python) S 9274 9276 9036 0 -1 4202560 37 933 0 0 0 0 0 0 20 0 34 0 668269853 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9383] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9383/stat : 9383 (python) S 9274 9276 9036 0 -1 4202560 39 933 0 0 0 0 0 0 19 0 34 0 668282313 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9386] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9386/stat : 9386 (python) S 9274 9276 9036 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 34 0 668282420 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 6 0 0 0
[pid=9276/tid=9400] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9400/stat : 9400 (python) S 9274 9276 9036 0 -1 4202560 41 933 0 0 0 0 0 0 19 0 34 0 668308123 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9403] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9403/stat : 9403 (python) S 9274 9276 9036 0 -1 4202560 37 933 0 0 0 0 0 0 19 0 34 0 668309913 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9409] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9409/stat : 9409 (python) S 9274 9276 9036 0 -1 4202560 34 933 0 0 0 0 0 0 19 0 34 0 668319174 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9415] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9415/stat : 9415 (python) S 9274 9276 9036 0 -1 4202560 35 933 0 0 0 0 0 0 19 0 34 0 668328517 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9419] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9419/stat : 9419 (python) S 9274 9276 9036 0 -1 4202560 38 933 0 0 0 0 0 0 18 0 34 0 668329820 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 3 0 0 0
[pid=9276/tid=9424] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9424/stat : 9424 (python) S 9274 9276 9036 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 34 0 668335060 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9434] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9434/stat : 9434 (python) S 9274 9276 9036 0 -1 4202560 34 933 0 0 0 0 0 0 19 0 34 0 668357013 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9443] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9443/stat : 9443 (python) S 9274 9276 9036 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 34 0 668373087 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 0 0 0 0
[pid=9276/tid=9449] ppid=9274 vsize=684064 CPUtime=0 cores=0-7
/proc/9276/task/9449/stat : 9449 (python) S 9274 9276 9036 0 -1 4202560 32 933 0 0 0 0 0 0 20 0 34 0 668384341 700481536 8282 33554432000 4194304 5683644 140735754747632 18446744073709551615 212699498929 0 0 16781312 2 18446604441594949888 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11323.8
Current children cumulated vsize (KiB) 32614612

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 9276 and gives
#  childrusage.ru_utime.tv_sec=2443
#  childrusage.ru_utime.tv_usec=911468
#  childrusage.ru_stime.tv_sec=19
#  childrusage.ru_stime.tv_usec=606019
# CPU time returned by wait4() is 2463.52
# while last known CPU time is 11323.8
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1605.02
CPU time (s): 11323.8
CPU user time (s): 11299.8
CPU system time (s): 24.05
CPU usage (%): 705.525
Max. virtual memory (cumulated for all children) (KiB): 32614612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2443.91
system time used= 19.606
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 106930
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16003
involuntary context switches= 17734

runsolver used 20.6869 second user time and 45.841 second system time

The end

Launcher Data 

Begin job on node139 at 2011-05-16 19:17:41
IDJOB=3385402
IDBENCH=82667
IDSOLVER=1870
FILE ID=node139/3385402-1305566261
RUNJOBID= node139-1305564961-9050
PBS_JOBID= 13350111
Free space on /tmp= 73300 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v250-c21250-S1274193329-021-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385402-1305566261/watcher-3385402-1305566261 -o /tmp/evaluation-result-3385402-1305566261/solver-3385402-1305566261 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385402-1305566261.cnf -seed 394335940 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3c4691c1028b5642345f341166405cb7
RANDOM SEED=394335940

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      14539984 kB
Buffers:        340684 kB
Cached:        3337232 kB
SwapCached:          0 kB
Active:       15865540 kB
Inactive:      2202336 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      14539984 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           32264 kB
Writeback:           0 kB
AnonPages:    14390356 kB
Mapped:          35388 kB
Slab:           208860 kB
PageTables:      62132 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 117146940 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73268 MiB
End job on node139 at 2011-05-16 19:44:28