Trace number 3321757

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 10203.8 1282.7

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1500-c30000-S715182559-083-UNKNOWN.cnf
MD5SUM1ae73e64babd5796adef68295bcaa14f
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark54.1288
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of clauses30000
Sum of the clauses size150000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530000
Number of clauses of size over 50

Solver Data 

0.34/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.34/0.67	c INFO: solving HOME/instance-3321757-1304366647.cnf
0.34/0.67	c INFO: computing task features
0.53/0.83	c INFO: computed variable-clause graph statistics
0.53/0.83	c INFO: computed clause balance statistics
1.23/1.59	c INFO: computed variable balance statistics
1.73/2.00	c INFO: computed small-clause counts
1.73/2.00	c INFO: computed Horn-clause counts
1.73/2.03	c INFO: computed variable graph statistics
1.73/2.03	c INFO: collected features for HOME/instance-3321757-1304366647.cnf in 1.36 s
1.73/2.07	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
1.85/2.11	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.14)
1.85/2.14	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.09)
1.85/2.18	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
2.05/2.22	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.06)
2.05/2.26	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.05)
2.05/2.30	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.04)
2.23/2.33	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
801.07/102.29	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.03)
801.84/102.34	c INFO: running FH@0 for 97 with 39898 remaining (b = 0.02)
801.84/102.39	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
802.31/102.44	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
802.70/102.51	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
802.70/102.57	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
802.81/102.63	c INFO: running TNM@0 for 1552 with 39898 remaining (b = 0.21)
802.81/102.69	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.02)
1600.96/202.54	c INFO: running FH@0 for 97 with 39798 remaining (b = 0.01)
1601.67/202.60	c INFO: running hybridGM3@0 for 194 with 39798 remaining (b = 0.02)
1602.26/202.72	c INFO: running adaptg2wsat2009++@0 for 97 with 39798 remaining (b = 0.01)
1603.47/202.93	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
2362.35/298.02	c INFO: running hybridGM3@99 for 97 with 39702 remaining (b = 0.01)
2369.47/298.95	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2377.41/299.95	c INFO: running adaptg2wsat2009++@0 for 97 with 39700 remaining (b = 0.01)
2379.01/300.16	c INFO: running adaptg2wsat2009++@100 for 97 with 39700 remaining (b = 0.01)
2399.70/302.77	c INFO: running gnovelty+2@0 for 97 with 39697 remaining (b = 0.01)
2416.41/304.86	c INFO: running hybridGM3@100 for 97 with 39695 remaining (b = 0.01)
3128.43/394.17	c INFO: running hybridGM3@0 for 194 with 39606 remaining (b = 0.02)
3152.40/397.18	c INFO: running hybridGM3@100 for 97 with 39603 remaining (b = 0.01)
3153.94/397.38	c INFO: running hybridGM3@0 for 194 with 39603 remaining (b = 0.02)
3161.14/398.27	c INFO: running hybridGM3@295 for 97 with 39602 remaining (b = 0.01)
3167.41/399.10	c INFO: running TNM@0 for 1552 with 39601 remaining (b = 0.14)
3199.26/403.10	c INFO: running adaptg2wsat2009++@100 for 97 with 39597 remaining (b = 0.01)
3200.06/403.19	c INFO: running FH@0 for 291 with 39597 remaining (b = 0.03)
3920.80/493.51	c INFO: running hybridGM3@389 for 97 with 39507 remaining (b = 0.01)
3959.86/498.44	c INFO: running iPAWS@0 for 97 with 39502 remaining (b = 0.01)
3975.00/500.34	c INFO: running adaptg2wsat2009++@100 for 97 with 39500 remaining (b = 0.01)
4694.87/590.66	c INFO: running FH@100 for 291 with 39410 remaining (b = 0.03)
4727.49/594.77	c INFO: running iPAWS@0 for 97 with 39405 remaining (b = 0.01)
4749.77/597.60	c INFO: running hybridGM3@0 for 194 with 39403 remaining (b = 0.02)
4751.24/597.75	c INFO: running adaptg2wsat2009++@296 for 291 with 39403 remaining (b = 0.02)
4768.03/599.90	c INFO: running hybridGM3@99 for 97 with 39400 remaining (b = 0.01)
5507.82/692.77	c INFO: running hybridGM3@0 for 194 with 39307 remaining (b = 0.01)
5526.96/695.15	c INFO: running hybridGM3@389 for 97 with 39305 remaining (b = 0.01)
5573.84/701.05	c INFO: running TNM@0 for 1552 with 39299 remaining (b = 0.12)
6333.61/796.42	c INFO: running NCVWr@0 for 485 with 39204 remaining (b = 0.04)
6362.96/800.13	c INFO: running gnovelty+2@0 for 97 with 39200 remaining (b = 0.01)
7000.73/880.25	c INFO: running hybridGM3@98 for 97 with 39120 remaining (b = 0.01)
7064.42/888.29	c INFO: running hybridGM3@94 for 97 with 39112 remaining (b = 0.01)
7089.10/891.34	c INFO: running adaptg2wsat2009++@492 for 97 with 39109 remaining (b = 0.01)
7153.61/899.46	c INFO: running FH@201 for 194 with 39101 remaining (b = 0.01)
7775.46/977.52	c INFO: running hybridGM3@293 for 194 with 39023 remaining (b = 0.02)
7847.13/986.60	c INFO: running FH@0 for 97 with 39014 remaining (b = 0.01)
7871.00/989.57	c INFO: running hybridGM3@388 for 97 with 39011 remaining (b = 0.01)
8629.82/1084.83	c INFO: running hybridGM3@483 for 97 with 38915 remaining (b = 0.01)
8638.58/1085.92	c INFO: running adaptg2wsat2009++@99 for 97 with 38914 remaining (b = 0.01)
8726.15/1096.92	c INFO: running FH@294 for 97 with 38903 remaining (b = 0.01)
9387.83/1180.10	c INFO: running FH@100 for 291 with 38820 remaining (b = 0.02)
9394.97/1180.97	c INFO: running hybridGM3@389 for 97 with 38819 remaining (b = 0.01)
9412.50/1183.20	c INFO: running adaptg2wsat2009++@297 for 291 with 38817 remaining (b = 0.02)
9484.16/1192.19	c INFO: running TNM@0 for 1552 with 38808 remaining (b = 0.09)
10201.32/1282.25	c INFO: running iPAWS@0 for 97 with 38718 remaining (b = 0.01)
10203.82/1282.65	c INFO: running iPAWS@0 for 97 with 38718 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321757-1304366647/watcher-3321757-1304366647 -o /tmp/evaluation-result-3321757-1304366647/solver-3321757-1304366647 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321757-1304366647.cnf -seed 2129846060 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.58 3.56 1.38 3/208 31482
/proc/meminfo: memFree=16629960/32950928 swapFree=67111524/67111528
[pid=31482] ppid=31480 vsize=15776 CPUtime=0 cores=0-7
/proc/31482/stat : 31482 (python) R 31480 31482 31414 0 -1 4202496 886 0 0 0 0 0 0 0 20 0 1 0 548264392 16154624 767 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473628357 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31482/statm: 3944 767 343 364 0 431 0

[startup+0.047553 s]
/proc/loadavg: 7.58 3.56 1.38 3/208 31482
/proc/meminfo: memFree=16629960/32950928 swapFree=67111524/67111528
[pid=31482] ppid=31480 vsize=18884 CPUtime=0.02 cores=0-7
/proc/31482/stat : 31482 (python) R 31480 31482 31414 0 -1 4202496 1289 0 0 0 2 0 0 0 20 0 1 0 548264392 19337216 1141 33554432000 4194304 5683644 140737257209760 18446744073709551615 4887645 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31482/statm: 4721 1141 421 364 0 690 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18884

[startup+0.100551 s]
/proc/loadavg: 7.58 3.56 1.38 3/208 31482
/proc/meminfo: memFree=16629960/32950928 swapFree=67111524/67111528
[pid=31482] ppid=31480 vsize=87704 CPUtime=0.06 cores=0-7
/proc/31482/stat : 31482 (python) R 31480 31482 31414 0 -1 4202496 2639 0 0 0 5 1 0 0 17 0 1 0 548264392 89808896 2354 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473965568 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31482/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87704

[startup+0.300547 s]
/proc/loadavg: 7.58 3.56 1.38 3/208 31482
/proc/meminfo: memFree=16629960/32950928 swapFree=67111524/67111528
[pid=31482] ppid=31480 vsize=135752 CPUtime=0.18 cores=0-7
/proc/31482/stat : 31482 (python) S 31480 31482 31414 0 -1 4202496 5968 932 1 0 14 4 0 0 18 0 1 0 548264392 139010048 4152 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473963525 0 2147483391 16781312 2 18446744071699215550 0 0 17 2 0 0 0
/proc/31482/statm: 33938 4152 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.700477 s]
/proc/loadavg: 7.58 3.56 1.38 3/208 31482
/proc/meminfo: memFree=16629960/32950928 swapFree=67111524/67111528
[pid=31482] ppid=31480 vsize=280492 CPUtime=0.42 cores=0-7
/proc/31482/stat : 31482 (python) R 31480 31482 31414 0 -1 4202496 9772 932 1 0 32 10 0 0 17 0 1 0 548264392 287223808 7451 33554432000 4194304 5683644 140737257209760 18446744073709551615 46963758054329 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31482/statm: 70123 7451 1761 364 0 6047 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 280492

[startup+1.50023 s]
/proc/loadavg: 7.05 3.52 1.37 2/208 31487
/proc/meminfo: memFree=16630768/32950928 swapFree=67111524/67111528
[pid=31482] ppid=31480 vsize=287580 CPUtime=1.23 cores=0-7
/proc/31482/stat : 31482 (python) R 31480 31482 31414 0 -1 4202496 12683 932 1 0 112 11 0 0 18 0 1 0 548264392 294481920 9280 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473628187 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/31482/statm: 71895 9280 1826 364 0 7819 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 287580

[startup+3.10095 s]
/proc/loadavg: 7.05 3.52 1.37 3/211 31490
/proc/meminfo: memFree=16630880/32950928 swapFree=67111524/67111528
[pid=31482] ppid=31480 vsize=430528 CPUtime=2.06 cores=0-7
/proc/31482/stat : 31482 (python) S 31480 31482 31414 0 -1 4202496 18694 932 1 0 194 12 0 0 25 0 9 0 548264392 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31482/statm: 107632 8384 1891 364 0 43529 0
[pid=31488] ppid=31482 vsize=283440 CPUtime=0 cores=0-7
/proc/31488/stat : 31488 (python) S 31482 31482 31414 0 -1 4202560 739 0 0 0 0 0 0 0 20 0 1 0 548264600 290242560 6648 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987599 0 0 16781312 514 4086834971837202431 0 0 17 1 0 0 0
/proc/31488/statm: 70860 6648 355 364 0 6778 0
[pid=31490] ppid=31488 vsize=1018996 CPUtime=1.01 cores=0-7
/proc/31490/stat : 31490 (gnovelty+2) R 31488 31490 31490 0 -1 4202496 964 0 0 0 101 0 0 0 25 0 1 0 548264600 1043451904 698 33554432000 134512640 135663704 4294291872 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31490/statm: 254749 698 113 282 0 254465 0
[pid=31482/tid=31489] ppid=31480 vsize=430528 CPUtime=0 cores=0-7
/proc/31482/task/31489/stat : 31489 (python) S 31480 31482 31414 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 9 0 548264600 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 1732964

[startup+6.30139 s]
/proc/loadavg: 7.05 3.52 1.37 9/232 31511
/proc/meminfo: memFree=16562384/32950928 swapFree=67111524/67111528
[pid=31482] ppid=31480 vsize=430528 CPUtime=2.06 cores=0-7
/proc/31482/stat : 31482 (python) S 31480 31482 31414 0 -1 4202496 18694 932 1 0 194 12 0 0 25 0 9 0 548264392 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31482/statm: 107632 8384 1891 364 0 43529 0
[pid=31488] ppid=31482 vsize=283440 CPUtime=0 cores=0-7
/proc/31488/stat : 31488 (python) S 31482 31482 31414 0 -1 4202560 903 0 0 0 0 0 0 0 18 0 1 0 548264600 290242560 6671 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987599 0 0 16781312 514 4086834971837169924 0 0 17 1 0 0 0
/proc/31488/statm: 70860 6671 378 364 0 6778 0
[pid=31490] ppid=31488 vsize=1018996 CPUtime=4.21 cores=0-7
/proc/31490/stat : 31490 (gnovelty+2) R 31488 31490 31490 0 -1 4202496 964 0 0 0 421 0 0 0 25 0 1 0 548264600 1043451904 698 33554432000 134512640 135663704 4294291872 18446744073709551615 134525111 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31490/statm: 254749 698 113 282 0 254465 0
[pid=31491] ppid=31482 vsize=293696 CPUtime=0 cores=0-7
/proc/31491/stat : 31491 (python) S 31482 31482 31414 0 -1 4202560 905 0 0 0 0 0 0 0 18 0 1 0 548264603 300744704 6669 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 4086823426965078276 0 0 17 1 0 0 0
/proc/31491/statm: 73424 6669 372 364 0 9339 0
[pid=31493] ppid=31491 vsize=1018996 CPUtime=4.18 cores=0-7
/proc/31493/stat : 31493 (gnovelty+2) R 31491 31493 31493 0 -1 4202496 959 0 0 0 418 0 0 0 25 0 1 0 548264603 1043451904 697 33554432000 134512640 135663704 4290825312 18446744073709551615 134544157 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/31493/statm: 254749 697 113 282 0 254465 0
[pid=31494] ppid=31482 vsize=369004 CPUtime=0 cores=0-7
/proc/31494/stat : 31494 (python) S 31482 31482 31414 0 -1 4202560 778 0 0 0 0 0 0 0 18 0 1 0 548264607 377860096 6843 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 4110286180468097284 0 0 17 1 0 0 0
/proc/31494/statm: 92251 6843 370 364 0 28163 0
[pid=31496] ppid=31494 vsize=421556 CPUtime=4.14 cores=0-7
/proc/31496/stat : 31496 (adaptg2wsat2009) R 31494 31496 31496 0 -1 4202496 2037 0 0 0 414 0 0 0 25 0 1 0 548264607 431673344 1781 33554432000 134512640 135107411 4287310736 18446744073709551615 134531935 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/31496/statm: 105389 1781 59 146 0 104265 0
[pid=31497] ppid=31482 vsize=379260 CPUtime=0 cores=0-7
/proc/31497/stat : 31497 (python) S 31482 31482 31414 0 -1 4202560 791 0 0 0 0 0 0 0 18 0 1 0 548264611 388362240 6801 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 3984912442965590276 0 0 17 1 0 0 0
/proc/31497/statm: 94815 6801 370 364 0 30724 0
[pid=31499] ppid=31497 vsize=421556 CPUtime=4.1 cores=0-7
/proc/31499/stat : 31499 (adaptg2wsat2009) R 31497 31499 31499 0 -1 4202496 2036 0 0 0 410 0 0 0 25 0 1 0 548264611 431673344 1782 33554432000 134512640 135107411 4288558656 18446744073709551615 134532364 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/31499/statm: 105389 1782 59 146 0 104265 0
[pid=31500] ppid=31482 vsize=389516 CPUtime=0 cores=0-7
/proc/31500/stat : 31500 (python) S 31482 31482 31414 0 -1 4202560 804 0 0 0 0 0 0 0 18 0 1 0 548264614 398864384 6926 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 4024815644082929924 0 0 17 1 0 0 0
/proc/31500/statm: 97379 6926 371 364 0 33285 0
[pid=31502] ppid=31500 vsize=421556 CPUtime=4.04 cores=0-7
/proc/31502/stat : 31502 (adaptg2wsat2009) R 31500 31502 31502 0 -1 4202496 2041 0 0 0 404 0 0 0 25 0 1 0 548264615 431673344 1782 33554432000 134512640 135107411 4287813600 18446744073709551615 134531848 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31502/statm: 105389 1782 59 146 0 104265 0
[pid=31503] ppid=31482 vsize=399772 CPUtime=0 cores=0-7
/proc/31503/stat : 31503 (python) S 31482 31482 31414 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 548264618 409366528 6907 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 6189753764295966980 0 0 17 2 0 0 0
/proc/31503/statm: 99943 6907 348 364 0 35846 0
[pid=31505] ppid=31503 vsize=1018996 CPUtime=4.03 cores=0-7
/proc/31505/stat : 31505 (gnovelty+2) R 31503 31505 31505 0 -1 4202496 956 0 0 0 403 0 0 0 25 0 1 0 548264619 1043451904 697 33554432000 134512640 135663704 4291941488 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/31505/statm: 254749 697 113 282 0 254465 0
[pid=31506] ppid=31482 vsize=410028 CPUtime=0 cores=0-7
/proc/31506/stat : 31506 (python) S 31482 31482 31414 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 548264622 419868672 6816 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 2900278032147120388 0 0 17 1 0 0 0
/proc/31506/statm: 102507 6816 348 364 0 38407 0
[pid=31508] ppid=31506 vsize=251296 CPUtime=3.92 cores=0-7
/proc/31508/stat : 31508 (FH) R 31506 31508 31508 0 -1 4202496 1945 0 0 0 392 0 0 0 25 0 1 0 548264624 257327104 1684 33554432000 134512640 134936988 4290299280 18446744073709551615 134547092 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/31508/statm: 62824 1684 41 104 0 62328 0
[pid=31509] ppid=31482 vsize=420284 CPUtime=0 cores=0-7
/proc/31509/stat : 31509 (python) S 31482 31482 31414 0 -1 4202560 784 0 0 0 0 0 0 0 18 0 1 0 548264626 430370816 6843 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 2900266487275028740 0 0 17 2 0 0 0
/proc/31509/statm: 105071 6843 354 364 0 40968 0
[pid=31511] ppid=31509 vsize=421556 CPUtime=3.94 cores=0-7
/proc/31511/stat : 31511 (adaptg2wsat2009) R 31509 31511 31511 0 -1 4202496 2046 0 0 0 394 0 0 0 25 0 1 0 548264626 431673344 1783 33554432000 134512640 135107411 4292063280 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/31511/statm: 105389 1783 59 146 0 104265 0
[pid=31482/tid=31489] ppid=31480 vsize=430528 CPUtime=0 cores=0-7
/proc/31482/task/31489/stat : 31489 (python) S 31480 31482 31414 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 9 0 548264600 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 6 0 0 0
[pid=31482/tid=31492] ppid=31480 vsize=430528 CPUtime=0 cores=0-7
/proc/31482/task/31492/stat : 31492 (python) S 31480 31482 31414 0 -1 4202560 23 932 0 0 0 0 0 0 21 0 9 0 548264603 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 3 0 0 0
[pid=31482/tid=31495] ppid=31480 vsize=430528 CPUtime=0 cores=0-7
/proc/31482/task/31495/stat : 31495 (python) S 31480 31482 31414 0 -1 4202560 89 932 0 0 0 0 0 0 22 0 9 0 548264607 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 0 0 0 0
[pid=31482/tid=31498] ppid=31480 vsize=430528 CPUtime=0 cores=0-7
/proc/31482/task/31498/stat : 31498 (python) S 31480 31482 31414 0 -1 4202560 32 932 0 0 0 0 0 0 23 0 9 0 548264611 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 5 0 0 0
[pid=31482/tid=31501] ppid=31480 vsize=430528 CPUtime=0 cores=0-7
/proc/31482/task/31501/stat : 31501 (python) S 31480 31482 31414 0 -1 4202560 35 932 0 0 0 0 0 0 24 0 9 0 548264614 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 0 0 0 0
[pid=31482/tid=31504] ppid=31480 vsize=430528 CPUtime=0 cores=0-7
/proc/31482/task/31504/stat : 31504 (python) S 31480 31482 31414 0 -1 4202560 31 932 0 0 0 0 0 0 25 0 9 0 548264618 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 0 0 0 0
[pid=31482/tid=31507] ppid=31480 vsize=430528 CPUtime=0 cores=0-7
/proc/31482/task/31507/stat : 31507 (python) S 31480 31482 31414 0 -1 4202560 32 932 0 0 0 0 0 0 25 0 9 0 548264622 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 2 0 0 0
[pid=31482/tid=31510] ppid=31480 vsize=430528 CPUtime=0 cores=0-7
/proc/31482/task/31510/stat : 31510 (python) S 31480 31482 31414 0 -1 4202560 85 932 0 0 0 0 0 0 25 0 9 0 548264626 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 34.62
Current children cumulated vsize (KiB) 8370036

[startup+12.7013 s]
/proc/loadavg: 7.20 3.66 1.44 9/232 31511
/proc/meminfo: memFree=16562052/32950928 swapFree=67111524/67111528
[pid=31482] ppid=31480 vsize=430528 CPUtime=2.06 cores=0-7
/proc/31482/stat : 31482 (python) S 31480 31482 31414 0 -1 4202496 18694 932 1 0 194 12 0 0 25 0 9 0 548264392 440860672 8384 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485794251 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/31482/statm: 107632 8384 1891 364 0 43529 0
[pid=31488] ppid=31482 vsize=283440 CPUtime=0 cores=0-7
/proc/31488/stat : 31488 (python) S 31482 31482 31414 0 -1 4202560 907 0 0 0 0 0 0 0 18 0 1 0 548264600 290242560 6671 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987599 0 0 16781312 514 10152556119348707588 0 0 17 1 0 0 0
/proc/31488/statm: 70860 6671 378 364 0 6778 0
[pid=31490] ppid=31488 vsize=1018996 CPUtime=10.61 cores=0-7
/proc/31490/stat : 31490 (gnovelty+2) R 31488 31490 31490 0 -1 4202496 964 0 0 0 1061 0 0 0 25 0 1 0 548264600 1043451904 698 33554432000 134512640 135663704 4294291872 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/31490/statm: 254749 698 113 282 0 254465 0
[pid=31491] ppid=31482 vsize=293696 CPUtime=0.01 cores=0-7
/proc/31491/stat : 31491 (python) S 31482 31482 31414 0 -1 4202560 908 0 0 0 0 1 0 0 18 0 1 0 548264603 300744704 6669 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 10152556119348707588 0 0 17 1 0 0 0
/proc/31491/statm: 73424 6669 372 364 0 9339 0
[pid=31493] ppid=31491 vsize=1018996 CPUtime=10.58 cores=0-7
/proc/31493/stat : 31493 (gnovelty+2) R 31491 31493 31493 0 -1 4202496 959 0 0 0 1058 0 0 0 25 0 1 0 548264603 1043451904 697 33554432000 134512640 135663704 4290825312 18446744073709551615 134543970 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/31493/statm: 254749 697 113 282 0 254465 0
[pid=31494] ppid=31482 vsize=369004 CPUtime=0 cores=0-7
/proc/31494/stat : 31494 (python) S 31482 31482 31414 0 -1 4202560 780 0 0 0 0 0 0 0 18 0 1 0 548264607 377860096 6844 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 10152556119348707588 0 0 17 1 0 0 0
/proc/31494/statm: 92251 6844 371 364 0 28163 0
[pid=31496] ppid=31494 vsize=421556 CPUtime=10.54 cores=0-7
/proc/31496/stat : 31496 (adaptg2wsat2009) R 31494 31496 31496 0 -1 4202496 2037 0 0 0 1054 0 0 0 25 0 1 0 548264607 431673344 1781 33554432000 134512640 135107411 4287310736 18446744073709551615 134531604 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/31496/statm: 105389 1781 59 146 0 104265 0
[pid=31497] ppid=31482 vsize=379260 CPUtime=0.01 cores=0-7
/proc/31497/stat : 31497 (python) S 31482 31482 31414 0 -1 4202560 793 0 0 0 1 0 0 0 18 0 1 0 548264611 388362240 6802 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 10152556119348707588 0 0 17 1 0 0 0
/proc/31497/statm: 94815 6802 371 364 0 30724 0
[pid=31499] ppid=31497 vsize=421556 CPUtime=10.5 cores=0-7
/proc/31499/stat : 31499 (adaptg2wsat2009) R 31497 31499 31499 0 -1 4202496 2036 0 0 0 1050 0 0 0 25 0 1 0 548264611 431673344 1782 33554432000 134512640 135107411 4288558656 18446744073709551615 134532376 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/31499/statm: 105389 1782 59 146 0 104265 0
[pid=31500] ppid=31482 vsize=389516 CPUtime=0.01 cores=0-7
/proc/31500/stat : 31500 (python) S 31482 31482 31414 0 -1 4202560 806 0 0 0 0 1 0 0 18 0 1 0 548264614 398864384 6926 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 10152556119348707588 0 0 17 1 0 0 0
/proc/31500/statm: 97379 6926 371 364 0 33285 0
[pid=31502] ppid=31500 vsize=421556 CPUtime=10.39 cores=0-7
/proc/31502/stat : 31502 (adaptg2wsat2009) R 31500 31502 31502 0 -1 4202496 2041 0 0 0 1039 0 0 0 25 0 1 0 548264615 431673344 1782 33554432000 134512640 135107411 4287813600 18446744073709551615 134532264 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31502/statm: 105389 1782 59 146 0 104265 0
[pid=31503] ppid=31482 vsize=399772 CPUtime=0.02 cores=0-7

################
# More data... #
################

/proc/31573/stat : 31573 (hybridGM3) T 31571 31573 31573 0 -1 4202496 5817 0 0 0 19594 1 0 0 25 0 1 0 548303810 274870272 5545 33554432000 134512640 135204385 4291299744 18446744073709551615 134538034 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/31573/statm: 67107 5545 63 169 0 66937 0
[pid=31571/tid=31590] ppid=31482 vsize=543356 CPUtime=0 cores=0-7
/proc/31571/task/31590/stat : 31590 (python) S 31482 31482 31414 0 -1 4202560 83 0 0 0 0 0 0 0 19 0 2 0 548323450 556396544 7157 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 514 18446604457931438784 0 0 -1 0 0 0 0
[pid=31575] ppid=31482 vsize=553612 CPUtime=0.73 cores=0-7
/proc/31575/stat : 31575 (python) S 31482 31482 31414 0 -1 4202560 1164 0 0 0 38 35 0 0 18 0 2 0 548304131 566898688 7244 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/31575/statm: 138403 7244 400 364 0 74261 0
[pid=31577] ppid=31575 vsize=268428 CPUtime=392.31 cores=0-7
/proc/31577/stat : 31577 (hybridGM3) T 31575 31577 31577 0 -1 4202496 5822 0 0 0 39231 0 0 0 25 0 1 0 548304131 274870272 5544 33554432000 134512640 135204385 4292208400 18446744073709551615 134538282 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/31577/statm: 67107 5544 63 169 0 66937 0
[pid=31575/tid=31599] ppid=31482 vsize=553612 CPUtime=0 cores=0-7
/proc/31575/task/31599/stat : 31599 (python) S 31482 31482 31414 0 -1 4202560 87 0 0 0 0 0 0 0 18 0 2 0 548324373 566898688 7244 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 514 18446604459033946176 0 0 -1 5 0 0 0
[pid=31578] ppid=31482 vsize=563868 CPUtime=1.61 cores=0-7
/proc/31578/stat : 31578 (python) S 31482 31482 31414 0 -1 4202560 991 0 0 0 98 63 0 0 18 0 1 0 548304302 577400832 7110 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 10152556119348707590 0 0 17 0 0 0 0
/proc/31578/statm: 140967 7110 378 364 0 76822 0
[pid=31580] ppid=31578 vsize=459772 CPUtime=881.43 cores=0-7
/proc/31580/stat : 31580 (TNM) R 31578 31580 31580 0 -1 4202496 1934 0 0 0 88140 3 0 0 25 0 1 0 548304303 470806528 1652 33554432000 134512640 135008748 4288260144 18446744073709551615 134527524 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/31580/statm: 114943 1652 46 122 0 113843 0
[pid=31585] ppid=31482 vsize=574124 CPUtime=0.18 cores=0-7
/proc/31585/stat : 31585 (python) S 31482 31482 31414 0 -1 4202560 1190 0 0 0 10 8 0 0 19 0 2 0 548314237 587902976 7161 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/31585/statm: 143531 7161 407 364 0 79383 0
[pid=31587] ppid=31585 vsize=335996 CPUtime=98.46 cores=0-7
/proc/31587/stat : 31587 (iPAWS) T 31585 31587 31587 0 -1 4202496 1830 0 0 0 9846 0 0 0 25 0 1 0 548314238 344059904 1547 33554432000 134512640 135114423 4288603312 18446744073709551615 134517054 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/31587/statm: 83999 1547 59 147 0 83851 0
[pid=31585/tid=31597] ppid=31482 vsize=574124 CPUtime=0 cores=0-7
/proc/31585/task/31597/stat : 31597 (python) S 31482 31482 31414 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 548324156 587902976 7161 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 514 18446604471164520512 0 0 -1 2 0 0 0
[pid=31591] ppid=31482 vsize=584380 CPUtime=0.19 cores=0-7
/proc/31591/stat : 31591 (python) S 31482 31482 31414 0 -1 4202560 1204 0 0 0 11 8 0 0 19 0 2 0 548323869 598405120 7156 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/31591/statm: 146095 7156 407 364 0 81944 0
[pid=31593] ppid=31591 vsize=335996 CPUtime=102.43 cores=0-7
/proc/31593/stat : 31593 (iPAWS) T 31591 31593 31593 0 -1 4202496 1827 0 0 0 10243 0 0 0 25 0 1 0 548323870 344059904 1547 33554432000 134512640 135114423 4287008944 18446744073709551615 134517031 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/31593/statm: 83999 1547 59 147 0 83851 0
[pid=31591/tid=31605] ppid=31482 vsize=584380 CPUtime=0 cores=0-7
/proc/31591/task/31605/stat : 31605 (python) S 31482 31482 31414 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 548334488 598405120 7156 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 514 18446604458873337024 0 0 -1 5 0 0 0
[pid=31594] ppid=31482 vsize=594636 CPUtime=1.12 cores=0-7
/proc/31594/stat : 31594 (python) S 31482 31482 31414 0 -1 4202560 1207 0 0 0 59 53 0 0 18 0 2 0 548324152 608907264 7218 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/31594/statm: 148659 7218 400 364 0 84505 0
[pid=31596] ppid=31594 vsize=268420 CPUtime=584.68 cores=0-7
/proc/31596/stat : 31596 (hybridGM3) T 31594 31596 31596 0 -1 4202496 5830 0 0 0 58467 1 0 0 25 0 1 0 548324153 274862080 5544 33554432000 134512640 135204385 4293825216 18446744073709551615 134538339 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/31596/statm: 67105 5544 63 169 0 66935 0
[pid=31594/tid=31615] ppid=31482 vsize=594636 CPUtime=0 cores=0-7
/proc/31594/task/31615/stat : 31615 (python) S 31482 31482 31414 0 -1 4202560 88 0 0 0 0 0 0 0 18 0 2 0 548344396 608907264 7218 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 514 18446604458873336128 0 0 -1 5 0 0 0
[pid=31602] ppid=31482 vsize=604892 CPUtime=0.9 cores=0-7
/proc/31602/stat : 31602 (python) S 31482 31482 31414 0 -1 4202560 1217 0 0 0 45 45 0 0 18 0 2 0 548333669 619409408 7183 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/31602/statm: 151223 7183 400 364 0 87066 0
[pid=31604] ppid=31602 vsize=268424 CPUtime=486.19 cores=0-7
/proc/31604/stat : 31604 (hybridGM3) T 31602 31604 31604 0 -1 4202496 5828 0 0 0 48619 0 0 0 25 0 1 0 548333670 274866176 5545 33554432000 134512640 135204385 4292838176 18446744073709551615 134538264 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/31604/statm: 67106 5545 63 169 0 66936 0
[pid=31602/tid=31621] ppid=31482 vsize=604892 CPUtime=0 cores=0-7
/proc/31602/task/31621/stat : 31621 (python) S 31482 31482 31414 0 -1 4202560 93 0 0 0 0 0 0 0 18 0 2 0 548353212 619409408 7183 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 514 18446604453558880384 0 0 -1 4 0 0 0
[pid=31606] ppid=31482 vsize=615148 CPUtime=1.06 cores=0-7
/proc/31606/stat : 31606 (python) S 31482 31482 31414 0 -1 4202560 1016 0 0 0 50 56 0 0 18 0 1 0 548334498 629911552 7164 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 10152556119348707587 0 0 17 2 0 0 0
/proc/31606/statm: 153787 7164 372 364 0 89627 0
[pid=31608] ppid=31606 vsize=459768 CPUtime=576.69 cores=0-7
/proc/31608/stat : 31608 (TNM) R 31606 31608 31608 0 -1 4202496 1934 0 0 0 57669 0 0 0 25 0 1 0 548334498 470802432 1653 33554432000 134512640 135008748 4288126944 18446744073709551615 134527693 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/31608/statm: 114942 1653 46 122 0 113842 0
[pid=31612] ppid=31482 vsize=625404 CPUtime=0.88 cores=0-7
/proc/31612/stat : 31612 (python) S 31482 31482 31414 0 -1 4202560 1022 0 0 0 44 44 0 0 18 0 1 0 548344034 640413696 7255 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 10152556119348707586 0 0 17 2 0 0 0
/proc/31612/statm: 156351 7255 373 364 0 92188 0
[pid=31614] ppid=31612 vsize=421364 CPUtime=484.93 cores=0-7
/proc/31614/stat : 31614 (NCVWr) R 31612 31614 31614 0 -1 4202496 1992 0 0 0 48493 0 0 0 25 0 1 0 548344035 431476736 1710 33554432000 134512640 135113558 4290155408 18446744073709551615 134531766 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/31614/statm: 105341 1710 58 147 0 104216 0
[pid=31616] ppid=31482 vsize=635660 CPUtime=0.18 cores=0-7
/proc/31616/stat : 31616 (python) S 31482 31482 31414 0 -1 4202560 1241 0 0 0 9 9 0 0 19 0 2 0 548344406 650915840 7222 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/31616/statm: 158915 7222 406 364 0 94749 0
[pid=31618] ppid=31616 vsize=1018996 CPUtime=98.46 cores=0-7
/proc/31618/stat : 31618 (gnovelty+2) T 31616 31618 31618 0 -1 4202496 984 0 0 0 9846 0 0 0 25 0 1 0 548344406 1043451904 697 33554432000 134512640 135663704 4292115792 18446744073709551615 134525286 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/31618/statm: 254749 697 113 282 0 254465 0
[pid=31616/tid=31623] ppid=31482 vsize=635660 CPUtime=0 cores=0-7
/proc/31616/task/31623/stat : 31623 (python) S 31482 31482 31414 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 548354328 650915840 7222 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 514 18446604453875218496 0 0 -1 2 0 0 0
[pid=31626] ppid=31482 vsize=645916 CPUtime=0.19 cores=0-7
/proc/31626/stat : 31626 (python) S 31482 31482 31414 0 -1 4202560 1268 0 0 0 11 8 0 0 19 0 2 0 548363053 661417984 7273 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485794251 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/31626/statm: 161479 7273 406 364 0 97310 0
[pid=31628] ppid=31626 vsize=251292 CPUtime=98.44 cores=0-7
/proc/31628/stat : 31628 (FH) T 31626 31628 31628 0 -1 4202496 1974 0 0 0 9844 0 0 0 25 0 1 0 548363054 257323008 1684 33554432000 134512640 134936988 4292964512 18446744073709551615 134554854 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/31628/statm: 62823 1684 41 104 0 62327 0
[pid=31626/tid=31631] ppid=31482 vsize=645916 CPUtime=0 cores=0-7
/proc/31626/task/31631/stat : 31631 (python) S 31482 31482 31414 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 548372974 661417984 7273 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 514 18446604453882629056 0 0 -1 6 0 0 0
[pid=31635] ppid=31482 vsize=656172 CPUtime=0.16 cores=0-7
/proc/31635/stat : 31635 (python) S 31482 31482 31414 0 -1 4202560 1064 0 0 0 8 8 0 0 18 0 1 0 548383611 671920128 7268 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 10152556119348707586 0 0 17 1 0 0 0
/proc/31635/statm: 164043 7268 378 364 0 99871 0
[pid=31637] ppid=31635 vsize=459772 CPUtime=89.81 cores=0-7
/proc/31637/stat : 31637 (TNM) R 31635 31637 31637 0 -1 4202496 1939 0 0 0 8981 0 0 0 25 0 1 0 548383612 470806528 1653 33554432000 134512640 135008748 4294412272 18446744073709551615 134527542 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/31637/statm: 114943 1653 46 122 0 113843 0
[pid=31641] ppid=31482 vsize=666428 CPUtime=0 cores=0-7
/proc/31641/stat : 31641 (python) S 31482 31482 31414 0 -1 4202560 938 0 0 0 0 0 0 0 19 0 1 0 548392617 682422272 7340 33554432000 4194304 5683644 140737257209760 18446744073709551615 274473987654 0 0 16781312 514 4604186528787202047 0 0 17 6 0 0 0
/proc/31641/statm: 166607 7340 352 364 0 102432 0
[pid=31643] ppid=31641 vsize=335996 CPUtime=0.26 cores=0-7
/proc/31643/stat : 31643 (iPAWS) R 31641 31643 31643 0 -1 4202496 1836 0 0 0 26 0 0 0 21 0 1 0 548392618 344059904 1546 33554432000 134512640 135114423 4289811360 18446744073709551615 134514774 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/31643/statm: 83999 1546 59 147 0 83851 0
[pid=31482/tid=31489] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31489/stat : 31489 (python) S 31480 31482 31414 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 33 0 548264600 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 6 0 0 0
[pid=31482/tid=31492] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31492/stat : 31492 (python) S 31480 31482 31414 0 -1 4202560 23 932 0 0 0 0 0 0 21 0 33 0 548264603 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 3 0 0 0
[pid=31482/tid=31495] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31495/stat : 31495 (python) S 31480 31482 31414 0 -1 4202560 97 932 0 0 0 0 0 0 18 0 33 0 548264607 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 0 0 0 0
[pid=31482/tid=31498] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31498/stat : 31498 (python) S 31480 31482 31414 0 -1 4202560 36 932 0 0 0 0 0 0 18 0 33 0 548264611 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 5 0 0 0
[pid=31482/tid=31501] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31501/stat : 31501 (python) S 31480 31482 31414 0 -1 4202560 40 932 0 0 0 0 0 0 18 0 33 0 548264614 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 0 0 0 0
[pid=31482/tid=31504] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31504/stat : 31504 (python) S 31480 31482 31414 0 -1 4202560 31 932 0 0 0 0 0 0 25 0 33 0 548264618 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 0 0 0 0
[pid=31482/tid=31507] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31507/stat : 31507 (python) S 31480 31482 31414 0 -1 4202560 37 932 0 0 0 0 0 0 18 0 33 0 548264622 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 2 0 0 0
[pid=31482/tid=31510] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31510/stat : 31510 (python) S 31480 31482 31414 0 -1 4202560 91 932 0 0 0 0 0 0 18 0 33 0 548264626 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 2 0 0 0
[pid=31482/tid=31517] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31517/stat : 31517 (python) S 31480 31482 31414 0 -1 4202560 41 932 0 0 0 0 0 0 18 0 33 0 548274622 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 3 0 0 0
[pid=31482/tid=31522] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31522/stat : 31522 (python) S 31480 31482 31414 0 -1 4202560 54 932 0 0 0 0 0 0 18 0 33 0 548274627 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 2 0 0 0
[pid=31482/tid=31526] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31526/stat : 31526 (python) S 31480 31482 31414 0 -1 4202560 40 932 0 0 0 0 0 0 18 0 33 0 548274632 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 1 0 0 0
[pid=31482/tid=31529] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31529/stat : 31529 (python) S 31480 31482 31414 0 -1 4202560 32 932 0 0 0 0 0 0 25 0 33 0 548274637 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 0 0 0 0
[pid=31482/tid=31535] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31535/stat : 31535 (python) S 31480 31482 31414 0 -1 4202560 40 932 0 0 0 0 0 0 18 0 33 0 548274644 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 1 0 0 0
[pid=31482/tid=31538] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31538/stat : 31538 (python) S 31480 31482 31414 0 -1 4202560 53 932 0 0 0 0 0 0 18 0 33 0 548274649 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 1 0 0 0
[pid=31482/tid=31541] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31541/stat : 31541 (python) S 31480 31482 31414 0 -1 4202560 31 932 0 0 0 0 0 0 25 0 33 0 548274656 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 5 0 0 0
[pid=31482/tid=31544] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31544/stat : 31544 (python) S 31480 31482 31414 0 -1 4202560 52 932 0 0 0 0 0 0 18 0 33 0 548274662 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 5 0 0 0
[pid=31482/tid=31552] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31552/stat : 31552 (python) S 31480 31482 31414 0 -1 4202560 38 932 0 0 0 0 0 0 18 0 33 0 548284646 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 5 0 0 0
[pid=31482/tid=31555] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31555/stat : 31555 (python) S 31480 31482 31414 0 -1 4202560 39 932 0 0 0 0 0 0 18 0 33 0 548284653 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 5 0 0 0
[pid=31482/tid=31566] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31566/stat : 31566 (python) S 31480 31482 31414 0 -1 4202560 39 932 0 0 0 0 0 0 20 0 33 0 548294670 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 0 0 0 0
[pid=31482/tid=31572] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31572/stat : 31572 (python) S 31480 31482 31414 0 -1 4202560 37 932 0 0 0 0 0 0 19 0 33 0 548303810 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 5 0 0 0
[pid=31482/tid=31576] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31576/stat : 31576 (python) S 31480 31482 31414 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 33 0 548304131 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 5 0 0 0
[pid=31482/tid=31579] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31579/stat : 31579 (python) S 31480 31482 31414 0 -1 4202560 36 932 0 0 0 0 0 0 19 0 33 0 548304303 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 5 0 0 0
[pid=31482/tid=31586] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31586/stat : 31586 (python) S 31480 31482 31414 0 -1 4202560 36 932 0 0 0 0 0 0 20 0 33 0 548314237 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 0 0 0 0
[pid=31482/tid=31592] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31592/stat : 31592 (python) S 31480 31482 31414 0 -1 4202560 38 932 0 0 0 0 0 0 20 0 33 0 548323870 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 0 0 0 0
[pid=31482/tid=31595] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31595/stat : 31595 (python) S 31480 31482 31414 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 33 0 548324153 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 5 0 0 0
[pid=31482/tid=31603] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31603/stat : 31603 (python) S 31480 31482 31414 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 33 0 548333669 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 1 0 0 0
[pid=31482/tid=31607] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31607/stat : 31607 (python) S 31480 31482 31414 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 33 0 548334498 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 2 0 0 0
[pid=31482/tid=31613] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31613/stat : 31613 (python) S 31480 31482 31414 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 33 0 548344034 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 2 0 0 0
[pid=31482/tid=31617] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31617/stat : 31617 (python) S 31480 31482 31414 0 -1 4202560 33 932 0 0 0 0 0 0 20 0 33 0 548344406 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 2 0 0 0
[pid=31482/tid=31627] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31627/stat : 31627 (python) S 31480 31482 31414 0 -1 4202560 36 932 0 0 0 0 0 0 20 0 33 0 548363053 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 1 0 0 0
[pid=31482/tid=31636] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31636/stat : 31636 (python) S 31480 31482 31414 0 -1 4202560 37 932 0 0 0 0 0 0 19 0 33 0 548383611 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 6 0 0 0
[pid=31482/tid=31642] ppid=31480 vsize=676672 CPUtime=0 cores=0-7
/proc/31482/task/31642/stat : 31642 (python) S 31480 31482 31414 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 33 0 548392617 692912128 8932 33554432000 4194304 5683644 140737257209760 18446744073709551615 274485791153 0 0 16781312 2 18446604437173987520 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 10203.8
Current children cumulated vsize (KiB) 31859852

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31482 and gives
#  childrusage.ru_utime.tv_sec=1491
#  childrusage.ru_utime.tv_usec=442266
#  childrusage.ru_stime.tv_sec=6
#  childrusage.ru_stime.tv_usec=827961
# CPU time returned by wait4() is 1498.27
# while last known CPU time is 10203.8
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1282.7
CPU time (s): 10203.8
CPU user time (s): 10194.9
CPU system time (s): 8.88
CPU usage (%): 795.498
Max. virtual memory (cumulated for all children) (KiB): 31859852

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1491.44
system time used= 6.82796
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 118884
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13373
involuntary context switches= 7672

runsolver used 11.3843 second user time and 27.7408 second system time

The end

Launcher Data 

Begin job on node125 at 2011-05-02 22:04:07
IDJOB=3321757
IDBENCH=82535
IDSOLVER=1712
FILE ID=node125/3321757-1304366647
RUNJOBID= node125-1304366466-31428
PBS_JOBID= 13181746
Free space on /tmp= 73104 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k5-r20-v1500-c30000-S715182559-083-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321757-1304366647/watcher-3321757-1304366647 -o /tmp/evaluation-result-3321757-1304366647/solver-3321757-1304366647 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321757-1304366647.cnf -seed 2129846060 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1ae73e64babd5796adef68295bcaa14f
RANDOM SEED=2129846060

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      16630612 kB
Buffers:       2147868 kB
Cached:        7533144 kB
SwapCached:          4 kB
Active:        9851116 kB
Inactive:      5922508 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      16630612 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           34132 kB
Writeback:           0 kB
AnonPages:     6091712 kB
Mapped:          24368 kB
Slab:           465012 kB
PageTables:      19504 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  6835548 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73072 MiB
End job on node125 at 2011-05-02 22:25:32