Trace number 3321745

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 7123.16 897.707

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1500-c30000-S877088425-001-UNKNOWN.cnf
MD5SUM419b5972e0565bacaabacb029af6176c
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark610.499
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of clauses30000
Sum of the clauses size150000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530000
Number of clauses of size over 50

Solver Data 

0.42/2.18	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.42/2.18	c INFO: solving HOME/instance-3321745-1304366595.cnf
0.42/2.18	c INFO: computing task features
0.56/2.34	c INFO: computed variable-clause graph statistics
0.56/2.34	c INFO: computed clause balance statistics
1.37/3.10	c INFO: computed variable balance statistics
1.77/3.51	c INFO: computed small-clause counts
1.77/3.51	c INFO: computed Horn-clause counts
1.77/3.54	c INFO: computed variable graph statistics
1.77/3.54	c INFO: collected features for HOME/instance-3321745-1304366595.cnf in 1.36 s
1.77/3.58	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
1.86/3.62	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.14)
1.86/3.65	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.09)
1.86/3.69	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
1.96/3.73	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.06)
1.96/3.77	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.05)
2.05/3.81	c INFO: running FH@0 for 97 with 39998 remaining (b = 0.04)
2.05/3.87	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.03)
801.53/103.87	c INFO: running adaptg2wsat2009++@0 for 97 with 39898 remaining (b = 0.03)
802.27/103.91	c INFO: running FH@0 for 97 with 39898 remaining (b = 0.02)
802.27/103.97	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.04)
802.76/104.04	c INFO: running gnovelty+2@0 for 97 with 39898 remaining (b = 0.02)
802.76/104.09	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
803.03/104.15	c INFO: running hybridGM3@0 for 194 with 39898 remaining (b = 0.03)
803.14/104.21	c INFO: running TNM@0 for 1552 with 39898 remaining (b = 0.21)
803.14/104.27	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.02)
1601.01/204.15	c INFO: running FH@0 for 97 with 39798 remaining (b = 0.01)
1602.48/204.36	c INFO: running hybridGM3@0 for 194 with 39797 remaining (b = 0.02)
1604.24/204.57	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
1633.66/208.25	c INFO: running adaptg2wsat2009++@0 for 97 with 39793 remaining (b = 0.01)
2361.35/299.54	c INFO: running hybridGM3@100 for 97 with 39702 remaining (b = 0.01)
2370.10/300.64	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2371.70/300.87	c INFO: running adaptg2wsat2009++@0 for 97 with 39701 remaining (b = 0.01)
2400.37/304.45	c INFO: running adaptg2wsat2009++@100 for 97 with 39697 remaining (b = 0.01)
2401.17/304.56	c INFO: running gnovelty+2@0 for 97 with 39697 remaining (b = 0.01)
2410.78/305.77	c INFO: running hybridGM3@100 for 97 with 39696 remaining (b = 0.01)
3147.30/398.17	c INFO: running hybridGM3@0 for 194 with 39604 remaining (b = 0.02)
3168.73/400.88	c INFO: running hybridGM3@295 for 97 with 39601 remaining (b = 0.01)
3169.48/400.97	c INFO: running hybridGM3@99 for 97 with 39601 remaining (b = 0.01)
3170.26/401.05	c INFO: running hybridGM3@0 for 194 with 39601 remaining (b = 0.02)
3175.80/401.76	c INFO: running TNM@0 for 1552 with 39600 remaining (b = 0.14)
3177.26/401.99	c INFO: running adaptg2wsat2009++@100 for 97 with 39600 remaining (b = 0.01)
3241.12/409.99	c INFO: running FH@0 for 291 with 39592 remaining (b = 0.03)
3928.19/496.17	c INFO: running iPAWS@0 for 97 with 39506 remaining (b = 0.01)
3952.79/499.30	c INFO: running adaptg2wsat2009++@99 for 97 with 39502 remaining (b = 0.01)
3976.69/502.30	c INFO: running hybridGM3@0 for 194 with 39499 remaining (b = 0.02)
4712.99/594.76	c INFO: running hybridGM3@100 for 97 with 39407 remaining (b = 0.01)
4726.53/596.49	c INFO: running FH@100 for 291 with 39405 remaining (b = 0.03)
4728.11/596.69	c INFO: running hybridGM3@0 for 194 with 39405 remaining (b = 0.02)
4728.84/596.78	c INFO: running iPAWS@0 for 97 with 39405 remaining (b = 0.01)
5472.29/690.10	c INFO: running hybridGM3@96 for 97 with 39312 remaining (b = 0.01)
5528.03/697.11	c INFO: running hybridGM3@0 for 194 with 39305 remaining (b = 0.01)
5535.17/698.03	c INFO: running TNM@0 for 1552 with 39304 remaining (b = 0.11)
5548.68/699.73	c INFO: running adaptg2wsat2009++@101 for 97 with 39302 remaining (b = 0.01)
6246.80/787.43	c INFO: running adaptg2wsat2009++@100 for 97 with 39214 remaining (b = 0.01)
6285.77/792.35	c INFO: running FH@0 for 97 with 39209 remaining (b = 0.01)
6323.18/797.09	c INFO: running gnovelty+2@0 for 97 with 39205 remaining (b = 0.01)
7021.21/884.78	c INFO: running hybridGM3@0 for 194 with 39117 remaining (b = 0.01)
7033.13/886.29	c INFO: running adaptg2wsat2009++@295 for 291 with 39115 remaining (b = 0.02)
7084.84/892.70	c INFO: running FH@197 for 194 with 39109 remaining (b = 0.01)
7085.65/892.83	c INFO: running iPAWS@0 for 97 with 39109 remaining (b = 0.01)
7122.21/897.49	c INFO: running hybridGM3@0 for 194 with 39104 remaining (b = 0.01)
7123.16/897.69	c INFO: running NCVWr@0 for 485 with 39104 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321745-1304366595/watcher-3321745-1304366595 -o /tmp/evaluation-result-3321745-1304366595/solver-3321745-1304366595 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321745-1304366595.cnf -seed 977768611 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.77 2.50 0.91 1/277 15218
/proc/meminfo: memFree=8675336/32951124 swapFree=61020456/67111528
[pid=15218] ppid=15216 vsize=15188 CPUtime=0 cores=0-7
/proc/15218/stat : 15218 (python) S 15216 15218 15120 0 -1 4202496 713 0 0 0 0 0 0 0 20 0 1 0 626890303 15552512 604 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284921780 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/15218/statm: 3797 604 319 364 0 284 0

[startup+0.023357 s]
/proc/loadavg: 6.77 2.50 0.91 1/277 15218
/proc/meminfo: memFree=8675336/32951124 swapFree=61020456/67111528
[pid=15218] ppid=15216 vsize=15764 CPUtime=0 cores=0-7
/proc/15218/stat : 15218 (python) S 15216 15218 15120 0 -1 4202496 846 0 0 0 0 0 0 0 20 0 1 0 626890303 16142336 728 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284921780 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/15218/statm: 3941 728 334 364 0 428 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15764

[startup+0.100349 s]
/proc/loadavg: 6.77 2.50 0.91 1/277 15218
/proc/meminfo: memFree=8675336/32951124 swapFree=61020456/67111528
[pid=15218] ppid=15216 vsize=16536 CPUtime=0.01 cores=0-7
/proc/15218/stat : 15218 (python) D 15216 15218 15120 0 -1 4202496 1191 0 1 0 1 0 0 0 20 0 1 0 626890303 16932864 1051 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284925696 0 0 16781312 2 18446744071562234166 0 0 17 2 0 0 1
/proc/15218/statm: 4134 1051 417 364 0 621 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16536

[startup+0.300378 s]
/proc/loadavg: 6.77 2.50 0.91 1/277 15218
/proc/meminfo: memFree=8675336/32951124 swapFree=61020456/67111528
[pid=15218] ppid=15216 vsize=36508 CPUtime=0.06 cores=0-7
/proc/15218/stat : 15218 (python) D 15216 15218 15120 0 -1 4202496 1613 0 6 0 4 2 0 0 18 0 1 0 626890303 37384192 1449 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284925696 0 0 16781312 2 18446744071562234166 0 0 17 2 0 0 13
/proc/15218/statm: 9127 1449 452 364 0 944 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 36508

[startup+0.700263 s]
/proc/loadavg: 6.77 2.50 0.91 1/277 15218
/proc/meminfo: memFree=8675336/32951124 swapFree=61020456/67111528
[pid=15218] ppid=15216 vsize=111020 CPUtime=0.1 cores=0-7
/proc/15218/stat : 15218 (python) S 15216 15218 15120 0 -1 4202496 3435 0 14 0 7 3 0 0 17 0 1 0 626890303 113684480 3101 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284923904 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 42
/proc/15218/statm: 27755 3101 881 364 0 2291 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 111020

[startup+1.50113 s]
/proc/loadavg: 6.77 2.50 0.91 2/278 15219
/proc/meminfo: memFree=8658772/32951124 swapFree=61020456/67111528
[pid=15218] ppid=15216 vsize=135748 CPUtime=0.23 cores=0-7
/proc/15218/stat : 15218 (python) R 15216 15218 15120 0 -1 4202496 5950 928 18 8 16 7 0 0 17 0 1 0 626890303 139005952 4151 33554432000 4194304 5683644 140734596108384 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 2 0 0 95
/proc/15218/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 135748

[startup+3.10086 s]
/proc/loadavg: 6.77 2.50 0.91 2/278 15223
/proc/meminfo: memFree=8630496/32951124 swapFree=61020456/67111528
[pid=15218] ppid=15216 vsize=287580 CPUtime=1.37 cores=0-7
/proc/15218/stat : 15218 (python) R 15216 15218 15120 0 -1 4202496 12599 928 86 8 123 14 0 0 16 0 1 0 626890303 294481920 9280 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284574636 0 0 16781312 2 0 0 0 17 2 0 0 118
/proc/15218/statm: 71895 9280 1826 364 0 7819 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 287580
heavy processes:

[startup+6.30124 s]
/proc/loadavg: 6.31 2.48 0.91 9/302 15247
/proc/meminfo: memFree=8547448/32951124 swapFree=61020456/67111528
[pid=15218] ppid=15216 vsize=430596 CPUtime=2.11 cores=0-7
/proc/15218/stat : 15218 (python) S 15216 15218 15120 0 -1 4202496 18460 928 86 8 195 16 0 0 25 0 9 0 626890303 440930304 8487 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 118
/proc/15218/statm: 107649 8487 1891 364 0 43546 0
[pid=15224] ppid=15218 vsize=283508 CPUtime=0 cores=0-7
/proc/15224/stat : 15224 (python) S 15218 15218 15120 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 626890661 290312192 6582 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945935 0 0 16781312 514 4158414278317015300 0 0 17 1 0 0 0
/proc/15224/statm: 70877 6582 355 364 0 6795 0
[pid=15226] ppid=15224 vsize=1018996 CPUtime=2.7 cores=0-7
/proc/15226/stat : 15226 (gnovelty+2) R 15224 15226 15226 0 -1 4202496 961 0 0 0 270 0 0 0 25 0 1 0 626890662 1043451904 698 33554432000 134512640 135663704 4294090944 18446744073709551615 134525213 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/15226/statm: 254749 698 113 282 0 254465 0
[pid=15227] ppid=15218 vsize=293696 CPUtime=0 cores=0-7
/proc/15227/stat : 15227 (python) S 15218 15218 15120 0 -1 4202560 733 0 0 0 0 0 0 0 18 0 1 0 626890665 300744704 6663 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 14942339936026591494 0 0 17 1 0 0 0
/proc/15227/statm: 73424 6663 349 364 0 9339 0
[pid=15229] ppid=15227 vsize=1018996 CPUtime=2.67 cores=0-7
/proc/15229/stat : 15229 (gnovelty+2) R 15227 15229 15229 0 -1 4202496 958 0 0 0 267 0 0 0 25 0 1 0 626890665 1043451904 697 33554432000 134512640 135663704 4294103920 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/15229/statm: 254749 697 113 282 0 254465 0
[pid=15230] ppid=15218 vsize=369072 CPUtime=0 cores=0-7
/proc/15230/stat : 15230 (python) S 15218 15218 15120 0 -1 4202560 702 0 0 0 0 0 0 0 18 0 1 0 626890669 377929728 6838 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 14942332239445197059 0 0 17 7 0 0 0
/proc/15230/statm: 92268 6838 348 364 0 28180 0
[pid=15232] ppid=15230 vsize=421560 CPUtime=2.63 cores=0-7
/proc/15232/stat : 15232 (adaptg2wsat2009) R 15230 15232 15232 0 -1 4202496 2039 0 0 0 263 0 0 0 25 0 1 0 626890669 431677440 1783 33554432000 134512640 135107411 4290155312 18446744073709551615 134531561 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/15232/statm: 105390 1783 59 146 0 104266 0
[pid=15233] ppid=15218 vsize=379328 CPUtime=0 cores=0-7
/proc/15233/stat : 15233 (python) S 15218 15218 15120 0 -1 4202560 714 0 0 0 0 0 0 0 18 0 1 0 626890673 388431872 6796 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 14942336087735894274 0 0 17 2 0 0 0
/proc/15233/statm: 94832 6796 348 364 0 30741 0
[pid=15235] ppid=15233 vsize=421560 CPUtime=2.59 cores=0-7
/proc/15235/stat : 15235 (adaptg2wsat2009) R 15233 15235 15235 0 -1 4202496 2038 0 0 0 259 0 0 0 25 0 1 0 626890673 431677440 1784 33554432000 134512640 135107411 4293501168 18446744073709551615 134532371 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/15235/statm: 105390 1784 59 146 0 104266 0
[pid=15236] ppid=15218 vsize=389584 CPUtime=0 cores=0-7
/proc/15236/stat : 15236 (python) S 15218 15218 15120 0 -1 4202560 724 0 0 0 0 0 0 0 18 0 1 0 626890677 398934016 6920 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 14192175038232232196 0 0 17 1 0 0 0
/proc/15236/statm: 97396 6920 348 364 0 33302 0
[pid=15238] ppid=15236 vsize=421560 CPUtime=2.54 cores=0-7
/proc/15238/stat : 15238 (adaptg2wsat2009) R 15236 15238 15238 0 -1 4202496 2040 0 0 0 254 0 0 0 25 0 1 0 626890677 431677440 1783 33554432000 134512640 135107411 4292077680 18446744073709551615 134531959 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/15238/statm: 105390 1783 59 146 0 104266 0
[pid=15239] ppid=15218 vsize=399840 CPUtime=0 cores=0-7
/proc/15239/stat : 15239 (python) S 15218 15218 15120 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 626890681 409436160 6924 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 13672203070195335428 0 0 17 1 0 0 0
/proc/15239/statm: 99960 6924 348 364 0 35863 0
[pid=15241] ppid=15239 vsize=1018996 CPUtime=2.49 cores=0-7
/proc/15241/stat : 15241 (gnovelty+2) R 15239 15241 15241 0 -1 4202496 954 0 0 0 249 0 0 0 25 0 1 0 626890681 1043451904 697 33554432000 134512640 135663704 4291046304 18446744073709551615 134544196 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/15241/statm: 254749 697 113 282 0 254465 0
[pid=15242] ppid=15218 vsize=410096 CPUtime=0 cores=0-7
/proc/15242/stat : 15242 (python) S 15218 15218 15120 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 626890684 419938304 6816 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 13672199221904638212 0 0 17 1 0 0 0
/proc/15242/statm: 102524 6816 348 364 0 38424 0
[pid=15244] ppid=15242 vsize=251296 CPUtime=2.46 cores=0-7
/proc/15244/stat : 15244 (FH) R 15242 15244 15244 0 -1 4202496 1944 0 0 0 246 0 0 0 25 0 1 0 626890686 257327104 1682 33554432000 134512640 134936988 4291598832 18446744073709551615 134545269 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/15244/statm: 62824 1682 41 104 0 62328 0
[pid=15245] ppid=15218 vsize=420352 CPUtime=0 cores=0-7
/proc/15245/stat : 15245 (python) S 15218 15218 15120 0 -1 4202560 767 0 0 0 0 0 0 0 18 0 1 0 626890690 430440448 6946 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 1570885186160132360 0 0 17 1 0 0 0
/proc/15245/statm: 105088 6946 354 364 0 40985 0
[pid=15247] ppid=15245 vsize=421560 CPUtime=2.42 cores=0-7
/proc/15247/stat : 15247 (adaptg2wsat2009) R 15245 15247 15247 0 -1 4202496 2047 0 0 0 242 0 0 0 25 0 1 0 626890690 431677440 1783 33554432000 134512640 135107411 4292810272 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/15247/statm: 105390 1783 59 146 0 104266 0
[pid=15218/tid=15225] ppid=15216 vsize=430596 CPUtime=0 cores=0-7
/proc/15218/task/15225/stat : 15225 (python) S 15216 15218 15120 0 -1 4202560 27 928 0 8 0 0 0 0 18 0 9 0 626890662 440930304 8487 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15228] ppid=15216 vsize=430596 CPUtime=0 cores=0-7
/proc/15218/task/15228/stat : 15228 (python) S 15216 15218 15120 0 -1 4202560 25 928 0 8 0 0 0 0 18 0 9 0 626890665 440930304 8487 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 3 0 0 0
[pid=15218/tid=15231] ppid=15216 vsize=430596 CPUtime=0 cores=0-7
/proc/15218/task/15231/stat : 15231 (python) S 15216 15218 15120 0 -1 4202560 91 928 0 8 0 0 0 0 19 0 9 0 626890669 440930304 8487 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15234] ppid=15216 vsize=430596 CPUtime=0 cores=0-7
/proc/15218/task/15234/stat : 15234 (python) S 15216 15218 15120 0 -1 4202560 30 928 0 8 0 0 0 0 18 0 9 0 626890673 440930304 8487 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 2 0 0 0
[pid=15218/tid=15237] ppid=15216 vsize=430596 CPUtime=0 cores=0-7
/proc/15218/task/15237/stat : 15237 (python) S 15216 15218 15120 0 -1 4202560 35 928 0 8 0 0 0 0 22 0 9 0 626890677 440930304 8487 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 2 0 0 0
[pid=15218/tid=15240] ppid=15216 vsize=430596 CPUtime=0 cores=0-7
/proc/15218/task/15240/stat : 15240 (python) S 15216 15218 15120 0 -1 4202560 30 928 0 8 0 0 0 0 23 0 9 0 626890681 440930304 8487 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 7 0 0 0
[pid=15218/tid=15243] ppid=15216 vsize=430596 CPUtime=0 cores=0-7
/proc/15218/task/15243/stat : 15243 (python) S 15216 15218 15120 0 -1 4202560 31 928 0 8 0 0 0 0 24 0 9 0 626890685 440930304 8487 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 1 0 0 0
[pid=15218/tid=15246] ppid=15216 vsize=430596 CPUtime=0 cores=0-7
/proc/15218/task/15246/stat : 15246 (python) S 15216 15218 15120 0 -1 4202560 85 928 0 8 0 0 0 0 25 0 9 0 626890690 440930304 8487 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 22.61
Current children cumulated vsize (KiB) 8370596

[startup+12.7012 s]
/proc/loadavg: 6.44 2.57 0.95 9/302 15247
/proc/meminfo: memFree=8546632/32951124 swapFree=61020456/67111528
[pid=15218] ppid=15216 vsize=430596 CPUtime=2.11 cores=0-7
/proc/15218/stat : 15218 (python) S 15216 15218 15120 0 -1 4202496 18460 928 86 8 195 16 0 0 25 0 9 0 626890303 440930304 8487 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296752587 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 118
/proc/15218/statm: 107649 8487 1891 364 0 43546 0
[pid=15224] ppid=15218 vsize=283508 CPUtime=0 cores=0-7
/proc/15224/stat : 15224 (python) S 15218 15218 15120 0 -1 4202560 893 0 0 0 0 0 0 0 18 0 1 0 626890661 290312192 6605 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945935 0 0 16781312 514 4158414278317015300 0 0 17 1 0 0 0
/proc/15224/statm: 70877 6605 378 364 0 6795 0
[pid=15226] ppid=15224 vsize=1018996 CPUtime=9.1 cores=0-7
/proc/15226/stat : 15226 (gnovelty+2) R 15224 15226 15226 0 -1 4202496 961 0 0 0 910 0 0 0 25 0 1 0 626890662 1043451904 698 33554432000 134512640 135663704 4294090944 18446744073709551615 134545187 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/15226/statm: 254749 698 113 282 0 254465 0
[pid=15227] ppid=15218 vsize=293696 CPUtime=0 cores=0-7
/proc/15227/stat : 15227 (python) S 15218 15218 15120 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 626890665 300744704 6686 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 14942339936026591494 0 0 17 1 0 0 0
/proc/15227/statm: 73424 6686 372 364 0 9339 0
[pid=15229] ppid=15227 vsize=1018996 CPUtime=9.07 cores=0-7
/proc/15229/stat : 15229 (gnovelty+2) R 15227 15229 15229 0 -1 4202496 958 0 0 0 907 0 0 0 25 0 1 0 626890665 1043451904 697 33554432000 134512640 135663704 4294103920 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/15229/statm: 254749 697 113 282 0 254465 0
[pid=15230] ppid=15218 vsize=369072 CPUtime=0 cores=0-7
/proc/15230/stat : 15230 (python) S 15218 15218 15120 0 -1 4202560 777 0 0 0 0 0 0 0 18 0 1 0 626890669 377929728 6860 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 14942332239445197059 0 0 17 7 0 0 0
/proc/15230/statm: 92268 6860 370 364 0 28180 0
[pid=15232] ppid=15230 vsize=421560 CPUtime=9.03 cores=0-7
/proc/15232/stat : 15232 (adaptg2wsat2009) R 15230 15232 15232 0 -1 4202496 2039 0 0 0 903 0 0 0 25 0 1 0 626890669 431677440 1783 33554432000 134512640 135107411 4290155312 18446744073709551615 134532264 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/15232/statm: 105390 1783 59 146 0 104266 0
[pid=15233] ppid=15218 vsize=379328 CPUtime=0 cores=0-7
/proc/15233/stat : 15233 (python) S 15218 15218 15120 0 -1 4202560 792 0 0 0 0 0 0 0 18 0 1 0 626890673 388431872 6818 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 14942336087735894274 0 0 17 2 0 0 0
/proc/15233/statm: 94832 6818 370 364 0 30741 0
[pid=15235] ppid=15233 vsize=421560 CPUtime=8.99 cores=0-7
/proc/15235/stat : 15235 (adaptg2wsat2009) R 15233 15235 15235 0 -1 4202496 2038 0 0 0 899 0 0 0 25 0 1 0 626890673 431677440 1784 33554432000 134512640 135107411 4293501168 18446744073709551615 134531561 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/15235/statm: 105390 1784 59 146 0 104266 0
[pid=15236] ppid=15218 vsize=389584 CPUtime=0 cores=0-7
/proc/15236/stat : 15236 (python) S 15218 15218 15120 0 -1 4202560 801 0 0 0 0 0 0 0 18 0 1 0 626890677 398934016 6943 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 14192175038232232196 0 0 17 1 0 0 0
/proc/15236/statm: 97396 6943 371 364 0 33302 0
[pid=15238] ppid=15236 vsize=421560 CPUtime=8.93 cores=0-7
/proc/15238/stat : 15238 (adaptg2wsat2009) R 15236 15238 15238 0 -1 4202496 2040 0 0 0 893 0 0 0 25 0 1 0 626890677 431677440 1783 33554432000 134512640 135107411 4292077680 18446744073709551615 134532128 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/15238/statm: 105390 1783 59 146 0 104266 0
[pid=15239] ppid=15218 vsize=399840 CPUtime=0 cores=0-7
/proc/15239/stat : 15239 (python) S 15218 15218 15120 0 -1 4202560 813 0 0 0 0 0 0 0 18 0 1 0 626890681 409436160 6947 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 13672203070195335428 0 0 17 1 0 0 0
/proc/15239/statm: 99960 6947 371 364 0 35863 0
[pid=15241] ppid=15239 vsize=1018996 CPUtime=8.81 cores=0-7
/proc/15241/stat : 15241 (gnovelty+2) R 15239 15241 15241 0 -1 4202496 954 0 0 0 881 0 0 0 25 0 1 0 626890681 1043451904 697 33554432000 134512640 135663704 4291046304 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/15241/statm: 254749 697 113 282 0 254465 0
[pid=15242] ppid=15218 vsize=410096 CPUtime=0 cores=0-7
/proc/15242/stat : 15242 (python) S 15218 15218 15120 0 -1 4202560 819 0 0 0 0 0 0 0 18 0 1 0 626890684 419938304 6839 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 13672199221904638212 0 0 17 1 0 0 0

################
# More data... #
################

[pid=15311/tid=15332] ppid=15218 vsize=553680 CPUtime=0 cores=0-7
/proc/15311/task/15332/stat : 15332 (python) S 15218 15218 15120 0 -1 4202560 85 0 0 0 0 0 0 0 18 0 2 0 626949963 566968320 7117 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 514 18446604470699603264 0 0 -1 4 0 0 0
[pid=15314] ppid=15218 vsize=563936 CPUtime=1.19 cores=0-7
/proc/15314/stat : 15314 (python) S 15218 15218 15120 0 -1 4202560 984 0 0 0 64 55 0 0 18 0 1 0 626930479 577470464 7184 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 6054773039650799876 0 0 17 3 0 0 0
/proc/15314/statm: 140984 7184 378 364 0 76839 0
[pid=15316] ppid=15314 vsize=459764 CPUtime=476.97 cores=0-7
/proc/15316/stat : 15316 (TNM) R 15314 15316 15316 0 -1 4202496 1936 0 0 0 47697 0 0 0 25 0 1 0 626930479 470798336 1652 33554432000 134512640 135008748 4291408656 18446744073709551615 134527542 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/15316/statm: 114941 1652 46 122 0 113841 0
[pid=15320] ppid=15218 vsize=574192 CPUtime=0.23 cores=0-7
/proc/15320/stat : 15320 (python) S 15218 15218 15120 0 -1 4202560 1182 0 0 0 12 11 0 0 18 0 2 0 626939920 587972608 7184 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/15320/statm: 143548 7184 407 364 0 79400 0
[pid=15322] ppid=15320 vsize=335996 CPUtime=100.07 cores=0-7
/proc/15322/stat : 15322 (iPAWS) T 15320 15322 15322 0 -1 4202496 1829 0 0 0 10007 0 0 0 25 0 1 0 626939921 344059904 1547 33554432000 134512640 135114423 4288100944 18446744073709551615 134516669 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/15322/statm: 83999 1547 59 147 0 83851 0
[pid=15320/tid=15331] ppid=15218 vsize=574192 CPUtime=0 cores=0-7
/proc/15320/task/15331/stat : 15331 (python) S 15218 15218 15120 0 -1 4202560 82 0 0 0 0 0 0 0 19 0 2 0 626949943 587972608 7184 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 514 18446604469304921024 0 0 -1 2 0 0 0
[pid=15323] ppid=15218 vsize=584448 CPUtime=0.45 cores=0-7
/proc/15323/stat : 15323 (python) S 15218 15218 15120 0 -1 4202560 1200 0 0 0 25 20 0 0 19 0 2 0 626940533 598474752 7194 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/15323/statm: 146112 7194 407 364 0 81961 0
[pid=15325] ppid=15323 vsize=268420 CPUtime=195.39 cores=0-7
/proc/15325/stat : 15325 (hybridGM3) T 15323 15325 15325 0 -1 4202496 5826 0 0 0 19537 2 0 0 25 0 1 0 626940533 274862080 5544 33554432000 134512640 135204385 4290383344 18446744073709551615 134538264 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/15325/statm: 67105 5544 63 169 0 66935 0
[pid=15323/tid=15345] ppid=15218 vsize=584448 CPUtime=0 cores=0-7
/proc/15323/task/15345/stat : 15345 (python) S 15218 15218 15120 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 626960097 598474752 7194 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 514 18446604456699130112 0 0 -1 4 0 0 0
[pid=15333] ppid=15218 vsize=594704 CPUtime=0.47 cores=0-7
/proc/15333/stat : 15333 (python) S 15218 15218 15120 0 -1 4202560 1183 0 0 0 23 24 0 0 19 0 2 0 626949972 608976896 7180 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/15333/statm: 148676 7180 400 364 0 84522 0
[pid=15335] ppid=15333 vsize=268424 CPUtime=194.82 cores=0-7
/proc/15335/stat : 15335 (hybridGM3) T 15333 15335 15335 0 -1 4202496 5832 0 0 0 19482 0 0 0 25 0 1 0 626949975 274866176 5545 33554432000 134512640 135204385 4288193056 18446744073709551615 134538264 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/15335/statm: 67106 5545 63 169 0 66936 0
[pid=15333/tid=15351] ppid=15218 vsize=594704 CPUtime=0 cores=0-7
/proc/15333/task/15351/stat : 15351 (python) S 15218 15218 15120 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 626969527 608976896 7180 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 514 18446604471117113536 0 0 -1 4 0 0 0
[pid=15336] ppid=15218 vsize=604960 CPUtime=0.23 cores=0-7
/proc/15336/stat : 15336 (python) S 15218 15218 15120 0 -1 4202560 1171 0 0 0 13 10 0 0 19 0 2 0 626949982 619479040 7285 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/15336/statm: 151240 7285 400 364 0 87083 0
[pid=15338] ppid=15336 vsize=335996 CPUtime=99.72 cores=0-7
/proc/15338/stat : 15338 (iPAWS) T 15336 15338 15338 0 -1 4202496 1828 0 0 0 9972 0 0 0 25 0 1 0 626949982 344059904 1547 33554432000 134512640 135114423 4292063600 18446744073709551615 134546166 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/15338/statm: 83999 1547 59 147 0 83851 0
[pid=15336/tid=15341] ppid=15218 vsize=604960 CPUtime=0 cores=0-7
/proc/15336/task/15341/stat : 15341 (python) S 15218 15218 15120 0 -1 4202560 83 0 0 0 0 0 0 0 19 0 2 0 626960005 619479040 7285 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 514 18446604471117111744 0 0 -1 0 0 0 0
[pid=15342] ppid=15218 vsize=615216 CPUtime=0.49 cores=0-7
/proc/15342/stat : 15342 (python) S 15218 15218 15120 0 -1 4202560 1199 0 0 0 24 25 0 0 19 0 2 0 626960014 629981184 7259 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/15342/statm: 153804 7259 400 364 0 89644 0
[pid=15344] ppid=15342 vsize=268420 CPUtime=194.61 cores=0-7
/proc/15344/stat : 15344 (hybridGM3) T 15342 15344 15344 0 -1 4202496 5827 0 0 0 19460 1 0 0 25 0 1 0 626960014 274862080 5544 33554432000 134512640 135204385 4287900656 18446744073709551615 134538284 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/15344/statm: 67105 5544 63 169 0 66935 0
[pid=15342/tid=15366] ppid=15218 vsize=615216 CPUtime=0 cores=0-7
/proc/15342/task/15366/stat : 15366 (python) S 15218 15218 15120 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 626979575 629981184 7259 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 514 18446604457500705792 0 0 -1 6 0 0 0
[pid=15346] ppid=15218 vsize=625472 CPUtime=0.49 cores=0-7
/proc/15346/stat : 15346 (python) S 15218 15218 15120 0 -1 4202560 1011 0 0 0 25 24 0 0 18 0 1 0 626960107 640483328 7321 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 6054773039650799877 0 0 17 5 0 0 0
/proc/15346/statm: 156368 7321 373 364 0 92205 0
[pid=15348] ppid=15346 vsize=459772 CPUtime=199.45 cores=0-7
/proc/15348/stat : 15348 (TNM) R 15346 15348 15348 0 -1 4202496 1934 0 0 0 19945 0 0 0 25 0 1 0 626960107 470806528 1653 33554432000 134512640 135008748 4287032320 18446744073709551615 134529430 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/15348/statm: 114943 1653 46 122 0 113843 0
[pid=15352] ppid=15218 vsize=635728 CPUtime=0.25 cores=0-7
/proc/15352/stat : 15352 (python) S 15218 15218 15120 0 -1 4202560 1237 0 0 0 11 14 0 0 19 0 2 0 626969538 650985472 7277 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/15352/statm: 158932 7277 406 364 0 94766 0
[pid=15354] ppid=15352 vsize=251296 CPUtime=100.17 cores=0-7
/proc/15354/stat : 15354 (FH) T 15352 15354 15354 0 -1 4202496 1971 0 0 0 10017 0 0 0 25 0 1 0 626969539 257327104 1683 33554432000 134512640 134936988 4290971152 18446744073709551615 134545264 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/15354/statm: 62824 1683 41 104 0 62328 0
[pid=15352/tid=15365] ppid=15218 vsize=635728 CPUtime=0 cores=0-7
/proc/15352/task/15365/stat : 15365 (python) S 15218 15218 15120 0 -1 4202560 83 0 0 0 0 0 0 0 19 0 2 0 626979563 650985472 7277 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 514 18446604461118060608 0 0 -1 4 0 0 0
[pid=15355] ppid=15218 vsize=645984 CPUtime=0.25 cores=0-7
/proc/15355/stat : 15355 (python) S 15218 15218 15120 0 -1 4202560 1249 0 0 0 12 13 0 0 19 0 2 0 626970012 661487616 7371 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296752587 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/15355/statm: 161496 7371 406 364 0 97327 0
[pid=15357] ppid=15355 vsize=1018996 CPUtime=99.1 cores=0-7
/proc/15357/stat : 15357 (gnovelty+2) T 15355 15357 15357 0 -1 4202496 987 0 0 0 9910 0 0 0 25 0 1 0 626970013 1043451904 697 33554432000 134512640 135663704 4293896992 18446744073709551615 134524894 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/15357/statm: 254749 697 113 282 0 254465 0
[pid=15355/tid=15370] ppid=15218 vsize=645984 CPUtime=0 cores=0-7
/proc/15355/task/15370/stat : 15370 (python) S 15218 15218 15120 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 626980041 661487616 7371 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 514 18446604461118058816 0 0 -1 4 0 0 0
[pid=15360] ppid=15218 vsize=656240 CPUtime=0.02 cores=0-7
/proc/15360/stat : 15360 (python) S 15218 15218 15120 0 -1 4202560 1049 0 0 0 1 1 0 0 18 0 1 0 626978781 671989760 7407 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 6054773039650799880 0 0 17 5 0 0 0
/proc/15360/statm: 164060 7407 379 364 0 99888 0
[pid=15362] ppid=15360 vsize=268424 CPUtime=12.66 cores=0-7
/proc/15362/stat : 15362 (hybridGM3) R 15360 15362 15362 0 -1 4202496 5833 0 0 0 1265 1 0 0 25 0 1 0 626978782 274866176 5544 33554432000 134512640 135204385 4291242032 18446744073709551615 134538349 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/15362/statm: 67106 5544 63 169 0 66936 0
[pid=15367] ppid=15218 vsize=666496 CPUtime=0.01 cores=0-7
/proc/15367/stat : 15367 (python) S 15218 15218 15120 0 -1 4202560 1059 0 0 0 1 0 0 0 18 0 1 0 626979586 682491904 7328 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 4476709975296540935 0 0 17 5 0 0 0
/proc/15367/statm: 166624 7328 379 364 0 102449 0
[pid=15369] ppid=15367 vsize=335996 CPUtime=4.68 cores=0-7
/proc/15369/stat : 15369 (iPAWS) R 15367 15369 15369 0 -1 4202496 1834 0 0 0 468 0 0 0 25 0 1 0 626979587 344059904 1547 33554432000 134512640 135114423 4286953600 18446744073709551615 134546153 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/15369/statm: 83999 1547 59 147 0 83851 0
[pid=15371] ppid=15218 vsize=676752 CPUtime=0 cores=0-7
/proc/15371/stat : 15371 (python) S 15218 15218 15120 0 -1 4202560 935 0 0 0 0 0 0 0 19 0 1 0 626980052 692994048 7368 33554432000 4194304 5683644 140734596108384 18446744073709551615 224284945990 0 0 16781312 514 3886795873593589759 0 0 17 5 0 0 0
/proc/15371/statm: 169188 7368 351 364 0 105010 0
[pid=15373] ppid=15371 vsize=268428 CPUtime=0.02 cores=0-7
/proc/15373/stat : 15373 (hybridGM3) R 15371 15373 15373 0 -1 4202496 1473 0 0 0 2 0 0 0 19 0 1 0 626980053 274870272 1184 33554432000 134512640 135204385 4292496000 18446744073709551615 134542911 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/15373/statm: 67107 1184 57 169 0 66937 0
[pid=15218/tid=15225] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15225/stat : 15225 (python) S 15216 15218 15120 0 -1 4202560 27 928 0 8 0 0 0 0 18 0 34 0 626890662 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15228] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15228/stat : 15228 (python) S 15216 15218 15120 0 -1 4202560 25 928 0 8 0 0 0 0 18 0 34 0 626890665 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 3 0 0 0
[pid=15218/tid=15231] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15231/stat : 15231 (python) S 15216 15218 15120 0 -1 4202560 102 928 0 8 0 0 0 0 18 0 34 0 626890669 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15234] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15234/stat : 15234 (python) S 15216 15218 15120 0 -1 4202560 34 928 0 8 0 0 0 0 18 0 34 0 626890673 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 2 0 0 0
[pid=15218/tid=15237] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15237/stat : 15237 (python) S 15216 15218 15120 0 -1 4202560 51 928 0 8 0 0 0 0 18 0 34 0 626890677 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 2 0 0 0
[pid=15218/tid=15240] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15240/stat : 15240 (python) S 15216 15218 15120 0 -1 4202560 30 928 0 8 0 0 0 0 23 0 34 0 626890681 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 7 0 0 0
[pid=15218/tid=15243] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15243/stat : 15243 (python) S 15216 15218 15120 0 -1 4202560 36 928 0 8 0 0 0 0 18 0 34 0 626890685 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 1 0 0 0
[pid=15218/tid=15246] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15246/stat : 15246 (python) S 15216 15218 15120 0 -1 4202560 91 928 0 8 0 0 0 0 18 0 34 0 626890690 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 1 0 0 0
[pid=15218/tid=15253] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15253/stat : 15253 (python) S 15216 15218 15120 0 -1 4202560 37 928 0 8 0 0 0 0 18 0 34 0 626900691 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 5 0 0 0
[pid=15218/tid=15258] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15258/stat : 15258 (python) S 15216 15218 15120 0 -1 4202560 44 928 0 8 0 0 0 0 18 0 34 0 626900695 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 7 0 0 0
[pid=15218/tid=15262] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15262/stat : 15262 (python) S 15216 15218 15120 0 -1 4202560 45 928 0 8 0 0 0 0 18 0 34 0 626900701 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 6 0 0 0
[pid=15218/tid=15267] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15267/stat : 15267 (python) S 15216 15218 15120 0 -1 4202560 31 928 0 8 0 0 0 0 20 0 34 0 626900708 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 1 0 0 0
[pid=15218/tid=15271] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15271/stat : 15271 (python) S 15216 15218 15120 0 -1 4202560 40 928 0 8 0 0 0 0 18 0 34 0 626900713 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 1 0 0 0
[pid=15218/tid=15274] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15274/stat : 15274 (python) S 15216 15218 15120 0 -1 4202560 39 928 0 8 0 0 0 0 18 0 34 0 626900719 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 4 0 0 0
[pid=15218/tid=15277] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15277/stat : 15277 (python) S 15216 15218 15120 0 -1 4202560 33 928 0 8 0 0 0 0 19 0 34 0 626900725 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 3 0 0 0
[pid=15218/tid=15280] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15280/stat : 15280 (python) S 15216 15218 15120 0 -1 4202560 36 928 0 8 0 0 0 0 18 0 34 0 626900731 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 3 0 0 0
[pid=15218/tid=15286] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15286/stat : 15286 (python) S 15216 15218 15120 0 -1 4202560 30 928 0 8 0 0 0 0 20 0 34 0 626910719 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 3 0 0 0
[pid=15218/tid=15290] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15290/stat : 15290 (python) S 15216 15218 15120 0 -1 4202560 39 928 0 8 0 0 0 0 18 0 34 0 626910740 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 3 0 0 0
[pid=15218/tid=15302] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15302/stat : 15302 (python) S 15216 15218 15120 0 -1 4202560 40 928 0 8 0 0 0 0 20 0 34 0 626920760 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15308] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15308/stat : 15308 (python) S 15216 15218 15120 0 -1 4202560 46 928 0 8 0 0 0 0 18 0 34 0 626930120 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15312] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15312/stat : 15312 (python) S 15216 15218 15120 0 -1 4202560 45 928 0 8 0 0 0 0 18 0 34 0 626930409 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 3 0 0 0
[pid=15218/tid=15315] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15315/stat : 15315 (python) S 15216 15218 15120 0 -1 4202560 33 928 0 8 0 0 0 0 20 0 34 0 626930479 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 3 0 0 0
[pid=15218/tid=15321] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15321/stat : 15321 (python) S 15216 15218 15120 0 -1 4202560 34 928 0 8 0 0 0 0 18 0 34 0 626939921 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15324] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15324/stat : 15324 (python) S 15216 15218 15120 0 -1 4202560 32 928 0 8 0 0 0 0 20 0 34 0 626940533 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15334] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15334/stat : 15334 (python) S 15216 15218 15120 0 -1 4202560 31 928 0 8 0 0 0 0 19 0 34 0 626949972 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 4 0 0 0
[pid=15218/tid=15337] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15337/stat : 15337 (python) S 15216 15218 15120 0 -1 4202560 32 928 0 8 0 0 0 0 20 0 34 0 626949982 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 5 0 0 0
[pid=15218/tid=15343] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15343/stat : 15343 (python) S 15216 15218 15120 0 -1 4202560 33 928 0 8 0 0 0 0 20 0 34 0 626960014 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15347] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15347/stat : 15347 (python) S 15216 15218 15120 0 -1 4202560 32 928 0 8 0 0 0 0 18 0 34 0 626960107 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15353] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15353/stat : 15353 (python) S 15216 15218 15120 0 -1 4202560 35 928 0 8 0 0 0 0 20 0 34 0 626969539 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15356] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15356/stat : 15356 (python) S 15216 15218 15120 0 -1 4202560 33 928 0 8 0 0 0 0 20 0 34 0 626970013 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 5 0 0 0
[pid=15218/tid=15361] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15361/stat : 15361 (python) S 15216 15218 15120 0 -1 4202560 32 928 0 8 0 0 0 0 20 0 34 0 626978781 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 0 0 0 0
[pid=15218/tid=15368] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15368/stat : 15368 (python) S 15216 15218 15120 0 -1 4202560 37 928 0 8 0 0 0 0 20 0 34 0 626979587 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 5 0 0 0
[pid=15218/tid=15372] ppid=15216 vsize=686996 CPUtime=0 cores=0-7
/proc/15218/task/15372/stat : 15372 (python) S 15216 15218 15120 0 -1 4202560 29 928 0 8 0 0 0 0 20 0 34 0 626980053 703483904 8963 33554432000 4194304 5683644 140734596108384 18446744073709551615 224296749489 0 0 16781312 2 18446604441245204672 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7123.16
Current children cumulated vsize (KiB) 32473172

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15218 and gives
#  childrusage.ru_utime.tv_sec=2201
#  childrusage.ru_utime.tv_usec=859266
#  childrusage.ru_stime.tv_sec=8
#  childrusage.ru_stime.tv_usec=570697
# CPU time returned by wait4() is 2210.43
# while last known CPU time is 7123.16
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 897.707
CPU time (s): 7123.16
CPU user time (s): 7114.81
CPU system time (s): 8.35
CPU usage (%): 793.483
Max. virtual memory (cumulated for all children) (KiB): 32473172

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2201.86
system time used= 8.5707
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 118353
page faults= 94
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15608
involuntary context switches= 18206

runsolver used 8.49671 second user time and 19.2661 second system time

The end

Launcher Data 

Begin job on node118 at 2011-05-02 22:03:16
IDJOB=3321745
IDBENCH=82523
IDSOLVER=1712
FILE ID=node118/3321745-1304366595
RUNJOBID= node118-1304366467-15134
PBS_JOBID= 13181753
Free space on /tmp= 73276 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k5-r20-v1500-c30000-S877088425-001-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321745-1304366595/watcher-3321745-1304366595 -o /tmp/evaluation-result-3321745-1304366595/solver-3321745-1304366595 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321745-1304366595.cnf -seed 977768611 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 419b5972e0565bacaabacb029af6176c
RANDOM SEED=977768611

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       8675740 kB
Buffers:          8112 kB
Cached:         149112 kB
SwapCached:      96544 kB
Active:       11009468 kB
Inactive:     13047732 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       8675740 kB
SwapTotal:    67111528 kB
SwapFree:     61020456 kB
Dirty:           32300 kB
Writeback:           0 kB
AnonPages:    23815056 kB
Mapped:          13064 kB
Slab:            77096 kB
PageTables:      76620 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 53741376 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73244 MiB
End job on node118 at 2011-05-02 22:18:16