Trace number 3321858

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 10051.9 1437.81

General information on the benchmark

Namerandom/large/
unif-k5-r20-v2000-c40000-S971556279-001-UNKNOWN.cnf
MD5SUM9224277e61359574518ca553717e02ee
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark640.831
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of clauses40000
Sum of the clauses size200000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 540000
Number of clauses of size over 50

Solver Data

0.38/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.38/0.67	c INFO: solving HOME/instance-3321858-1304368477.cnf
0.38/0.67	c INFO: computing task features
0.57/0.88	c INFO: computed variable-clause graph statistics
0.57/0.88	c INFO: computed clause balance statistics
1.67/1.94	c INFO: computed variable balance statistics
2.27/2.52	c INFO: computed small-clause counts
2.27/2.53	c INFO: computed Horn-clause counts
2.27/2.57	c INFO: computed variable graph statistics
2.27/2.57	c INFO: collected features for HOME/instance-3321858-1304368477.cnf in 1.90 s
2.36/2.61	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
2.36/2.65	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
2.36/2.68	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.08)
2.47/2.72	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.07)
2.47/2.76	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.05)
2.47/2.80	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.05)
2.57/2.83	c INFO: running FH@0 for 97 with 39997 remaining (b = 0.03)
2.62/2.99	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.03)
702.43/102.93	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.02)
702.43/102.97	c INFO: running FH@0 for 97 with 39897 remaining (b = 0.02)
703.00/103.02	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.04)
703.00/103.08	c INFO: running gnovelty+2@0 for 97 with 39897 remaining (b = 0.02)
703.38/103.13	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
829.91/121.21	c INFO: running adaptg2wsat2009++@0 for 97 with 39879 remaining (b = 0.01)
957.61/139.56	c INFO: running hybridGM3@0 for 194 with 39861 remaining (b = 0.03)
1081.92/157.32	c INFO: running hybridGM3@0 for 194 with 39843 remaining (b = 0.02)
1402.02/203.24	c INFO: running TNM@0 for 1552 with 39797 remaining (b = 0.19)
1486.36/215.35	c INFO: running FH@0 for 97 with 39785 remaining (b = 0.01)
1522.57/220.55	c INFO: running adaptg2wsat2009++@0 for 97 with 39780 remaining (b = 0.01)
1655.03/239.56	c INFO: running adaptg2wsat2009++@0 for 97 with 39761 remaining (b = 0.01)
2073.89/299.67	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2185.48/315.67	c INFO: running adaptg2wsat2009++@0 for 97 with 39685 remaining (b = 0.01)
2244.96/323.87	c INFO: running adaptg2wsat2009++@100 for 97 with 39676 remaining (b = 0.01)
2331.44/336.27	c INFO: running hybridGM3@99 for 97 with 39664 remaining (b = 0.01)
2667.51/384.45	c INFO: running hybridGM3@97 for 97 with 39616 remaining (b = 0.01)
2709.36/390.07	c INFO: running hybridGM3@98 for 97 with 39610 remaining (b = 0.01)
2715.62/391.00	c INFO: running hybridGM3@0 for 194 with 39609 remaining (b = 0.02)
2820.83/406.01	c INFO: running hybridGM3@0 for 194 with 39594 remaining (b = 0.02)
2999.62/430.08	c INFO: running TNM@0 for 1552 with 39570 remaining (b = 0.15)
3045.04/436.61	c INFO: running hybridGM3@298 for 97 with 39564 remaining (b = 0.01)
3147.91/451.26	c INFO: running adaptg2wsat2009++@100 for 97 with 39549 remaining (b = 0.01)
3347.41/479.76	c INFO: running hybridGM3@294 for 97 with 39520 remaining (b = 0.01)
3513.33/503.43	c INFO: running FH@0 for 291 with 39497 remaining (b = 0.03)
3712.78/531.92	c INFO: running gnovelty+2@0 for 97 with 39468 remaining (b = 0.01)
4039.75/578.66	c INFO: running hybridGM3@395 for 97 with 39422 remaining (b = 0.01)
4056.47/581.09	c INFO: running hybridGM3@389 for 97 with 39419 remaining (b = 0.01)
4137.66/592.69	c INFO: running iPAWS@0 for 97 with 39408 remaining (b = 0.01)
4313.99/617.85	c INFO: running hybridGM3@97 for 97 with 39382 remaining (b = 0.01)
4415.51/632.32	c INFO: running hybridGM3@99 for 97 with 39368 remaining (b = 0.01)
4722.18/675.46	c INFO: running adaptg2wsat2009++@294 for 291 with 39325 remaining (b = 0.02)
4809.84/688.03	c INFO: running FH@100 for 291 with 39312 remaining (b = 0.02)
5011.75/717.11	c INFO: running hybridGM3@0 for 194 with 39283 remaining (b = 0.02)
5075.74/726.24	c INFO: running TNM@0 for 1552 with 39274 remaining (b = 0.12)
5141.18/735.68	c INFO: running hybridGM3@193 for 97 with 39265 remaining (b = 0.01)
6098.56/873.12	c INFO: running hybridGM3@292 for 194 with 39127 remaining (b = 0.02)
6198.82/887.53	c INFO: running iPAWS@0 for 97 with 39113 remaining (b = 0.01)
6716.81/961.95	c INFO: running hybridGM3@92 for 97 with 39038 remaining (b = 0.01)
6907.59/989.35	c INFO: running adaptg2wsat2009++@395 for 194 with 39011 remaining (b = 0.02)
7023.14/1005.94	c INFO: running adaptg2wsat2009++@101 for 97 with 38994 remaining (b = 0.01)
7204.15/1031.99	c INFO: running FH@197 for 194 with 38968 remaining (b = 0.01)
7599.62/1088.75	c INFO: running FH@0 for 97 with 38911 remaining (b = 0.01)
7715.16/1105.41	c INFO: running hybridGM3@378 for 97 with 38895 remaining (b = 0.01)
7868.29/1127.37	c INFO: running adaptg2wsat2009++@392 for 194 with 38873 remaining (b = 0.01)
8379.32/1200.75	c INFO: running hybridGM3@479 for 97 with 38800 remaining (b = 0.01)
8408.53/1204.99	c INFO: running adaptg2wsat2009++@492 for 97 with 38795 remaining (b = 0.01)
8423.86/1207.16	c INFO: running NCVWr@0 for 485 with 38793 remaining (b = 0.03)
8579.78/1229.59	c INFO: running iPAWS@0 for 97 with 38771 remaining (b = 0.01)
9282.22/1330.41	c INFO: running gnovelty+2@0 for 97 with 38670 remaining (b = 0.01)
9294.14/1332.19	c INFO: running hybridGM3@0 for 194 with 38668 remaining (b = 0.01)
9419.55/1349.04	c INFO: running adaptg2wsat2009++@486 for 97 with 38651 remaining (b = 0.01)
9500.81/1360.04	c INFO: running FH@101 for 291 with 38640 remaining (b = 0.02)
10046.88/1436.92	c INFO: running iPAWS@0 for 97 with 38563 remaining (b = 0.01)

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321858-1304368477/watcher-3321858-1304368477 -o /tmp/evaluation-result-3321858-1304368477/solver-3321858-1304368477 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321858-1304368477.cnf -seed 492488376 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.62 8.15 7.20 3/310 10310
/proc/meminfo: memFree=7614140/32950928 swapFree=67111448/67111528
[pid=10310] ppid=10308 vsize=15776 CPUtime=0 cores=0-7
/proc/10310/stat : 10310 (python) R 10308 10310 9896 0 -1 4202496 871 0 0 0 0 0 0 0 25 0 1 0 548446452 16154624 753 33554432000 4194304 5683644 140736360345696 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10310/statm: 3944 753 343 364 0 431 0

[startup+0.0765429 s]
/proc/loadavg: 7.62 8.15 7.20 3/310 10310
/proc/meminfo: memFree=7614140/32950928 swapFree=67111448/67111528
[pid=10310] ppid=10308 vsize=43816 CPUtime=0.05 cores=0-7
/proc/10310/stat : 10310 (python) R 10308 10310 9896 0 -1 4202496 1879 0 0 0 4 1 0 0 25 0 1 0 548446452 44867584 1703 33554432000 4194304 5683644 140736360345696 18446744073709551615 251813934173 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10310/statm: 10954 1703 467 364 0 1219 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 43816

[startup+0.100523 s]
/proc/loadavg: 7.62 8.15 7.20 3/310 10310
/proc/meminfo: memFree=7614140/32950928 swapFree=67111448/67111528
[pid=10310] ppid=10308 vsize=87708 CPUtime=0.06 cores=0-7
/proc/10310/stat : 10310 (python) R 10308 10310 9896 0 -1 4202496 2637 0 0 0 5 1 0 0 17 0 1 0 548446452 89812992 2354 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814240000 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10310/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87708

[startup+0.300509 s]
/proc/loadavg: 7.62 8.15 7.20 3/310 10310
/proc/meminfo: memFree=7614140/32950928 swapFree=67111448/67111528
[pid=10310] ppid=10308 vsize=135752 CPUtime=0.2 cores=0-7
/proc/10310/stat : 10310 (python) R 10308 10310 9896 0 -1 4202496 5966 934 1 0 14 6 0 0 17 0 1 0 548446452 139010048 4152 33554432000 4194304 5683644 140736360345696 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10310/statm: 33938 4152 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 135752

[startup+0.700412 s]
/proc/loadavg: 7.62 8.15 7.20 3/310 10310
/proc/meminfo: memFree=7614140/32950928 swapFree=67111448/67111528
[pid=10310] ppid=10308 vsize=280864 CPUtime=0.47 cores=0-7
/proc/10310/stat : 10310 (python) R 10308 10310 9896 0 -1 4202496 9869 934 1 0 34 13 0 0 16 0 1 0 548446452 287604736 7549 33554432000 4194304 5683644 140736360345696 18446744073709551615 47733218276576 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10310/statm: 70216 7550 1761 364 0 6140 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 280864

[startup+1.50027 s]
/proc/loadavg: 7.62 8.15 7.20 3/311 10316
/proc/meminfo: memFree=7580096/32950928 swapFree=67111448/67111528
[pid=10310] ppid=10308 vsize=290808 CPUtime=1.27 cores=0-7
/proc/10310/stat : 10310 (python) R 10308 10310 9896 0 -1 4202496 14012 934 1 0 114 13 0 0 17 0 1 0 548446452 297787392 10086 33554432000 4194304 5683644 140736360345696 18446744073709551615 251813931410 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/10310/statm: 72702 10086 1826 364 0 8626 0
Current children cumulated CPU time (s) 1.27
Current children cumulated vsize (KiB) 290808

[startup+3.10094 s]
/proc/loadavg: 7.62 8.15 7.20 3/311 10316
/proc/meminfo: memFree=7578980/32950928 swapFree=67111448/67111528
[pid=10310] ppid=10308 vsize=432076 CPUtime=2.64 cores=0-7
/proc/10310/stat : 10310 (python) S 10308 10310 9896 0 -1 4202496 20128 934 1 0 249 15 0 0 23 0 9 0 548446452 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826066891 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/10310/statm: 108019 8857 1891 364 0 43916 0
Current children cumulated CPU time (s) 2.64
Current children cumulated vsize (KiB) 432076

[startup+6.30141 s]
/proc/loadavg: 7.25 8.07 7.18 10/335 10340
/proc/meminfo: memFree=7502396/32950928 swapFree=67111448/67111528
[pid=10310] ppid=10308 vsize=432076 CPUtime=2.64 cores=0-7
/proc/10310/stat : 10310 (python) S 10308 10310 9896 0 -1 4202496 20128 934 1 0 249 15 0 0 23 0 9 0 548446452 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826066891 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/10310/statm: 108019 8857 1891 364 0 43916 0
[pid=10317] ppid=10310 vsize=284988 CPUtime=0 cores=0-7
/proc/10317/stat : 10317 (python) S 10310 10310 9896 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 548446714 291827712 6900 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260239 0 0 16781312 514 4954922216832598273 0 0 17 4 0 0 0
/proc/10317/statm: 71247 6900 355 364 0 7165 0
[pid=10319] ppid=10317 vsize=1020308 CPUtime=3.67 cores=0-7
/proc/10319/stat : 10319 (gnovelty+2) R 10317 10319 10319 0 -1 4202496 1153 0 0 0 367 0 0 0 25 0 1 0 548446714 1044795392 891 33554432000 134512640 135663704 4288936768 18446744073709551615 134545583 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/10319/statm: 255077 891 113 282 0 254793 0
[pid=10320] ppid=10310 vsize=294908 CPUtime=0 cores=0-7
/proc/10320/stat : 10320 (python) S 10310 10310 9896 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 548446717 301985792 7033 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 4645908322136850692 0 0 17 1 0 0 0
/proc/10320/statm: 73727 7033 349 364 0 9642 0
[pid=10322] ppid=10320 vsize=1020308 CPUtime=3.64 cores=0-7
/proc/10322/stat : 10322 (gnovelty+2) R 10320 10322 10322 0 -1 4202496 1154 0 0 0 364 0 0 0 25 0 1 0 548446718 1044795392 892 33554432000 134512640 135663704 4286887024 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/10322/statm: 255077 892 113 282 0 254793 0
[pid=10323] ppid=10310 vsize=305016 CPUtime=0 cores=0-7
/proc/10323/stat : 10323 (python) S 10310 10310 9896 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 548446721 312336384 7035 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 18020085462793683202 0 0 17 1 0 0 0
/proc/10323/statm: 76254 7035 347 364 0 12166 0
[pid=10325] ppid=10323 vsize=423400 CPUtime=3.6 cores=0-7
/proc/10325/stat : 10325 (adaptg2wsat2009) R 10323 10325 10325 0 -1 4202496 2622 0 0 0 360 0 0 0 25 0 1 0 548446721 433561600 2357 33554432000 134512640 135107411 4287735504 18446744073709551615 134531582 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10325/statm: 105850 2357 59 146 0 104726 0
[pid=10326] ppid=10310 vsize=380808 CPUtime=0 cores=0-7
/proc/10326/stat : 10326 (python) S 10310 10310 9896 0 -1 4202560 708 0 0 0 0 0 0 0 18 0 1 0 548446725 389947392 7212 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 4055848535143186689 0 0 17 1 0 0 0
/proc/10326/statm: 95202 7212 348 364 0 31111 0
[pid=10328] ppid=10326 vsize=423400 CPUtime=3.56 cores=0-7
/proc/10328/stat : 10328 (adaptg2wsat2009) R 10326 10328 10328 0 -1 4202496 2609 0 0 0 356 0 0 0 25 0 1 0 548446725 433561600 2358 33554432000 134512640 135107411 4288532640 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/10328/statm: 105850 2358 59 146 0 104726 0
[pid=10329] ppid=10310 vsize=391064 CPUtime=0 cores=0-7
/proc/10329/stat : 10329 (python) S 10310 10310 9896 0 -1 4202560 722 0 0 0 0 0 0 0 18 0 1 0 548446729 400449536 7186 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 4131825063500415234 0 0 17 1 0 0 0
/proc/10329/statm: 97766 7186 348 364 0 33672 0
[pid=10331] ppid=10329 vsize=423400 CPUtime=3.49 cores=0-7
/proc/10331/stat : 10331 (adaptg2wsat2009) R 10329 10331 10331 0 -1 4202496 2612 0 0 0 349 0 0 0 25 0 1 0 548446729 433561600 2358 33554432000 134512640 135107411 4288332224 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10331/statm: 105850 2358 59 146 0 104726 0
[pid=10332] ppid=10310 vsize=401320 CPUtime=0 cores=0-7
/proc/10332/stat : 10332 (python) S 10310 10310 9896 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 548446732 410951680 7207 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 18020081614502985986 0 0 17 1 0 0 0
/proc/10332/statm: 100330 7207 348 364 0 36233 0
[pid=10334] ppid=10332 vsize=1020308 CPUtime=3.42 cores=0-7
/proc/10334/stat : 10334 (gnovelty+2) R 10332 10334 10334 0 -1 4202496 1151 0 0 0 342 0 0 0 25 0 1 0 548446734 1044795392 892 33554432000 134512640 135663704 4288510256 18446744073709551615 134544167 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/10334/statm: 255077 892 113 282 0 254793 0
[pid=10335] ppid=10310 vsize=411576 CPUtime=0 cores=0-7
/proc/10335/stat : 10335 (python) S 10310 10310 9896 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 548446736 421453824 7177 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 1138156442130284803 0 0 17 1 0 0 0
/proc/10335/statm: 102894 7177 348 364 0 38794 0
[pid=10337] ppid=10335 vsize=253036 CPUtime=1.9 cores=0-7
/proc/10337/stat : 10337 (FH) R 10335 10337 10337 0 -1 4202496 2491 0 0 0 190 0 0 0 25 0 1 0 548446739 259108864 2234 33554432000 134512640 134936988 4288350336 18446744073709551615 134545336 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10337/statm: 63259 2234 41 104 0 62763 0
[pid=10338] ppid=10310 vsize=421832 CPUtime=0 cores=0-7
/proc/10338/stat : 10338 (python) S 10310 10310 9896 0 -1 4202560 769 0 0 0 0 0 0 0 18 0 1 0 548446752 431955968 7316 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 1138144897258193156 0 0 17 1 0 0 0
/proc/10338/statm: 105458 7316 354 364 0 41355 0
[pid=10340] ppid=10338 vsize=423400 CPUtime=1.51 cores=0-7
/proc/10340/stat : 10340 (adaptg2wsat2009) R 10338 10340 10340 0 -1 4202496 2618 0 0 0 151 0 0 0 25 0 1 0 548446762 433561600 2356 33554432000 134512640 135107411 4289461152 18446744073709551615 134532381 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10340/statm: 105850 2356 59 146 0 104726 0
[pid=10310/tid=10318] ppid=10308 vsize=432076 CPUtime=0 cores=0-7
/proc/10310/task/10318/stat : 10318 (python) S 10308 10310 9896 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 9 0 548446714 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 4 0 0 0
[pid=10310/tid=10321] ppid=10308 vsize=432076 CPUtime=0 cores=0-7
/proc/10310/task/10321/stat : 10321 (python) S 10308 10310 9896 0 -1 4202560 22 934 0 0 0 0 0 0 21 0 9 0 548446718 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 4 0 0 0
[pid=10310/tid=10324] ppid=10308 vsize=432076 CPUtime=0 cores=0-7
/proc/10310/task/10324/stat : 10324 (python) S 10308 10310 9896 0 -1 4202560 25 934 0 0 0 0 0 0 19 0 9 0 548446721 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 3 0 0 0
[pid=10310/tid=10327] ppid=10308 vsize=432076 CPUtime=0 cores=0-7
/proc/10310/task/10327/stat : 10327 (python) S 10308 10310 9896 0 -1 4202560 98 934 0 0 0 0 0 0 20 0 9 0 548446725 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 0 0 0 0
[pid=10310/tid=10330] ppid=10308 vsize=432076 CPUtime=0 cores=0-7
/proc/10310/task/10330/stat : 10330 (python) S 10308 10310 9896 0 -1 4202560 35 934 0 0 0 0 0 0 21 0 9 0 548446729 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 7 0 0 0
[pid=10310/tid=10333] ppid=10308 vsize=432076 CPUtime=0 cores=0-7
/proc/10310/task/10333/stat : 10333 (python) S 10308 10310 9896 0 -1 4202560 30 934 0 0 0 0 0 0 22 0 9 0 548446733 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 1 0 0 0
[pid=10310/tid=10336] ppid=10308 vsize=432076 CPUtime=0 cores=0-7
/proc/10310/task/10336/stat : 10336 (python) S 10308 10310 9896 0 -1 4202560 31 934 0 0 0 0 0 0 23 0 9 0 548446736 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 1 0 0 0
[pid=10310/tid=10339] ppid=10308 vsize=432076 CPUtime=0 cores=0-7
/proc/10310/task/10339/stat : 10339 (python) S 10308 10310 9896 0 -1 4202560 34 934 0 0 0 0 0 0 24 0 9 0 548446752 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 27.43
Current children cumulated vsize (KiB) 8331148

[startup+12.7013 s]
/proc/loadavg: 7.39 8.08 7.19 10/335 10340
/proc/meminfo: memFree=7501568/32950928 swapFree=67111448/67111528
[pid=10310] ppid=10308 vsize=432076 CPUtime=2.64 cores=0-7
/proc/10310/stat : 10310 (python) S 10308 10310 9896 0 -1 4202496 20128 934 1 0 249 15 0 0 23 0 9 0 548446452 442445824 8857 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826066891 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/10310/statm: 108019 8857 1891 364 0 43916 0
[pid=10317] ppid=10310 vsize=284988 CPUtime=0.02 cores=0-7
/proc/10317/stat : 10317 (python) S 10310 10310 9896 0 -1 4202560 900 0 0 0 1 1 0 0 18 0 1 0 548446714 291827712 6923 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260239 0 0 16781312 514 12991899762545361153 0 0 17 4 0 0 0
/proc/10317/statm: 71247 6923 378 364 0 7165 0
[pid=10319] ppid=10317 vsize=1020308 CPUtime=10.07 cores=0-7
/proc/10319/stat : 10319 (gnovelty+2) R 10317 10319 10319 0 -1 4202496 1153 0 0 0 1007 0 0 0 25 0 1 0 548446714 1044795392 891 33554432000 134512640 135663704 4288936768 18446744073709551615 134525224 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/10319/statm: 255077 891 113 282 0 254793 0
[pid=10320] ppid=10310 vsize=294908 CPUtime=0 cores=0-7
/proc/10320/stat : 10320 (python) S 10310 10310 9896 0 -1 4202560 908 0 0 0 0 0 0 0 18 0 1 0 548446717 301985792 7056 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 4645908322136850692 0 0 17 1 0 0 0
/proc/10320/statm: 73727 7056 372 364 0 9642 0
[pid=10322] ppid=10320 vsize=1020308 CPUtime=10.01 cores=0-7
/proc/10322/stat : 10322 (gnovelty+2) R 10320 10322 10322 0 -1 4202496 1154 0 0 0 1001 0 0 0 25 0 1 0 548446718 1044795392 892 33554432000 134512640 135663704 4286887024 18446744073709551615 134545631 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/10322/statm: 255077 892 113 282 0 254793 0
[pid=10323] ppid=10310 vsize=305016 CPUtime=0 cores=0-7
/proc/10323/stat : 10323 (python) S 10310 10310 9896 0 -1 4202560 907 0 0 0 0 0 0 0 18 0 1 0 548446721 312336384 7058 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 18020085462793683202 0 0 17 1 0 0 0
/proc/10323/statm: 76254 7058 370 364 0 12166 0
[pid=10325] ppid=10323 vsize=423400 CPUtime=10 cores=0-7
/proc/10325/stat : 10325 (adaptg2wsat2009) R 10323 10325 10325 0 -1 4202496 2622 0 0 0 1000 0 0 0 25 0 1 0 548446721 433561600 2357 33554432000 134512640 135107411 4287735504 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10325/statm: 105850 2357 59 146 0 104726 0
[pid=10326] ppid=10310 vsize=380808 CPUtime=0.01 cores=0-7
/proc/10326/stat : 10326 (python) S 10310 10310 9896 0 -1 4202560 786 0 0 0 1 0 0 0 18 0 1 0 548446725 389947392 7235 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 4055848535143186689 0 0 17 1 0 0 0
/proc/10326/statm: 95202 7235 371 364 0 31111 0
[pid=10328] ppid=10326 vsize=423400 CPUtime=9.96 cores=0-7
/proc/10328/stat : 10328 (adaptg2wsat2009) R 10326 10328 10328 0 -1 4202496 2609 0 0 0 996 0 0 0 25 0 1 0 548446725 433561600 2358 33554432000 134512640 135107411 4288532640 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/10328/statm: 105850 2358 59 146 0 104726 0
[pid=10329] ppid=10310 vsize=391064 CPUtime=0.01 cores=0-7
/proc/10329/stat : 10329 (python) S 10310 10310 9896 0 -1 4202560 797 0 0 0 0 1 0 0 18 0 1 0 548446729 400449536 7209 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 4131825063500415234 0 0 17 1 0 0 0
/proc/10329/statm: 97766 7209 371 364 0 33672 0
[pid=10331] ppid=10329 vsize=423400 CPUtime=9.81 cores=0-7
/proc/10331/stat : 10331 (adaptg2wsat2009) R 10329 10331 10331 0 -1 4202496 2612 0 0 0 981 0 0 0 25 0 1 0 548446729 433561600 2358 33554432000 134512640 135107411 4288332224 18446744073709551615 134531781 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10331/statm: 105850 2358 59 146 0 104726 0
[pid=10332] ppid=10310 vsize=401320 CPUtime=0 cores=0-7
/proc/10332/stat : 10332 (python) S 10310 10310 9896 0 -1 4202560 809 0 0 0 0 0 0 0 18 0 1 0 548446732 410951680 7230 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 18020081614502985986 0 0 17 1 0 0 0
/proc/10332/statm: 100330 7230 371 364 0 36233 0
[pid=10334] ppid=10332 vsize=1020308 CPUtime=6.82 cores=0-7
/proc/10334/stat : 10334 (gnovelty+2) R 10332 10334 10334 0 -1 4202496 1151 0 0 0 682 0 0 0 25 0 1 0 548446734 1044795392 892 33554432000 134512640 135663704 4288510256 18446744073709551615 134544189 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/10334/statm: 255077 892 113 282 0 254793 0
[pid=10335] ppid=10310 vsize=411576 CPUtime=0 cores=0-7
/proc/10335/stat : 10335 (python) S 10310 10310 9896 0 -1 4202560 817 0 0 0 0 0 0 0 18 0 1 0 548446736 421453824 7200 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 1138156442130284803 0 0 17 1 0 0 0
/proc/10335/statm: 102894 7200 371 364 0 38794 0

################
# More data... #
################

/proc/10405/stat : 10405 (python) S 10310 10310 9896 0 -1 4202560 955 0 0 0 135 132 0 0 18 0 1 0 548489461 568483840 7565 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 12991899762545361156 0 0 17 1 0 0 0
/proc/10405/statm: 138790 7565 372 364 0 74648 0
[pid=10407] ppid=10405 vsize=461512 CPUtime=757.58 cores=0-7
/proc/10407/stat : 10407 (TNM) R 10405 10407 10407 0 -1 4202496 2470 0 0 0 75757 1 0 0 25 0 1 0 548489461 472588288 2195 33554432000 134512640 135008748 4292634240 18446744073709551615 134527914 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/10407/statm: 115378 2195 46 122 0 114278 0
[pid=10411] ppid=10310 vsize=565416 CPUtime=0.26 cores=0-7
/proc/10411/stat : 10411 (python) S 10310 10310 9896 0 -1 4202560 1167 0 0 0 13 13 0 0 19 0 2 0 548499645 578985984 7559 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/10411/statm: 141354 7559 407 364 0 77209 0
[pid=10413] ppid=10411 vsize=1020308 CPUtime=99.85 cores=0-7
/proc/10413/stat : 10413 (gnovelty+2) T 10411 10413 10413 0 -1 4202496 1168 0 0 0 9985 0 0 0 25 0 1 0 548499645 1044795392 891 33554432000 134512640 135663704 4291959504 18446744073709551615 134525276 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/10413/statm: 255077 891 113 282 0 254793 0
[pid=10411/tid=10422] ppid=10310 vsize=565416 CPUtime=0 cores=0-7
/proc/10411/task/10422/stat : 10422 (python) S 10310 10310 9896 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 548509676 578985984 7559 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 514 18446604453880859456 0 0 -1 2 0 0 0
[pid=10416] ppid=10310 vsize=575672 CPUtime=0.32 cores=0-7
/proc/10416/stat : 10416 (python) S 10310 10310 9896 0 -1 4202560 1182 0 0 0 14 18 0 0 19 0 2 0 548505721 589488128 7564 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/10416/statm: 143918 7564 407 364 0 79770 0
[pid=10418] ppid=10416 vsize=335996 CPUtime=97.24 cores=0-7
/proc/10418/stat : 10418 (iPAWS) T 10416 10418 10418 0 -1 4202496 2055 0 0 0 9724 0 0 0 25 0 1 0 548505723 344059904 1774 33554432000 134512640 135114423 4287372816 18446744073709551615 134516658 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/10418/statm: 83999 1774 59 147 0 83851 0
[pid=10416/tid=10425] ppid=10310 vsize=575672 CPUtime=0 cores=0-7
/proc/10416/task/10425/stat : 10425 (python) S 10310 10310 9896 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 548518155 589488128 7564 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 514 18446604450310029696 0 0 -1 2 0 0 0
[pid=10426] ppid=10310 vsize=585928 CPUtime=1.65 cores=0-7
/proc/10426/stat : 10426 (python) S 10310 10310 9896 0 -1 4202560 1203 0 0 0 91 74 0 0 18 0 2 0 548518163 599990272 7522 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/10426/statm: 146482 7522 406 364 0 82331 0
[pid=10428] ppid=10426 vsize=268420 CPUtime=490.09 cores=0-7
/proc/10428/stat : 10428 (hybridGM3) T 10426 10428 10428 0 -1 4202496 6199 0 0 0 49008 1 0 0 25 0 1 0 548518164 274862080 5918 33554432000 134512640 135204385 4290641472 18446744073709551615 134537726 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/10428/statm: 67105 5918 63 169 0 66935 0
[pid=10426/tid=10441] ppid=10310 vsize=585928 CPUtime=0 cores=0-7
/proc/10426/task/10441/stat : 10441 (python) S 10310 10310 9896 0 -1 4202560 86 0 0 0 0 0 0 0 18 0 2 0 548542638 599990272 7522 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 514 18446604450310032384 0 0 -1 4 0 0 0
[pid=10429] ppid=10310 vsize=596184 CPUtime=1.89 cores=0-7
/proc/10429/stat : 10429 (python) S 10310 10310 9896 0 -1 4202560 982 0 0 0 94 95 0 0 18 0 1 0 548519077 610492416 7557 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 12991899762545361154 0 0 17 1 0 0 0
/proc/10429/statm: 149046 7557 372 364 0 84892 0
[pid=10431] ppid=10429 vsize=461504 CPUtime=672.29 cores=0-7
/proc/10431/stat : 10431 (TNM) R 10429 10431 10431 0 -1 4202496 2477 0 0 0 67229 0 0 0 25 0 1 0 548519077 472580096 2194 33554432000 134512640 135008748 4290986000 18446744073709551615 134527524 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10431/statm: 115376 2194 46 122 0 114276 0
[pid=10436] ppid=10310 vsize=606440 CPUtime=0.31 cores=0-7
/proc/10436/stat : 10436 (python) S 10310 10310 9896 0 -1 4202560 1179 0 0 0 15 16 0 0 19 0 2 0 548535206 620994560 7626 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/10436/statm: 151610 7626 400 364 0 87453 0
[pid=10438] ppid=10436 vsize=335996 CPUtime=97.14 cores=0-7
/proc/10438/stat : 10438 (iPAWS) T 10436 10438 10438 0 -1 4202496 2055 0 0 0 9714 0 0 0 25 0 1 0 548535207 344059904 1774 33554432000 134512640 135114423 4288043712 18446744073709551615 134517397 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/10438/statm: 83999 1774 59 147 0 83851 0
[pid=10436/tid=10444] ppid=10310 vsize=606440 CPUtime=0 cores=0-7
/proc/10436/task/10444/stat : 10444 (python) S 10310 10310 9896 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 548547037 620994560 7626 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 514 18446604445404467584 0 0 -1 2 0 0 0
[pid=10447] ppid=10310 vsize=616696 CPUtime=0.31 cores=0-7
/proc/10447/stat : 10447 (python) S 10310 10310 9896 0 -1 4202560 1198 0 0 0 15 16 0 0 19 0 2 0 548555328 631496704 7633 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/10447/statm: 154174 7633 400 364 0 90014 0
[pid=10449] ppid=10447 vsize=253036 CPUtime=97.61 cores=0-7
/proc/10449/stat : 10449 (FH) T 10447 10449 10449 0 -1 4202496 2514 0 0 0 9760 1 0 0 25 0 1 0 548555329 259108864 2233 33554432000 134512640 134936988 4289559728 18446744073709551615 134552080 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/10449/statm: 63259 2233 41 104 0 62763 0
[pid=10447/tid=10453] ppid=10310 vsize=616696 CPUtime=0 cores=0-7
/proc/10447/task/10453/stat : 10453 (python) S 10310 10310 9896 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 548567159 631496704 7633 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 514 18446604451343124288 0 0 -1 2 0 0 0
[pid=10454] ppid=10310 vsize=626952 CPUtime=0.6 cores=0-7
/proc/10454/stat : 10454 (python) S 10310 10310 9896 0 -1 4202560 1005 0 0 0 32 28 0 0 18 0 1 0 548567169 641998848 7581 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 12991899762545361154 0 0 17 3 0 0 0
/proc/10454/statm: 156738 7581 373 364 0 92575 0
[pid=10456] ppid=10454 vsize=423312 CPUtime=205.84 cores=0-7
/proc/10456/stat : 10456 (NCVWr) R 10454 10456 10456 0 -1 4202496 2548 0 0 0 20584 0 0 0 25 0 1 0 548567170 433471488 2266 33554432000 134512640 135113558 4293873984 18446744073709551615 134531326 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10456/statm: 105828 2266 58 147 0 104703 0
[pid=10458] ppid=10310 vsize=637208 CPUtime=0.35 cores=0-7
/proc/10458/stat : 10458 (python) S 10310 10310 9896 0 -1 4202560 1233 0 0 0 18 17 0 0 19 0 2 0 548569412 652500992 7707 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/10458/statm: 159302 7707 406 364 0 95136 0
[pid=10460] ppid=10458 vsize=335996 CPUtime=98.04 cores=0-7
/proc/10460/stat : 10460 (iPAWS) T 10458 10460 10460 0 -1 4202496 2064 0 0 0 9804 0 0 0 25 0 1 0 548569412 344059904 1774 33554432000 134512640 135114423 4291619296 18446744073709551615 134515629 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/10460/statm: 83999 1774 59 147 0 83851 0
[pid=10458/tid=10470] ppid=10310 vsize=637208 CPUtime=0 cores=0-7
/proc/10458/task/10470/stat : 10470 (python) S 10310 10310 9896 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 548582446 652500992 7707 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 514 18446604440550642880 0 0 -1 1 0 0 0
[pid=10463] ppid=10310 vsize=647464 CPUtime=0.29 cores=0-7
/proc/10463/stat : 10463 (python) S 10310 10310 9896 0 -1 4202560 1237 0 0 0 15 14 0 0 19 0 2 0 548579494 663003136 7631 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826066891 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/10463/statm: 161866 7631 406 364 0 97697 0
[pid=10465] ppid=10463 vsize=1020308 CPUtime=100.65 cores=0-7
/proc/10465/stat : 10465 (gnovelty+2) T 10463 10465 10465 0 -1 4202496 1177 0 0 0 10064 1 0 0 25 0 1 0 548579495 1044795392 892 33554432000 134512640 135663704 4291651824 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/10465/statm: 255077 892 113 282 0 254793 0
[pid=10463/tid=10473] ppid=10310 vsize=647464 CPUtime=0 cores=0-7
/proc/10463/task/10473/stat : 10473 (python) S 10310 10310 9896 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 548590134 663003136 7631 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 514 18446604440550641984 0 0 -1 1 0 0 0
[pid=10466] ppid=10310 vsize=657720 CPUtime=0.27 cores=0-7
/proc/10466/stat : 10466 (python) S 10310 10310 9896 0 -1 4202560 1055 0 0 0 13 14 0 0 18 0 1 0 548579671 673505280 7699 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 12991899762545361154 0 0 17 1 0 0 0
/proc/10466/statm: 164430 7699 379 364 0 100258 0
[pid=10468] ppid=10466 vsize=268420 CPUtime=103.69 cores=0-7
/proc/10468/stat : 10468 (hybridGM3) R 10466 10468 10468 0 -1 4202496 6208 0 0 0 10369 0 0 0 25 0 1 0 548579672 274862080 5919 33554432000 134512640 135204385 4290969680 18446744073709551615 134538282 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/10468/statm: 67105 5919 63 169 0 66935 0
[pid=10474] ppid=10310 vsize=667976 CPUtime=0 cores=0-7
/proc/10474/stat : 10474 (python) S 10310 10310 9896 0 -1 4202560 932 0 0 0 0 0 0 0 19 0 1 0 548590145 684007424 7661 33554432000 4194304 5683644 140736360345696 18446744073709551615 251814260294 0 0 16781312 514 18399517304812470271 0 0 17 1 0 0 0
/proc/10474/statm: 166994 7661 352 364 0 102819 0
[pid=10476] ppid=10474 vsize=335996 CPUtime=0.35 cores=0-7
/proc/10476/stat : 10476 (iPAWS) R 10474 10476 10476 0 -1 4202496 2061 0 0 0 35 0 0 0 21 0 1 0 548590146 344059904 1773 33554432000 134512640 135114423 4294667376 18446744073709551615 134546153 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10476/statm: 83999 1773 59 147 0 83851 0
[pid=10310/tid=10318] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10318/stat : 10318 (python) S 10308 10310 9896 0 -1 4202560 26 934 0 0 0 0 0 0 20 0 33 0 548446714 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 4 0 0 0
[pid=10310/tid=10321] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10321/stat : 10321 (python) S 10308 10310 9896 0 -1 4202560 22 934 0 0 0 0 0 0 21 0 33 0 548446718 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 4 0 0 0
[pid=10310/tid=10324] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10324/stat : 10324 (python) S 10308 10310 9896 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 33 0 548446721 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 3 0 0 0
[pid=10310/tid=10327] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10327/stat : 10327 (python) S 10308 10310 9896 0 -1 4202560 102 934 0 0 0 0 0 0 18 0 33 0 548446725 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 0 0 0 0
[pid=10310/tid=10330] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10330/stat : 10330 (python) S 10308 10310 9896 0 -1 4202560 42 934 0 0 0 0 0 0 18 0 33 0 548446729 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 7 0 0 0
[pid=10310/tid=10333] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10333/stat : 10333 (python) S 10308 10310 9896 0 -1 4202560 30 934 0 0 0 0 0 0 22 0 33 0 548446733 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 1 0 0 0
[pid=10310/tid=10336] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10336/stat : 10336 (python) S 10308 10310 9896 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 33 0 548446736 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10339] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10339/stat : 10339 (python) S 10308 10310 9896 0 -1 4202560 54 934 0 0 0 0 0 0 18 0 33 0 548446752 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10347] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10347/stat : 10347 (python) S 10308 10310 9896 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 33 0 548456746 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 2 0 0 0
[pid=10310/tid=10351] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10351/stat : 10351 (python) S 10308 10310 9896 0 -1 4202560 42 934 0 0 0 0 0 0 18 0 33 0 548456751 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 7 0 0 0
[pid=10310/tid=10356] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10356/stat : 10356 (python) S 10308 10310 9896 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 33 0 548456756 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10359] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10359/stat : 10359 (python) S 10308 10310 9896 0 -1 4202560 43 934 0 0 0 0 0 0 25 0 33 0 548456761 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10361] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10361/stat : 10361 (python) S 10308 10310 9896 0 -1 4202560 38 934 0 0 0 0 0 0 18 0 33 0 548456766 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 3 0 0 0
[pid=10310/tid=10366] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10366/stat : 10366 (python) S 10308 10310 9896 0 -1 4202560 51 934 0 0 0 0 0 0 18 0 33 0 548458574 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10370] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10370/stat : 10370 (python) S 10308 10310 9896 0 -1 4202560 48 934 0 0 0 0 0 0 18 0 33 0 548460409 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10375] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10375/stat : 10375 (python) S 10308 10310 9896 0 -1 4202560 37 934 0 0 0 0 0 0 18 0 33 0 548462185 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 3 0 0 0
[pid=10310/tid=10380] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10380/stat : 10380 (python) S 10308 10310 9896 0 -1 4202560 32 934 0 0 0 0 0 0 20 0 33 0 548466777 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10384] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10384/stat : 10384 (python) S 10308 10310 9896 0 -1 4202560 39 934 0 0 0 0 0 0 18 0 33 0 548467988 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10399] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10399/stat : 10399 (python) S 10308 10310 9896 0 -1 4202560 53 934 0 0 0 0 0 0 18 0 33 0 548485553 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10403] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10403/stat : 10403 (python) S 10308 10310 9896 0 -1 4202560 46 934 0 0 0 0 0 0 18 0 33 0 548487054 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10406] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10406/stat : 10406 (python) S 10308 10310 9896 0 -1 4202560 35 934 0 0 0 0 0 0 19 0 33 0 548489461 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10412] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10412/stat : 10412 (python) S 10308 10310 9896 0 -1 4202560 40 934 0 0 0 0 0 0 20 0 33 0 548499645 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 6 0 0 0
[pid=10310/tid=10417] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10417/stat : 10417 (python) S 10308 10310 9896 0 -1 4202560 39 934 0 0 0 0 0 0 19 0 33 0 548505722 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 3 0 0 0
[pid=10310/tid=10427] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10427/stat : 10427 (python) S 10308 10310 9896 0 -1 4202560 47 934 0 0 0 0 0 0 18 0 33 0 548518164 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 0 0 0 0
[pid=10310/tid=10430] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10430/stat : 10430 (python) S 10308 10310 9896 0 -1 4202560 32 934 0 0 0 0 0 0 19 0 33 0 548519077 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 0 0 0 0
[pid=10310/tid=10437] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10437/stat : 10437 (python) S 10308 10310 9896 0 -1 4202560 35 934 0 0 0 0 0 0 19 0 33 0 548535206 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 3 0 0 0
[pid=10310/tid=10448] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10448/stat : 10448 (python) S 10308 10310 9896 0 -1 4202560 36 934 0 0 0 0 0 0 20 0 33 0 548555328 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 0 0 0 0
[pid=10310/tid=10455] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10455/stat : 10455 (python) S 10308 10310 9896 0 -1 4202560 38 934 0 0 0 0 0 0 19 0 33 0 548567169 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 0 0 0 0
[pid=10310/tid=10459] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10459/stat : 10459 (python) S 10308 10310 9896 0 -1 4202560 33 934 0 0 0 0 0 0 19 0 33 0 548569412 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 0 0 0 0
[pid=10310/tid=10464] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10464/stat : 10464 (python) S 10308 10310 9896 0 -1 4202560 34 934 0 0 0 0 0 0 19 0 33 0 548579494 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 0 0 0 0
[pid=10310/tid=10467] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10467/stat : 10467 (python) S 10308 10310 9896 0 -1 4202560 33 934 0 0 0 0 0 0 19 0 33 0 548579672 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 0 0 0 0
[pid=10310/tid=10475] ppid=10308 vsize=678220 CPUtime=0 cores=0-7
/proc/10310/task/10475/stat : 10475 (python) S 10308 10310 9896 0 -1 4202560 39 934 0 0 0 0 0 0 19 0 33 0 548590145 694497280 9253 33554432000 4194304 5683644 140736360345696 18446744073709551615 251826063793 0 0 16781312 2 18446604452051961920 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10051.9
Current children cumulated vsize (KiB) 31885396

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10310 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=912949
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=277957
# CPU time returned by wait4() is 7.19091
# while last known CPU time is 10051.9
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1437.81
CPU time (s): 10051.9
CPU user time (s): 10036.9
CPU system time (s): 14.99
CPU usage (%): 699.114
Max. virtual memory (cumulated for all children) (KiB): 31885396

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.91295
system time used= 0.277957
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 73628
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3232
involuntary context switches= 131

runsolver used 14.3638 second user time and 34.5727 second system time

The end

Launcher Data

Begin job on node126 at 2011-05-02 22:34:37
IDJOB=3321858
IDBENCH=82636
IDSOLVER=1712
FILE ID=node126/3321858-1304368477
RUNJOBID= node126-1304366466-9910
PBS_JOBID= 13181745
Free space on /tmp= 73624 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k5-r20-v2000-c40000-S971556279-001-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321858-1304368477/watcher-3321858-1304368477 -o /tmp/evaluation-result-3321858-1304368477/solver-3321858-1304368477 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321858-1304368477.cnf -seed 492488376 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 9224277e61359574518ca553717e02ee
RANDOM SEED=492488376

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       7614420 kB
Buffers:        346840 kB
Cached:        2036372 kB
SwapCached:         76 kB
Active:       23071152 kB
Inactive:      1869404 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       7614420 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:           32724 kB
Writeback:           0 kB
AnonPages:    22557132 kB
Mapped:          26216 kB
Slab:           264400 kB
PageTables:      63072 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 56442392 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73592 MiB
End job on node126 at 2011-05-02 22:58:37