Trace number 3385346

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 8602.94 1083.61

General information on the benchmark

Namerandom/large/
unif-k5-r20-v1500-c30000-S969405384-096-UNKNOWN.cnf
MD5SUM6e345981a96012731da9bd2ce5420289
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1088.25
Satisfiable
(Un)Satisfiability was proved
Number of variables1500
Number of clauses30000
Sum of the clauses size150000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530000
Number of clauses of size over 50

Solver Data 

0.35/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.35/0.68	c INFO: solving HOME/instance-3385346-1305565416.cnf
0.35/0.68	c INFO: computing task features
0.53/0.84	c INFO: computed variable-clause graph statistics
0.53/0.84	c INFO: computed clause balance statistics
1.33/1.63	c INFO: computed variable balance statistics
1.73/2.08	c INFO: computed small-clause counts
1.73/2.08	c INFO: computed Horn-clause counts
1.84/2.11	c INFO: computed variable graph statistics
1.84/2.11	c INFO: collected features for HOME/instance-3385346-1305565416.cnf in 1.42 s
1.84/2.14	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.38)
1.84/2.17	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.14)
1.84/2.20	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.09)
1.94/2.23	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
1.94/2.27	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.06)
2.03/2.30	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.05)
2.03/2.33	c INFO: running FH@0 for 97 with 4998 remaining (b = 0.04)
2.03/2.36	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.03)
786.29/101.47	c INFO: running adaptg2wsat2009++@0 for 97 with 4899 remaining (b = 0.03)
787.06/101.52	c INFO: running FH@0 for 97 with 4899 remaining (b = 0.02)
794.25/102.48	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.04)
794.99/102.53	c INFO: running gnovelty+2@0 for 97 with 4898 remaining (b = 0.02)
794.99/102.57	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.03)
795.55/102.61	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.03)
795.55/102.66	c INFO: running TNM@0 for 1552 with 4898 remaining (b = 0.21)
838.58/108.03	c INFO: running adaptg2wsat2009++@0 for 97 with 4892 remaining (b = 0.02)
1584.27/201.75	c INFO: running FH@0 for 97 with 4798 remaining (b = 0.01)
1585.00/201.81	c INFO: running hybridGM3@0 for 194 with 4798 remaining (b = 0.02)
1592.98/202.86	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
1636.79/208.32	c INFO: running adaptg2wsat2009++@0 for 97 with 4792 remaining (b = 0.01)
2359.68/299.04	c INFO: running hybridGM3@97 for 97 with 4701 remaining (b = 0.01)
2360.53/299.16	c INFO: running adaptg2wsat2009++@0 for 97 with 4701 remaining (b = 0.01)
2361.34/299.23	c INFO: running hybridGM3@99 for 97 with 4701 remaining (b = 0.01)
2383.55/302.05	c INFO: running adaptg2wsat2009++@99 for 97 with 4698 remaining (b = 0.01)
2408.23/305.17	c INFO: running hybridGM3@99 for 97 with 4695 remaining (b = 0.01)
2411.40/305.59	c INFO: running gnovelty+2@0 for 97 with 4695 remaining (b = 0.01)
3135.83/396.44	c INFO: running hybridGM3@0 for 194 with 4604 remaining (b = 0.02)
3135.83/396.49	c INFO: running hybridGM3@100 for 97 with 4604 remaining (b = 0.01)
3150.89/398.34	c INFO: running hybridGM3@0 for 194 with 4602 remaining (b = 0.02)
3166.88/400.32	c INFO: running hybridGM3@193 for 97 with 4600 remaining (b = 0.01)
3167.70/400.44	c INFO: running TNM@0 for 1455 with 4600 remaining (b = 0.14)
3168.35/400.51	c INFO: running adaptg2wsat2009++@98 for 97 with 4600 remaining (b = 0.01)
3211.44/405.92	c INFO: running FH@0 for 291 with 4594 remaining (b = 0.03)
3925.39/495.58	c INFO: running iPAWS@0 for 97 with 4505 remaining (b = 0.01)
3929.40/496.05	c INFO: running hybridGM3@0 for 194 with 4504 remaining (b = 0.02)
3942.84/497.79	c INFO: running adaptg2wsat2009++@297 for 291 with 4502 remaining (b = 0.03)
4716.54/594.92	c INFO: running hybridGM3@101 for 97 with 4405 remaining (b = 0.01)
4723.67/595.87	c INFO: running FH@98 for 291 with 4404 remaining (b = 0.03)
4741.13/598.07	c INFO: running iPAWS@0 for 97 with 4402 remaining (b = 0.01)
5474.26/690.20	c INFO: running hybridGM3@0 for 194 with 4310 remaining (b = 0.02)
5494.14/692.63	c INFO: running hybridGM3@97 for 97 with 4308 remaining (b = 0.01)
5531.62/697.37	c INFO: running TNM@0 for 1552 with 4303 remaining (b = 0.12)
5613.48/707.67	c INFO: running gnovelty+2@0 for 97 with 4293 remaining (b = 0.01)
6289.19/792.60	c INFO: running adaptg2wsat2009++@494 for 97 with 4208 remaining (b = 0.01)
6292.36/792.94	c INFO: running hybridGM3@0 for 194 with 4207 remaining (b = 0.01)
6412.50/808.02	c INFO: running adaptg2wsat2009++@99 for 97 with 4192 remaining (b = 0.01)
7039.67/886.80	c INFO: running FH@0 for 97 with 4113 remaining (b = 0.01)
7077.83/891.63	c INFO: running FH@298 for 97 with 4109 remaining (b = 0.01)
7096.16/893.92	c INFO: running hybridGM3@0 for 194 with 4106 remaining (b = 0.01)
7226.55/910.35	c INFO: running adaptg2wsat2009++@296 for 291 with 4090 remaining (b = 0.02)
7835.66/986.94	c INFO: running NCVWr@0 for 485 with 4013 remaining (b = 0.03)
7837.11/987.13	c INFO: running FH@291 for 97 with 4013 remaining (b = 0.01)
7856.29/989.55	c INFO: running hybridGM3@98 for 97 with 4011 remaining (b = 0.01)
8594.90/1082.42	c INFO: running iPAWS@0 for 97 with 3918 remaining (b = 0.01)
8602.94/1083.58	c INFO: running hybridGM3@0 for 194 with 3917 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385346-1305565416/watcher-3385346-1305565416 -o /tmp/evaluation-result-3385346-1305565416/solver-3385346-1305565416 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385346-1305565416.cnf -seed 1084427613 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.23 6.32 3.11 2/283 26644
/proc/meminfo: memFree=16178088/32951132 swapFree=67093824/67111528
[pid=26644] ppid=26642 vsize=15760 CPUtime=0 cores=0-7
/proc/26644/stat : 26644 (python) R 26642 26644 26485 0 -1 4202496 842 0 0 0 0 0 0 0 23 0 1 0 668141247 16138240 726 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664808080 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/26644/statm: 3941 727 334 364 0 428 0

[startup+0.029857 s]
/proc/loadavg: 8.23 6.32 3.11 2/283 26644
/proc/meminfo: memFree=16178088/32951132 swapFree=67093824/67111528
[pid=26644] ppid=26642 vsize=16400 CPUtime=0.01 cores=0-7
/proc/26644/stat : 26644 (python) S 26642 26644 26485 0 -1 4202496 1121 0 0 0 1 0 0 0 24 0 1 0 668141247 16793600 989 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664806400 0 2147483391 16781312 2 18446744071699109054 0 0 17 6 0 0 0
/proc/26644/statm: 4100 989 413 364 0 587 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16400

[startup+0.100868 s]
/proc/loadavg: 8.23 6.32 3.11 2/283 26644
/proc/meminfo: memFree=16178088/32951132 swapFree=67093824/67111528
[pid=26644] ppid=26642 vsize=85624 CPUtime=0.05 cores=0-7
/proc/26644/stat : 26644 (python) S 26642 26644 26485 0 -1 4202496 2629 0 0 0 4 1 0 0 18 0 1 0 668141247 87678976 2348 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664806400 0 2147483391 16781312 2 18446744071699109054 0 0 17 6 0 0 0
/proc/26644/statm: 21406 2348 713 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85624

[startup+0.300813 s]
/proc/loadavg: 8.23 6.32 3.11 2/283 26644
/proc/meminfo: memFree=16178088/32951132 swapFree=67093824/67111528
[pid=26644] ppid=26642 vsize=135752 CPUtime=0.18 cores=0-7
/proc/26644/stat : 26644 (python) S 26642 26644 26485 0 -1 4202496 5961 935 1 0 13 5 0 0 17 0 1 0 668141247 139010048 4151 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664804357 0 2147483391 16781312 2 18446744071699109054 0 0 17 6 0 0 0
/proc/26644/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.700752 s]
/proc/loadavg: 8.23 6.32 3.11 2/283 26644
/proc/meminfo: memFree=16178088/32951132 swapFree=67093824/67111528
[pid=26644] ppid=26642 vsize=279488 CPUtime=0.43 cores=0-7
/proc/26644/stat : 26644 (python) R 26642 26644 26485 0 -1 4202496 9538 935 1 0 32 11 0 0 16 0 1 0 668141247 286195712 7221 33554432000 4194304 5683644 140734312876448 18446744073709551615 47505539156759 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/26644/statm: 69872 7221 1761 364 0 5796 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 279488

[startup+1.50057 s]
/proc/loadavg: 8.23 6.32 3.11 2/284 26649
/proc/meminfo: memFree=16147824/32951132 swapFree=67093824/67111528
[pid=26644] ppid=26642 vsize=287592 CPUtime=1.23 cores=0-7
/proc/26644/stat : 26644 (python) R 26642 26644 26485 0 -1 4202496 12681 935 1 0 111 12 0 0 17 0 1 0 668141247 294494208 9282 33554432000 4194304 5683644 140734312876448 18446744073709551615 4603055 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/26644/statm: 71898 9282 1826 364 0 7822 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 287592

[startup+3.10026 s]
/proc/loadavg: 8.23 6.32 3.11 2/284 26649
/proc/meminfo: memFree=16147576/32951132 swapFree=67093824/67111528
[pid=26644] ppid=26642 vsize=430608 CPUtime=2.1 cores=0-7
/proc/26644/stat : 26644 (python) S 26642 26644 26485 0 -1 4202496 18509 935 1 0 196 14 0 0 21 0 9 0 668141247 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26644/statm: 107652 8382 1891 364 0 43549 0
Current children cumulated CPU time (s) 2.1
Current children cumulated vsize (KiB) 430608
heavy processes:

[startup+6.3017 s]
/proc/loadavg: 8.29 6.36 3.14 10/308 26673
/proc/meminfo: memFree=16080300/32951132 swapFree=67093824/67111528
[pid=26644] ppid=26642 vsize=430608 CPUtime=2.1 cores=0-7
/proc/26644/stat : 26644 (python) S 26642 26644 26485 0 -1 4202496 18509 935 1 0 196 14 0 0 21 0 9 0 668141247 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26644/statm: 107652 8382 1891 364 0 43549 0
[pid=26650] ppid=26644 vsize=283520 CPUtime=0.04 cores=0-7
/proc/26650/stat : 26650 (python) R 26644 26644 26485 0 -1 4202560 892 0 0 0 0 4 0 0 18 0 1 0 668141462 290324480 6601 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664851591 0 0 16781312 514 0 0 0 17 4 0 0 0
/proc/26650/statm: 70881 6601 372 364 0 6799 0
[pid=26652] ppid=26650 vsize=1018996 CPUtime=4.13 cores=0-7
/proc/26652/stat : 26652 (gnovelty+2) R 26650 26652 26652 0 -1 4202496 963 0 0 0 413 0 0 0 25 0 1 0 668141462 1043451904 697 33554432000 134512640 135663704 4294548432 18446744073709551615 134524677 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26652/statm: 254749 697 113 282 0 254465 0
[pid=26653] ppid=26644 vsize=293708 CPUtime=0 cores=0-7
/proc/26653/stat : 26653 (python) S 26644 26644 26485 0 -1 4202560 905 0 0 0 0 0 0 0 18 0 1 0 668141465 300756992 6688 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 10001953816963940611 0 0 17 5 0 0 0
/proc/26653/statm: 73427 6688 372 364 0 9342 0
[pid=26655] ppid=26653 vsize=1018996 CPUtime=3.87 cores=0-7
/proc/26655/stat : 26655 (gnovelty+2) R 26653 26655 26655 0 -1 4202496 959 0 0 0 387 0 0 0 25 0 1 0 668141465 1043451904 697 33554432000 134512640 135663704 4292004832 18446744073709551615 134547212 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/26655/statm: 254749 697 113 282 0 254465 0
[pid=26656] ppid=26644 vsize=369084 CPUtime=0 cores=0-7
/proc/26656/stat : 26656 (python) S 26644 26644 26485 0 -1 4202560 782 0 0 0 0 0 0 0 18 0 1 0 668141468 377942016 6863 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 10001957665254637828 0 0 17 7 0 0 0
/proc/26656/statm: 92271 6863 371 364 0 28183 0
[pid=26658] ppid=26656 vsize=421428 CPUtime=4.07 cores=0-7
/proc/26658/stat : 26658 (adaptg2wsat2009) R 26656 26658 26658 0 -1 4202496 2037 0 0 0 407 0 0 0 25 0 1 0 668141469 431542272 1781 33554432000 134512640 135107411 4287986064 18446744073709551615 134539327 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/26658/statm: 105357 1781 59 146 0 104233 0
[pid=26659] ppid=26644 vsize=379340 CPUtime=0 cores=0-7
/proc/26659/stat : 26659 (python) S 26644 26644 26485 0 -1 4202560 798 0 0 0 0 0 0 0 18 0 1 0 668141471 388444160 6824 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 10001961513545335042 0 0 17 6 0 0 0
/proc/26659/statm: 94835 6824 371 364 0 30744 0
[pid=26661] ppid=26659 vsize=421428 CPUtime=2.78 cores=0-7
/proc/26661/stat : 26661 (adaptg2wsat2009) R 26659 26661 26661 0 -1 4202496 2036 0 0 0 269 9 0 0 25 0 1 0 668141472 431542272 1782 33554432000 134512640 135107411 4286820400 18446744073709551615 134531239 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/26661/statm: 105357 1782 59 146 0 104233 0
[pid=26662] ppid=26644 vsize=389596 CPUtime=0 cores=0-7
/proc/26662/stat : 26662 (python) S 26644 26644 26485 0 -1 4202560 802 0 0 0 0 0 0 0 18 0 1 0 668141475 398946304 6845 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 13935321425402364161 0 0 17 0 0 0 0
/proc/26662/statm: 97399 6845 370 364 0 33305 0
[pid=26664] ppid=26662 vsize=421428 CPUtime=3.91 cores=0-7
/proc/26664/stat : 26664 (adaptg2wsat2009) R 26662 26664 26664 0 -1 4202496 2042 0 0 0 391 0 0 0 25 0 1 0 668141475 431542272 1782 33554432000 134512640 135107411 4294682000 18446744073709551615 134532036 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26664/statm: 105357 1782 59 146 0 104233 0
[pid=26665] ppid=26644 vsize=399852 CPUtime=0 cores=0-7
/proc/26665/stat : 26665 (python) S 26644 26644 26485 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 668141478 409448448 6810 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 2439798439265927425 0 0 17 6 0 0 0
/proc/26665/statm: 99963 6810 348 364 0 35866 0
[pid=26667] ppid=26665 vsize=1018996 CPUtime=3.97 cores=0-7
/proc/26667/stat : 26667 (gnovelty+2) R 26665 26667 26667 0 -1 4202496 955 0 0 0 397 0 0 0 25 0 1 0 668141478 1043451904 697 33554432000 134512640 135663704 4289273184 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/26667/statm: 254749 697 113 282 0 254465 0
[pid=26668] ppid=26644 vsize=410108 CPUtime=0 cores=0-7
/proc/26668/stat : 26668 (python) S 26644 26644 26485 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 668141481 419950592 6934 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 2952392134524633348 0 0 17 0 0 0 0
/proc/26668/statm: 102527 6934 348 364 0 38427 0
[pid=26670] ppid=26668 vsize=251292 CPUtime=3.91 cores=0-7
/proc/26670/stat : 26670 (FH) R 26668 26670 26670 0 -1 4202496 1944 0 0 0 391 0 0 0 25 0 1 0 668141483 257323008 1683 33554432000 134512640 134936988 4289433584 18446744073709551615 134554109 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26670/statm: 62823 1683 41 104 0 62327 0
[pid=26671] ppid=26644 vsize=420364 CPUtime=0.11 cores=0-7
/proc/26671/stat : 26671 (python) S 26644 26644 26485 0 -1 4202560 776 0 0 0 7 4 0 0 18 0 1 0 668141484 430452736 6841 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 9224958803932315907 0 0 17 7 0 0 0
/proc/26671/statm: 105091 6841 354 364 0 40988 0
[pid=26673] ppid=26671 vsize=421428 CPUtime=3.67 cores=0-7
/proc/26673/stat : 26673 (adaptg2wsat2009) R 26671 26673 26673 0 -1 4202496 2050 0 0 0 365 2 0 0 25 0 1 0 668141487 431542272 1783 33554432000 134512640 135107411 4294394816 18446744073709551615 134532326 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/26673/statm: 105357 1783 59 146 0 104233 0
[pid=26644/tid=26651] ppid=26642 vsize=430608 CPUtime=0 cores=0-7
/proc/26644/task/26651/stat : 26651 (python) S 26642 26644 26485 0 -1 4202560 29 935 0 0 0 0 0 0 19 0 9 0 668141462 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 4 0 0 0
[pid=26644/tid=26654] ppid=26642 vsize=430608 CPUtime=0 cores=0-7
/proc/26644/task/26654/stat : 26654 (python) S 26642 26644 26485 0 -1 4202560 25 935 0 0 0 0 0 0 18 0 9 0 668141465 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 3 0 0 0
[pid=26644/tid=26657] ppid=26642 vsize=430608 CPUtime=0 cores=0-7
/proc/26644/task/26657/stat : 26657 (python) S 26642 26644 26485 0 -1 4202560 84 935 0 0 0 0 0 0 19 0 9 0 668141468 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26660] ppid=26642 vsize=430608 CPUtime=0 cores=0-7
/proc/26644/task/26660/stat : 26660 (python) S 26642 26644 26485 0 -1 4202560 32 935 0 0 0 0 0 0 21 0 9 0 668141471 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 4 0 0 0
[pid=26644/tid=26663] ppid=26642 vsize=430608 CPUtime=0 cores=0-7
/proc/26644/task/26663/stat : 26663 (python) S 26642 26644 26485 0 -1 4202560 33 935 0 0 0 0 0 0 23 0 9 0 668141475 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26666] ppid=26642 vsize=430608 CPUtime=0 cores=0-7
/proc/26644/task/26666/stat : 26666 (python) S 26642 26644 26485 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 9 0 668141478 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 6 0 0 0
[pid=26644/tid=26669] ppid=26642 vsize=430608 CPUtime=0 cores=0-7
/proc/26644/task/26669/stat : 26669 (python) S 26642 26644 26485 0 -1 4202560 33 935 0 0 0 0 0 0 21 0 9 0 668141481 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26672] ppid=26642 vsize=430608 CPUtime=0 cores=0-7
/proc/26644/task/26672/stat : 26672 (python) S 26642 26644 26485 0 -1 4202560 36 935 0 0 0 0 0 0 22 0 9 0 668141484 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 32.56
Current children cumulated vsize (KiB) 8370172

[startup+12.7016 s]
/proc/loadavg: 8.59 6.46 3.19 11/308 26673
/proc/meminfo: memFree=16079852/32951132 swapFree=67093824/67111528
[pid=26644] ppid=26642 vsize=430608 CPUtime=2.1 cores=0-7
/proc/26644/stat : 26644 (python) S 26642 26644 26485 0 -1 4202496 18509 935 1 0 196 14 0 0 21 0 9 0 668141247 440942592 8382 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26644/statm: 107652 8382 1891 364 0 43549 0
[pid=26650] ppid=26644 vsize=283520 CPUtime=0.06 cores=0-7
/proc/26650/stat : 26650 (python) S 26644 26644 26485 0 -1 4202560 912 0 0 0 1 5 0 0 18 0 1 0 668141462 290324480 6607 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828431 0 0 16781312 514 12794920055406035204 0 0 17 4 0 0 0
/proc/26650/statm: 70880 6607 378 364 0 6798 0
[pid=26652] ppid=26650 vsize=1018996 CPUtime=10.53 cores=0-7
/proc/26652/stat : 26652 (gnovelty+2) R 26650 26652 26652 0 -1 4202496 963 0 0 0 1053 0 0 0 25 0 1 0 668141462 1043451904 697 33554432000 134512640 135663704 4294548432 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26652/statm: 254749 697 113 282 0 254465 0
[pid=26653] ppid=26644 vsize=293708 CPUtime=0.02 cores=0-7
/proc/26653/stat : 26653 (python) S 26644 26644 26485 0 -1 4202560 909 0 0 0 1 1 0 0 18 0 1 0 668141465 300756992 6688 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 12794920055406035203 0 0 17 5 0 0 0
/proc/26653/statm: 73427 6688 372 364 0 9342 0
[pid=26655] ppid=26653 vsize=1018996 CPUtime=8.91 cores=0-7
/proc/26655/stat : 26655 (gnovelty+2) R 26653 26655 26655 0 -1 4202496 959 0 0 0 891 0 0 0 25 0 1 0 668141465 1043451904 697 33554432000 134512640 135663704 4292004832 18446744073709551615 134525382 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/26655/statm: 254749 697 113 282 0 254465 0
[pid=26656] ppid=26644 vsize=369084 CPUtime=0.02 cores=0-7
/proc/26656/stat : 26656 (python) S 26644 26644 26485 0 -1 4202560 782 0 0 0 1 1 0 0 18 0 1 0 668141468 377942016 6863 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 12794920055406035204 0 0 17 7 0 0 0
/proc/26656/statm: 92271 6863 371 364 0 28183 0
[pid=26658] ppid=26656 vsize=421428 CPUtime=10.45 cores=0-7
/proc/26658/stat : 26658 (adaptg2wsat2009) R 26656 26658 26658 0 -1 4202496 2037 0 0 0 1045 0 0 0 25 0 1 0 668141469 431542272 1781 33554432000 134512640 135107411 4287986064 18446744073709551615 134531561 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/26658/statm: 105357 1781 59 146 0 104233 0
[pid=26659] ppid=26644 vsize=379340 CPUtime=0.02 cores=0-7
/proc/26659/stat : 26659 (python) S 26644 26644 26485 0 -1 4202560 798 0 0 0 1 1 0 0 18 0 1 0 668141471 388444160 6824 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 12794920055406035202 0 0 17 6 0 0 0
/proc/26659/statm: 94835 6824 371 364 0 30744 0
[pid=26661] ppid=26659 vsize=421428 CPUtime=9.18 cores=0-7
/proc/26661/stat : 26661 (adaptg2wsat2009) R 26659 26661 26661 0 -1 4202496 2036 0 0 0 909 9 0 0 25 0 1 0 668141472 431542272 1782 33554432000 134512640 135107411 4286820400 18446744073709551615 134531584 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/26661/statm: 105357 1782 59 146 0 104233 0
[pid=26662] ppid=26644 vsize=389596 CPUtime=0.01 cores=0-7
/proc/26662/stat : 26662 (python) S 26644 26644 26485 0 -1 4202560 803 0 0 0 1 0 0 0 18 0 1 0 668141475 398946304 6845 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 12794920055406035201 0 0 17 0 0 0 0
/proc/26662/statm: 97399 6845 370 364 0 33305 0
[pid=26664] ppid=26662 vsize=421428 CPUtime=10.29 cores=0-7
/proc/26664/stat : 26664 (adaptg2wsat2009) R 26662 26664 26664 0 -1 4202496 2042 0 0 0 1029 0 0 0 25 0 1 0 668141475 431542272 1782 33554432000 134512640 135107411 4294682000 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26664/statm: 105357 1782 59 146 0 104233 0
[pid=26665] ppid=26644 vsize=399852 CPUtime=0.02 cores=0-7
/proc/26665/stat : 26665 (python) S 26644 26644 26485 0 -1 4202560 811 0 0 0 1 1 0 0 18 0 1 0 668141478 409448448 6833 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 12794920055406035201 0 0 17 6 0 0 0
/proc/26665/statm: 99963 6833 371 364 0 35866 0
[pid=26667] ppid=26665 vsize=1018996 CPUtime=10.34 cores=0-7
/proc/26667/stat : 26667 (gnovelty+2) R 26665 26667 26667 0 -1 4202496 955 0 0 0 1034 0 0 0 25 0 1 0 668141478 1043451904 697 33554432000 134512640 135663704 4289273184 18446744073709551615 134525258 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/26667/statm: 254749 697 113 282 0 254465 0
[pid=26668] ppid=26644 vsize=410108 CPUtime=0.01 cores=0-7
/proc/26668/stat : 26668 (python) S 26644 26644 26485 0 -1 4202560 824 0 0 0 1 0 0 0 18 0 1 0 668141481 419950592 6957 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 12794920055406035204 0 0 17 0 0 0 0

################
# More data... #
################

[pid=26745] ppid=26743 vsize=459772 CPUtime=682.27 cores=0-7
/proc/26745/stat : 26745 (TNM) R 26743 26745 26745 0 -1 4202496 1936 0 0 0 68227 0 0 0 25 0 1 0 668181292 470806528 1652 33554432000 134512640 135008748 4287978432 18446744073709551615 134527729 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/26745/statm: 114943 1652 46 122 0 113843 0
[pid=26750] ppid=26644 vsize=574204 CPUtime=0.24 cores=0-7
/proc/26750/stat : 26750 (python) S 26644 26644 26485 0 -1 4202560 1200 0 0 0 14 10 0 0 19 0 2 0 668190806 587984896 7206 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26750/statm: 143551 7206 407 364 0 79403 0
[pid=26752] ppid=26750 vsize=335996 CPUtime=100.21 cores=0-7
/proc/26752/stat : 26752 (iPAWS) T 26750 26752 26752 0 -1 4202496 1835 0 0 0 10021 0 0 0 25 0 1 0 668190807 344059904 1548 33554432000 134512640 135114423 4293707056 18446744073709551615 134514774 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/26752/statm: 83999 1548 59 147 0 83851 0
[pid=26750/tid=26760] ppid=26644 vsize=574204 CPUtime=0 cores=0-7
/proc/26750/task/26760/stat : 26760 (python) S 26644 26644 26485 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 668200829 587984896 7206 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 514 18446604451628995008 0 0 -1 0 0 0 0
[pid=26753] ppid=26644 vsize=584460 CPUtime=0.73 cores=0-7
/proc/26753/stat : 26753 (python) S 26644 26644 26485 0 -1 4202560 1208 0 0 0 39 34 0 0 18 0 2 0 668190853 598487040 7271 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26753/statm: 146115 7271 406 364 0 81964 0
[pid=26755] ppid=26753 vsize=268424 CPUtime=296.65 cores=0-7
/proc/26755/stat : 26755 (hybridGM3) T 26753 26755 26755 0 -1 4202496 5830 0 0 0 29664 1 0 0 25 0 1 0 668190853 274866176 5544 33554432000 134512640 135204385 4286918480 18446744073709551615 134538355 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/26755/statm: 67106 5544 63 169 0 66936 0
[pid=26753/tid=26770] ppid=26644 vsize=584460 CPUtime=0 cores=0-7
/proc/26753/task/26770/stat : 26770 (python) S 26644 26644 26485 0 -1 4202560 85 0 0 0 0 0 0 0 18 0 2 0 668210505 598487040 7271 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 514 18446604444071185472 0 0 -1 4 0 0 0
[pid=26762] ppid=26644 vsize=594716 CPUtime=0.24 cores=0-7
/proc/26762/stat : 26762 (python) S 26644 26644 26485 0 -1 4202560 1189 0 0 0 14 10 0 0 19 0 2 0 668201055 608989184 7272 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26762/statm: 148679 7272 400 364 0 84525 0
[pid=26764] ppid=26762 vsize=335996 CPUtime=97.86 cores=0-7
/proc/26764/stat : 26764 (iPAWS) T 26762 26764 26764 0 -1 4202496 1831 0 0 0 9783 3 0 0 25 0 1 0 668201056 344059904 1546 33554432000 134512640 135114423 4291041152 18446744073709551615 134516996 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/26764/statm: 83999 1546 59 147 0 83851 0
[pid=26762/tid=26771] ppid=26644 vsize=594716 CPUtime=0 cores=0-7
/proc/26762/task/26771/stat : 26771 (python) S 26644 26644 26485 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 668210979 608989184 7272 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 514 18446604451296847936 0 0 -1 6 0 0 0
[pid=26767] ppid=26644 vsize=604972 CPUtime=0.49 cores=0-7
/proc/26767/stat : 26767 (python) S 26644 26644 26485 0 -1 4202560 1202 0 0 0 28 21 0 0 19 0 2 0 668210268 619491328 7328 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26767/statm: 151243 7328 401 364 0 87086 0
[pid=26769] ppid=26767 vsize=268428 CPUtime=196.48 cores=0-7
/proc/26769/stat : 26769 (hybridGM3) T 26767 26769 26769 0 -1 4202496 5828 0 0 0 19648 0 0 0 25 0 1 0 668210268 274870272 5544 33554432000 134512640 135204385 4289321648 18446744073709551615 134545494 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/26769/statm: 67107 5544 63 169 0 66937 0
[pid=26767/tid=26787] ppid=26644 vsize=604972 CPUtime=0 cores=0-7
/proc/26767/task/26787/stat : 26787 (python) S 26644 26644 26485 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 668229922 619491328 7328 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 514 18446604441826052864 0 0 -1 4 0 0 0
[pid=26772] ppid=26644 vsize=615228 CPUtime=0.96 cores=0-7
/proc/26772/stat : 26772 (python) S 26644 26644 26485 0 -1 4202560 1014 0 0 0 49 47 0 0 18 0 1 0 668210985 629993472 7238 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 12794920055406035203 0 0 17 5 0 0 0
/proc/26772/statm: 153807 7238 372 364 0 89647 0
[pid=26774] ppid=26772 vsize=459772 CPUtime=375.81 cores=0-7
/proc/26774/stat : 26774 (TNM) R 26772 26774 26774 0 -1 4202496 1935 0 0 0 37578 3 0 0 25 0 1 0 668210985 470806528 1652 33554432000 134512640 135008748 4287477920 18446744073709551615 134529158 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/26774/statm: 114943 1652 46 122 0 113843 0
[pid=26776] ppid=26644 vsize=625484 CPUtime=0.25 cores=0-7
/proc/26776/stat : 26776 (python) S 26644 26644 26485 0 -1 4202560 1207 0 0 0 13 12 0 0 19 0 2 0 668212015 640495616 7327 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/26776/statm: 156371 7327 401 364 0 92208 0
[pid=26778] ppid=26776 vsize=1018996 CPUtime=98.59 cores=0-7
/proc/26778/stat : 26778 (gnovelty+2) T 26776 26778 26778 0 -1 4202496 979 0 0 0 9857 2 0 0 25 0 1 0 668212015 1043451904 698 33554432000 134512640 135663704 4294580192 18446744073709551615 134524897 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/26778/statm: 254749 698 113 282 0 254465 0
[pid=26776/tid=26784] ppid=26644 vsize=625484 CPUtime=0 cores=0-7
/proc/26776/task/26784/stat : 26784 (python) S 26644 26644 26485 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 668222043 640495616 7327 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 514 18446604453848674688 0 0 -1 1 0 0 0
[pid=26781] ppid=26644 vsize=635740 CPUtime=0.71 cores=0-7
/proc/26781/stat : 26781 (python) S 26644 26644 26485 0 -1 4202560 1268 0 0 0 40 31 0 0 18 0 2 0 668220542 650997760 7309 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26781/statm: 158935 7309 406 364 0 94769 0
[pid=26783] ppid=26781 vsize=268424 CPUtime=287.83 cores=0-7
/proc/26783/stat : 26783 (hybridGM3) R 26781 26783 26783 0 -1 4202496 5836 0 0 0 28778 5 0 0 25 0 1 0 668220543 274866176 5544 33554432000 134512640 135204385 4290781984 18446744073709551615 134538034 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/26783/statm: 67106 5544 63 169 0 66936 0
[pid=26781/tid=26801] ppid=26644 vsize=635740 CPUtime=0 cores=0-7
/proc/26781/task/26801/stat : 26801 (python) S 26644 26644 26485 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 668240196 650997760 7309 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 514 18446604441712958208 0 0 -1 0 0 0 0
[pid=26788] ppid=26644 vsize=645996 CPUtime=0.49 cores=0-7
/proc/26788/stat : 26788 (python) S 26644 26644 26485 0 -1 4202560 1269 0 0 0 28 21 0 0 18 0 2 0 668229928 661499904 7318 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26788/statm: 161499 7318 407 364 0 97330 0
[pid=26790] ppid=26788 vsize=251288 CPUtime=195.08 cores=0-7
/proc/26790/stat : 26790 (FH) T 26788 26790 26790 0 -1 4202496 1970 0 0 0 19508 0 0 0 25 0 1 0 668229929 257318912 1682 33554432000 134512640 134936988 4290102272 18446744073709551615 134554109 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/26790/statm: 62822 1682 41 104 0 62326 0
[pid=26788/tid=26800] ppid=26644 vsize=645996 CPUtime=0 cores=0-7
/proc/26788/task/26800/stat : 26800 (python) S 26644 26644 26485 0 -1 4202560 92 0 0 0 0 0 0 0 18 0 2 0 668239954 661499904 7318 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 514 18446604442127230976 0 0 -1 3 0 0 0
[pid=26792] ppid=26644 vsize=656252 CPUtime=0.46 cores=0-7
/proc/26792/stat : 26792 (python) S 26644 26644 26485 0 -1 4202560 1060 0 0 0 26 20 0 0 18 0 1 0 668230640 672002048 7413 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 12794920055406035201 0 0 17 0 0 0 0
/proc/26792/statm: 164063 7413 379 364 0 99891 0
[pid=26794] ppid=26792 vsize=268420 CPUtime=189.25 cores=0-7
/proc/26794/stat : 26794 (hybridGM3) R 26792 26794 26794 0 -1 4202496 5831 0 0 0 18924 1 0 0 25 0 1 0 668230640 274862080 5543 33554432000 134512640 135204385 4289429104 18446744073709551615 134538041 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/26794/statm: 67105 5543 63 169 0 66935 0
[pid=26797] ppid=26644 vsize=666508 CPUtime=0.23 cores=0-7
/proc/26797/stat : 26797 (python) S 26644 26644 26485 0 -1 4202560 1083 0 0 0 12 11 0 0 18 0 1 0 668239942 682504192 7274 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 12794920055406035202 0 0 17 0 0 0 0
/proc/26797/statm: 166627 7274 378 364 0 102452 0
[pid=26799] ppid=26797 vsize=421364 CPUtime=96.22 cores=0-7
/proc/26799/stat : 26799 (NCVWr) R 26797 26799 26799 0 -1 4202496 2001 0 0 0 9622 0 0 0 25 0 1 0 668239942 431476736 1709 33554432000 134512640 135113558 4291360672 18446744073709551615 134533479 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/26799/statm: 105341 1709 58 147 0 104216 0
[pid=26805] ppid=26644 vsize=676764 CPUtime=0 cores=0-7
/proc/26805/stat : 26805 (python) S 26644 26644 26485 0 -1 4202560 966 0 0 0 0 0 0 0 18 0 1 0 668249490 693006336 7320 33554432000 4194304 5683644 140734312876448 18446744073709551615 274664828486 0 0 16781312 514 9717929072788504575 0 0 17 0 0 0 0
/proc/26805/statm: 169191 7320 355 364 0 105013 0
[pid=26807] ppid=26805 vsize=335996 CPUtime=0.99 cores=0-7
/proc/26807/stat : 26807 (iPAWS) R 26805 26807 26807 0 -1 4202496 1837 0 0 0 99 0 0 0 23 0 1 0 668249490 344059904 1547 33554432000 134512640 135114423 4287775648 18446744073709551615 134546603 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26807/statm: 83999 1547 59 147 0 83851 0
[pid=26644/tid=26651] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26651/stat : 26651 (python) S 26642 26644 26485 0 -1 4202560 29 935 0 0 0 0 0 0 19 0 34 0 668141462 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 4 0 0 0
[pid=26644/tid=26654] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26654/stat : 26654 (python) S 26642 26644 26485 0 -1 4202560 25 935 0 0 0 0 0 0 18 0 34 0 668141465 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 3 0 0 0
[pid=26644/tid=26657] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26657/stat : 26657 (python) S 26642 26644 26485 0 -1 4202560 89 935 0 0 0 0 0 0 18 0 34 0 668141468 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26660] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26660/stat : 26660 (python) S 26642 26644 26485 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 34 0 668141471 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 4 0 0 0
[pid=26644/tid=26663] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26663/stat : 26663 (python) S 26642 26644 26485 0 -1 4202560 39 935 0 0 0 0 0 0 18 0 34 0 668141475 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26666] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26666/stat : 26666 (python) S 26642 26644 26485 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 34 0 668141478 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 6 0 0 0
[pid=26644/tid=26669] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26669/stat : 26669 (python) S 26642 26644 26485 0 -1 4202560 40 935 0 0 0 0 0 0 18 0 34 0 668141481 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26672] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26672/stat : 26672 (python) S 26642 26644 26485 0 -1 4202560 54 935 0 0 0 0 0 0 18 0 34 0 668141484 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 1 0 0 0
[pid=26644/tid=26679] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26679/stat : 26679 (python) S 26642 26644 26485 0 -1 4202560 51 935 0 0 0 0 0 0 18 0 34 0 668151395 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26683] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26683/stat : 26683 (python) S 26642 26644 26485 0 -1 4202560 52 935 0 0 0 0 0 0 18 0 34 0 668151400 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26688] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26688/stat : 26688 (python) S 26642 26644 26485 0 -1 4202560 45 935 0 0 0 0 0 0 18 0 34 0 668151496 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 5 0 0 0
[pid=26644/tid=26692] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26692/stat : 26692 (python) S 26642 26644 26485 0 -1 4202560 34 935 0 0 0 0 0 0 20 0 34 0 668151501 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 5 0 0 0
[pid=26644/tid=26696] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26696/stat : 26696 (python) S 26642 26644 26485 0 -1 4202560 37 935 0 0 0 0 0 0 18 0 34 0 668151505 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 5 0 0 0
[pid=26644/tid=26700] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26700/stat : 26700 (python) S 26642 26644 26485 0 -1 4202560 40 935 0 0 0 0 0 0 18 0 34 0 668151510 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 7 0 0 0
[pid=26644/tid=26703] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26703/stat : 26703 (python) S 26642 26644 26485 0 -1 4202560 34 935 0 0 0 0 0 0 25 0 34 0 668151515 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 7 0 0 0
[pid=26644/tid=26707] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26707/stat : 26707 (python) S 26642 26644 26485 0 -1 4202560 50 935 0 0 0 0 0 0 18 0 34 0 668152051 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 7 0 0 0
[pid=26644/tid=26717] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26717/stat : 26717 (python) S 26642 26644 26485 0 -1 4202560 33 935 0 0 0 0 0 0 19 0 34 0 668161424 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 7 0 0 0
[pid=26644/tid=26720] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26720/stat : 26720 (python) S 26642 26644 26485 0 -1 4202560 40 935 0 0 0 0 0 0 18 0 34 0 668161429 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 7 0 0 0
[pid=26644/tid=26732] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26732/stat : 26732 (python) S 26642 26644 26485 0 -1 4202560 42 935 0 0 0 0 0 0 20 0 34 0 668171807 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26738] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26738/stat : 26738 (python) S 26642 26644 26485 0 -1 4202560 31 935 0 0 0 0 0 0 19 0 34 0 668180892 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26741] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26741/stat : 26741 (python) S 26642 26644 26485 0 -1 4202560 45 935 0 0 0 0 0 0 18 0 34 0 668181083 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 1 0 0 0
[pid=26644/tid=26744] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26744/stat : 26744 (python) S 26642 26644 26485 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 34 0 668181292 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26751] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26751/stat : 26751 (python) S 26642 26644 26485 0 -1 4202560 37 935 0 0 0 0 0 0 20 0 34 0 668190806 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 1 0 0 0
[pid=26644/tid=26754] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26754/stat : 26754 (python) S 26642 26644 26485 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 34 0 668190853 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26763] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26763/stat : 26763 (python) S 26642 26644 26485 0 -1 4202560 38 935 0 0 0 0 0 0 20 0 34 0 668201055 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 1 0 0 0
[pid=26644/tid=26768] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26768/stat : 26768 (python) S 26642 26644 26485 0 -1 4202560 33 935 0 0 0 0 0 0 20 0 34 0 668210268 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26773] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26773/stat : 26773 (python) S 26642 26644 26485 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 34 0 668210985 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26777] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26777/stat : 26777 (python) S 26642 26644 26485 0 -1 4202560 30 935 0 0 0 0 0 0 19 0 34 0 668212015 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26782] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26782/stat : 26782 (python) S 26642 26644 26485 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 34 0 668220542 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 1 0 0 0
[pid=26644/tid=26789] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26789/stat : 26789 (python) S 26642 26644 26485 0 -1 4202560 40 935 0 0 0 0 0 0 18 0 34 0 668229928 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 1 0 0 0
[pid=26644/tid=26793] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26793/stat : 26793 (python) S 26642 26644 26485 0 -1 4202560 35 935 0 0 0 0 0 0 20 0 34 0 668230640 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 0 0 0 0
[pid=26644/tid=26798] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26798/stat : 26798 (python) S 26642 26644 26485 0 -1 4202560 35 935 0 0 0 0 0 0 20 0 34 0 668239942 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 1 0 0 0
[pid=26644/tid=26806] ppid=26642 vsize=687008 CPUtime=0 cores=0-7
/proc/26644/task/26806/stat : 26806 (python) S 26642 26644 26485 0 -1 4202560 36 935 0 0 0 0 0 0 20 0 34 0 668249490 703496192 8911 33554432000 4194304 5683644 140734312876448 18446744073709551615 274676631985 0 0 16781312 2 18446604449305136000 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 8602.94
Current children cumulated vsize (KiB) 32625708

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26644 and gives
#  childrusage.ru_utime.tv_sec=1733
#  childrusage.ru_utime.tv_usec=46536
#  childrusage.ru_stime.tv_sec=9
#  childrusage.ru_stime.tv_usec=854501
# CPU time returned by wait4() is 1742.9
# while last known CPU time is 8602.94
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1083.61
CPU time (s): 8602.94
CPU user time (s): 8591.83
CPU system time (s): 11.11
CPU usage (%): 793.917
Max. virtual memory (cumulated for all children) (KiB): 32625708

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1733.05
system time used= 9.8545
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 97208
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13301
involuntary context switches= 12068

runsolver used 11.5013 second user time and 26.123 second system time

The end

Launcher Data 

Begin job on node131 at 2011-05-16 19:03:36
IDJOB=3385346
IDBENCH=82611
IDSOLVER=1870
FILE ID=node131/3385346-1305565416
RUNJOBID= node131-1305564963-26499
PBS_JOBID= 13350119
Free space on /tmp= 73608 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k5-r20-v1500-c30000-S969405384-096-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385346-1305565416/watcher-3385346-1305565416 -o /tmp/evaluation-result-3385346-1305565416/solver-3385346-1305565416 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385346-1305565416.cnf -seed 1084427613 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6e345981a96012731da9bd2ce5420289
RANDOM SEED=1084427613

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      16178368 kB
Buffers:        305308 kB
Cached:        4713772 kB
SwapCached:       1504 kB
Active:       12812840 kB
Inactive:      3687856 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      16178368 kB
SwapTotal:    67111528 kB
SwapFree:     67093824 kB
Dirty:           32832 kB
Writeback:           4 kB
AnonPages:    11479632 kB
Mapped:          27168 kB
Slab:           170068 kB
PageTables:      34636 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 29783688 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73576 MiB
End job on node131 at 2011-05-16 19:21:42