Trace number 3385407

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 7849.7 996.722

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v50000-c210000-S517749870-003-UNKNOWN.cnf
MD5SUM4033245e3bd21ace8cfcd57089ff73c5
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1493.62
Satisfiable
(Un)Satisfiability was proved
Number of variables50000
Number of clauses210000
Sum of the clauses size630000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3210000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.33/0.69	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.33/0.69	c INFO: solving HOME/instance-3385407-1305566285.cnf
0.33/0.69	c INFO: computing task features
1.10/1.43	c INFO: computed variable-clause graph statistics
1.10/1.46	c INFO: computed clause balance statistics
4.80/5.11	c INFO: computed variable balance statistics
7.72/8.12	c INFO: computed small-clause counts
7.72/8.14	c INFO: computed Horn-clause counts
10.89/11.44	c INFO: computed variable graph statistics
10.89/11.44	c INFO: collected features for HOME/instance-3385407-1305566285.cnf in 10.49 s
10.89/11.47	c INFO: running hybridGM3@0 for 97 with 4989 remaining (b = 0.35)
10.99/11.50	c INFO: running hybridGM3@0 for 97 with 4989 remaining (b = 0.21)
10.99/11.53	c INFO: running hybridGM3@0 for 97 with 4989 remaining (b = 0.14)
10.99/11.56	c INFO: running hybridGM3@0 for 97 with 4989 remaining (b = 0.09)
11.08/11.60	c INFO: running hybridGM3@0 for 97 with 4989 remaining (b = 0.07)
11.08/11.63	c INFO: running hybridGM3@0 for 194 with 4989 remaining (b = 0.10)
11.08/11.66	c INFO: running hybridGM3@0 for 194 with 4989 remaining (b = 0.07)
11.17/11.70	c INFO: running hybridGM3@0 for 194 with 4989 remaining (b = 0.06)
808.30/111.95	c INFO: running hybridGM3@0 for 97 with 4888 remaining (b = 0.03)
809.04/112.02	c INFO: running hybridGM3@0 for 97 with 4888 remaining (b = 0.03)
809.04/112.07	c INFO: running hybridGM3@0 for 97 with 4888 remaining (b = 0.03)
809.84/112.13	c INFO: running hybridGM3@0 for 97 with 4888 remaining (b = 0.03)
811.35/112.33	c INFO: running hybridGM3@0 for 97 with 4888 remaining (b = 0.03)
1568.17/207.27	c INFO: running hybridGM3@100 for 97 with 4793 remaining (b = 0.03)
1568.98/207.34	c INFO: running hybridGM3@99 for 97 with 4793 remaining (b = 0.03)
1568.98/207.39	c INFO: running TNM@0 for 97 with 4793 remaining (b = 0.03)
1576.95/208.38	c INFO: running hybridGM3@98 for 97 with 4792 remaining (b = 0.02)
1577.75/208.42	c INFO: running hybridGM3@0 for 97 with 4792 remaining (b = 0.02)
1577.75/208.45	c INFO: running hybridGM3@0 for 97 with 4792 remaining (b = 0.02)
1617.69/213.47	c INFO: running hybridGM3@100 for 97 with 4787 remaining (b = 0.02)
1619.19/213.67	c INFO: running hybridGM3@97 for 97 with 4787 remaining (b = 0.02)
2337.73/303.77	c INFO: running hybridGM3@95 for 97 with 4696 remaining (b = 0.02)
2369.59/307.74	c INFO: running hybridGM3@100 for 97 with 4692 remaining (b = 0.02)
2376.80/308.61	c INFO: running hybridGM3@0 for 194 with 4692 remaining (b = 0.04)
2376.80/308.68	c INFO: running hybridGM3@0 for 194 with 4692 remaining (b = 0.03)
2377.50/308.73	c INFO: running TNM@0 for 97 with 4691 remaining (b = 0.02)
2378.53/309.00	c INFO: running hybridGM3@192 for 97 with 4691 remaining (b = 0.02)
2385.42/309.76	c INFO: running hybridGM3@294 for 97 with 4690 remaining (b = 0.02)
2442.10/316.83	c INFO: running TNM@0 for 97 with 4683 remaining (b = 0.01)
3114.18/401.12	c INFO: running TNM@0 for 97 with 4599 remaining (b = 0.01)
3139.66/404.34	c INFO: running hybridGM3@293 for 97 with 4596 remaining (b = 0.01)
3170.03/408.14	c INFO: running TNM@0 for 97 with 4592 remaining (b = 0.01)
3185.82/410.12	c INFO: running hybridGM3@394 for 97 with 4590 remaining (b = 0.01)
3201.75/412.13	c INFO: running TNM@0 for 97 with 4588 remaining (b = 0.01)
3242.33/417.29	c INFO: running TNM@0 for 97 with 4583 remaining (b = 0.01)
3913.81/501.58	c INFO: running TNM@194 for 1843 with 4499 remaining (b = 0.19)
3944.78/505.49	c INFO: running hybridGM3@0 for 194 with 4495 remaining (b = 0.02)
3945.57/505.55	c INFO: running hybridGM3@100 for 97 with 4495 remaining (b = 0.01)
3946.25/505.60	c INFO: running hybridGM3@99 for 97 with 4495 remaining (b = 0.01)
3946.94/505.72	c INFO: running hybridGM3@391 for 97 with 4495 remaining (b = 0.01)
3969.36/508.55	c INFO: running hybridGM3@0 for 194 with 4492 remaining (b = 0.02)
3993.34/511.58	c INFO: running hybridGM3@0 for 194 with 4489 remaining (b = 0.02)
4074.46/521.72	c INFO: running adaptg2wsat2009++@0 for 194 with 4479 remaining (b = 0.01)
4705.94/601.09	c INFO: running TNM@0 for 97 with 4399 remaining (b = 0.01)
4752.87/606.94	c INFO: running hybridGM3@297 for 97 with 4393 remaining (b = 0.01)
4752.87/606.99	c INFO: running TNM@0 for 97 with 4393 remaining (b = 0.01)
5504.57/701.50	c INFO: running TNM@0 for 97 with 4299 remaining (b = 0.01)
5511.70/702.32	c INFO: running hybridGM3@397 for 97 with 4298 remaining (b = 0.01)
5512.50/702.47	c INFO: running TNM@0 for 97 with 4298 remaining (b = 0.01)
5536.33/705.48	c INFO: running hybridGM3@99 for 97 with 4295 remaining (b = 0.01)
5552.20/707.40	c INFO: running TNM@0 for 97 with 4293 remaining (b = 0.01)
5608.65/714.53	c INFO: running hybridGM3@102 for 97 with 4286 remaining (b = 0.01)
5631.71/717.44	c INFO: running hybridGM3@0 for 194 with 4283 remaining (b = 0.01)
6269.61/797.70	c INFO: running adaptg2wsat2009++@95 for 97 with 4203 remaining (b = 0.01)
6295.16/800.88	c INFO: running adaptg2wsat2009++@0 for 194 with 4199 remaining (b = 0.01)
6295.80/800.95	c INFO: running TNM@0 for 97 with 4199 remaining (b = 0.01)
6303.03/801.92	c INFO: running TNM@0 for 97 with 4198 remaining (b = 0.01)
6382.52/811.86	c INFO: running TNM@0 for 97 with 4188 remaining (b = 0.01)
6414.93/815.95	c INFO: running hybridGM3@297 for 194 with 4184 remaining (b = 0.01)
7036.18/894.12	c INFO: running adaptg2wsat2009++@190 for 97 with 4106 remaining (b = 0.01)
7093.35/901.40	c INFO: running TNM@0 for 97 with 4099 remaining (b = 0.01)
7094.07/901.48	c INFO: running TNM@0 for 97 with 4099 remaining (b = 0.01)
7197.29/914.40	c INFO: running hybridGM3@95 for 97 with 4086 remaining (b = 0.01)
7220.42/917.35	c INFO: running hybridGM3@195 for 291 with 4083 remaining (b = 0.02)
7841.65/995.53	c INFO: running TNM@0 for 97 with 4005 remaining (b = 0.01)
7849.70/996.71	c INFO: running TNM@0 for 97 with 4004 remaining (b = 0.00)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385407-1305566285/watcher-3385407-1305566285 -o /tmp/evaluation-result-3385407-1305566285/solver-3385407-1305566285 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385407-1305566285.cnf -seed 2101738009 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.11 8.25 6.33 2/400 4854
/proc/meminfo: memFree=19711984/32951132 swapFree=64496000/67111528
[pid=4854] ppid=4852 vsize=15764 CPUtime=0 cores=0-7
/proc/4854/stat : 4854 (python) S 4852 4854 4528 0 -1 4202496 844 0 0 0 0 0 0 0 20 0 1 0 668228201 16142336 728 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647144448 0 2147483391 16781312 2 18446744071699109054 0 0 17 6 0 0 0
/proc/4854/statm: 3941 728 334 364 0 428 0

[startup+0.0243451 s]
/proc/loadavg: 8.11 8.25 6.33 2/400 4854
/proc/meminfo: memFree=19711984/32951132 swapFree=64496000/67111528
[pid=4854] ppid=4852 vsize=16244 CPUtime=0.01 cores=0-7
/proc/4854/stat : 4854 (python) R 4852 4854 4528 0 -1 4202496 1062 0 0 0 1 0 0 0 20 0 1 0 668228201 16633856 935 33554432000 4194304 5683644 140733855478272 18446744073709551615 4960220 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/4854/statm: 4061 935 381 364 0 548 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16244

[startup+0.100297 s]
/proc/loadavg: 8.11 8.25 6.33 2/400 4854
/proc/meminfo: memFree=19711984/32951132 swapFree=64496000/67111528
[pid=4854] ppid=4852 vsize=85624 CPUtime=0.06 cores=0-7
/proc/4854/stat : 4854 (python) R 4852 4854 4528 0 -1 4202496 2628 0 0 0 5 1 0 0 20 0 1 0 668228201 87678976 2349 33554432000 4194304 5683644 140733855478272 18446744073709551615 4505999 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/4854/statm: 21406 2349 713 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85624

[startup+0.300321 s]
/proc/loadavg: 8.11 8.25 6.33 2/400 4854
/proc/meminfo: memFree=19711984/32951132 swapFree=64496000/67111528
[pid=4854] ppid=4852 vsize=135748 CPUtime=0.18 cores=0-7
/proc/4854/stat : 4854 (python) S 4852 4854 4528 0 -1 4202496 5960 932 1 0 13 5 0 0 18 0 1 0 668228201 139005952 4151 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647142405 0 2147483391 16781312 2 18446744071699109054 0 0 17 6 0 0 0
/proc/4854/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700237 s]
/proc/loadavg: 8.11 8.25 6.33 2/400 4854
/proc/meminfo: memFree=19711984/32951132 swapFree=64496000/67111528
[pid=4854] ppid=4852 vsize=282408 CPUtime=0.4 cores=0-7
/proc/4854/stat : 4854 (python) R 4852 4854 4528 0 -1 4202496 10228 932 1 0 29 11 0 0 17 0 1 0 668228201 289185792 7913 33554432000 4194304 5683644 140733855478272 18446744073709551615 210646507270 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/4854/statm: 70602 7913 1761 364 0 6526 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 282408

[startup+1.50106 s]
/proc/loadavg: 7.46 8.11 6.30 2/401 4859
/proc/meminfo: memFree=19666544/32951132 swapFree=64496000/67111528
[pid=4854] ppid=4852 vsize=328000 CPUtime=1.2 cores=0-7
/proc/4854/stat : 4854 (python) R 4852 4854 4528 0 -1 4202496 27451 932 1 0 107 13 0 0 18 0 1 0 668228201 335872000 19385 33554432000 4194304 5683644 140733855478272 18446744073709551615 47233097072128 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/4854/statm: 82000 19385 1826 364 0 17924 0
Current children cumulated CPU time (s) 1.2
Current children cumulated vsize (KiB) 328000

[startup+3.10079 s]
/proc/loadavg: 7.46 8.11 6.30 2/401 4859
/proc/meminfo: memFree=19639388/32951132 swapFree=64496000/67111528
[pid=4854] ppid=4852 vsize=328000 CPUtime=2.8 cores=0-7
/proc/4854/stat : 4854 (python) R 4852 4854 4528 0 -1 4202496 27451 932 1 0 267 13 0 0 21 0 1 0 668228201 335872000 19385 33554432000 4194304 5683644 140733855478272 18446744073709551615 4531802 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/4854/statm: 82000 19385 1826 364 0 17924 0
Current children cumulated CPU time (s) 2.8
Current children cumulated vsize (KiB) 328000

[startup+6.30026 s]
/proc/loadavg: 7.46 8.11 6.30 2/401 4859
/proc/meminfo: memFree=19638848/32951132 swapFree=64496000/67111528
[pid=4854] ppid=4852 vsize=328000 CPUtime=5.99 cores=0-7
/proc/4854/stat : 4854 (python) R 4852 4854 4528 0 -1 4202496 27452 932 1 0 586 13 0 0 25 0 1 0 668228201 335872000 19386 33554432000 4194304 5683644 140733855478272 18446744073709551615 210646804853 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/4854/statm: 82000 19386 1827 364 0 17924 0
Current children cumulated CPU time (s) 5.99
Current children cumulated vsize (KiB) 328000

[startup+12.7011 s]
/proc/loadavg: 6.92 7.98 6.27 9/425 4883
/proc/meminfo: memFree=19501792/32951132 swapFree=64496000/67111528
[pid=4854] ppid=4852 vsize=406156 CPUtime=11.18 cores=0-7
/proc/4854/stat : 4854 (python) S 4852 4854 4528 0 -1 4202496 33980 932 1 0 1101 17 0 0 24 0 9 0 668228201 415903744 18504 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/4854/statm: 101539 18504 1889 364 0 37436 0
[pid=4860] ppid=4854 vsize=324120 CPUtime=0 cores=0-7
/proc/4860/stat : 4860 (python) S 4854 4854 4528 0 -1 4202560 617 0 0 0 0 0 0 0 25 0 1 0 668229348 331898880 16904 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658973072 0 0 16781312 514 18446744071562362840 0 0 17 2 0 0 0
/proc/4860/statm: 81030 16904 321 364 0 16948 0
[pid=4862] ppid=4860 vsize=324120 CPUtime=0.46 cores=0-7
/proc/4862/stat : 4862 (python) R 4860 4854 4528 0 -1 4202560 193 0 0 0 14 32 0 0 25 0 1 0 668229348 331898880 16752 33554432000 4194304 5683644 140733855478272 18446744073709551615 4331863 0 0 16781312 514 0 0 0 17 1 0 0 0
/proc/4862/statm: 81030 16752 169 364 0 16948 0
[pid=4863] ppid=4854 vsize=334376 CPUtime=0 cores=0-7
/proc/4863/stat : 4863 (python) S 4854 4854 4528 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 668229351 342401024 16934 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 6858314833222172671 0 0 17 6 0 0 0
/proc/4863/statm: 83594 16934 347 364 0 19509 0
[pid=4865] ppid=4863 vsize=268416 CPUtime=1.18 cores=0-7
/proc/4865/stat : 4865 (hybridGM3) R 4863 4865 4865 0 -1 4202496 4668 0 0 0 117 1 0 0 25 0 1 0 668229352 274857984 4406 33554432000 134512640 135204385 4292105440 18446744073709551615 134543968 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/4865/statm: 67104 4406 57 169 0 66934 0
[pid=4866] ppid=4854 vsize=344632 CPUtime=0 cores=0-7
/proc/4866/stat : 4866 (python) S 4854 4854 4528 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 668229354 352903168 16938 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 11898443974232244223 0 0 17 2 0 0 0
/proc/4866/statm: 86158 16938 347 364 0 22070 0
[pid=4868] ppid=4866 vsize=268416 CPUtime=1.12 cores=0-7
/proc/4868/stat : 4868 (hybridGM3) R 4866 4868 4868 0 -1 4202496 4628 0 0 0 112 0 0 0 25 0 1 0 668229356 274857984 4364 33554432000 134512640 135204385 4293536816 18446744073709551615 134543968 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/4868/statm: 67104 4364 57 169 0 66934 0
[pid=4869] ppid=4854 vsize=354888 CPUtime=0 cores=0-7
/proc/4869/stat : 4869 (python) S 4854 4854 4528 0 -1 4202560 750 0 0 0 0 0 0 0 18 0 1 0 668229357 363405312 16942 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 6858326378094264319 0 0 17 2 0 0 0
/proc/4869/statm: 88722 16942 347 364 0 24631 0
[pid=4871] ppid=4869 vsize=268420 CPUtime=1.11 cores=0-7
/proc/4871/stat : 4871 (hybridGM3) R 4869 4871 4871 0 -1 4202496 4621 0 0 0 111 0 0 0 25 0 1 0 668229358 274862080 4360 33554432000 134512640 135204385 4289184928 18446744073709551615 134543993 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/4871/statm: 67105 4360 57 169 0 66935 0
[pid=4872] ppid=4854 vsize=365144 CPUtime=0 cores=0-7
/proc/4872/stat : 4872 (python) S 4854 4854 4528 0 -1 4202560 752 0 0 0 0 0 0 0 18 0 1 0 668229361 373907456 16946 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 5989605814401236991 0 0 17 2 0 0 0
/proc/4872/statm: 91286 16946 347 364 0 27192 0
[pid=4874] ppid=4872 vsize=268416 CPUtime=1.08 cores=0-7
/proc/4874/stat : 4874 (hybridGM3) R 4872 4874 4874 0 -1 4202496 4600 0 0 0 108 0 0 0 24 0 1 0 668229361 274857984 4337 33554432000 134512640 135204385 4294523920 18446744073709551615 134543968 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/4874/statm: 67104 4337 57 169 0 66934 0
[pid=4875] ppid=4854 vsize=375400 CPUtime=0 cores=0-7
/proc/4875/stat : 4875 (python) S 4854 4854 4528 0 -1 4202560 752 0 0 0 0 0 0 0 18 0 1 0 668229364 384409600 16950 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 502064226450276351 0 0 17 6 0 0 0
/proc/4875/statm: 93850 16950 347 364 0 29753 0
[pid=4877] ppid=4875 vsize=268420 CPUtime=1.04 cores=0-7
/proc/4877/stat : 4877 (hybridGM3) R 4875 4877 4877 0 -1 4202496 4575 0 0 0 103 1 0 0 24 0 1 0 668229365 274862080 4311 33554432000 134512640 135204385 4289078944 18446744073709551615 134543993 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/4877/statm: 67105 4311 57 169 0 66935 0
[pid=4878] ppid=4854 vsize=385656 CPUtime=0 cores=0-7
/proc/4878/stat : 4878 (python) S 4854 4854 4528 0 -1 4202560 771 0 0 0 0 0 0 0 18 0 1 0 668229368 394911744 16954 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 502071923031670783 0 0 17 0 0 0 0
/proc/4878/statm: 96414 16954 347 364 0 32314 0
[pid=4880] ppid=4878 vsize=268416 CPUtime=1.01 cores=0-7
/proc/4880/stat : 4880 (hybridGM3) R 4878 4880 4880 0 -1 4202496 4558 0 0 0 101 0 0 0 25 0 1 0 668229368 274857984 4290 33554432000 134512640 135204385 4293221600 18446744073709551615 134543993 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/4880/statm: 67104 4290 57 169 0 66934 0
[pid=4881] ppid=4854 vsize=395912 CPUtime=0 cores=0-7
/proc/4881/stat : 4881 (python) S 4854 4854 4528 0 -1 4202560 779 0 0 0 0 0 0 0 24 0 1 0 668229371 405413888 16960 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 2091301631772590079 0 0 17 6 0 0 0
/proc/4881/statm: 98978 16960 349 364 0 34875 0
[pid=4883] ppid=4881 vsize=268420 CPUtime=0.98 cores=0-7
/proc/4883/stat : 4883 (hybridGM3) R 4881 4883 4883 0 -1 4202496 4539 0 0 0 98 0 0 0 25 0 1 0 668229371 274862080 4267 33554432000 134512640 135204385 4289383568 18446744073709551615 134543993 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/4883/statm: 67105 4267 57 169 0 66935 0
[pid=4854/tid=4861] ppid=4852 vsize=406156 CPUtime=0 cores=0-7
/proc/4854/task/4861/stat : 4861 (python) S 4852 4854 4528 0 -1 4202560 26 932 0 0 0 0 0 0 25 0 9 0 668229348 415903744 18504 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 2 0 0 0
[pid=4854/tid=4864] ppid=4852 vsize=406156 CPUtime=0 cores=0-7
/proc/4854/task/4864/stat : 4864 (python) S 4852 4854 4528 0 -1 4202560 24 932 0 0 0 0 0 0 20 0 9 0 668229351 415903744 18504 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 2 0 0 0
[pid=4854/tid=4867] ppid=4852 vsize=406156 CPUtime=0 cores=0-7
/proc/4854/task/4867/stat : 4867 (python) S 4852 4854 4528 0 -1 4202560 22 932 0 0 0 0 0 0 22 0 9 0 668229354 415903744 18504 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 6 0 0 0
[pid=4854/tid=4870] ppid=4852 vsize=406156 CPUtime=0 cores=0-7
/proc/4854/task/4870/stat : 4870 (python) S 4852 4854 4528 0 -1 4202560 25 932 0 0 0 0 0 0 24 0 9 0 668229358 415903744 18504 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 0 0 0 0
[pid=4854/tid=4873] ppid=4852 vsize=406156 CPUtime=0 cores=0-7
/proc/4854/task/4873/stat : 4873 (python) S 4852 4854 4528 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 9 0 668229361 415903744 18504 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 2 0 0 0
[pid=4854/tid=4876] ppid=4852 vsize=406156 CPUtime=0 cores=0-7
/proc/4854/task/4876/stat : 4876 (python) S 4852 4854 4528 0 -1 4202560 23 932 0 0 0 0 0 0 20 0 9 0 668229364 415903744 18504 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 0 0 0 0
[pid=4854/tid=4879] ppid=4852 vsize=406156 CPUtime=0 cores=0-7
/proc/4854/task/4879/stat : 4879 (python) S 4852 4854 4528 0 -1 4202560 25 932 0 0 0 0 0 0 22 0 9 0 668229368 415903744 18504 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 6 0 0 0
[pid=4854/tid=4882] ppid=4852 vsize=406156 CPUtime=0 cores=0-7
/proc/4854/task/4882/stat : 4882 (python) S 4852 4854 4528 0 -1 4202560 29 932 0 0 0 0 0 0 24 0 9 0 668229371 415903744 18504 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 19.16
Current children cumulated vsize (KiB) 5489328

[startup+25.502 s]
/proc/loadavg: 7.16 7.99 6.30 9/425 4883
/proc/meminfo: memFree=19312976/32951132 swapFree=64496000/67111528
[pid=4854] ppid=4852 vsize=406156 CPUtime=11.18 cores=0-7
/proc/4854/stat : 4854 (python) S 4852 4854 4528 0 -1 4202496 33980 932 1 0 1101 17 0 0 24 0 9 0 668228201 415903744 18504 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658973131 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/4854/statm: 101539 18504 1889 364 0 37436 0
[pid=4860] ppid=4854 vsize=324120 CPUtime=0.04 cores=0-7
/proc/4860/stat : 4860 (python) S 4854 4854 4528 0 -1 4202560 897 0 0 0 2 2 0 0 15 0 1 0 668229348 331898880 16959 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166479 0 0 16781312 514 5542523766409494786 0 0 17 2 0 0 0
/proc/4860/statm: 81030 16959 376 364 0 16948 0
[pid=4862] ppid=4860 vsize=276240 CPUtime=11.66 cores=0-7
/proc/4862/stat : 4862 (hybridGM3) R 4860 4862 4862 0 -1 4202496 9516 0 0 0 1099 67 0 0 25 0 1 0 668229348 282869760 9250 33554432000 134512640 135204385 4291661424 18446744073709551615 134537483 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/4862/statm: 69060 9250 64 169 0 68890 0
[pid=4863] ppid=4854 vsize=334376 CPUtime=0.03 cores=0-7
/proc/4863/stat : 4863 (python) S 4854 4854 4528 0 -1 4202560 915 0 0 0 2 1 0 0 15 0 1 0 668229351 342401024 16957 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 5542523766409494786 0 0 17 6 0 0 0
/proc/4863/statm: 83594 16957 370 364 0 19509 0
[pid=4865] ppid=4863 vsize=276236 CPUtime=13.98 cores=0-7
/proc/4865/stat : 4865 (hybridGM3) R 4863 4865 4865 0 -1 4202496 9514 0 0 0 1396 2 0 0 25 0 1 0 668229352 282865664 9252 33554432000 134512640 135204385 4292105440 18446744073709551615 134536744 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/4865/statm: 69059 9252 64 169 0 68889 0
[pid=4866] ppid=4854 vsize=344632 CPUtime=0.03 cores=0-7
/proc/4866/stat : 4866 (python) S 4854 4854 4528 0 -1 4202560 918 0 0 0 1 2 0 0 15 0 1 0 668229354 352903168 16961 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 5542523766409494787 0 0 17 3 0 0 0
/proc/4866/statm: 86158 16961 370 364 0 22070 0
[pid=4868] ppid=4866 vsize=276236 CPUtime=13.69 cores=0-7
/proc/4868/stat : 4868 (hybridGM3) R 4866 4868 4868 0 -1 4202496 9513 0 0 0 1368 1 0 0 25 0 1 0 668229356 282865664 9249 33554432000 134512640 135204385 4293536816 18446744073709551615 134549079 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/4868/statm: 69059 9249 64 169 0 68889 0
[pid=4869] ppid=4854 vsize=354888 CPUtime=0.03 cores=0-7
/proc/4869/stat : 4869 (python) S 4854 4854 4528 0 -1 4202560 938 0 0 0 1 2 0 0 15 0 1 0 668229357 363405312 16965 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 5542523766409494787 0 0 17 6 0 0 0
/proc/4869/statm: 88722 16965 370 364 0 24631 0
[pid=4871] ppid=4869 vsize=276240 CPUtime=13.92 cores=0-7
/proc/4871/stat : 4871 (hybridGM3) R 4869 4871 4871 0 -1 4202496 9509 0 0 0 1391 1 0 0 25 0 1 0 668229358 282869760 9248 33554432000 134512640 135204385 4289184928 18446744073709551615 134547802 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/4871/statm: 69060 9248 64 169 0 68890 0
[pid=4872] ppid=4854 vsize=365144 CPUtime=0.04 cores=0-7
/proc/4872/stat : 4872 (python) S 4854 4854 4528 0 -1 4202560 961 0 0 0 2 2 0 0 15 0 1 0 668229361 373907456 16969 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 5542523766409494788 0 0 17 2 0 0 0
/proc/4872/statm: 91286 16969 370 364 0 27192 0
[pid=4874] ppid=4872 vsize=276236 CPUtime=13.77 cores=0-7
/proc/4874/stat : 4874 (hybridGM3) R 4872 4874 4874 0 -1 4202496 9519 0 0 0 1376 1 0 0 25 0 1 0 668229361 282865664 9256 33554432000 134512640 135204385 4294523920 18446744073709551615 134536663 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/4874/statm: 69059 9256 64 169 0 68889 0

################
# More data... #
################

/proc/4959/statm: 153822 17215 407 364 0 89674 0
[pid=4961] ppid=4959 vsize=471116 CPUtime=98.99 cores=0-7
/proc/4961/stat : 4961 (TNM) T 4959 4961 4961 0 -1 4202496 8454 0 0 0 9898 1 0 0 25 0 1 0 668288901 482422784 8169 33554432000 134512640 135008748 4294524064 18446744073709551615 134527788 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/4961/statm: 117779 8169 46 122 0 116679 0
[pid=4959/tid=4974] ppid=4854 vsize=615288 CPUtime=0 cores=0-7
/proc/4959/task/4974/stat : 4974 (python) S 4854 4854 4528 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 668298935 630054912 17215 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 514 18446604458095919168 0 0 -1 1 0 0 0
[pid=4965] ppid=4854 vsize=625544 CPUtime=0.35 cores=0-7
/proc/4965/stat : 4965 (python) S 4854 4854 4528 0 -1 4202560 1263 0 0 0 18 17 0 0 19 0 2 0 668298351 640557056 17218 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/4965/statm: 156386 17218 406 364 0 92235 0
[pid=4967] ppid=4965 vsize=471116 CPUtime=99.02 cores=0-7
/proc/4967/stat : 4967 (TNM) T 4965 4967 4967 0 -1 4202496 8460 0 0 0 9900 2 0 0 25 0 1 0 668298352 482422784 8171 33554432000 134512640 135008748 4293114672 18446744073709551615 134524952 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/4967/statm: 117779 8171 46 122 0 116679 0
[pid=4965/tid=4992] ppid=4854 vsize=625544 CPUtime=0 cores=0-7
/proc/4965/task/4992/stat : 4992 (python) S 4854 4854 4528 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 668308386 640557056 17218 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 514 18446604466124284288 0 0 -1 5 0 0 0
[pid=4969] ppid=4854 vsize=635800 CPUtime=0.35 cores=0-7
/proc/4969/stat : 4969 (python) S 4854 4854 4528 0 -1 4202560 1259 0 0 0 16 19 0 0 19 0 2 0 668298448 651059200 17216 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/4969/statm: 158950 17216 400 364 0 94796 0
[pid=4971] ppid=4969 vsize=471116 CPUtime=97.4 cores=0-7
/proc/4971/stat : 4971 (TNM) T 4969 4971 4971 0 -1 4202496 8459 0 0 0 9736 4 0 0 25 0 1 0 668298449 482422784 8172 33554432000 134512640 135008748 4290307136 18446744073709551615 134528967 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/4971/statm: 117779 8172 46 122 0 116679 0
[pid=4969/tid=4985] ppid=4854 vsize=635800 CPUtime=0 cores=0-7
/proc/4969/task/4985/stat : 4985 (python) S 4854 4854 4528 0 -1 4202560 68 0 0 0 0 0 0 0 19 0 2 0 668308289 651059200 17216 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 514 18446604466124286976 0 0 -1 0 0 0 0
[pid=4975] ppid=4854 vsize=646056 CPUtime=0.37 cores=0-7
/proc/4975/stat : 4975 (python) S 4854 4854 4528 0 -1 4202560 1242 0 0 0 19 18 0 0 19 0 2 0 668298941 661561344 17220 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/4975/statm: 161514 17220 400 364 0 97357 0
[pid=4977] ppid=4975 vsize=471116 CPUtime=100.5 cores=0-7
/proc/4977/stat : 4977 (TNM) T 4975 4977 4977 0 -1 4202496 8455 0 0 0 10049 1 0 0 25 0 1 0 668298942 482422784 8170 33554432000 134512640 135008748 4288416656 18446744073709551615 134527773 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/4977/statm: 117779 8170 46 122 0 116679 0
[pid=4975/tid=4996] ppid=4854 vsize=646056 CPUtime=0 cores=0-7
/proc/4975/task/4996/stat : 4996 (python) S 4854 4854 4528 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 668309380 661561344 17220 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 514 18446604457751646656 0 0 -1 3 0 0 0
[pid=4980] ppid=4854 vsize=656312 CPUtime=0.99 cores=0-7
/proc/4980/stat : 4980 (python) S 4854 4854 4528 0 -1 4202560 1299 0 0 0 47 52 0 0 15 0 2 0 668299945 672063488 17224 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/4980/statm: 164078 17224 400 364 0 99918 0
[pid=4982] ppid=4980 vsize=276240 CPUtime=277.96 cores=0-7
/proc/4982/stat : 4982 (hybridGM3) R 4980 4982 4982 0 -1 4202496 9539 0 0 0 27792 4 0 0 25 0 1 0 668299946 282869760 9257 33554432000 134512640 135204385 4288341536 18446744073709551615 134536605 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/4982/statm: 69060 9257 64 169 0 68890 0
[pid=4980/tid=5011] ppid=4854 vsize=656312 CPUtime=0 cores=0-7
/proc/4980/task/5011/stat : 5011 (python) S 4854 4854 4528 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 668319634 672063488 17224 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 514 18446604457751649344 0 0 -1 1 0 0 0
[pid=4986] ppid=4854 vsize=666568 CPUtime=0.69 cores=0-7
/proc/4986/stat : 4986 (python) S 4854 4854 4528 0 -1 4202560 1159 0 0 0 35 34 0 0 18 0 1 0 668308289 682565632 17199 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 5542523766409494789 0 0 17 0 0 0 0
/proc/4986/statm: 166642 17199 372 364 0 102479 0
[pid=4988] ppid=4986 vsize=438604 CPUtime=194.1 cores=0-7
/proc/4988/stat : 4988 (adaptg2wsat2009) R 4986 4988 4988 0 -1 4202496 8789 0 0 0 19405 5 0 0 25 0 1 0 668308290 449130496 8499 33554432000 134512640 135107411 4294284624 18446744073709551615 134531508 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/4988/statm: 109651 8499 59 146 0 108527 0
[pid=4989] ppid=4854 vsize=676824 CPUtime=0.36 cores=0-7
/proc/4989/stat : 4989 (python) S 4854 4854 4528 0 -1 4202560 1308 0 0 0 18 18 0 0 18 0 2 0 668308296 693067776 17238 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/4989/statm: 169206 17238 406 364 0 105040 0
[pid=4991] ppid=4989 vsize=471116 CPUtime=100.34 cores=0-7
/proc/4991/stat : 4991 (TNM) T 4989 4991 4991 0 -1 4202496 8470 0 0 0 10032 2 0 0 25 0 1 0 668308297 482422784 8172 33554432000 134512640 135008748 4294108832 18446744073709551615 134528942 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/4991/statm: 117779 8172 46 122 0 116679 0
[pid=4989/tid=5003] ppid=4854 vsize=676824 CPUtime=0 cores=0-7
/proc/4989/task/5003/stat : 5003 (python) S 4854 4854 4528 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 668318332 693067776 17238 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 514 18446604462433605504 0 0 -1 2 0 0 0
[pid=4993] ppid=4854 vsize=687080 CPUtime=0.36 cores=0-7
/proc/4993/stat : 4993 (python) S 4854 4854 4528 0 -1 4202560 1280 0 0 0 17 19 0 0 19 0 2 0 668308393 703569920 17243 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/4993/statm: 171770 17243 407 364 0 107601 0
[pid=4995] ppid=4993 vsize=471116 CPUtime=99.2 cores=0-7
/proc/4995/stat : 4995 (TNM) T 4993 4995 4995 0 -1 4202496 8458 0 0 0 9918 2 0 0 25 0 1 0 668308393 482422784 8170 33554432000 134512640 135008748 4292829232 18446744073709551615 134529176 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/4995/statm: 117779 8170 46 122 0 116679 0
[pid=4993/tid=5004] ppid=4854 vsize=687080 CPUtime=0 cores=0-7
/proc/4993/task/5004/stat : 5004 (python) S 4854 4854 4528 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 668318334 703569920 17243 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 514 18446604462433604608 0 0 -1 2 0 0 0
[pid=4997] ppid=4854 vsize=697336 CPUtime=0.38 cores=0-7
/proc/4997/stat : 4997 (python) S 4854 4854 4528 0 -1 4202560 1320 0 0 0 18 20 0 0 19 0 2 0 668309387 714072064 17246 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658973131 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/4997/statm: 174334 17246 406 364 0 110162 0
[pid=4999] ppid=4997 vsize=471116 CPUtime=100.7 cores=0-7
/proc/4999/stat : 4999 (TNM) T 4997 4999 4999 0 -1 4202496 8463 0 0 0 10068 2 0 0 25 0 1 0 668309388 482422784 8171 33554432000 134512640 135008748 4291630048 18446744073709551615 134527526 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/4999/statm: 117779 8171 46 122 0 116679 0
[pid=4997/tid=5012] ppid=4854 vsize=697336 CPUtime=0 cores=0-7
/proc/4997/task/5012/stat : 5012 (python) S 4854 4854 4528 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 668319929 714072064 17246 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 514 18446604458007670976 0 0 -1 0 0 0 0
[pid=5005] ppid=4854 vsize=707592 CPUtime=0.35 cores=0-7
/proc/5005/stat : 5005 (python) S 4854 4854 4528 0 -1 4202560 1170 0 0 0 19 16 0 0 18 0 1 0 668318341 724574208 17221 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 5542523766409494791 0 0 17 2 0 0 0
/proc/5005/statm: 176898 17221 378 364 0 112723 0
[pid=5007] ppid=5005 vsize=471116 CPUtime=95.04 cores=0-7
/proc/5007/stat : 5007 (TNM) R 5005 5007 5007 0 -1 4202496 8465 0 0 0 9502 2 0 0 25 0 1 0 668318342 482422784 8172 33554432000 134512640 135008748 4292561536 18446744073709551615 134529367 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/5007/statm: 117779 8172 46 122 0 116679 0
[pid=5008] ppid=4854 vsize=717848 CPUtime=0.34 cores=0-7
/proc/5008/stat : 5008 (python) S 4854 4854 4528 0 -1 4202560 1135 0 0 0 19 15 0 0 18 0 1 0 668318349 735076352 17224 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 5542523766409494792 0 0 17 1 0 0 0
/proc/5008/statm: 179462 17224 377 364 0 115284 0
[pid=5010] ppid=5008 vsize=471116 CPUtime=89.75 cores=0-7
/proc/5010/stat : 5010 (TNM) R 5008 5010 5010 0 -1 4202496 8461 0 0 0 8974 1 0 0 25 0 1 0 668318349 482422784 8171 33554432000 134512640 135008748 4290376464 18446744073709551615 134527542 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/5010/statm: 117779 8171 46 122 0 116679 0
[pid=5015] ppid=4854 vsize=728104 CPUtime=0 cores=0-7
/proc/5015/stat : 5015 (python) S 4854 4854 4528 0 -1 4202560 935 0 0 0 0 0 0 0 19 0 1 0 668327754 745578496 17196 33554432000 4194304 5683644 140733855478272 18446744073709551615 210647166534 0 0 16781312 514 1525384371345817599 0 0 17 5 0 0 0
/proc/5015/statm: 182026 17196 345 364 0 117845 0
[pid=5017] ppid=5015 vsize=471116 CPUtime=0.98 cores=0-7
/proc/5017/stat : 5017 (TNM) R 5015 5017 5017 0 -1 4202496 8462 0 0 0 97 1 0 0 23 0 1 0 668327755 482422784 8170 33554432000 134512640 135008748 4293224160 18446744073709551615 134528780 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/5017/statm: 117779 8170 46 122 0 116679 0
[pid=4854/tid=4861] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4861/stat : 4861 (python) S 4852 4854 4528 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 35 0 668229348 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 2 0 0 0
[pid=4854/tid=4864] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4864/stat : 4864 (python) S 4852 4854 4528 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 35 0 668229351 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 2 0 0 0
[pid=4854/tid=4867] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4867/stat : 4867 (python) S 4852 4854 4528 0 -1 4202560 39 932 0 0 0 0 0 0 18 0 35 0 668229354 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 6 0 0 0
[pid=4854/tid=4870] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4870/stat : 4870 (python) S 4852 4854 4528 0 -1 4202560 29 932 0 0 0 0 0 0 15 0 35 0 668229358 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 0 0 0 0
[pid=4854/tid=4873] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4873/stat : 4873 (python) S 4852 4854 4528 0 -1 4202560 45 932 0 0 0 0 0 0 15 0 35 0 668229361 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 2 0 0 0
[pid=4854/tid=4876] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4876/stat : 4876 (python) S 4852 4854 4528 0 -1 4202560 27 932 0 0 0 0 0 0 18 0 35 0 668229364 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 0 0 0 0
[pid=4854/tid=4879] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4879/stat : 4879 (python) S 4852 4854 4528 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 35 0 668229368 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4882] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4882/stat : 4882 (python) S 4852 4854 4528 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 35 0 668229371 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 6 0 0 0
[pid=4854/tid=4895] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4895/stat : 4895 (python) S 4852 4854 4528 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 35 0 668248941 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 6 0 0 0
[pid=4854/tid=4905] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4905/stat : 4905 (python) S 4852 4854 4528 0 -1 4202560 41 932 0 0 0 0 0 0 15 0 35 0 668259062 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 0 0 0 0
[pid=4854/tid=4908] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4908/stat : 4908 (python) S 4852 4854 4528 0 -1 4202560 114 932 0 0 0 0 0 0 18 0 35 0 668259070 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 2 0 0 0
[pid=4854/tid=4911] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4911/stat : 4911 (python) S 4852 4854 4528 0 -1 4202560 34 932 0 0 0 0 0 0 21 0 35 0 668259074 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 2 0 0 0
[pid=4854/tid=4914] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4914/stat : 4914 (python) S 4852 4854 4528 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 35 0 668259884 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 0 0 0 0
[pid=4854/tid=4919] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4919/stat : 4919 (python) S 4852 4854 4528 0 -1 4202560 101 932 0 0 0 0 0 0 20 0 35 0 668268314 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 0 0 0 0
[pid=4854/tid=4924] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4924/stat : 4924 (python) S 4852 4854 4528 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 35 0 668269016 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4927] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4927/stat : 4927 (python) S 4852 4854 4528 0 -1 4202560 38 932 0 0 0 0 0 0 20 0 35 0 668269414 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4931] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4931/stat : 4931 (python) S 4852 4854 4528 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 35 0 668269931 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4938] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4938/stat : 4938 (python) S 4852 4854 4528 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 35 0 668278750 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 7 0 0 0
[pid=4854/tid=4943] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4943/stat : 4943 (python) S 4852 4854 4528 0 -1 4202560 37 932 0 0 0 0 0 0 18 0 35 0 668279056 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 2 0 0 0
[pid=4854/tid=4947] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4947/stat : 4947 (python) S 4852 4854 4528 0 -1 4202560 36 932 0 0 0 0 0 0 18 0 35 0 668279359 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4952] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4952/stat : 4952 (python) S 4852 4854 4528 0 -1 4202560 42 932 0 0 0 0 0 0 18 0 35 0 668280373 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4957] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4957/stat : 4957 (python) S 4852 4854 4528 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 35 0 668288310 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4960] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4960/stat : 4960 (python) S 4852 4854 4528 0 -1 4202560 24 932 0 0 0 0 0 0 20 0 35 0 668288901 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4966] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4966/stat : 4966 (python) S 4852 4854 4528 0 -1 4202560 29 932 0 0 0 0 0 0 19 0 35 0 668298351 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4970] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4970/stat : 4970 (python) S 4852 4854 4528 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 35 0 668298449 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4976] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4976/stat : 4976 (python) S 4852 4854 4528 0 -1 4202560 27 932 0 0 0 0 0 0 19 0 35 0 668298942 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4981] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4981/stat : 4981 (python) S 4852 4854 4528 0 -1 4202560 34 932 0 0 0 0 0 0 18 0 35 0 668299945 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4987] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4987/stat : 4987 (python) S 4852 4854 4528 0 -1 4202560 28 932 0 0 0 0 0 0 19 0 35 0 668308289 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 0 0 0 0
[pid=4854/tid=4990] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4990/stat : 4990 (python) S 4852 4854 4528 0 -1 4202560 25 932 0 0 0 0 0 0 21 0 35 0 668308297 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4994] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4994/stat : 4994 (python) S 4852 4854 4528 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 35 0 668308393 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=4998] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/4998/stat : 4998 (python) S 4852 4854 4528 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 35 0 668309388 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=5006] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/5006/stat : 5006 (python) S 4852 4854 4528 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 35 0 668318342 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 2 0 0 0
[pid=4854/tid=5009] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/5009/stat : 5009 (python) S 4852 4854 4528 0 -1 4202560 27 932 0 0 0 0 0 0 22 0 35 0 668318349 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 1 0 0 0
[pid=4854/tid=5016] ppid=4852 vsize=738348 CPUtime=0 cores=0-7
/proc/4854/task/5016/stat : 5016 (python) S 4852 4854 4528 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 35 0 668327755 756068352 18797 33554432000 4194304 5683644 140733855478272 18446744073709551615 210658970033 0 0 16781312 2 18446604452685872192 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7849.7
Current children cumulated vsize (KiB) 32385336

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4854 and gives
#  childrusage.ru_utime.tv_sec=965
#  childrusage.ru_utime.tv_usec=163272
#  childrusage.ru_stime.tv_sec=13
#  childrusage.ru_stime.tv_usec=714915
# CPU time returned by wait4() is 978.878
# while last known CPU time is 7849.7
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 996.722
CPU time (s): 7849.7
CPU user time (s): 7834.82
CPU system time (s): 14.88
CPU usage (%): 787.551
Max. virtual memory (cumulated for all children) (KiB): 32385336

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 965.163
system time used= 13.7149
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 150172
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13130
involuntary context switches= 7325

runsolver used 9.91649 second user time and 25.5591 second system time

The end

Launcher Data 

Begin job on node129 at 2011-05-16 19:18:06
IDJOB=3385407
IDBENCH=82672
IDSOLVER=1870
FILE ID=node129/3385407-1305566285
RUNJOBID= node129-1305564963-4542
PBS_JOBID= 13350121
Free space on /tmp= 73288 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v50000-c210000-S517749870-003-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385407-1305566285/watcher-3385407-1305566285 -o /tmp/evaluation-result-3385407-1305566285/solver-3385407-1305566285 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385407-1305566285.cnf -seed 2101738009 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4033245e3bd21ace8cfcd57089ff73c5
RANDOM SEED=2101738009

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      19712388 kB
Buffers:        287912 kB
Cached:        7032064 kB
SwapCached:      52664 kB
Active:        4011040 kB
Inactive:      8974712 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      19712388 kB
SwapTotal:    67111528 kB
SwapFree:     64496000 kB
Dirty:           36148 kB
Writeback:           0 kB
AnonPages:     5622060 kB
Mapped:          21960 kB
Slab:           140408 kB
PageTables:      43672 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 105889960 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73256 MiB
End job on node129 at 2011-05-16 19:34:45