Trace number 3317251

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (TO) 4800.33 1206.51

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v80-c7120-S1494985128-003.UNKNOWN.cnf
MD5SUM6317a356b3e87abef9291d8243489542
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables80
Number of clauses7120
Sum of the clauses size49840
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 57120

Solver Data 

0.30/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.30/0.47	c INFO: solving HOME/instance-3317251-1304268518.cnf
0.30/0.47	c INFO: computing task features
0.39/0.51	c INFO: computed variable-clause graph statistics
0.39/0.51	c INFO: computed clause balance statistics
0.59/0.76	c INFO: computed variable balance statistics
0.69/0.85	c INFO: computed small-clause counts
0.69/0.85	c INFO: computed Horn-clause counts
0.69/0.86	c INFO: computed variable graph statistics
0.69/0.86	c INFO: collected features for HOME/instance-3317251-1304268518.cnf in 0.40 s
0.69/0.89	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.49)
0.78/0.92	c INFO: running gnovelty+2@0 for 97 with 4799 remaining (b = 0.11)
0.78/0.95	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.06)
0.78/0.98	c INFO: running adaptg2wsat2009++@0 for 97 with 4799 remaining (b = 0.04)
400.39/101.07	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.04)
400.76/101.10	c INFO: running gnovelty+2@0 for 97 with 4699 remaining (b = 0.03)
400.76/101.14	c INFO: running FH@0 for 97 with 4699 remaining (b = 0.02)
400.76/101.17	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.02)
796.34/200.27	c INFO: running adaptg2wsat2009++@0 for 97 with 4600 remaining (b = 0.02)
800.72/201.32	c INFO: running march_hi@0 for 388 with 4599 remaining (b = 0.05)
800.72/201.38	c INFO: running hybridGM3@0 for 194 with 4599 remaining (b = 0.03)
800.99/201.42	c INFO: running FH@0 for 97 with 4599 remaining (b = 0.01)
1195.32/300.48	c INFO: running march_hi@0 for 388 with 4500 remaining (b = 0.05)
1200.05/301.64	c INFO: running hybridGM3@0 for 194 with 4498 remaining (b = 0.02)
1582.79/397.77	c INFO: running gnovelty+2@0 for 97 with 4402 remaining (b = 0.01)
1982.21/498.00	c INFO: running hybridGM3@99 for 97 with 4302 remaining (b = 0.01)
1982.21/498.06	c INFO: running march_hi@0 for 388 with 4302 remaining (b = 0.04)
2364.84/594.12	c INFO: running march_hi@99 for 97 with 4206 remaining (b = 0.01)
2369.19/595.23	c INFO: running hybridGM3@295 for 97 with 4205 remaining (b = 0.01)
2754.84/692.14	c INFO: running march_hi@195 for 194 with 4108 remaining (b = 0.03)
2771.18/696.31	c INFO: running march_hi@99 for 97 with 4104 remaining (b = 0.01)
2771.99/696.44	c INFO: running adaptg2wsat2009++@0 for 97 with 4104 remaining (b = 0.01)
3154.73/792.66	c INFO: running adaptg2wsat2009++@99 for 97 with 4007 remaining (b = 0.01)
3163.88/794.97	c INFO: running march_hi@200 for 194 with 4005 remaining (b = 0.03)
3522.66/885.04	c INFO: running march_hi@587 for 97 with 3915 remaining (b = 0.02)
3541.75/889.86	c INFO: running adaptg2wsat2009++@99 for 97 with 3910 remaining (b = 0.01)
3560.87/894.65	c INFO: running march_hi@392 for 97 with 3905 remaining (b = 0.02)
3918.41/984.51	c INFO: running march_hi@685 for 97 with 3815 remaining (b = 0.01)
3924.77/986.08	c INFO: running FH@0 for 97 with 3814 remaining (b = 0.01)
3950.59/992.57	c INFO: running march_hi@491 for 194 with 3807 remaining (b = 0.03)
3954.96/993.69	c INFO: running march_hi@391 for 97 with 3806 remaining (b = 0.02)
4300.97/1080.77	c INFO: running march_hi@781 for 1358 with 3719 remaining (b = 0.13)
4322.82/1086.30	c INFO: running march_hi@0 for 388 with 3714 remaining (b = 0.04)
4333.15/1088.89	c INFO: running march_hi@485 for 194 with 3711 remaining (b = 0.02)
4716.50/1185.34	c INFO: running hybridGM3@393 for 97 with 3615 remaining (b = 0.01)
4800.33/1206.50	c INFO: running hybridGM3@0 for 194 with 3593 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317251-1304268518/watcher-3317251-1304268518 -o /tmp/evaluation-result-3317251-1304268518/solver-3317251-1304268518 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317251-1304268518.cnf -seed 1962411866 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.90 8.70 6.26 7/224 29747
/proc/meminfo: memFree=29188980/32951124 swapFree=67111348/67111528
[pid=29747] ppid=29745 vsize=15780 CPUtime=0 cores=0,2,4,6
/proc/29747/stat : 29747 (python) R 29745 29747 29287 0 -1 4202496 829 0 0 0 0 0 0 0 25 0 1 0 519267140 16158720 714 33554432000 4194304 5683644 140734545627408 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/29747/statm: 3945 716 334 364 0 432 0

[startup+0.105907 s]
/proc/loadavg: 8.90 8.70 6.26 7/224 29747
/proc/meminfo: memFree=29188980/32951124 swapFree=67111348/67111528
[pid=29747] ppid=29745 vsize=104612 CPUtime=0.06 cores=0,2,4,6
/proc/29747/stat : 29747 (python) S 29745 29747 29287 0 -1 4202496 3151 0 0 0 5 1 0 0 25 0 1 0 519267140 107122688 2827 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261614592 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/29747/statm: 26153 2827 847 364 0 1901 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104612

[startup+0.200849 s]
/proc/loadavg: 8.90 8.70 6.26 7/224 29747
/proc/meminfo: memFree=29188980/32951124 swapFree=67111348/67111528
[pid=29747] ppid=29745 vsize=128864 CPUtime=0.15 cores=0,2,4,6
/proc/29747/stat : 29747 (python) S 29745 29747 29287 0 -1 4202496 5595 937 1 0 12 3 0 0 18 0 1 0 519267140 131956736 4019 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261614592 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/29747/statm: 32216 4019 1011 364 0 2995 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 128864

[startup+0.300842 s]
/proc/loadavg: 8.90 8.70 6.26 7/224 29747
/proc/meminfo: memFree=29188980/32951124 swapFree=67111348/67111528
[pid=29747] ppid=29745 vsize=187740 CPUtime=0.22 cores=0,2,4,6
/proc/29747/stat : 29747 (python) R 29745 29747 29287 0 -1 4202496 6794 937 1 0 17 5 0 0 17 0 1 0 519267140 192245760 4860 33554432000 4194304 5683644 140734545627408 18446744073709551615 254256648154 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/29747/statm: 46935 4860 1380 364 0 3723 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 187740

[startup+0.7008 s]
/proc/loadavg: 8.90 8.70 6.26 7/224 29747
/proc/meminfo: memFree=29188980/32951124 swapFree=67111348/67111528
[pid=29747] ppid=29745 vsize=279940 CPUtime=0.59 cores=0,2,4,6
/proc/29747/stat : 29747 (python) R 29745 29747 29287 0 -1 4202496 10123 937 1 0 52 7 0 0 17 0 1 0 519267140 286658560 7384 33554432000 4194304 5683644 140734545627408 18446744073709551615 47804071818258 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/29747/statm: 69985 7384 1826 364 0 5909 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 279940

[startup+1.50062 s]
/proc/loadavg: 8.90 8.70 6.26 11/237 29764
/proc/meminfo: memFree=29148452/32951124 swapFree=67111348/67111528
[pid=29747] ppid=29745 vsize=320288 CPUtime=0.86 cores=0,2,4,6
/proc/29747/stat : 29747 (python) S 29745 29747 29287 0 -1 4202496 13109 937 1 0 78 8 0 0 20 0 5 0 519267140 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/29747/statm: 80072 7271 1883 364 0 15981 0
[pid=29753] ppid=29747 vsize=278796 CPUtime=0 cores=0,2,4,6
/proc/29753/stat : 29753 (python) S 29747 29747 29287 0 -1 4202560 741 0 0 0 0 0 0 0 19 0 1 0 519267229 285487104 5638 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636623 0 0 16781312 514 4466943288384946175 0 0 17 2 0 0 0
/proc/29753/statm: 69699 5638 354 364 0 5617 0
[pid=29755] ppid=29753 vsize=1018084 CPUtime=0.59 cores=0,2,4,6
/proc/29755/stat : 29755 (gnovelty+2) R 29753 29755 29755 0 -1 4202496 550 0 0 0 59 0 0 0 22 0 1 0 519267229 1042518016 287 33554432000 134512640 135663704 4293461920 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29755/statm: 254521 287 113 282 0 254237 0
[pid=29756] ppid=29747 vsize=289396 CPUtime=0 cores=0,2,4,6
/proc/29756/stat : 29756 (python) S 29747 29747 29287 0 -1 4202560 741 0 0 0 0 0 0 0 21 0 1 0 519267232 296341504 5707 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 4361023210112679935 0 0 17 6 0 0 0
/proc/29756/statm: 72349 5707 348 364 0 8264 0
[pid=29758] ppid=29756 vsize=1018084 CPUtime=0.56 cores=0,2,4,6
/proc/29758/stat : 29758 (gnovelty+2) R 29756 29758 29758 0 -1 4202496 551 0 0 0 56 0 0 0 25 0 1 0 519267232 1042518016 287 33554432000 134512640 135663704 4287534960 18446744073709551615 134524945 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29758/statm: 254521 287 113 282 0 254237 0
[pid=29759] ppid=29747 vsize=299180 CPUtime=0 cores=0,2,4,6
/proc/29759/stat : 29759 (python) S 29747 29747 29287 0 -1 4202560 720 0 0 0 0 0 0 0 19 0 1 0 519267235 306360320 5604 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 4455669445909544959 0 0 17 6 0 0 0
/proc/29759/statm: 74795 5604 344 364 0 10707 0
[pid=29761] ppid=29759 vsize=416916 CPUtime=0.54 cores=0,2,4,6
/proc/29761/stat : 29761 (adaptg2wsat2009) R 29759 29761 29761 0 -1 4202496 646 0 0 0 54 0 0 0 22 0 1 0 519267235 426921984 380 33554432000 134512640 135107411 4291978400 18446744073709551615 134523500 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29761/statm: 104229 380 49 146 0 103105 0
[pid=29762] ppid=29747 vsize=310044 CPUtime=0 cores=0,2,4,6
/proc/29762/stat : 29762 (python) S 29747 29747 29287 0 -1 4202560 732 0 0 0 0 0 0 0 19 0 1 0 519267238 317485056 5728 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 4514463356303704063 0 0 17 2 0 0 0
/proc/29762/statm: 77511 5728 344 364 0 13420 0
[pid=29764] ppid=29762 vsize=416916 CPUtime=0.51 cores=0,2,4,6
/proc/29764/stat : 29764 (adaptg2wsat2009) R 29762 29764 29764 0 -1 4202496 645 0 0 0 51 0 0 0 21 0 1 0 519267238 426921984 380 33554432000 134512640 135107411 4292292752 18446744073709551615 134523310 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29764/statm: 104229 380 49 146 0 103105 0
[pid=29747/tid=29754] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29754/stat : 29754 (python) S 29745 29747 29287 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 5 0 519267229 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29757] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29757/stat : 29757 (python) S 29745 29747 29287 0 -1 4202560 24 937 0 0 0 0 0 0 22 0 5 0 519267232 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29760] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29760/stat : 29760 (python) S 29745 29747 29287 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 5 0 519267235 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29763] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29763/stat : 29763 (python) S 29745 29747 29287 0 -1 4202560 32 937 0 0 0 0 0 0 20 0 5 0 519267238 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 4367704

[startup+3.10134 s]
/proc/loadavg: 8.98 8.72 6.28 11/237 29764
/proc/meminfo: memFree=29147212/32951124 swapFree=67111348/67111528
[pid=29747] ppid=29745 vsize=320288 CPUtime=0.86 cores=0,2,4,6
/proc/29747/stat : 29747 (python) S 29745 29747 29287 0 -1 4202496 13109 937 1 0 78 8 0 0 20 0 5 0 519267140 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/29747/statm: 80072 7271 1883 364 0 15981 0
[pid=29753] ppid=29747 vsize=278796 CPUtime=0 cores=0,2,4,6
/proc/29753/stat : 29753 (python) S 29747 29747 29287 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 519267229 285487104 5638 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636623 0 0 16781312 514 4466943288384913667 0 0 17 2 0 0 0
/proc/29753/statm: 69699 5638 354 364 0 5617 0
[pid=29755] ppid=29753 vsize=1018084 CPUtime=2.2 cores=0,2,4,6
/proc/29755/stat : 29755 (gnovelty+2) R 29753 29755 29755 0 -1 4202496 550 0 0 0 220 0 0 0 25 0 1 0 519267229 1042518016 287 33554432000 134512640 135663704 4293461920 18446744073709551615 134545631 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29755/statm: 254521 287 113 282 0 254237 0
[pid=29756] ppid=29747 vsize=289396 CPUtime=0 cores=0,2,4,6
/proc/29756/stat : 29756 (python) S 29747 29747 29287 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 519267232 296341504 5707 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 4361023210112647428 0 0 17 6 0 0 0
/proc/29756/statm: 72349 5707 348 364 0 8264 0
[pid=29758] ppid=29756 vsize=1018084 CPUtime=2.15 cores=0,2,4,6
/proc/29758/stat : 29758 (gnovelty+2) R 29756 29758 29758 0 -1 4202496 551 0 0 0 215 0 0 0 25 0 1 0 519267232 1042518016 287 33554432000 134512640 135663704 4287534960 18446744073709551615 134524882 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29758/statm: 254521 287 113 282 0 254237 0
[pid=29759] ppid=29747 vsize=299180 CPUtime=0 cores=0,2,4,6
/proc/29759/stat : 29759 (python) S 29747 29747 29287 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 519267235 306360320 5608 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 4455669445909512449 0 0 17 6 0 0 0
/proc/29759/statm: 74795 5608 348 364 0 10707 0
[pid=29761] ppid=29759 vsize=417056 CPUtime=2.14 cores=0,2,4,6
/proc/29761/stat : 29761 (adaptg2wsat2009) R 29759 29761 29761 0 -1 4202496 717 0 0 0 214 0 0 0 25 0 1 0 519267235 427065344 451 33554432000 134512640 135107411 4291978400 18446744073709551615 134531822 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29761/statm: 104264 451 59 146 0 103140 0
[pid=29762] ppid=29747 vsize=310044 CPUtime=0 cores=0,2,4,6
/proc/29762/stat : 29762 (python) S 29747 29747 29287 0 -1 4202560 750 0 0 0 0 0 0 0 18 0 1 0 519267238 317485056 5732 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 4514463356303671554 0 0 17 2 0 0 0
/proc/29762/statm: 77511 5732 348 364 0 13420 0
[pid=29764] ppid=29762 vsize=417056 CPUtime=2.11 cores=0,2,4,6
/proc/29764/stat : 29764 (adaptg2wsat2009) R 29762 29764 29764 0 -1 4202496 715 0 0 0 211 0 0 0 25 0 1 0 519267238 427065344 450 33554432000 134512640 135107411 4292292752 18446744073709551615 134532107 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29764/statm: 104264 450 59 146 0 103140 0
[pid=29747/tid=29754] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29754/stat : 29754 (python) S 29745 29747 29287 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 5 0 519267229 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29757] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29757/stat : 29757 (python) S 29745 29747 29287 0 -1 4202560 24 937 0 0 0 0 0 0 22 0 5 0 519267232 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29760] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29760/stat : 29760 (python) S 29745 29747 29287 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 5 0 519267235 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29763] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29763/stat : 29763 (python) S 29745 29747 29287 0 -1 4202560 32 937 0 0 0 0 0 0 20 0 5 0 519267238 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 9.46
Current children cumulated vsize (KiB) 4367984

[startup+6.30077 s]
/proc/loadavg: 8.98 8.72 6.28 10/241 29768
/proc/meminfo: memFree=29138868/32951124 swapFree=67111348/67111528
[pid=29747] ppid=29745 vsize=320288 CPUtime=0.86 cores=0,2,4,6
/proc/29747/stat : 29747 (python) S 29745 29747 29287 0 -1 4202496 13109 937 1 0 78 8 0 0 20 0 5 0 519267140 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/29747/statm: 80072 7271 1883 364 0 15981 0
[pid=29753] ppid=29747 vsize=278796 CPUtime=0 cores=0,2,4,6
/proc/29753/stat : 29753 (python) S 29747 29747 29287 0 -1 4202560 899 0 0 0 0 0 0 0 18 0 1 0 519267229 285487104 5660 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636623 0 0 16781312 514 4466943288384913667 0 0 17 2 0 0 0
/proc/29753/statm: 69699 5660 376 364 0 5617 0
[pid=29755] ppid=29753 vsize=1018084 CPUtime=5.38 cores=0,2,4,6
/proc/29755/stat : 29755 (gnovelty+2) R 29753 29755 29755 0 -1 4202496 550 0 0 0 538 0 0 0 25 0 1 0 519267229 1042518016 287 33554432000 134512640 135663704 4293461920 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29755/statm: 254521 287 113 282 0 254237 0
[pid=29756] ppid=29747 vsize=289396 CPUtime=0 cores=0,2,4,6
/proc/29756/stat : 29756 (python) S 29747 29747 29287 0 -1 4202560 899 0 0 0 0 0 0 0 18 0 1 0 519267232 296341504 5730 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 4361023210112647428 0 0 17 6 0 0 0
/proc/29756/statm: 72349 5730 371 364 0 8264 0
[pid=29758] ppid=29756 vsize=1018084 CPUtime=5.31 cores=0,2,4,6
/proc/29758/stat : 29758 (gnovelty+2) R 29756 29758 29758 0 -1 4202496 551 0 0 0 531 0 0 0 25 0 1 0 519267232 1042518016 287 33554432000 134512640 135663704 4287534960 18446744073709551615 134525218 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/29758/statm: 254521 287 113 282 0 254237 0
[pid=29759] ppid=29747 vsize=299180 CPUtime=0 cores=0,2,4,6
/proc/29759/stat : 29759 (python) S 29747 29747 29287 0 -1 4202560 894 0 0 0 0 0 0 0 18 0 1 0 519267235 306360320 5630 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 4455669445909512449 0 0 17 6 0 0 0
/proc/29759/statm: 74795 5630 370 364 0 10707 0
[pid=29761] ppid=29759 vsize=417056 CPUtime=5.34 cores=0,2,4,6
/proc/29761/stat : 29761 (adaptg2wsat2009) R 29759 29761 29761 0 -1 4202496 717 0 0 0 534 0 0 0 25 0 1 0 519267235 427065344 451 33554432000 134512640 135107411 4291978400 18446744073709551615 134531781 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29761/statm: 104264 451 59 146 0 103140 0
[pid=29762] ppid=29747 vsize=310044 CPUtime=0 cores=0,2,4,6
/proc/29762/stat : 29762 (python) S 29747 29747 29287 0 -1 4202560 923 0 0 0 0 0 0 0 18 0 1 0 519267238 317485056 5755 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 4514463356303671554 0 0 17 2 0 0 0
/proc/29762/statm: 77511 5755 371 364 0 13420 0
[pid=29764] ppid=29762 vsize=417056 CPUtime=5.3 cores=0,2,4,6
/proc/29764/stat : 29764 (adaptg2wsat2009) R 29762 29764 29764 0 -1 4202496 715 0 0 0 530 0 0 0 25 0 1 0 519267238 427065344 450 33554432000 134512640 135107411 4292292752 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29764/statm: 104264 450 59 146 0 103140 0
[pid=29747/tid=29754] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29754/stat : 29754 (python) S 29745 29747 29287 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 5 0 519267229 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29757] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29757/stat : 29757 (python) S 29745 29747 29287 0 -1 4202560 24 937 0 0 0 0 0 0 22 0 5 0 519267232 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29760] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29760/stat : 29760 (python) S 29745 29747 29287 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 5 0 519267235 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29763] ppid=29745 vsize=320288 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29763/stat : 29763 (python) S 29745 29747 29287 0 -1 4202560 32 937 0 0 0 0 0 0 20 0 5 0 519267238 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 22.19
Current children cumulated vsize (KiB) 4367984

[startup+12.7006 s]
/proc/loadavg: 8.99 8.73 6.31 10/245 29772
/proc/meminfo: memFree=29130256/32951124 swapFree=67111348/67111528
[pid=29747] ppid=29745 vsize=320288 CPUtime=0.86 cores=0,2,4,6
/proc/29747/stat : 29747 (python) S 29745 29747 29287 0 -1 4202496 13109 937 1 0 78 8 0 0 20 0 5 0 519267140 327974912 7271 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/29747/statm: 80072 7271 1883 364 0 15981 0
[pid=29753] ppid=29747 vsize=278796 CPUtime=0.01 cores=0,2,4,6
/proc/29753/stat : 29753 (python) S 29747 29747 29287 0 -1 4202560 902 0 0 0 0 1 0 0 18 0 1 0 519267229 285487104 5661 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636623 0 0 16781312 514 5416317423726854403 0 0 17 2 0 0 0
/proc/29753/statm: 69699 5661 377 364 0 5617 0
[pid=29755] ppid=29753 vsize=1018084 CPUtime=11.76 cores=0,2,4,6
/proc/29755/stat : 29755 (gnovelty+2) R 29753 29755 29755 0 -1 4202496 550 0 0 0 1176 0 0 0 25 0 1 0 519267229 1042518016 287 33554432000 134512640 135663704 4293461920 18446744073709551615 134525070 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29755/statm: 254521 287 113 282 0 254237 0
[pid=29756] ppid=29747 vsize=289396 CPUtime=0.01 cores=0,2,4,6

################
# More data... #
################

[pid=29762] ppid=29747 vsize=310044 CPUtime=0.32 cores=0,2,4,6
/proc/29762/stat : 29762 (python) S 29747 29747 29287 0 -1 4202560 1148 0 0 0 17 15 0 0 18 0 2 0 519267238 317485056 5785 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/29762/statm: 77511 5785 400 364 0 13420 0
[pid=29764] ppid=29762 vsize=417056 CPUtime=197.27 cores=0,2,4,6
/proc/29764/stat : 29764 (adaptg2wsat2009) T 29762 29764 29764 0 -1 4202496 715 0 0 0 19721 6 0 0 25 0 1 0 519267238 427065344 450 33554432000 134512640 135107411 4292292752 18446744073709551615 134532242 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/29764/statm: 104264 450 59 146 0 103140 0
[pid=29762/tid=29789] ppid=29747 vsize=310044 CPUtime=0 cores=0,2,4,6
/proc/29762/task/29789/stat : 29789 (python) S 29747 29747 29287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 519277252 317485056 5785 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453963798656 0 0 -1 2 0 0 0
[pid=29781] ppid=29747 vsize=320300 CPUtime=0.35 cores=0,2,4,6
/proc/29781/stat : 29781 (python) S 29747 29747 29287 0 -1 4202560 1148 0 0 0 20 15 0 0 18 0 2 0 519277247 327987200 5806 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29781/statm: 80075 5806 400 364 0 15981 0
[pid=29784] ppid=29781 vsize=417056 CPUtime=195.15 cores=0,2,4,6
/proc/29784/stat : 29784 (adaptg2wsat2009) T 29781 29784 29784 0 -1 4202496 719 0 0 0 19514 1 0 0 25 0 1 0 519277247 427065344 452 33554432000 134512640 135107411 4292293024 18446744073709551615 134531392 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29784/statm: 104264 452 59 146 0 103140 0
[pid=29781/tid=29814] ppid=29747 vsize=320300 CPUtime=0 cores=0,2,4,6
/proc/29781/task/29814/stat : 29814 (python) S 29747 29747 29287 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 519287163 327987200 5806 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453899397184 0 0 -1 6 0 0 0
[pid=29786] ppid=29747 vsize=330556 CPUtime=0.16 cores=0,2,4,6
/proc/29786/stat : 29786 (python) S 29747 29747 29287 0 -1 4202560 1123 0 0 0 8 8 0 0 19 0 2 0 519277250 338489344 5810 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/29786/statm: 82639 5810 400 364 0 18542 0
[pid=29788] ppid=29786 vsize=1018084 CPUtime=100.16 cores=0,2,4,6
/proc/29788/stat : 29788 (gnovelty+2) T 29786 29788 29788 0 -1 4202496 550 0 0 0 10016 0 0 0 25 0 1 0 519277251 1042518016 287 33554432000 134512640 135663704 4290054224 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/29788/statm: 254521 287 113 282 0 254237 0
[pid=29786/tid=29818] ppid=29747 vsize=330556 CPUtime=0 cores=0,2,4,6
/proc/29786/task/29818/stat : 29818 (python) S 29747 29747 29287 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 519287268 338489344 5810 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453899395392 0 0 -1 2 0 0 0
[pid=29790] ppid=29747 vsize=340812 CPUtime=0.16 cores=0,2,4,6
/proc/29790/stat : 29790 (python) S 29747 29747 29287 0 -1 4202560 1164 0 0 0 10 6 0 0 19 0 2 0 519277254 348991488 5826 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/29790/statm: 85203 5826 406 364 0 21103 0
[pid=29792] ppid=29790 vsize=247228 CPUtime=99.08 cores=0,2,4,6
/proc/29792/stat : 29792 (FH) T 29790 29792 29792 0 -1 4202496 670 0 0 0 9908 0 0 0 25 0 1 0 519277254 253161472 405 33554432000 134512640 134936988 4289986944 18446744073709551615 134552073 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/29792/statm: 61807 405 41 104 0 61311 0
[pid=29790/tid=29822] ppid=29747 vsize=340812 CPUtime=0 cores=0,2,4,6
/proc/29790/task/29822/stat : 29822 (python) S 29747 29747 29287 0 -1 4202560 89 0 0 0 0 0 0 0 19 0 2 0 519287273 348991488 5826 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453930566784 0 0 -1 6 0 0 0
[pid=29793] ppid=29747 vsize=351340 CPUtime=0.16 cores=0,2,4,6
/proc/29793/stat : 29793 (python) S 29747 29747 29287 0 -1 4202560 1175 0 0 0 8 8 0 0 19 0 2 0 519277257 359772160 5875 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/29793/statm: 87835 5875 406 364 0 23732 0
[pid=29795] ppid=29793 vsize=417056 CPUtime=99.85 cores=0,2,4,6
/proc/29795/stat : 29795 (adaptg2wsat2009) T 29793 29795 29795 0 -1 4202496 723 0 0 0 9985 0 0 0 25 0 1 0 519277258 427065344 450 33554432000 134512640 135107411 4291069024 18446744073709551615 134531696 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29795/statm: 104264 450 59 146 0 103140 0
[pid=29793/tid=29823] ppid=29747 vsize=351340 CPUtime=0 cores=0,2,4,6
/proc/29793/task/29823/stat : 29823 (python) S 29747 29747 29287 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 519287275 359772160 5875 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453908820928 0 0 -1 0 0 0 0
[pid=29815] ppid=29747 vsize=361596 CPUtime=0.17 cores=0,2,4,6
/proc/29815/stat : 29815 (python) S 29747 29747 29287 0 -1 4202560 1154 0 0 0 10 7 0 0 19 0 2 0 519287167 370274304 5897 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29815/statm: 90399 5897 400 364 0 26293 0
[pid=29817] ppid=29815 vsize=417056 CPUtime=98.43 cores=0,2,4,6
/proc/29817/stat : 29817 (adaptg2wsat2009) T 29815 29817 29817 0 -1 4202496 719 0 0 0 9843 0 0 0 25 0 1 0 519287167 427065344 450 33554432000 134512640 135107411 4288007200 18446744073709551615 134531792 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/29817/statm: 104264 450 59 146 0 103140 0
[pid=29815/tid=29845] ppid=29747 vsize=361596 CPUtime=0 cores=0,2,4,6
/proc/29815/task/29845/stat : 29845 (python) S 29747 29747 29287 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 519297184 370274304 5897 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453933410496 0 0 -1 4 0 0 0
[pid=29819] ppid=29747 vsize=372052 CPUtime=1.89 cores=0,2,4,6
/proc/29819/stat : 29819 (python) S 29747 29747 29287 0 -1 4202560 1209 0 0 0 99 90 0 0 15 0 2 0 519287272 380981248 5927 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/29819/statm: 93013 5927 400 364 0 28904 0
[pid=29821] ppid=29819 vsize=137668 CPUtime=999.28 cores=0,2,4,6
/proc/29821/stat : 29821 (march_hi) R 29819 29821 29821 0 -1 4202496 27546 0 0 0 99922 6 0 0 25 0 1 0 519287272 140972032 26187 33554432000 4194304 4955518 140736362657056 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/29821/statm: 34417 26187 106 186 0 34230 0
[pid=29819/tid=29876] ppid=29747 vsize=372052 CPUtime=0 cores=0,2,4,6
/proc/29819/task/29876/stat : 29876 (python) S 29747 29747 29287 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 519326547 380981248 5927 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453952500864 0 0 -1 2 0 0 0
[pid=29824] ppid=29747 vsize=382308 CPUtime=0.76 cores=0,2,4,6
/proc/29824/stat : 29824 (python) S 29747 29747 29287 0 -1 4202560 1187 0 0 0 44 32 0 0 18 0 2 0 519287278 391483392 5931 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/29824/statm: 95577 5931 400 364 0 31465 0
[pid=29826] ppid=29824 vsize=268424 CPUtime=414.34 cores=0,2,4,6
/proc/29826/stat : 29826 (hybridGM3) R 29824 29826 29826 0 -1 4202496 4919 0 0 0 41431 3 0 0 25 0 1 0 519287278 274866176 4650 33554432000 134512640 135204385 4294732000 18446744073709551615 134537403 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/29826/statm: 67106 4650 64 169 0 66936 0
[pid=29824/tid=29857] ppid=29747 vsize=382308 CPUtime=0 cores=0,2,4,6
/proc/29824/task/29857/stat : 29857 (python) S 29747 29747 29287 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 519306913 391483392 5931 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453908821824 0 0 -1 4 0 0 0
[pid=29827] ppid=29747 vsize=392564 CPUtime=0.17 cores=0,2,4,6
/proc/29827/stat : 29827 (python) S 29747 29747 29287 0 -1 4202560 1161 0 0 0 9 8 0 0 19 0 2 0 519287282 401985536 5935 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/29827/statm: 98141 5935 400 364 0 34026 0
[pid=29829] ppid=29827 vsize=247232 CPUtime=99.82 cores=0,2,4,6
/proc/29829/stat : 29829 (FH) T 29827 29829 29829 0 -1 4202496 679 0 0 0 9981 1 0 0 25 0 1 0 519287283 253165568 405 33554432000 134512640 134936988 4292615360 18446744073709551615 134552073 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/29829/statm: 61808 405 41 104 0 61312 0
[pid=29827/tid=29849] ppid=29747 vsize=392564 CPUtime=0 cores=0,2,4,6
/proc/29827/task/29849/stat : 29849 (python) S 29747 29747 29287 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 519297300 401985536 5935 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604443201285056 0 0 -1 6 0 0 0
[pid=29846] ppid=29747 vsize=402820 CPUtime=1.73 cores=0,2,4,6
/proc/29846/stat : 29846 (python) S 29747 29747 29287 0 -1 4202560 1206 0 0 0 98 75 0 0 15 0 2 0 519297188 412487680 5939 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/29846/statm: 100705 5939 400 364 0 36587 0
[pid=29848] ppid=29846 vsize=137668 CPUtime=896.11 cores=0,2,4,6
/proc/29848/stat : 29848 (march_hi) R 29846 29848 29848 0 -1 4202496 24879 0 0 0 89603 8 0 0 25 0 1 0 519297188 140972032 23517 33554432000 4194304 4955518 140737037834928 18446744073709551615 4244474 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29848/statm: 34417 23517 106 186 0 34230 0
[pid=29846/tid=29883] ppid=29747 vsize=402820 CPUtime=0 cores=0,2,4,6
/proc/29846/task/29883/stat : 29883 (python) S 29747 29747 29287 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 519336766 412487680 5939 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453900929152 0 0 -1 0 0 0 0
[pid=29850] ppid=29747 vsize=412508 CPUtime=0.35 cores=0,2,4,6
/proc/29850/stat : 29850 (python) S 29747 29747 29287 0 -1 4202560 1177 0 0 0 20 15 0 0 19 0 2 0 519297304 422408192 5801 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/29850/statm: 103127 5801 400 364 0 39006 0
[pid=29852] ppid=29850 vsize=268424 CPUtime=195.98 cores=0,2,4,6
/proc/29852/stat : 29852 (hybridGM3) T 29850 29852 29852 0 -1 4202496 4921 0 0 0 19598 0 0 0 25 0 1 0 519297305 274866176 4649 33554432000 134512640 135204385 4286802784 18446744073709551615 134537403 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/29852/statm: 67106 4649 64 169 0 66936 0
[pid=29850/tid=29865] ppid=29747 vsize=412508 CPUtime=0 cores=0,2,4,6
/proc/29850/task/29865/stat : 29865 (python) S 29747 29747 29287 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 519316941 422408192 5801 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453900928256 0 0 -1 0 0 0 0
[pid=29858] ppid=29747 vsize=423484 CPUtime=0.18 cores=0,2,4,6
/proc/29858/stat : 29858 (python) S 29747 29747 29287 0 -1 4202560 1189 0 0 0 9 9 0 0 19 0 2 0 519306917 433647616 5933 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/29858/statm: 105871 5933 409 364 0 41747 0
[pid=29860] ppid=29858 vsize=1018084 CPUtime=99.99 cores=0,2,4,6
/proc/29860/stat : 29860 (gnovelty+2) T 29858 29860 29860 0 -1 4202496 566 0 0 0 9999 0 0 0 25 0 1 0 519306917 1042518016 286 33554432000 134512640 135663704 4293896720 18446744073709551615 134524894 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/29860/statm: 254521 286 113 282 0 254237 0
[pid=29858/tid=29864] ppid=29747 vsize=423484 CPUtime=0 cores=0,2,4,6
/proc/29858/task/29864/stat : 29864 (python) S 29747 29747 29287 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 519316936 433647616 5933 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453936515840 0 0 -1 4 0 0 0
[pid=29866] ppid=29747 vsize=433520 CPUtime=1.31 cores=0,2,4,6
/proc/29866/stat : 29866 (python) S 29747 29747 29287 0 -1 4202560 1259 0 0 0 71 60 0 0 16 0 2 0 519316946 443924480 5968 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/29866/statm: 108380 5968 417 364 0 44253 0
[pid=29868] ppid=29866 vsize=93468 CPUtime=682.02 cores=0,2,4,6
/proc/29868/stat : 29868 (march_hi) T 29866 29868 29868 0 -1 4202496 19643 0 0 0 68195 7 0 0 25 0 1 0 519316946 95711232 18282 33554432000 4194304 4955518 140734737586048 18446744073709551615 4208626 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/29868/statm: 23367 18282 106 186 0 23180 0
[pid=29866/tid=30125] ppid=29747 vsize=433520 CPUtime=0 cores=0,2,4,6
/proc/29866/task/30125/stat : 30125 (python) S 29747 29747 29287 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 519356601 443924480 5968 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604443201284160 0 0 -1 2 0 0 0
[pid=30144] ppid=29747 vsize=444124 CPUtime=0.18 cores=0,2,4,6
/proc/30144/stat : 30144 (python) S 29747 29747 29287 0 -1 4202560 1173 0 0 0 9 9 0 0 19 0 2 0 519365748 454782976 6027 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273443275 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/30144/statm: 111031 6027 402 364 0 46901 0
[pid=30146] ppid=30144 vsize=247232 CPUtime=100.11 cores=0,2,4,6
/proc/30146/stat : 30146 (FH) T 30144 30146 30146 0 -1 4202496 682 0 0 0 10011 0 0 0 25 0 1 0 519365749 253165568 405 33554432000 134512640 134936988 4288904112 18446744073709551615 134545068 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/30146/statm: 61808 405 41 104 0 61312 0
[pid=30144/tid=30158] ppid=29747 vsize=444124 CPUtime=0 cores=0,2,4,6
/proc/30144/task/30158/stat : 30158 (python) S 29747 29747 29287 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 519375766 454782976 6027 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 514 18446604453943891264 0 0 -1 4 0 0 0
[pid=30159] ppid=29747 vsize=454380 CPUtime=0.24 cores=0,2,4,6
/proc/30159/stat : 30159 (python) S 29747 29747 29287 0 -1 4202560 1023 0 0 0 11 13 0 0 15 0 1 0 519375770 465285120 6006 33554432000 4194304 5683644 140734545627408 18446744073709551615 254261636678 0 0 16781312 514 5416317423726854404 0 0 17 6 0 0 0
/proc/30159/statm: 113595 6006 372 364 0 49462 0
[pid=30161] ppid=30159 vsize=20484 CPUtime=116.69 cores=0,2,4,6
/proc/30161/stat : 30161 (march_hi) R 30159 30161 30161 0 -1 4202496 5075 0 0 0 11668 1 0 0 25 0 1 0 519375770 20975616 3711 33554432000 4194304 4955518 140734752835936 18446744073709551615 4297483 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30161/statm: 5121 3711 106 186 0 4934 0
[pid=29747/tid=29754] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29754/stat : 29754 (python) S 29745 29747 29287 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 19 0 519267229 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29757] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29757/stat : 29757 (python) S 29745 29747 29287 0 -1 4202560 24 937 0 0 0 0 0 0 22 0 19 0 519267232 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29760] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29760/stat : 29760 (python) S 29745 29747 29287 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 19 0 519267235 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29763] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29763/stat : 29763 (python) S 29745 29747 29287 0 -1 4202560 37 937 0 0 0 0 0 0 18 0 19 0 519267238 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
[pid=29747/tid=29783] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29783/stat : 29783 (python) S 29745 29747 29287 0 -1 4202560 27 937 0 0 0 0 0 0 18 0 19 0 519277247 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29787] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29787/stat : 29787 (python) S 29745 29747 29287 0 -1 4202560 25 937 0 0 0 0 0 0 22 0 19 0 519277250 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
[pid=29747/tid=29791] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29791/stat : 29791 (python) S 29745 29747 29287 0 -1 4202560 23 937 0 0 0 0 0 0 24 0 19 0 519277254 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 6 0 0 0
[pid=29747/tid=29794] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29794/stat : 29794 (python) S 29745 29747 29287 0 -1 4202560 32 937 0 0 0 0 0 0 25 0 19 0 519277258 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
[pid=29747/tid=29816] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29816/stat : 29816 (python) S 29745 29747 29287 0 -1 4202560 33 937 0 0 0 0 0 0 20 0 19 0 519287167 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
[pid=29747/tid=29820] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29820/stat : 29820 (python) S 29745 29747 29287 0 -1 4202560 29 937 0 0 0 0 0 0 18 0 19 0 519287272 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
[pid=29747/tid=29825] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29825/stat : 29825 (python) S 29745 29747 29287 0 -1 4202560 35 937 0 0 0 0 0 0 18 0 19 0 519287278 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
[pid=29747/tid=29828] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29828/stat : 29828 (python) S 29745 29747 29287 0 -1 4202560 32 937 0 0 0 0 0 0 23 0 19 0 519287283 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 0 0 0 0
[pid=29747/tid=29847] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29847/stat : 29847 (python) S 29745 29747 29287 0 -1 4202560 42 937 0 0 0 0 0 0 18 0 19 0 519297188 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 0 0 0 0
[pid=29747/tid=29851] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29851/stat : 29851 (python) S 29745 29747 29287 0 -1 4202560 29 937 0 0 0 0 0 0 20 0 19 0 519297305 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 0 0 0 0
[pid=29747/tid=29859] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29859/stat : 29859 (python) S 29745 29747 29287 0 -1 4202560 28 937 0 0 0 0 0 0 20 0 19 0 519306917 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 0 0 0 0
[pid=29747/tid=29867] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/29867/stat : 29867 (python) S 29745 29747 29287 0 -1 4202560 32 937 0 0 0 0 0 0 18 0 19 0 519316946 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 0 0 0 0
[pid=29747/tid=30145] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/30145/stat : 30145 (python) S 29745 29747 29287 0 -1 4202560 27 937 0 0 0 0 0 0 20 0 19 0 519365749 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
[pid=29747/tid=30160] ppid=29745 vsize=464624 CPUtime=0 cores=0,2,4,6
/proc/29747/task/30160/stat : 30160 (python) S 29745 29747 29287 0 -1 4202560 28 937 0 0 0 0 0 0 20 0 19 0 519375770 475774976 7562 33554432000 4194304 5683644 140734545627408 18446744073709551615 254273440177 0 0 16781312 2 18446604453952499968 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 14900092

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29747 and gives
#  childrusage.ru_utime.tv_sec=538
#  childrusage.ru_utime.tv_usec=56203
#  childrusage.ru_stime.tv_sec=4
#  childrusage.ru_stime.tv_usec=267351
# CPU time returned by wait4() is 542.324
# while last known CPU time is 4800.33
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1206.51
CPU time (s): 4800.33
CPU user time (s): 4795.9
CPU system time (s): 4.43
CPU usage (%): 397.868
Max. virtual memory (cumulated for all children) (KiB): 14900092

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 538.056
system time used= 4.26735
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 60193
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7589
involuntary context switches= 3998

runsolver used 7.8698 second user time and 13.9759 second system time

The end

Launcher Data 

Begin job on node140 at 2011-05-01 18:48:38
IDJOB=3317251
IDBENCH=82716
IDSOLVER=1705
FILE ID=node140/3317251-1304268518
RUNJOBID= node140-1304267280-29305
PBS_JOBID= 13173939
Free space on /tmp= 73280 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k7-r89-v80-c7120-S1494985128-003.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317251-1304268518/watcher-3317251-1304268518 -o /tmp/evaluation-result-3317251-1304268518/solver-3317251-1304268518 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3317251-1304268518.cnf -seed 1962411866 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6317a356b3e87abef9291d8243489542
RANDOM SEED=1962411866

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29189260 kB
Buffers:        982524 kB
Cached:        1598764 kB
SwapCached:        176 kB
Active:         854256 kB
Inactive:      2399264 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29189260 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           31948 kB
Writeback:           0 kB
AnonPages:      672008 kB
Mapped:          22948 kB
Slab:           435244 kB
PageTables:      13148 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 16947188 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73240 MiB
End job on node140 at 2011-05-01 19:08:47