Trace number 3263674

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4UNSAT 4244.96 1068.05

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_50_30_20_3-log.shuffled-as.sat03-109.cnf
MD5SUMf19999592ac4a0c798533d80c1c7f2d7
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4244.96
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses58358
Sum of the clauses size583280
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 560
Number of clauses of size over 558298

Solver Data 

0.10/0.14	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3263674-1304097472.cnf 
0.10/0.14	c Using SATTIMEOUT of 4800
0.10/0.14	c Using SATRAM of 15500
0.10/0.14	c Size of subset node = 32
0.10/0.14	c Variables = 150
0.10/0.14	c Clauses = 58358
0.10/0.14	c Literals = 583280
0.10/0.14	c Reduced size:
0.10/0.14	c Variables = 150
0.10/0.14	c Clauses = 58358
0.10/0.14	c Literals = 583280
0.10/0.14	c a2
0.99/1.02	c a1
2.79/2.81	c Independent sub-problems = 1
2.79/2.81	c Sub-problem with 150 variables and 58358 clauses
2.79/2.81	c using permutation method 4
2.79/2.81	c count = 1
2.79/2.81	c Ordering finished 2.770 seconds
2.79/2.81	c mapped 2.800 seconds
2.79/2.81	c permuted 2.800 seconds
2.79/2.81	c about to sort
2.79/2.83	c sorted
2.89/2.96	c clauses now 58358
2.89/2.96	c init finished 2.830 seconds
2.89/2.96	c tree built 2.950 seconds
2.89/2.96	c 
2.89/2.96	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
2.89/2.96	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
2.89/2.96	c ................................ | ..........                    |                                  3.0         0.0             
2.89/2.96	c ................................ | ..........                  1 |                                  3.0         0.3             
2.89/2.96	c ................................ | ..........                  2 |                                  3.0         0.7             
2.89/2.96	c ................................ | ..........                  3 |                                  3.0         1.0             
2.89/2.96	c ................................ | ..........                  4 |                                  3.0         1.4             
2.89/2.96	c ................................ | ..........                  5 |                                  3.0         1.7             
2.89/2.96	c ................................ | ..........               1000 | 116          2123                3.0       337.8        10583
46.96/14.06	c *............................... | ..........            1064647 | 262545       1484064            47.2     22556.1     12825550
95.98/26.31	c *............................... | ..........            1864000 | 469591       2535508            96.0     19412.6     21060924
191.68/50.39	c *............................... | ..........            3107000 | 793837       4242938           192.1     16177.2     33304270
288.04/74.50	c *............................... | ..........            4186000 | 1075193      5701348           288.1     14531.2     42209766
384.01/98.61	c *............................... | ..........            5145000 | 1325759      7025286           384.1     13395.3     49903849
479.92/122.72	c *............................... | *.........            6061000 | 1566372      8299009           480.0     12626.6     56966348
486.33/124.33	c **.............................. | *.........            6127401 | 1583959      8388456           486.5     12595.9     57524715
486.33/124.33	c **.............................. | *.........            6127402 | 1583959      8388456           486.5     12595.9     57524715
575.94/146.82	c **.............................. | *.........            7037000 | 1824027      9529614           576.0     12216.2     63317602
671.99/170.91	c **.............................. | *.........            7888000 | 2048839      10662637          672.1     11737.0     68684723
767.63/194.99	c **.............................. | *.........            8709000 | 2265968      11763298          768.0     11339.4     74464203
863.73/219.08	c **.............................. | *.........            9477000 | 2467763      12810060          864.0     10968.1     80295978
959.79/243.17	c **.............................. | **........           10229000 | 2667014      13815444          960.0     10654.7     86122254
1055.75/267.28	c **.............................. | **........           10963000 | 2860956      14787280         1056.1     10380.7     88929620
1060.15/268.38	c ***............................. | **........           10997864 | 2870109      14832670         1060.5     10370.7     89215917
1151.80/291.37	c ***............................. | **........           11749000 | 3071637      15743356         1152.1     10197.8     93300299
1192.52/301.57	c ****............................ | **........           12078601 | 3159837      16138099         1192.8     10126.4     95036660
1192.52/301.57	c ****............................ | **........           12078602 | 3159837      16138102         1192.8     10126.4     95036681
1192.52/301.57	c ****............................ | **........           12078603 | 3159837      16138102         1192.8     10126.4     95036681
1247.88/315.46	c ****............................ | **........           12502000 | 3271292      16664332         1248.1     10016.5     97695052
1343.82/339.55	c ****............................ | **........           13206000 | 3456633      17569704         1344.0      9825.7    101675719
1439.83/363.67	c ****............................ | ***.......           13928000 | 3647666      18484851         1440.1      9671.3    107085327
1535.80/387.76	c ****............................ | ***.......           14603000 | 3825606      19367440         1536.1      9506.7    108389885
1631.89/411.84	c ****............................ | ***.......           15269000 | 4001486      20236252         1632.1      9355.6    110813907
1728.03/435.90	c ****............................ | ***.......           15940000 | 4180093      21089682         1728.1      9224.2    113629431
1823.70/459.99	c ****............................ | ***.......           16599000 | 4355518      21940583         1824.0      9100.1    115835192
1880.97/474.36	c *****........................... | ***.......           16974128 | 4454433      22435763         1881.2      9023.0    116473862
1920.03/484.10	c *****........................... | ****......           17230000 | 4523040      22770759         1920.0      8973.8    117379250
2015.91/508.27	c *****........................... | ****......           17872000 | 4691188      23597097         2016.2      8864.2    119420937
2112.05/532.31	c *****........................... | ****......           18459000 | 4845184      24406518         2112.1      8739.6    123830052
2208.01/556.41	c *****........................... | ****......           19059000 | 5004001      25229521         2208.1      8631.5    127368219
2303.96/580.51	c *****........................... | ****......           19671000 | 5166696      26059458         2304.0      8537.7    129343517
2399.96/604.62	c *****........................... | *****.....           20286000 | 5328944      26884467         2400.1      8452.2    132766162
2495.94/628.72	c *****........................... | *****.....           20872000 | 5484614      27687015         2496.0      8362.1    133725799
2592.04/652.82	c *****........................... | *****.....           21454000 | 5638319      28493909         2592.1      8276.6    136666397
2688.04/676.92	c *****........................... | *****.....           21998000 | 5782454      29268879         2688.1      8183.4    140008370
2726.25/686.56	c ******.......................... | *****.....           22214917 | 5839459      29581585         2726.5      8147.8    141858486
2726.25/686.56	c ******.......................... | *****.....           22214918 | 5839459      29581586         2726.5      8147.8    141858486
2783.94/701.02	c ******.......................... | *****.....           22557000 | 5930367      30037022         2784.1      8102.2    142520647
2880.00/725.12	c ******.......................... | ******....           23099000 | 6073943      30787641         2880.1      8020.3    144855796
2976.06/749.22	c ******.......................... | ******....           23705000 | 6233526      31586110         2976.2      7965.0    147030586
3072.01/773.32	c ******.......................... | ******....           24237000 | 6374646      32365312         3072.1      7889.5    149164430
3167.99/797.41	c ******.......................... | ******....           24828000 | 6530993      33128609         3168.0      7837.0    149969526
3264.02/821.53	c ******.......................... | ******....           25424000 | 6690057      33900932         3264.1      7788.9    150858487
3359.97/845.62	c ******.......................... | *******...           25979000 | 6836714      34656939         3360.1      7731.7    152333835
3456.05/869.72	c ******.......................... | *******...           26583000 | 6998807      35435790         3456.1      7691.5    153960539
3495.92/879.75	c *******......................... | *******...           26830480 | 7065016      35759287         3496.1      7674.3    154794730
3551.93/893.83	c *******......................... | *******...           27199000 | 7163356      36189589         3552.1      7657.2    155394534
3647.83/917.97	c *******......................... | *******...           27822000 | 7329213      36960305         3648.1      7626.4    155793402
3743.80/942.07	c *******......................... | *******...           28450000 | 7497129      37720124         3744.1      7598.6    156340701
3839.64/966.19	c *******......................... | ********..           29038000 | 7653097      38481606         3840.0      7561.9    156917391
3936.09/990.32	c *******......................... | ********..           29636000 | 7812458      39227355         3936.2      7529.1    158123547
4032.03/1014.43	c *******......................... | ********..           30231000 | 7970416      39961349         4032.2      7497.5    159292681
4128.10/1038.51	c *******......................... | ********..           30874000 | 8142145      40774578         4128.1      7478.9    159911526
4170.30/1049.18	c ********........................ | ********..           31154824 | 8217791      41132209         4170.6      7470.1    160077592
4170.30/1049.18	c ********........................ | ********..           31154825 | 8217791      41132209         4170.6      7470.1    160077592
4170.30/1049.18	c ************.................... | ********..           31154826 | 8217792      41132209         4170.6      7470.1    160077592
4170.30/1049.18	c ************.................... | ********..           31154827 | 8217792      41132209         4170.6      7470.1    160077592
4170.30/1049.18	c **************.................. | ********..           31154828 | 8217793      41132209         4170.6      7470.1    160077592
4170.30/1049.18	c **************.................. | ********..           31154829 | 8217793      41132209         4170.6      7470.1    160077592
4170.30/1049.18	c ***************................. | ********..           31154830 | 8217794      41132209         4170.6      7470.1    160077592
4224.05/1062.60	c ***************................. | ********..           31540000 | 8320757      41628878         4224.1      7466.8    160190623
4244.34/1067.79	c Thread 3 result 0
4244.34/1067.79	c Thread 3 found (nil)
4244.34/1067.79	c Thread 2 result 0
4244.34/1067.79	c ****************................ | ********..           31694625 | 8362151      41827899         4244.7      7466.9    160213830
4244.34/1067.79	c Thread 1 result 0
4244.34/1067.79	c Thread 0 result 0
4244.34/1067.79	c Partial assignments = 31694626, improvements = 8362151  ucps = 41827899 PA/sec = 7466.87, subset nodes = 160213830
4244.34/1067.79	s UNSATISFIABLE
4244.34/1067.79	c CPU time = 4244.70 seconds
4244.34/1067.79	c Elapsed time = 1068 seconds

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3263674-1304097472/watcher-3263674-1304097472 -o /tmp/evaluation-result-3263674-1304097472/solver-3263674-1304097472 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3263674-1304097472.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.06 8.03 7.63 1/175 21676
/proc/meminfo: memFree=30875976/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=8972 CPUtime=0 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) R 21674 21676 21560 0 -1 4202496 320 0 0 0 0 0 0 0 21 0 1 0 599977787 9187328 263 33554432000 4194304 4338100 140735737711360 18446744073709551615 260020056773 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/21676/statm: 2243 269 147 36 0 148 0

[startup+0.103414 s]
/proc/loadavg: 8.06 8.03 7.63 1/175 21676
/proc/meminfo: memFree=30875976/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=15924 CPUtime=0.1 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) R 21674 21676 21560 0 -1 4202496 2020 0 0 0 10 0 0 0 21 0 1 0 599977787 16306176 1963 33554432000 4194304 4338100 140735737711360 18446744073709551615 260020395776 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/21676/statm: 3981 1964 148 36 0 1886 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 15924

[startup+0.2004 s]
/proc/loadavg: 8.06 8.03 7.63 1/175 21676
/proc/meminfo: memFree=30875976/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=61652 CPUtime=0.19 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) R 21674 21676 21560 0 -1 4202496 8739 0 0 0 19 0 0 0 22 0 1 0 599977787 63131648 8353 33554432000 4194304 4338100 140735737711360 18446744073709551615 4244820 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/21676/statm: 15413 8360 512 36 0 13318 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 61652

[startup+0.300376 s]
/proc/loadavg: 8.06 8.03 7.63 1/175 21676
/proc/meminfo: memFree=30875976/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=98324 CPUtime=0.29 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) R 21674 21676 21560 0 -1 4202496 11601 0 0 0 28 1 0 0 22 0 1 0 599977787 100683776 11129 33554432000 4194304 4338100 140735737711360 18446744073709551615 260019791457 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/21676/statm: 24581 11129 429 36 0 22486 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 98324

[startup+0.700302 s]
/proc/loadavg: 8.06 8.03 7.63 1/175 21676
/proc/meminfo: memFree=30875976/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=98324 CPUtime=0.69 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) R 21674 21676 21560 0 -1 4202496 11601 0 0 0 68 1 0 0 24 0 1 0 599977787 100683776 11129 33554432000 4194304 4338100 140735737711360 18446744073709551615 260019790864 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/21676/statm: 24581 11129 429 36 0 22486 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 98324

[startup+1.50015 s]
/proc/loadavg: 8.06 8.03 7.63 3/178 21704
/proc/meminfo: memFree=30857028/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=24296 CPUtime=1.49 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) R 21674 21676 21560 0 -1 4202496 11797 0 0 0 148 1 0 0 25 0 1 0 599977787 24879104 4112 33554432000 4194304 4338100 140735737711360 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/21676/statm: 6074 4112 212 36 0 3979 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 24296

[startup+3.10083 s]
/proc/loadavg: 8.06 8.03 7.63 7/182 21708
/proc/meminfo: memFree=30799744/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=226344 CPUtime=3.5 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 16781 0 0 0 348 2 0 0 25 0 5 0 599977787 231776256 8924 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 56586 8924 176 36 0 54491 0
Current children cumulated CPU time (s) 3.5
Current children cumulated vsize (KiB) 226344

[startup+6.30024 s]
/proc/loadavg: 7.82 7.98 7.62 10/186 21712
/proc/meminfo: memFree=30553128/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=382144 CPUtime=16.28 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 59946 0 0 0 1617 11 0 0 25 0 5 0 599977787 391315456 52089 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 95536 52089 176 36 0 93441 0
[pid=21676/tid=21709] ppid=21674 vsize=382144 CPUtime=3.32 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 11746 0 0 0 330 2 0 0 25 0 5 0 599978083 391315456 52089 33554432000 4194304 4338100 140735737711360 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=382144 CPUtime=3.31 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 11236 0 0 0 330 1 0 0 25 0 5 0 599978083 391315456 52090 33554432000 4194304 4338100 140735737711360 18446744073709551615 4288196 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=382144 CPUtime=3.33 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 12000 0 0 0 331 2 0 0 25 0 5 0 599978083 391315456 52090 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=382144 CPUtime=3.32 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 11775 0 0 0 330 2 0 0 25 0 5 0 599978083 391315456 52091 33554432000 4194304 4338100 140735737711360 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 16.28
Current children cumulated vsize (KiB) 382144

[startup+12.7011 s]
/proc/loadavg: 7.83 7.98 7.62 9/186 21713
/proc/meminfo: memFree=30175940/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=585576 CPUtime=41.77 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 115104 0 0 0 4152 25 0 0 25 0 5 0 599977787 599629824 107247 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 146394 107248 176 36 0 144299 0
[pid=21676/tid=21709] ppid=21674 vsize=585576 CPUtime=9.69 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 25200 0 0 0 964 5 0 0 25 0 5 0 599978083 599629824 107248 33554432000 4194304 4338100 140735737711360 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=585576 CPUtime=9.66 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 26514 0 0 0 962 4 0 0 25 0 5 0 599978083 599629824 107248 33554432000 4194304 4338100 140735737711360 18446744073709551615 4229545 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=585576 CPUtime=9.72 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 25065 0 0 0 966 6 0 0 25 0 5 0 599978083 599629824 107249 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=585576 CPUtime=9.7 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 25137 0 0 0 964 6 0 0 25 0 5 0 599978083 599629824 107249 33554432000 4194304 4338100 140735737711360 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 41.77
Current children cumulated vsize (KiB) 585576

[startup+25.5007 s]
/proc/loadavg: 7.94 8.00 7.63 9/186 21713
/proc/meminfo: memFree=29692596/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=878076 CPUtime=92.78 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 193401 0 0 0 9231 47 0 0 25 0 5 0 599977787 899149824 185544 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 219519 185544 176 36 0 217424 0
[pid=21676/tid=21709] ppid=21674 vsize=878076 CPUtime=22.42 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 47003 0 0 0 2229 13 0 0 25 0 5 0 599978083 899149824 185544 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=878076 CPUtime=22.43 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 45222 0 0 0 2233 10 0 0 25 0 5 0 599978083 899149824 185544 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254317 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=878076 CPUtime=22.46 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 44558 0 0 0 2235 11 0 0 25 0 5 0 599978083 899149824 185544 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=878076 CPUtime=22.47 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 43428 0 0 0 2237 10 0 0 25 0 5 0 599978083 899149824 185544 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 92.78
Current children cumulated vsize (KiB) 878076

[startup+51.101 s]
/proc/loadavg: 8.02 8.01 7.65 9/186 21714
/proc/meminfo: memFree=28900760/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=1315144 CPUtime=194.88 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 311176 0 0 0 19404 84 0 0 25 0 5 0 599977787 1346707456 303319 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 328786 303319 176 36 0 326691 0
[pid=21676/tid=21709] ppid=21674 vsize=1315144 CPUtime=47.82 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 79232 0 0 0 4758 24 0 0 25 0 5 0 599978083 1346707456 303319 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=1315144 CPUtime=48 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 74468 0 0 0 4782 18 0 0 25 0 5 0 599978083 1346707456 303319 33554432000 4194304 4338100 140735737711360 18446744073709551615 260019790864 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=1315144 CPUtime=48.04 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 72695 0 0 0 4784 20 0 0 25 0 5 0 599978083 1346707456 303319 33554432000 4194304 4338100 140735737711360 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=1315144 CPUtime=48.03 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 71591 0 0 0 4785 18 0 0 25 0 5 0 599978083 1346707456 303319 33554432000 4194304 4338100 140735737711360 18446744073709551615 4240519 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 194.88
Current children cumulated vsize (KiB) 1315144

[startup+102.301 s]
/proc/loadavg: 8.12 8.04 7.67 9/186 21715
/proc/meminfo: memFree=27895580/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=2031472 CPUtime=398.76 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 472420 0 0 0 39737 139 0 0 25 0 5 0 599977787 2080227328 464563 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 507868 464563 176 36 0 505773 0
[pid=21676/tid=21709] ppid=21674 vsize=2031472 CPUtime=98.55 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 125495 0 0 0 9813 42 0 0 25 0 5 0 599978083 2080227328 464563 33554432000 4194304 4338100 140735737711360 18446744073709551615 4286307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=2031472 CPUtime=99.03 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 112438 0 0 0 9873 30 0 0 25 0 5 0 599978083 2080227328 464563 33554432000 4194304 4338100 140735737711360 18446744073709551615 4256013 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=2031472 CPUtime=99.08 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 110605 0 0 0 9875 33 0 0 25 0 5 0 599978083 2080227328 464563 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=2031472 CPUtime=99.11 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 110692 0 0 0 9880 31 0 0 25 0 5 0 599978083 2080227328 464563 33554432000 4194304 4338100 140735737711360 18446744073709551615 4263564 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 398.76
Current children cumulated vsize (KiB) 2031472

[startup+162.3 s]
/proc/loadavg: 8.04 8.03 7.69 9/186 21717
/proc/meminfo: memFree=26826404/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=2605212 CPUtime=637.7 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 615934 0 0 0 63576 194 0 0 25 0 5 0 599977787 2667737088 608077 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 651303 608077 176 36 0 649208 0
[pid=21676/tid=21709] ppid=21674 vsize=2605212 CPUtime=158.22 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 166964 0 0 0 15767 55 0 0 25 0 5 0 599978083 2667737088 608077 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=2605212 CPUtime=158.85 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 147769 0 0 0 15840 45 0 0 25 0 5 0 599978083 2667737088 608077 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=2605212 CPUtime=158.73 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 140893 0 0 0 15829 44 0 0 25 0 5 0 599978083 2667737088 608077 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=2605212 CPUtime=158.89 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 147118 0 0 0 15843 46 0 0 25 0 5 0 599978083 2667737088 608077 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 637.7
Current children cumulated vsize (KiB) 2605212

[startup+222.306 s]
/proc/loadavg: 8.05 8.03 7.71 9/186 21718
/proc/meminfo: memFree=25798124/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=3070112 CPUtime=876.88 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 748203 0 0 0 87444 244 0 0 25 0 5 0 599977787 3143794688 740346 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 767528 740346 176 36 0 765433 0
[pid=21676/tid=21709] ppid=21674 vsize=3070112 CPUtime=217.72 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 207971 0 0 0 21702 70 0 0 25 0 5 0 599978083 3143794688 740346 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=3070112 CPUtime=218.73 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 182782 0 0 0 21815 58 0 0 25 0 5 0 599978083 3143794688 740346 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=3070112 CPUtime=218.64 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 170317 0 0 0 21809 55 0 0 25 0 5 0 599978083 3143794688 740346 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=3070112 CPUtime=218.78 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 173943 0 0 0 21822 56 0 0 25 0 5 0 599978083 3143794688 740346 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 876.88
Current children cumulated vsize (KiB) 3070112

################
# More data... #
################

[pid=21676/tid=21711] ppid=21674 vsize=5876812 CPUtime=756.38 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 314797 0 0 0 75513 125 0 0 25 0 5 0 599978083 6017855488 1418763 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=5876812 CPUtime=757.51 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 313586 0 0 0 75551 200 0 0 25 0 5 0 599978083 6017855488 1418763 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3028.18
Current children cumulated vsize (KiB) 5876812

[startup+822.301 s]
/proc/loadavg: 8.10 8.08 7.87 9/186 21734
/proc/meminfo: memFree=20487776/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=6106552 CPUtime=3267.22 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 1472572 0 0 0 325771 951 0 0 25 0 5 0 599977787 6253109248 1464715 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 1526638 1464715 176 36 0 1524543 0
[pid=21676/tid=21709] ppid=21674 vsize=6106552 CPUtime=814.71 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 477977 0 0 0 81268 203 0 0 25 0 5 0 599978083 6253109248 1464715 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=6106552 CPUtime=816.03 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 337150 0 0 0 81291 312 0 0 25 0 5 0 599978083 6253109248 1464715 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254291 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=6106552 CPUtime=816.25 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 322620 0 0 0 81494 131 0 0 25 0 5 0 599978083 6253109248 1464715 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254321 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=6106552 CPUtime=817.23 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 321635 0 0 0 81422 301 0 0 25 0 5 0 599978083 6253109248 1464716 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254437 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3267.22
Current children cumulated vsize (KiB) 6106552

[startup+882.307 s]
/proc/loadavg: 8.04 8.07 7.88 9/186 21736
/proc/meminfo: memFree=20087792/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=6246852 CPUtime=3506.32 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 1518963 0 0 0 349445 1187 0 0 25 0 5 0 599977787 6396776448 1511106 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 1561713 1511106 176 36 0 1559618 0
[pid=21676/tid=21709] ppid=21674 vsize=6246852 CPUtime=874.52 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 502448 0 0 0 87236 216 0 0 25 0 5 0 599978083 6396776448 1511106 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=6246852 CPUtime=875.88 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 341778 0 0 0 87170 418 0 0 25 0 5 0 599978083 6396776448 1511106 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254030 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=6246852 CPUtime=876.17 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 335853 0 0 0 87479 138 0 0 25 0 5 0 599978083 6396776448 1511106 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=6246852 CPUtime=876.76 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 325694 0 0 0 87264 412 0 0 25 0 5 0 599978083 6396776448 1511106 33554432000 4194304 4338100 140735737711360 18446744073709551615 260019791091 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3506.32
Current children cumulated vsize (KiB) 6246852

[startup+942.301 s]
/proc/loadavg: 8.13 8.08 7.90 9/186 21738
/proc/meminfo: memFree=19681136/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=6349516 CPUtime=3745 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 1554330 0 0 0 373099 1401 0 0 25 0 5 0 599977787 6501904384 1546473 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 1587379 1546473 176 36 0 1585284 0
[pid=21676/tid=21709] ppid=21674 vsize=6349516 CPUtime=934.16 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 518607 0 0 0 93188 228 0 0 25 0 5 0 599978083 6501904384 1546473 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=6349516 CPUtime=935.44 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 350069 0 0 0 93024 520 0 0 25 0 5 0 599978083 6501904384 1546473 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=6349516 CPUtime=935.95 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 339531 0 0 0 93454 141 0 0 25 0 5 0 599978083 6501904384 1546473 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254321 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=6349516 CPUtime=936.46 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 332933 0 0 0 93137 509 0 0 25 0 5 0 599978083 6501904384 1546473 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3745
Current children cumulated vsize (KiB) 6349516

[startup+1002.3 s]
/proc/loadavg: 8.05 8.06 7.90 9/186 21739
/proc/meminfo: memFree=19379384/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=6474340 CPUtime=3983.83 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 1590545 0 0 0 396758 1625 0 0 25 0 5 0 599977787 6629724160 1582688 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 1618585 1582688 176 36 0 1616490 0
[pid=21676/tid=21709] ppid=21674 vsize=6474340 CPUtime=993.8 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 532285 0 0 0 99145 235 0 0 25 0 5 0 599978083 6629724160 1582688 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=6474340 CPUtime=995.07 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 355020 0 0 0 98881 626 0 0 25 0 5 0 599978083 6629724160 1582688 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=6474340 CPUtime=995.82 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 350516 0 0 0 99435 147 0 0 25 0 5 0 599978083 6629724160 1582688 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=6474340 CPUtime=996.16 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 339534 0 0 0 99001 615 0 0 25 0 5 0 599978083 6629724160 1582688 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3983.83
Current children cumulated vsize (KiB) 6474340

[startup+1062.3 s]
/proc/loadavg: 8.19 8.10 7.92 9/186 21741
/proc/meminfo: memFree=19178404/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=6671696 CPUtime=4222.83 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 1621081 0 0 0 420134 2149 0 0 25 0 5 0 599977787 6831816704 1613224 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 1667924 1613224 176 36 0 1665829 0
[pid=21676/tid=21709] ppid=21674 vsize=6671696 CPUtime=1053.45 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 545758 0 0 0 104996 349 0 0 25 0 5 0 599978083 6831816704 1613224 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=6671696 CPUtime=1054.8 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 360359 0 0 0 104708 772 0 0 25 0 5 0 599978083 6831816704 1613224 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=6671696 CPUtime=1055.58 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 357992 0 0 0 105295 263 0 0 25 0 5 0 599978083 6831816704 1613224 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=6671696 CPUtime=1056.01 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 343782 0 0 0 104839 762 0 0 25 0 5 0 599978083 6831816704 1613224 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4222.83
Current children cumulated vsize (KiB) 6671696

Solver just ended. Dumping a history of the last processes samples

[startup+1062.4 s]
/proc/loadavg: 8.19 8.10 7.92 9/186 21741
/proc/meminfo: memFree=19178404/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=6671696 CPUtime=4223.23 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 1621113 0 0 0 420172 2151 0 0 25 0 5 0 599977787 6831816704 1613256 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 1667924 1613256 176 36 0 1665829 0
[pid=21676/tid=21709] ppid=21674 vsize=6671696 CPUtime=1053.55 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 545766 0 0 0 105005 350 0 0 25 0 5 0 599978083 6831816704 1613256 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221560 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=6671696 CPUtime=1054.89 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) S 21674 21676 21560 0 -1 4202560 360367 0 0 0 104717 772 0 0 25 0 5 0 599978083 6831816704 1613256 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221556 0 0 4096 0 18446604471094448192 0 0 -1 3 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=6671696 CPUtime=1055.68 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 358000 0 0 0 105304 264 0 0 25 0 5 0 599978083 6831816704 1613256 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=6671696 CPUtime=1056.11 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 343790 0 0 0 104849 762 0 0 25 0 5 0 599978083 6831816704 1613256 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4223.23
Current children cumulated vsize (KiB) 6671696

[startup+1065.6 s]
/proc/loadavg: 8.17 8.09 7.92 9/186 21741
/proc/meminfo: memFree=19166872/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=6672620 CPUtime=4235.96 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 1622396 0 0 0 421385 2211 0 0 25 0 5 0 599977787 6832762880 1614539 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 1668155 1614539 176 36 0 1666060 0
[pid=21676/tid=21709] ppid=21674 vsize=6672620 CPUtime=1056.71 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 546202 0 0 0 105306 365 0 0 20 0 5 0 599978083 6832762880 1614539 33554432000 4194304 4338100 140735737711360 18446744073709551615 4242683 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=6672620 CPUtime=1058.09 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 360727 0 0 0 105022 787 0 0 21 0 5 0 599978083 6832762880 1614539 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=6672620 CPUtime=1058.87 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 358244 0 0 0 105609 278 0 0 18 0 5 0 599978083 6832762880 1614539 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=6672620 CPUtime=1059.31 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 344033 0 0 0 105153 778 0 0 20 0 5 0 599978083 6832762880 1614539 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4235.96
Current children cumulated vsize (KiB) 6672620

[startup+1067.2 s]
/proc/loadavg: 8.17 8.09 7.92 6/186 21741
/proc/meminfo: memFree=19158068/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=6673148 CPUtime=4242.34 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 1622884 0 0 0 421997 2237 0 0 25 0 5 0 599977787 6833303552 1615027 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 1668287 1615027 176 36 0 1666192 0
[pid=21676/tid=21709] ppid=21674 vsize=6673148 CPUtime=1058.3 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 546321 0 0 0 105458 372 0 0 25 0 5 0 599978083 6833303552 1615027 33554432000 4194304 4338100 140735737711360 18446744073709551615 4287681 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=6673148 CPUtime=1059.69 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 360846 0 0 0 105176 793 0 0 25 0 5 0 599978083 6833303552 1615027 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=6673148 CPUtime=1060.46 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 358364 0 0 0 105762 284 0 0 20 0 5 0 599978083 6833303552 1615027 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=6673148 CPUtime=1060.9 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 344163 0 0 0 105305 785 0 0 19 0 5 0 599978083 6833303552 1615027 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4242.34
Current children cumulated vsize (KiB) 6673148

[startup+1067.6 s]
/proc/loadavg: 8.17 8.09 7.92 6/186 21741
/proc/meminfo: memFree=19158068/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=6673280 CPUtime=4243.94 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) S 21674 21676 21560 0 -1 4202496 1622993 0 0 0 422150 2244 0 0 25 0 5 0 599977787 6833438720 1615136 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 1668320 1615136 176 36 0 1666225 0
[pid=21676/tid=21709] ppid=21674 vsize=6673280 CPUtime=1058.7 cores=1,3,5,7
/proc/21676/task/21709/stat : 21709 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 546349 0 0 0 105497 373 0 0 25 0 5 0 599978083 6833438720 1615136 33554432000 4194304 4338100 140735737711360 18446744073709551615 4254400 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=21676/tid=21710] ppid=21674 vsize=6673280 CPUtime=1060.08 cores=1,3,5,7
/proc/21676/task/21710/stat : 21710 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 360873 0 0 0 105214 794 0 0 18 0 5 0 599978083 6833438720 1615136 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=21676/tid=21711] ppid=21674 vsize=6673280 CPUtime=1060.85 cores=1,3,5,7
/proc/21676/task/21711/stat : 21711 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 358391 0 0 0 105799 286 0 0 21 0 5 0 599978083 6833438720 1615136 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=21676/tid=21712] ppid=21674 vsize=6673280 CPUtime=1061.3 cores=1,3,5,7
/proc/21676/task/21712/stat : 21712 (ttsth-5-4) R 21674 21676 21560 0 -1 4202560 344190 0 0 0 105344 786 0 0 19 0 5 0 599978083 6833438720 1615136 33554432000 4194304 4338100 140735737711360 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4243.94
Current children cumulated vsize (KiB) 6673280

[startup+1068 s]
/proc/loadavg: 8.17 8.09 7.92 6/186 21741
/proc/meminfo: memFree=19158068/32951124 swapFree=67111464/67111528
[pid=21676] ppid=21674 vsize=0 CPUtime=4244.9 cores=1,3,5,7
/proc/21676/stat : 21676 (ttsth-5-4) R 21674 21676 21560 0 -1 4202500 1623080 0 0 0 422222 2268 0 0 18 0 1 0 599977787 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/21676/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 4244.9
Current children cumulated vsize (KiB) 0

Child status: 20
Real time (s): 1068.05
CPU time (s): 4244.96
CPU user time (s): 4222.23
CPU system time (s): 22.7325
CPU usage (%): 397.451
Max. virtual memory (cumulated for all children) (KiB): 6673280

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4222.23
system time used= 22.7325
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1623080
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 42397
involuntary context switches= 31030

runsolver used 1.77173 second user time and 4.05738 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-29 19:17:52
IDJOB=3263674
IDBENCH=84004
IDSOLVER=1654
FILE ID=node110/3263674-1304097472
RUNJOBID= node110-1304096259-21579
PBS_JOBID= 13170606
Free space on /tmp= 72836 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_50_30_20_3-log.shuffled-as.sat03-109.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3263674-1304097472/watcher-3263674-1304097472 -o /tmp/evaluation-result-3263674-1304097472/solver-3263674-1304097472 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3263674-1304097472.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f19999592ac4a0c798533d80c1c7f2d7
RANDOM SEED=1171089639

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30876256 kB
Buffers:        904372 kB
Cached:         699496 kB
SwapCached:         64 kB
Active:         124952 kB
Inactive:      1544976 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30876256 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:            2380 kB
Writeback:           0 kB
AnonPages:       65608 kB
Mapped:          15072 kB
Slab:           341720 kB
PageTables:       4764 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   220160 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72836 MiB
End job on node110 at 2011-04-29 19:35:40