Trace number 1775850

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (16 threads)? (MO) 6428.18 418.087

General information on the benchmark

Nameindustrial/fuhs/medium/
AProVE07-09.cnf
MD5SUM50ed98553825ac1825482c1496260592
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark623.33
Satisfiable
(Un)Satisfiability was proved
Number of variables33582
Number of clauses160817
Sum of the clauses size423605
Maximum clause length4200
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2136464
Number of clauses of size 36536
Number of clauses of size 46374
Number of clauses of size 52328
Number of clauses of size over 59114

Solver Data 

0.20/0.26	c Command: HOME/ttsth-5-0 -num-threads 16 HOME/instance-1775850-1244921811.cnf 
0.20/0.26	c Using SATTIMEOUT of 10000
0.20/0.26	c Using SATRAM of 2047
0.20/0.26	c Size of subset node = 16
0.20/0.26	c Variables = 33582
0.20/0.26	c Clauses = 160817
0.20/0.26	c Literals = 423605
0.20/0.26	c Reduced size:
0.20/0.26	c Variables = 33582
0.20/0.26	c Clauses = 135355
0.20/0.26	c Literals = 355691
0.20/0.26	c a2
1.10/1.17	c a1
12.70/12.75	c Independent sub-problems = 1
12.70/12.75	c Sub-problem with 29275 variables and 135355 clauses
12.70/12.75	c using permutation method 4
12.70/12.75	c count = 1
12.70/12.75	c Ordering finished 12.690 seconds
12.70/12.75	c mapped 12.740 seconds
12.70/12.75	c permuted 12.740 seconds
12.70/12.75	c about to sort
12.70/12.78	c sorted
14.48/14.55	c clauses now 135355
14.48/14.55	c init finished 13.320 seconds
14.48/14.55	c tree built 14.540 seconds
14.48/14.55	c 
14.48/14.55	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
14.48/14.55	c ---------------------------------|----------------------------------|------------------------------------------------------
14.48/14.55	c ................................ | ..........                       |                       14.6           0.0             
14.48/14.55	c ................................ | ..........                     1 |                       14.6           0.1             
14.48/14.55	c ................................ | ..........                     2 |                       14.6           0.1             
14.48/14.55	c ................................ | ..........                     3 |                       14.6           0.2             
14.48/14.55	c ................................ | ..........                     4 |                       14.6           0.3             
14.48/14.55	c ................................ | ..........                     5 |                       14.6           0.3             
14.48/14.57	c ................................ | ..........                  1000 | 38                    14.6          68.3          943
299.14/32.78	c ................................ | ..........               1718000 | 24000                200.7        8562.2      1540187
585.72/51.05	c ................................ | ..........               3303000 | 46214                400.0        8256.7      3498138
855.45/68.24	c ................................ | ..........               4957000 | 66283                601.7        8238.5      5651551
1121.18/85.26	c ................................ | ..........               6387000 | 82377                800.4        7979.8      7803362
1393.27/102.64	c ................................ | *.........               7612000 | 96306               1000.1        7611.4      9063393
1658.00/119.55	c ................................ | *.........               8881000 | 112432              1200.0        7400.8      9972781
1925.84/136.64	c ................................ | *.........              10151000 | 128633              1402.0        7240.3     11719272
2174.98/152.50	c ................................ | *.........              10941000 | 148868              1600.5        6836.1     14138962
2431.61/168.96	c ................................ | *.........              11635000 | 164745              1800.2        6463.2     17492721
2685.28/185.12	c ................................ | **........              12387000 | 181995              2000.0        6193.5     19984051

Verifier Data 

sh: BIN/SAT-verifier: No such file or directory

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1775850-1244921811/watcher-1775850-1244921811 -o /tmp/evaluation-result-1775850-1244921811/solver-1775850-1244921811 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 16 HOME/instance-1775850-1244921811.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 2/184 16656
/proc/meminfo: memFree=19076792/36427776 swapFree=4320/7896
[pid=16656] ppid=16654 vsize=1580 CPUtime=0
/proc/16656/stat : 16656 (ttsth-5-0) R 16654 16656 15497 0 -1 4202496 271 0 0 0 0 0 0 0 20 0 1 0 651487481 1617920 227 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134732614 0 0 1 0 0 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 395 228 75 177 0 217 0

[startup+0.108252 s]
/proc/loadavg: 0.92 0.98 0.99 2/184 16656
/proc/meminfo: memFree=19076792/36427776 swapFree=4320/7896
[pid=16656] ppid=16654 vsize=8348 CPUtime=0.1
/proc/16656/stat : 16656 (ttsth-5-0) R 16654 16656 15497 0 -1 4202496 1948 0 0 0 10 0 0 0 20 0 1 0 651487481 8548352 1904 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134735855 0 0 1 0 0 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 2087 1905 75 177 0 1909 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 8348

[startup+0.204267 s]
/proc/loadavg: 0.92 0.98 0.99 2/184 16656
/proc/meminfo: memFree=19076792/36427776 swapFree=4320/7896
[pid=16656] ppid=16654 vsize=12576 CPUtime=0.2
/proc/16656/stat : 16656 (ttsth-5-0) R 16654 16656 15497 0 -1 4202496 2937 0 0 0 18 2 0 0 20 0 1 0 651487481 12877824 2893 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134534262 0 0 1 0 0 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 3144 2893 75 177 0 2966 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 12576

[startup+0.300294 s]
/proc/loadavg: 0.92 0.98 0.99 2/184 16656
/proc/meminfo: memFree=19076792/36427776 swapFree=4320/7896
[pid=16656] ppid=16654 vsize=22316 CPUtime=0.28
/proc/16656/stat : 16656 (ttsth-5-0) R 16654 16656 15497 0 -1 4202496 5264 0 0 0 26 2 0 0 20 0 1 0 651487481 22851584 5220 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134749343 0 0 1 0 0 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 5579 5220 76 177 0 5401 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 22316

[startup+0.700281 s]
/proc/loadavg: 0.92 0.98 0.99 2/184 16656
/proc/meminfo: memFree=19076792/36427776 swapFree=4320/7896
[pid=16656] ppid=16654 vsize=48744 CPUtime=0.68
/proc/16656/stat : 16656 (ttsth-5-0) R 16654 16656 15497 0 -1 4202496 11140 0 0 0 64 4 0 0 20 0 1 0 651487481 49913856 11095 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134519986 0 0 1 0 0 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 12186 11095 76 177 0 12008 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 48744

[startup+1.50035 s]
/proc/loadavg: 0.92 0.98 0.99 2/185 16657
/proc/meminfo: memFree=19033024/36427776 swapFree=5016/52220
[pid=16656] ppid=16654 vsize=48860 CPUtime=1.5
/proc/16656/stat : 16656 (ttsth-5-0) R 16654 16656 15497 0 -1 4202496 11828 0 0 0 144 6 0 0 20 0 1 0 651487481 50032640 11393 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134730914 0 0 1 0 0 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 12215 11393 77 177 0 12037 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 48860

[startup+3.10045 s]
/proc/loadavg: 0.92 0.98 0.99 2/185 16657
/proc/meminfo: memFree=19029512/36427776 swapFree=5060/56256
[pid=16656] ppid=16654 vsize=48860 CPUtime=3.1
/proc/16656/stat : 16656 (ttsth-5-0) R 16654 16656 15497 0 -1 4202496 12381 0 0 0 304 6 0 0 20 0 1 0 651487481 50032640 11946 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134555272 0 0 1 0 0 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 12215 11946 77 177 0 12037 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 48860

[startup+6.30071 s]
/proc/loadavg: 0.93 0.98 0.99 2/185 16657
/proc/meminfo: memFree=19028732/36427776 swapFree=4620/56768
[pid=16656] ppid=16654 vsize=48860 CPUtime=6.3
/proc/16656/stat : 16656 (ttsth-5-0) R 16654 16656 15497 0 -1 4202496 12381 0 0 0 624 6 0 0 20 0 1 0 651487481 50032640 11946 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134555272 0 0 1 0 0 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 12215 11946 77 177 0 12037 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 48860

[startup+12.7013 s]
/proc/loadavg: 0.93 0.98 0.99 2/185 16657
/proc/meminfo: memFree=19028376/36427776 swapFree=4620/56892
[pid=16656] ppid=16654 vsize=48860 CPUtime=12.7
/proc/16656/stat : 16656 (ttsth-5-0) R 16654 16656 15497 0 -1 4202496 12408 0 0 0 1264 6 0 0 20 0 1 0 651487481 50032640 11973 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134723354 0 0 1 0 0 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 12215 11973 77 177 0 12037 0
Current children cumulated CPU time (s) 12.7
Current children cumulated vsize (KiB) 48860

[startup+25.5077 s]
/proc/loadavg: 3.25 1.48 1.16 17/201 16673
/proc/meminfo: memFree=18646056/36427776 swapFree=4692/441880
[pid=16656] ppid=16654 vsize=549408 CPUtime=186.29
/proc/16656/stat : 16656 (ttsth-5-0) S 16654 16656 15497 0 -1 4202496 109382 0 0 0 7898 10731 0 0 20 0 17 0 651487481 562593792 108487 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 137352 108487 95 177 0 137174 0
[pid=16656/tid=16658] ppid=16654 vsize=549408 CPUtime=10.92
/proc/16656/task/16658/stat : 16658 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1220 0 0 0 1088 4 0 0 20 0 17 0 651488936 562593792 108487 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134591304 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=16656/tid=16659] ppid=16654 vsize=549408 CPUtime=10.72
/proc/16656/task/16659/stat : 16659 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 716 0 0 0 334 738 0 0 20 0 17 0 651488936 562593792 108487 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=16656/tid=16660] ppid=16654 vsize=549408 CPUtime=10.7
/proc/16656/task/16660/stat : 16660 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 836 0 0 0 340 730 0 0 20 0 17 0 651488936 562593792 108488 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=16656/tid=16661] ppid=16654 vsize=549408 CPUtime=10.72
/proc/16656/task/16661/stat : 16661 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 617 0 0 0 364 708 0 0 20 0 17 0 651488936 562593792 108488 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=16656/tid=16662] ppid=16654 vsize=549408 CPUtime=10.72
/proc/16656/task/16662/stat : 16662 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 615 0 0 0 356 716 0 0 20 0 17 0 651488936 562593792 108488 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=16656/tid=16663] ppid=16654 vsize=549408 CPUtime=10.72
/proc/16656/task/16663/stat : 16663 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 585 0 0 0 346 726 0 0 20 0 17 0 651488936 562593792 108488 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=16656/tid=16664] ppid=16654 vsize=549408 CPUtime=10.74
/proc/16656/task/16664/stat : 16664 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 845 0 0 0 364 710 0 0 20 0 17 0 651488936 562593792 108488 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=16656/tid=16665] ppid=16654 vsize=549408 CPUtime=10.72
/proc/16656/task/16665/stat : 16665 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 848 0 0 0 372 700 0 0 20 0 17 0 651488936 562593792 108488 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=16656/tid=16666] ppid=16654 vsize=549408 CPUtime=10.72
/proc/16656/task/16666/stat : 16666 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 599 0 0 0 360 712 0 0 20 0 17 0 651488936 562593792 108488 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=16656/tid=16667] ppid=16654 vsize=549408 CPUtime=10.74
/proc/16656/task/16667/stat : 16667 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 855 0 0 0 364 710 0 0 20 0 17 0 651488936 562593792 108488 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=16656/tid=16668] ppid=16654 vsize=549408 CPUtime=10.76
/proc/16656/task/16668/stat : 16668 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 505 0 0 0 378 698 0 0 20 0 17 0 651488936 562593792 108488 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134591168 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=16656/tid=16669] ppid=16654 vsize=549408 CPUtime=10.74
/proc/16656/task/16669/stat : 16669 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 544 0 0 0 366 708 0 0 20 0 17 0 651488937 562593792 108489 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=16656/tid=16670] ppid=16654 vsize=549408 CPUtime=10.74
/proc/16656/task/16670/stat : 16670 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 598 0 0 0 364 710 0 0 20 0 17 0 651488937 562593792 108489 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=16656/tid=16671] ppid=16654 vsize=549408 CPUtime=10.52
/proc/16656/task/16671/stat : 16671 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 652 0 0 0 336 716 0 0 20 0 17 0 651488937 562593792 108491 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=16656/tid=16672] ppid=16654 vsize=549408 CPUtime=10.72
/proc/16656/task/16672/stat : 16672 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 737 0 0 0 378 694 0 0 20 0 17 0 651488937 562593792 108491 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134732614 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=16656/tid=16673] ppid=16654 vsize=549408 CPUtime=10.7
/proc/16656/task/16673/stat : 16673 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 526 0 0 0 366 704 0 0 20 0 17 0 651488938 562593792 108491 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134551002 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 186.29
Current children cumulated vsize (KiB) 549408

[startup+51.1044 s]
/proc/loadavg: 7.60 2.64 1.55 17/201 16673
/proc/meminfo: memFree=18579260/36427776 swapFree=4692/508396
[pid=16656] ppid=16654 vsize=609968 CPUtime=587.32
/proc/16656/stat : 16656 (ttsth-5-0) S 16654 16656 15497 0 -1 4202496 125797 0 0 0 26376 32356 0 0 20 0 17 0 651487481 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 152492 124902 95 177 0 152314 0
[pid=16656/tid=16658] ppid=16654 vsize=609968 CPUtime=36.53
/proc/16656/task/16658/stat : 16658 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 3298 0 0 0 3645 8 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134588414 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=16656/tid=16659] ppid=16654 vsize=609968 CPUtime=35.7
/proc/16656/task/16659/stat : 16659 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1898 0 0 0 1358 2212 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=16656/tid=16660] ppid=16654 vsize=609968 CPUtime=35.72
/proc/16656/task/16660/stat : 16660 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1757 0 0 0 1392 2180 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134551710 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=16656/tid=16661] ppid=16654 vsize=609968 CPUtime=35.78
/proc/16656/task/16661/stat : 16661 (ttsth-5-0) S 16654 16656 15497 0 -1 4202560 1362 0 0 0 1418 2160 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 18446744071564503368 0 0 -1 5 0 0 0 0 0
[pid=16656/tid=16662] ppid=16654 vsize=609968 CPUtime=35.74
/proc/16656/task/16662/stat : 16662 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1572 0 0 0 1394 2180 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=16656/tid=16663] ppid=16654 vsize=609968 CPUtime=35.8
/proc/16656/task/16663/stat : 16663 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1704 0 0 0 1464 2116 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=16656/tid=16664] ppid=16654 vsize=609968 CPUtime=35.8
/proc/16656/task/16664/stat : 16664 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 2081 0 0 0 1432 2148 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=16656/tid=16665] ppid=16654 vsize=609968 CPUtime=35.76
/proc/16656/task/16665/stat : 16665 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1396 0 0 0 1442 2134 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=16656/tid=16666] ppid=16654 vsize=609968 CPUtime=35.76
/proc/16656/task/16666/stat : 16666 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1446 0 0 0 1382 2194 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=16656/tid=16667] ppid=16654 vsize=609968 CPUtime=35.84
/proc/16656/task/16667/stat : 16667 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1565 0 0 0 1436 2148 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=16656/tid=16668] ppid=16654 vsize=609968 CPUtime=35.82
/proc/16656/task/16668/stat : 16668 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1558 0 0 0 1462 2120 0 0 20 0 17 0 651488936 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=16656/tid=16669] ppid=16654 vsize=609968 CPUtime=35.88
/proc/16656/task/16669/stat : 16669 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1558 0 0 0 1480 2108 0 0 20 0 17 0 651488937 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=16656/tid=16670] ppid=16654 vsize=609968 CPUtime=35.84
/proc/16656/task/16670/stat : 16670 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1556 0 0 0 1388 2196 0 0 20 0 17 0 651488937 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=16656/tid=16671] ppid=16654 vsize=609968 CPUtime=35.18
/proc/16656/task/16671/stat : 16671 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1660 0 0 0 1402 2116 0 0 20 0 17 0 651488937 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=16656/tid=16672] ppid=16654 vsize=609968 CPUtime=35.78
/proc/16656/task/16672/stat : 16672 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1910 0 0 0 1484 2094 0 0 20 0 17 0 651488937 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=16656/tid=16673] ppid=16654 vsize=609968 CPUtime=35.7
/proc/16656/task/16673/stat : 16673 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 1389 0 0 0 1376 2194 0 0 20 0 17 0 651488938 624607232 124902 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134592489 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 587.32
Current children cumulated vsize (KiB) 609968

[startup+102.303 s]
/proc/loadavg: 12.35 4.70 2.30 16/201 16673
/proc/meminfo: memFree=18433624/36427776 swapFree=4692/653900
[pid=16656] ppid=16654 vsize=737840 CPUtime=1388.71
/proc/16656/stat : 16656 (ttsth-5-0) S 16654 16656 15497 0 -1 4202496 162126 0 0 0 72276 66595 0 0 20 0 17 0 651487481 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 184460 161231 95 177 0 184282 0
[pid=16656/tid=16658] ppid=16654 vsize=737840 CPUtime=87.74
/proc/16656/task/16658/stat : 16658 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 4342 0 0 0 8756 18 0 0 20 0 17 0 651488936 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562388 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=16656/tid=16659] ppid=16654 vsize=737840 CPUtime=85.65
/proc/16656/task/16659/stat : 16659 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 4139 0 0 0 3988 4577 0 0 20 0 17 0 651488936 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=16656/tid=16660] ppid=16654 vsize=737840 CPUtime=85.58
/proc/16656/task/16660/stat : 16660 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 4365 0 0 0 3923 4635 0 0 20 0 17 0 651488936 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=16656/tid=16661] ppid=16654 vsize=737840 CPUtime=85.74
/proc/16656/task/16661/stat : 16661 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 3158 0 0 0 4095 4479 0 0 20 0 17 0 651488936 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=16656/tid=16662] ppid=16654 vsize=737840 CPUtime=85.73
/proc/16656/task/16662/stat : 16662 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 4083 0 0 0 4065 4508 0 0 20 0 17 0 651488936 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=16656/tid=16663] ppid=16654 vsize=737840 CPUtime=86.07
/proc/16656/task/16663/stat : 16663 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 5415 0 0 0 4355 4252 0 0 20 0 17 0 651488936 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=16656/tid=16664] ppid=16654 vsize=737840 CPUtime=85.86
/proc/16656/task/16664/stat : 16664 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 4585 0 0 0 4160 4426 0 0 20 0 17 0 651488936 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=16656/tid=16665] ppid=16654 vsize=737840 CPUtime=86.05
/proc/16656/task/16665/stat : 16665 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 3672 0 0 0 4258 4347 0 0 20 0 17 0 651488936 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=16656/tid=16666] ppid=16654 vsize=737840 CPUtime=85.76
/proc/16656/task/16666/stat : 16666 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 3341 0 0 0 4059 4517 0 0 20 0 17 0 651488936 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=16656/tid=16667] ppid=16654 vsize=737840 CPUtime=85.93
/proc/16656/task/16667/stat : 16667 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 3541 0 0 0 4201 4392 0 0 20 0 17 0 651488936 755548160 161231 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=16656/tid=16668] ppid=16654 vsize=737840 CPUtime=85.9

################
# More data... #
################

/proc/16656/task/16668/stat : 16668 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 26480 0 0 0 18311 7789 0 0 20 0 17 0 651488936 1528315904 344900 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=16656/tid=16669] ppid=16654 vsize=1492496 CPUtime=259.56
/proc/16656/task/16669/stat : 16669 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 11131 0 0 0 17385 8571 0 0 20 0 17 0 651488937 1528315904 344901 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=16656/tid=16670] ppid=16654 vsize=1492496 CPUtime=263.01
/proc/16656/task/16670/stat : 16670 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 14489 0 0 0 17673 8628 0 0 20 0 17 0 651488937 1528315904 344901 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=16656/tid=16671] ppid=16654 vsize=1492496 CPUtime=259.91
/proc/16656/task/16671/stat : 16671 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 15132 0 0 0 17597 8394 0 0 20 0 17 0 651488937 1528315904 344901 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134591264 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=16656/tid=16672] ppid=16654 vsize=1492496 CPUtime=257.85
/proc/16656/task/16672/stat : 16672 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 11546 0 0 0 17089 8696 0 0 20 0 17 0 651488937 1528315904 344901 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562351 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=16656/tid=16673] ppid=16654 vsize=1492496 CPUtime=259.61
/proc/16656/task/16673/stat : 16673 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 9214 0 0 0 17227 8734 0 0 20 0 17 0 651488938 1528315904 344901 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
Current children cumulated CPU time (s) 4169.14
Current children cumulated vsize (KiB) 1492496

[startup+342.302 s]
/proc/loadavg: 15.92 10.91 5.40 17/201 16678
/proc/meminfo: memFree=17392012/36427776 swapFree=4692/1693804
[pid=16656] ppid=16654 vsize=1820944 CPUtime=5180.21
/proc/16656/stat : 16656 (ttsth-5-0) S 16654 16656 15497 0 -1 4202496 422550 0 0 0 389565 128456 0 0 20 0 17 0 651487481 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 455236 421655 95 177 0 455058 0
[pid=16656/tid=16658] ppid=16654 vsize=1820944 CPUtime=327.56
/proc/16656/task/16658/stat : 16658 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 26049 0 0 0 32676 80 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562357 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=16656/tid=16659] ppid=16654 vsize=1820944 CPUtime=323.45
/proc/16656/task/16659/stat : 16659 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 23168 0 0 0 23690 8655 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562351 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=16656/tid=16660] ppid=16654 vsize=1820944 CPUtime=317.77
/proc/16656/task/16660/stat : 16660 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 36826 0 0 0 22799 8978 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=16656/tid=16661] ppid=16654 vsize=1820944 CPUtime=324.4
/proc/16656/task/16661/stat : 16661 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 15474 0 0 0 23779 8661 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=16656/tid=16662] ppid=16654 vsize=1820944 CPUtime=315.8
/proc/16656/task/16662/stat : 16662 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 17444 0 0 0 23180 8400 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=16656/tid=16663] ppid=16654 vsize=1820944 CPUtime=321.52
/proc/16656/task/16663/stat : 16663 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 18922 0 0 0 23620 8532 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=16656/tid=16664] ppid=16654 vsize=1820944 CPUtime=325.61
/proc/16656/task/16664/stat : 16664 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 17301 0 0 0 24033 8528 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562272 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=16656/tid=16665] ppid=16654 vsize=1820944 CPUtime=323.92
/proc/16656/task/16665/stat : 16665 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 20787 0 0 0 23876 8516 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562357 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=16656/tid=16666] ppid=16654 vsize=1820944 CPUtime=324.83
/proc/16656/task/16666/stat : 16666 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 15705 0 0 0 23710 8773 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=16656/tid=16667] ppid=16654 vsize=1820944 CPUtime=320.62
/proc/16656/task/16667/stat : 16667 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 21759 0 0 0 23588 8474 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=16656/tid=16668] ppid=16654 vsize=1820944 CPUtime=323.79
/proc/16656/task/16668/stat : 16668 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 30803 0 0 0 24590 7789 0 0 20 0 17 0 651488936 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=16656/tid=16669] ppid=16654 vsize=1820944 CPUtime=323.21
/proc/16656/task/16669/stat : 16669 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 14190 0 0 0 23750 8571 0 0 20 0 17 0 651488937 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=16656/tid=16670] ppid=16654 vsize=1820944 CPUtime=326.34
/proc/16656/task/16670/stat : 16670 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 19826 0 0 0 24006 8628 0 0 20 0 17 0 651488937 1864646656 421655 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=16656/tid=16671] ppid=16654 vsize=1820944 CPUtime=321.91
/proc/16656/task/16671/stat : 16671 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 18538 0 0 0 23797 8394 0 0 20 0 17 0 651488937 1864646656 421656 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=16656/tid=16672] ppid=16654 vsize=1820944 CPUtime=321.5
/proc/16656/task/16672/stat : 16672 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 16239 0 0 0 23454 8696 0 0 20 0 17 0 651488937 1864646656 421656 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=16656/tid=16673] ppid=16654 vsize=1820944 CPUtime=323.31
/proc/16656/task/16673/stat : 16673 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 11432 0 0 0 23597 8734 0 0 20 0 17 0 651488938 1864646656 421656 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
Current children cumulated CPU time (s) 5180.21
Current children cumulated vsize (KiB) 1820944

[startup+402.306 s]
/proc/loadavg: 15.97 11.84 6.06 17/201 16678
/proc/meminfo: memFree=17186244/36427776 swapFree=4692/1898752
[pid=16656] ppid=16654 vsize=2040980 CPUtime=6171.95
/proc/16656/stat : 16656 (ttsth-5-0) S 16654 16656 15497 0 -1 4202496 474216 0 0 0 488734 128461 0 0 20 0 17 0 651487481 2089963520 473321 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 510245 473321 95 177 0 510067 0
[pid=16656/tid=16658] ppid=16654 vsize=2040980 CPUtime=387.55
/proc/16656/task/16658/stat : 16658 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 28623 0 0 0 38671 84 0 0 20 0 17 0 651488936 2089963520 473321 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=16656/tid=16659] ppid=16654 vsize=2040980 CPUtime=385.69
/proc/16656/task/16659/stat : 16659 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 26249 0 0 0 29914 8655 0 0 20 0 17 0 651488936 2089963520 473321 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=16656/tid=16660] ppid=16654 vsize=2040980 CPUtime=379.75
/proc/16656/task/16660/stat : 16660 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 50871 0 0 0 28997 8978 0 0 20 0 17 0 651488936 2089963520 473321 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=16656/tid=16661] ppid=16654 vsize=2040980 CPUtime=386.75
/proc/16656/task/16661/stat : 16661 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 17759 0 0 0 30014 8661 0 0 20 0 17 0 651488936 2089963520 473321 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=16656/tid=16662] ppid=16654 vsize=2040980 CPUtime=377.64
/proc/16656/task/16662/stat : 16662 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 19440 0 0 0 29364 8400 0 0 20 0 17 0 651488936 2089963520 473321 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134561428 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=16656/tid=16663] ppid=16654 vsize=2040980 CPUtime=383.88
/proc/16656/task/16663/stat : 16663 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 20380 0 0 0 29856 8532 0 0 20 0 17 0 651488936 2089963520 473321 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=16656/tid=16664] ppid=16654 vsize=2040980 CPUtime=387.86
/proc/16656/task/16664/stat : 16664 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 19001 0 0 0 30258 8528 0 0 20 0 17 0 651488936 2089963520 473321 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=16656/tid=16665] ppid=16654 vsize=2040980 CPUtime=386.15
/proc/16656/task/16665/stat : 16665 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 23669 0 0 0 30099 8516 0 0 20 0 17 0 651488936 2089963520 473321 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=16656/tid=16666] ppid=16654 vsize=2040980 CPUtime=387.06
/proc/16656/task/16666/stat : 16666 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 20097 0 0 0 29933 8773 0 0 20 0 17 0 651488936 2089963520 473321 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562380 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=16656/tid=16667] ppid=16654 vsize=2040980 CPUtime=383.02
/proc/16656/task/16667/stat : 16667 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 22938 0 0 0 29828 8474 0 0 20 0 17 0 651488936 2089963520 473322 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562351 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=16656/tid=16668] ppid=16654 vsize=2040980 CPUtime=385.61
/proc/16656/task/16668/stat : 16668 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 33612 0 0 0 30772 7789 0 0 20 0 17 0 651488936 2089963520 473322 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=16656/tid=16669] ppid=16654 vsize=2040980 CPUtime=385.46
/proc/16656/task/16669/stat : 16669 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 16411 0 0 0 29975 8571 0 0 20 0 17 0 651488937 2089963520 473322 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=16656/tid=16670] ppid=16654 vsize=2040980 CPUtime=388.61
/proc/16656/task/16670/stat : 16670 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 22916 0 0 0 30233 8628 0 0 20 0 17 0 651488937 2089963520 473322 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=16656/tid=16671] ppid=16654 vsize=2040980 CPUtime=382.76
/proc/16656/task/16671/stat : 16671 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 21268 0 0 0 29882 8394 0 0 20 0 17 0 651488937 2089963520 473322 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=16656/tid=16672] ppid=16654 vsize=2040980 CPUtime=383.8
/proc/16656/task/16672/stat : 16672 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 19770 0 0 0 29684 8696 0 0 20 0 17 0 651488937 2089963520 473322 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=16656/tid=16673] ppid=16654 vsize=2040980 CPUtime=385.63
/proc/16656/task/16673/stat : 16673 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 13126 0 0 0 29829 8734 0 0 20 0 17 0 651488938 2089963520 473322 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
Current children cumulated CPU time (s) 6171.95
Current children cumulated vsize (KiB) 2040980



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+417.905 s]
/proc/loadavg: 15.98 12.04 6.22 17/201 16678
/proc/meminfo: memFree=17131312/36427776 swapFree=4692/1953688
[pid=16656] ppid=16654 vsize=2096540 CPUtime=6428.03
/proc/16656/stat : 16656 (ttsth-5-0) S 16654 16656 15497 0 -1 4202496 487092 0 0 0 514340 128463 0 0 20 0 17 0 651487481 2146856960 486197 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 524135 486197 95 177 0 523957 0
[pid=16656/tid=16658] ppid=16654 vsize=2096540 CPUtime=403.16
/proc/16656/task/16658/stat : 16658 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 29266 0 0 0 40230 86 0 0 20 0 17 0 651488936 2146856960 486199 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=16656/tid=16659] ppid=16654 vsize=2096540 CPUtime=401.78
/proc/16656/task/16659/stat : 16659 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 26854 0 0 0 31523 8655 0 0 20 0 17 0 651488936 2146856960 486200 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562344 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=16656/tid=16660] ppid=16654 vsize=2096540 CPUtime=395.78
/proc/16656/task/16660/stat : 16660 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 54335 0 0 0 30600 8978 0 0 20 0 17 0 651488936 2146856960 486200 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562290 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=16656/tid=16661] ppid=16654 vsize=2096540 CPUtime=402.81
/proc/16656/task/16661/stat : 16661 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 18369 0 0 0 31620 8661 0 0 20 0 17 0 651488936 2146856960 486200 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562273 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=16656/tid=16662] ppid=16654 vsize=2096540 CPUtime=393.61
/proc/16656/task/16662/stat : 16662 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 20098 0 0 0 30961 8400 0 0 20 0 17 0 651488936 2146856960 486200 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=16656/tid=16663] ppid=16654 vsize=2096540 CPUtime=399.97
/proc/16656/task/16663/stat : 16663 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 20631 0 0 0 31465 8532 0 0 20 0 17 0 651488936 2146856960 486200 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=16656/tid=16664] ppid=16654 vsize=2096540 CPUtime=403.93
/proc/16656/task/16664/stat : 16664 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 19388 0 0 0 31865 8528 0 0 20 0 17 0 651488936 2146856960 486200 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=16656/tid=16665] ppid=16654 vsize=2096540 CPUtime=402.2
/proc/16656/task/16665/stat : 16665 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 24475 0 0 0 31704 8516 0 0 20 0 17 0 651488936 2146856960 486200 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562341 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=16656/tid=16666] ppid=16654 vsize=2096540 CPUtime=403.13
/proc/16656/task/16666/stat : 16666 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 20959 0 0 0 31540 8773 0 0 20 0 17 0 651488936 2146856960 486200 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=16656/tid=16667] ppid=16654 vsize=2096540 CPUtime=399.11
/proc/16656/task/16667/stat : 16667 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 23228 0 0 0 31437 8474 0 0 20 0 17 0 651488936 2146856960 486200 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562380 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=16656/tid=16668] ppid=16654 vsize=2096540 CPUtime=401.61
/proc/16656/task/16668/stat : 16668 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 34205 0 0 0 32372 7789 0 0 20 0 17 0 651488936 2146856960 486201 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=16656/tid=16669] ppid=16654 vsize=2096540 CPUtime=401.56
/proc/16656/task/16669/stat : 16669 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 17099 0 0 0 31585 8571 0 0 20 0 17 0 651488937 2146856960 486201 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562344 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=16656/tid=16670] ppid=16654 vsize=2096540 CPUtime=404.65
/proc/16656/task/16670/stat : 16670 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 23857 0 0 0 31837 8628 0 0 20 0 17 0 651488937 2146856960 486201 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=16656/tid=16671] ppid=16654 vsize=2096540 CPUtime=398.46
/proc/16656/task/16671/stat : 16671 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 22088 0 0 0 31452 8394 0 0 20 0 17 0 651488937 2146856960 486201 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=16656/tid=16672] ppid=16654 vsize=2096540 CPUtime=399.87
/proc/16656/task/16672/stat : 16672 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 20433 0 0 0 31291 8696 0 0 20 0 17 0 651488937 2146856960 486201 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=16656/tid=16673] ppid=16654 vsize=2096540 CPUtime=401.69
/proc/16656/task/16673/stat : 16673 (ttsth-5-0) R 16654 16656 15497 0 -1 4202560 13723 0 0 0 31435 8734 0 0 20 0 17 0 651488938 2146856960 486201 18446744073709551615 134512640 135237372 4287098720 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
Current children cumulated CPU time (s) 6428.03
Current children cumulated vsize (KiB) 2096540

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+418.025 s]
/proc/loadavg: 15.98 12.04 6.22 2/187 16679
/proc/meminfo: memFree=17986456/36427776 swapFree=4692/1097128
[pid=16656] ppid=16654 vsize=0 CPUtime=6428.18
/proc/16656/stat : 16656 (ttsth-5-0) Z 16654 16656 15497 0 -1 4203532 487100 0 0 0 514354 128464 0 0 20 0 2 0 651487481 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/16656/statm: 0 0 0 0 0 0 0
[pid=16656/tid=16668] ppid=16654 vsize=0 CPUtime=401.61
/proc/16656/task/16668/stat : 16668 (ttsth-5-0) R 16654 16656 15497 0 -1 4203588 34205 0 0 0 32372 7789 0 0 20 0 2 0 651488936 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6428.18
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16656 and gives
#  childrusage.ru_utime.tv_sec=5143
#  childrusage.ru_utime.tv_usec=537451
#  childrusage.ru_stime.tv_sec=1284
#  childrusage.ru_stime.tv_usec=636284
# CPU time returned by wait4() is 6428.17
# while last known CPU time is 6428.18
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 418.087
CPU time (s): 6428.18
CPU user time (s): 5143.54
CPU system time (s): 1284.64
CPU usage (%): 1537.52
Max. virtual memory (cumulated for all children) (KiB): 2096540

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5143.54
system time used= 1284.64
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 487100
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 510824
involuntary context switches= 23632

runsolver used 2.32815 second user time and 6.13638 second system time

The end

Launcher Data 

Begin job on xenhost3-49 at 2009-06-13 21:36:51
IDJOB=1775850
IDBENCH=20390
IDSOLVER=634
FILE ID=xenhost3-49/1775850-1244921811
PBS_JOBID=
Free space on /tmp= 7024 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (16 threads)
BENCH NAME= SAT07/industrial/fuhs/medium/AProVE07-09.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1775850-1244921811/watcher-1775850-1244921811 -o /tmp/evaluation-result-1775850-1244921811/solver-1775850-1244921811 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 16 HOME/instance-1775850-1244921811.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 16

MD5SUM BENCH= 50ed98553825ac1825482c1496260592
RANDOM SEED= 1694656977

Linux xenhost3-49 2.6.27.5 #1 SMP Mon Mar 30 10:34:22 CEST 2009 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 8
initial apicid	: 8
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 24
initial apicid	: 24
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 10
initial apicid	: 10
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 26
initial apicid	: 26
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 9
initial apicid	: 9
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 25
initial apicid	: 25
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 11
initial apicid	: 11
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 27
initial apicid	: 27
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:     36427776 kB
MemFree:      19076792 kB
Buffers:        460096 kB
Cached:       14116608 kB
SwapCached:          0 kB
Active:        4106380 kB
Inactive:     10478784 kB
SwapTotal:    25398692 kB
SwapFree:     25398692 kB
Dirty:            3324 kB
Writeback:           0 kB
AnonPages:        7896 kB
Mapped:           4320 kB
Slab:           711416 kB
SReclaimable:   684688 kB
SUnreclaim:      26728 kB
PageTables:          0 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
WritebackTmp:        0 kB
CommitLimit:  43612580 kB
Committed_AS:    29736 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    275248 kB
VmallocChunk: 34359462839 kB
DirectMap4k:  99216660 kB
DirectMap2M:         0 kB

Free space on /tmp at the end= 7023 MiB
End job on xenhost3-49 at 2009-06-13 21:43:51