Trace number 1780830

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (16 threads)? (MO) 1494.35 104.63

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_17_UNKNOWN.cnf
MD5SUMd554330e1400d4f25a793413df9abc4e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3582
Number of clauses395999
Sum of the clauses size1182858
Maximum clause length18
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 25604
Number of clauses of size 3390364
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data 

0.38/0.46	c Command: HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780830-1244978667.cnf 
0.38/0.46	c Using SATTIMEOUT of 10000
0.38/0.46	c Using SATRAM of 2047
0.38/0.46	c Size of subset node = 16
0.38/0.46	c Variables = 3582
0.38/0.46	c Clauses = 395999
0.38/0.46	c Literals = 1182858
0.38/0.46	c Reduced size:
0.38/0.46	c Variables = 3582
0.38/0.46	c Clauses = 395999
0.38/0.46	c Literals = 1182858
0.38/0.46	c a2
1.20/1.20	c a1
2.78/2.88	c Independent sub-problems = 1
2.78/2.88	c Sub-problem with 3582 variables and 395999 clauses
2.78/2.88	c using permutation method 4
2.78/2.88	c count = 1
2.78/2.88	c Ordering finished 2.750 seconds
2.78/2.88	c mapped 2.880 seconds
2.78/2.88	c permuted 2.880 seconds
2.78/2.88	c about to sort
2.88/2.97	c sorted
5.50/5.52	c clauses now 395999
5.50/5.52	c init finished 3.060 seconds
5.50/5.52	c tree built 5.510 seconds
5.50/5.52	c 
5.50/5.52	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
5.50/5.52	c ---------------------------------|----------------------------------|------------------------------------------------------
5.50/5.52	c ................................ | ..........                       |                        5.5           0.0             
5.50/5.53	c ................................ | ..........                     1 |                        5.5           0.2             
5.50/5.53	c ................................ | ..........                     2 |                        5.5           0.4             
5.50/5.53	c ................................ | ..........                     3 |                        5.5           0.5             
5.50/5.53	c ................................ | ..........                     4 |                        5.5           0.7             
5.50/5.53	c ................................ | ..........                     5 |                        5.5           0.9             
6.36/5.68	c ................................ | ..........                  1000 | 22                     6.6         151.5         5017
215.72/21.44	c ................................ | ..........                240000 | 9247                 200.4        1197.6     15493842
423.29/37.13	c ................................ | ..........                427000 | 17355                401.4        1063.7     34100739
629.51/50.17	c ................................ | ..........                559000 | 23585                601.8         928.8     47501916
833.08/62.93	c ................................ | ..........                633000 | 27473                801.0         790.2     61158146
1036.65/75.78	c ................................ | *.........                696000 | 32501               1001.8         694.7     74248716
1238.87/88.43	c ................................ | *.........                758000 | 36438               1200.8         631.2     87405484
1441.35/101.20	c ................................ | *.........                823000 | 40934               1402.0         587.0    100261369

Verifier Data 

sh: BIN/SAT-verifier: No such file or directory

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780830-1244978667/watcher-1780830-1244978667 -o /tmp/evaluation-result-1780830-1244978667/solver-1780830-1244978667 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780830-1244978667.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 14.49 14.06 9.04 2/184 29423
/proc/meminfo: memFree=18985108/36427776 swapFree=3648/8592
[pid=29423] ppid=29421 vsize=1540 CPUtime=0
/proc/29423/stat : 29423 (ttsth-5-0) R 29421 29423 15497 0 -1 4202496 281 0 0 0 0 0 0 0 20 0 1 0 657173065 1576960 237 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134639534 0 0 1 0 0 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 385 238 75 177 0 207 0

[startup+0.053948 s]
/proc/loadavg: 14.49 14.06 9.04 2/184 29423
/proc/meminfo: memFree=18985108/36427776 swapFree=3648/8592
[pid=29423] ppid=29421 vsize=4292 CPUtime=0.04
/proc/29423/stat : 29423 (ttsth-5-0) R 29421 29423 15497 0 -1 4202496 945 0 0 0 4 0 0 0 20 0 1 0 657173065 4395008 901 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134732614 0 0 1 0 0 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 1073 902 75 177 0 895 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 4292

[startup+0.101909 s]
/proc/loadavg: 14.49 14.06 9.04 2/184 29423
/proc/meminfo: memFree=18985108/36427776 swapFree=3648/8592
[pid=29423] ppid=29421 vsize=7232 CPUtime=0.08
/proc/29423/stat : 29423 (ttsth-5-0) R 29421 29423 15497 0 -1 4202496 1671 0 0 0 6 2 0 0 20 0 1 0 657173065 7405568 1627 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134732614 0 0 1 0 0 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 1808 1628 75 177 0 1630 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 7232

[startup+0.301934 s]
/proc/loadavg: 14.49 14.06 9.04 2/184 29423
/proc/meminfo: memFree=18985108/36427776 swapFree=3648/8592
[pid=29423] ppid=29421 vsize=19124 CPUtime=0.28
/proc/29423/stat : 29423 (ttsth-5-0) R 29421 29423 15497 0 -1 4202496 4687 0 0 0 26 2 0 0 20 0 1 0 657173065 19582976 4643 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134732614 0 0 1 0 0 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 4781 4644 75 177 0 4603 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 19124

[startup+0.701953 s]
/proc/loadavg: 14.49 14.06 9.04 2/184 29423
/proc/meminfo: memFree=18985108/36427776 swapFree=3648/8592
[pid=29423] ppid=29421 vsize=53740 CPUtime=0.68
/proc/29423/stat : 29423 (ttsth-5-0) R 29421 29423 15497 0 -1 4202496 12436 0 0 0 64 4 0 0 20 0 1 0 657173065 55029760 12391 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134680464 0 0 1 0 0 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 13435 12391 76 177 0 13257 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 53740

[startup+1.50203 s]
/proc/loadavg: 14.49 14.06 9.04 2/185 29424
/proc/meminfo: memFree=18935344/36427776 swapFree=4672/58084
[pid=29423] ppid=29421 vsize=53464 CPUtime=1.5
/proc/29423/stat : 29423 (ttsth-5-0) R 29421 29423 15497 0 -1 4202496 13281 0 0 0 144 6 0 0 20 0 1 0 657173065 54747136 12462 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134555279 0 0 1 0 0 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 13366 12462 77 177 0 13188 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 53464

[startup+3.10218 s]
/proc/loadavg: 14.49 14.06 9.04 2/185 29424
/proc/meminfo: memFree=18929164/36427776 swapFree=4620/63396
[pid=29423] ppid=29421 vsize=78020 CPUtime=3.08
/proc/29423/stat : 29423 (ttsth-5-0) R 29421 29423 15497 0 -1 4202496 20324 0 0 0 300 8 0 0 20 0 1 0 657173065 79892480 19110 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134732614 0 0 1 0 0 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 19505 19110 88 177 0 19327 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 78020

[startup+6.30211 s]
/proc/loadavg: 13.41 13.84 9.00 2/185 29424
/proc/meminfo: memFree=18849632/36427776 swapFree=4664/141860
[pid=29423] ppid=29421 vsize=277896 CPUtime=15.68
/proc/29423/stat : 29423 (ttsth-5-0) S 29421 29423 15497 0 -1 4202496 38692 0 0 0 994 574 0 0 20 0 17 0 657173065 284565504 36863 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 69474 36863 95 177 0 69296 0
Current children cumulated CPU time (s) 15.68
Current children cumulated vsize (KiB) 277896

[startup+12.702 s]
/proc/loadavg: 13.62 13.88 9.04 17/201 29440
/proc/meminfo: memFree=18741724/36427776 swapFree=4692/252908
[pid=29423] ppid=29421 vsize=393248 CPUtime=103.37
/proc/29423/stat : 29423 (ttsth-5-0) S 29421 29423 15497 0 -1 4202496 66191 0 0 0 8158 2179 0 0 20 0 17 0 657173065 402685952 64362 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 98312 64362 95 177 0 98134 0
[pid=29423/tid=29425] ppid=29421 vsize=393248 CPUtime=7.12
/proc/29423/task/29425/stat : 29425 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 1940 0 0 0 680 32 0 0 20 0 17 0 657173618 402685952 64362 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134591122 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29423/tid=29426] ppid=29421 vsize=393248 CPUtime=6.94
/proc/29423/task/29426/stat : 29426 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 2430 0 0 0 540 154 0 0 20 0 17 0 657173618 402685952 64362 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29423/tid=29427] ppid=29421 vsize=393248 CPUtime=5.12
/proc/29423/task/29427/stat : 29427 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 2783 0 0 0 386 126 0 0 20 0 17 0 657173618 402685952 64362 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29423/tid=29428] ppid=29421 vsize=393248 CPUtime=6.94
/proc/29423/task/29428/stat : 29428 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 1089 0 0 0 520 174 0 0 20 0 17 0 657173618 402685952 64362 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134588792 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29423/tid=29429] ppid=29421 vsize=393248 CPUtime=6.96
/proc/29423/task/29429/stat : 29429 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 1466 0 0 0 526 170 0 0 20 0 17 0 657173618 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134592323 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29423/tid=29430] ppid=29421 vsize=393248 CPUtime=6.96
/proc/29423/task/29430/stat : 29430 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 2119 0 0 0 542 154 0 0 20 0 17 0 657173618 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134592447 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29423/tid=29431] ppid=29421 vsize=393248 CPUtime=4.88
/proc/29423/task/29431/stat : 29431 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 1780 0 0 0 348 140 0 0 20 0 17 0 657173618 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29423/tid=29432] ppid=29421 vsize=393248 CPUtime=5.62
/proc/29423/task/29432/stat : 29432 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 1186 0 0 0 440 122 0 0 20 0 17 0 657173618 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134552720 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29423/tid=29433] ppid=29421 vsize=393248 CPUtime=6.92
/proc/29423/task/29433/stat : 29433 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 633 0 0 0 526 166 0 0 20 0 17 0 657173618 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134549888 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29423/tid=29434] ppid=29421 vsize=393248 CPUtime=3.54
/proc/29423/task/29434/stat : 29434 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 1352 0 0 0 266 88 0 0 20 0 17 0 657173618 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29423/tid=29435] ppid=29421 vsize=393248 CPUtime=5.84
/proc/29423/task/29435/stat : 29435 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 2668 0 0 0 466 118 0 0 20 0 17 0 657173619 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29423/tid=29436] ppid=29421 vsize=393248 CPUtime=6.92
/proc/29423/task/29436/stat : 29436 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 2589 0 0 0 516 176 0 0 20 0 17 0 657173619 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29423/tid=29437] ppid=29421 vsize=393248 CPUtime=6.8
/proc/29423/task/29437/stat : 29437 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 1736 0 0 0 516 164 0 0 20 0 17 0 657173619 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134561510 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29423/tid=29438] ppid=29421 vsize=393248 CPUtime=5.62
/proc/29423/task/29438/stat : 29438 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 2690 0 0 0 444 118 0 0 20 0 17 0 657173619 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29423/tid=29439] ppid=29421 vsize=393248 CPUtime=4.56
/proc/29423/task/29439/stat : 29439 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 1570 0 0 0 348 108 0 0 20 0 17 0 657173619 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29423/tid=29440] ppid=29421 vsize=393248 CPUtime=6.98
/proc/29423/task/29440/stat : 29440 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 2703 0 0 0 546 152 0 0 20 0 17 0 657173619 402685952 64363 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134552748 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 103.37
Current children cumulated vsize (KiB) 393248

[startup+25.504 s]
/proc/loadavg: 14.06 13.96 9.14 17/201 29440
/proc/meminfo: memFree=18504644/36427776 swapFree=4692/489564
[pid=29423] ppid=29421 vsize=639408 CPUtime=266.75
/proc/29423/stat : 29423 (ttsth-5-0) S 29421 29423 15497 0 -1 4202496 124071 0 0 0 23425 3250 0 0 20 0 17 0 657173065 654753792 122242 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 159852 122242 95 177 0 159674 0
[pid=29423/tid=29425] ppid=29421 vsize=639408 CPUtime=19.62
/proc/29423/task/29425/stat : 29425 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 5185 0 0 0 1930 32 0 0 20 0 17 0 657173618 654753792 122242 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29423/tid=29426] ppid=29421 vsize=639408 CPUtime=15.84
/proc/29423/task/29426/stat : 29426 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 4788 0 0 0 1374 210 0 0 20 0 17 0 657173618 654753792 122242 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29423/tid=29427] ppid=29421 vsize=639408 CPUtime=16.5
/proc/29423/task/29427/stat : 29427 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 9373 0 0 0 1450 200 0 0 20 0 17 0 657173618 654753792 122242 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29423/tid=29428] ppid=29421 vsize=639408 CPUtime=16.48
/proc/29423/task/29428/stat : 29428 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 2759 0 0 0 1390 258 0 0 20 0 17 0 657173618 654753792 122242 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29423/tid=29429] ppid=29421 vsize=639408 CPUtime=18.28
/proc/29423/task/29429/stat : 29429 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 3892 0 0 0 1586 242 0 0 20 0 17 0 657173618 654753792 122242 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134749337 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29423/tid=29430] ppid=29421 vsize=639408 CPUtime=18.42
/proc/29423/task/29430/stat : 29430 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 5510 0 0 0 1610 232 0 0 20 0 17 0 657173618 654753792 122242 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29423/tid=29431] ppid=29421 vsize=639408 CPUtime=11.16
/proc/29423/task/29431/stat : 29431 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 5088 0 0 0 924 192 0 0 20 0 17 0 657173618 654753792 122242 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29423/tid=29432] ppid=29421 vsize=639408 CPUtime=16.3
/proc/29423/task/29432/stat : 29432 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 3828 0 0 0 1418 212 0 0 20 0 17 0 657173618 654753792 122242 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29423/tid=29433] ppid=29421 vsize=639408 CPUtime=16.06
/proc/29423/task/29433/stat : 29433 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 1687 0 0 0 1348 258 0 0 20 0 17 0 657173618 654753792 122242 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29423/tid=29434] ppid=29421 vsize=639408 CPUtime=15.86
/proc/29423/task/29434/stat : 29434 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 8071 0 0 0 1424 162 0 0 20 0 17 0 657173618 654753792 122243 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29423/tid=29435] ppid=29421 vsize=639408 CPUtime=14.98
/proc/29423/task/29435/stat : 29435 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 7586 0 0 0 1336 162 0 0 20 0 17 0 657173619 654753792 122243 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29423/tid=29436] ppid=29421 vsize=639408 CPUtime=18.44
/proc/29423/task/29436/stat : 29436 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 7026 0 0 0 1586 258 0 0 20 0 17 0 657173619 654753792 122243 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134591056 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29423/tid=29437] ppid=29421 vsize=639408 CPUtime=17.16
/proc/29423/task/29437/stat : 29437 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 5149 0 0 0 1468 248 0 0 20 0 17 0 657173619 654753792 122243 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29423/tid=29438] ppid=29421 vsize=639408 CPUtime=14.96
/proc/29423/task/29438/stat : 29438 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 5802 0 0 0 1316 180 0 0 20 0 17 0 657173619 654753792 122243 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29423/tid=29439] ppid=29421 vsize=639408 CPUtime=11.94
/proc/29423/task/29439/stat : 29439 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 3273 0 0 0 1036 158 0 0 20 0 17 0 657173619 654753792 122243 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134593204 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29423/tid=29440] ppid=29421 vsize=639408 CPUtime=19.08
/proc/29423/task/29440/stat : 29440 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 9598 0 0 0 1682 226 0 0 20 0 17 0 657173619 654753792 122243 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 266.75
Current children cumulated vsize (KiB) 639408

[startup+51.1063 s]
/proc/loadavg: 14.66 14.11 9.32 17/201 29445
/proc/meminfo: memFree=18040580/36427776 swapFree=4692/952536
[pid=29423] ppid=29421 vsize=1135520 CPUtime=645.52
/proc/29423/stat : 29423 (ttsth-5-0) S 29421 29423 15497 0 -1 4202496 240618 0 0 0 58856 5696 0 0 20 0 17 0 657173065 1162772480 238790 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 283880 238791 95 177 0 283702 0
[pid=29423/tid=29425] ppid=29421 vsize=1135520 CPUtime=44.98
/proc/29423/task/29425/stat : 29425 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 9837 0 0 0 4460 38 0 0 20 0 17 0 657173618 1162772480 238792 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29423/tid=29426] ppid=29421 vsize=1135520 CPUtime=38.26
/proc/29423/task/29426/stat : 29426 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 7927 0 0 0 3436 390 0 0 20 0 17 0 657173618 1162772480 238792 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134680326 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29423/tid=29427] ppid=29421 vsize=1135520 CPUtime=41.46
/proc/29423/task/29427/stat : 29427 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 19621 0 0 0 3818 328 0 0 20 0 17 0 657173618 1162772480 238792 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29423/tid=29428] ppid=29421 vsize=1135520 CPUtime=40.59
/proc/29423/task/29428/stat : 29428 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 7237 0 0 0 3625 434 0 0 20 0 17 0 657173618 1162772480 238792 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29423/tid=29429] ppid=29421 vsize=1135520 CPUtime=42.96
/proc/29423/task/29429/stat : 29429 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 6917 0 0 0 3864 432 0 0 20 0 17 0 657173618 1162772480 238792 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29423/tid=29430] ppid=29421 vsize=1135520 CPUtime=41.18
/proc/29423/task/29430/stat : 29430 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 12164 0 0 0 3756 362 0 0 20 0 17 0 657173618 1162772480 238792 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134749337 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29423/tid=29431] ppid=29421 vsize=1135520 CPUtime=32.6
/proc/29423/task/29431/stat : 29431 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 14052 0 0 0 2918 342 0 0 20 0 17 0 657173618 1162772480 238794 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29423/tid=29432] ppid=29421 vsize=1135520 CPUtime=39.87
/proc/29423/task/29432/stat : 29432 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 9319 0 0 0 3605 382 0 0 20 0 17 0 657173618 1162772480 238794 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134549877 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29423/tid=29433] ppid=29421 vsize=1135520 CPUtime=38.53
/proc/29423/task/29433/stat : 29433 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 9733 0 0 0 3413 440 0 0 20 0 17 0 657173618 1162772480 238794 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29423/tid=29434] ppid=29421 vsize=1135520 CPUtime=40.95
/proc/29423/task/29434/stat : 29434 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 22080 0 0 0 3757 338 0 0 20 0 17 0 657173618 1162772480 238794 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29423/tid=29435] ppid=29421 vsize=1135520 CPUtime=40.11
/proc/29423/task/29435/stat : 29435 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 18243 0 0 0 3703 308 0 0 20 0 17 0 657173619 1162772480 238794 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134590245 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29423/tid=29436] ppid=29421 vsize=1135520 CPUtime=42.58
/proc/29423/task/29436/stat : 29436 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 13583 0 0 0 3830 428 0 0 20 0 17 0 657173619 1162772480 238794 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134552732 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29423/tid=29437] ppid=29421 vsize=1135520 CPUtime=42.25
/proc/29423/task/29437/stat : 29437 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 13583 0 0 0 3813 412 0 0 20 0 17 0 657173619 1162772480 238794 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29423/tid=29438] ppid=29421 vsize=1135520 CPUtime=36.35
/proc/29423/task/29438/stat : 29438 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 12590 0 0 0 3285 350 0 0 20 0 17 0 657173619 1162772480 238795 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29423/tid=29439] ppid=29421 vsize=1135520 CPUtime=34.02
/proc/29423/task/29439/stat : 29439 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 11055 0 0 0 3078 324 0 0 20 0 17 0 657173619 1162772480 238795 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29423/tid=29440] ppid=29421 vsize=1135520 CPUtime=43.24
/proc/29423/task/29440/stat : 29440 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 17225 0 0 0 3952 372 0 0 20 0 17 0 657173619 1162772480 238796 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 645.52
Current children cumulated vsize (KiB) 1135520

[startup+102.313 s]
/proc/loadavg: 15.48 14.42 9.67 17/201 29445
/proc/meminfo: memFree=17165196/36427776 swapFree=4692/1827820
[pid=29423] ppid=29421 vsize=2060472 CPUtime=1460.37
/proc/29423/stat : 29423 (ttsth-5-0) S 29421 29423 15497 0 -1 4202496 457255 0 0 0 137387 8650 0 0 20 0 17 0 657173065 2109923328 455426 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 515118 455427 95 177 0 514940 0
[pid=29423/tid=29425] ppid=29421 vsize=2060472 CPUtime=96.18
/proc/29423/task/29425/stat : 29425 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 26168 0 0 0 9558 60 0 0 20 0 17 0 657173618 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134749353 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29423/tid=29426] ppid=29421 vsize=2060472 CPUtime=89.2
/proc/29423/task/29426/stat : 29426 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 15584 0 0 0 8318 602 0 0 20 0 17 0 657173618 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29423/tid=29427] ppid=29421 vsize=2060472 CPUtime=92.54
/proc/29423/task/29427/stat : 29427 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 37579 0 0 0 8806 448 0 0 20 0 17 0 657173618 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29423/tid=29428] ppid=29421 vsize=2060472 CPUtime=91.52
/proc/29423/task/29428/stat : 29428 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 15196 0 0 0 8508 644 0 0 20 0 17 0 657173618 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29423/tid=29429] ppid=29421 vsize=2060472 CPUtime=92.87
/proc/29423/task/29429/stat : 29429 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 13724 0 0 0 8631 656 0 0 20 0 17 0 657173618 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134749353 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29423/tid=29430] ppid=29421 vsize=2060472 CPUtime=92.22
/proc/29423/task/29430/stat : 29430 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 23289 0 0 0 8700 522 0 0 20 0 17 0 657173618 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29423/tid=29431] ppid=29421 vsize=2060472 CPUtime=83.59
/proc/29423/task/29431/stat : 29431 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 33177 0 0 0 7807 552 0 0 20 0 17 0 657173618 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29423/tid=29432] ppid=29421 vsize=2060472 CPUtime=90.76
/proc/29423/task/29432/stat : 29432 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 19742 0 0 0 8454 622 0 0 20 0 17 0 657173618 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29423/tid=29433] ppid=29421 vsize=2060472 CPUtime=89.35
/proc/29423/task/29433/stat : 29433 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 20719 0 0 0 8227 708 0 0 20 0 17 0 657173618 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29423/tid=29434] ppid=29421 vsize=2060472 CPUtime=92.01
/proc/29423/task/29434/stat : 29434 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 39951 0 0 0 8689 512 0 0 20 0 17 0 657173618 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134749353 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29423/tid=29435] ppid=29421 vsize=2060472 CPUtime=91.17
/proc/29423/task/29435/stat : 29435 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 34708 0 0 0 8643 474 0 0 20 0 17 0 657173619 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29423/tid=29436] ppid=29421 vsize=2060472 CPUtime=93.52
/proc/29423/task/29436/stat : 29436 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 27860 0 0 0 8718 634 0 0 20 0 17 0 657173619 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29423/tid=29437] ppid=29421 vsize=2060472 CPUtime=93.27
/proc/29423/task/29437/stat : 29437 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 26040 0 0 0 8743 584 0 0 20 0 17 0 657173619 2109923328 455427 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29423/tid=29438] ppid=29421 vsize=2060472 CPUtime=87.34
/proc/29423/task/29438/stat : 29438 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 28600 0 0 0 8202 532 0 0 20 0 17 0 657173619 2109923328 455428 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29423/tid=29439] ppid=29421 vsize=2060472 CPUtime=84.95
/proc/29423/task/29439/stat : 29439 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 27526 0 0 0 7981 514 0 0 20 0 17 0 657173619 2109923328 455428 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29423/tid=29440] ppid=29421 vsize=2060472 CPUtime=94.25
/proc/29423/task/29440/stat : 29440 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 31936 0 0 0 8857 568 0 0 20 0 17 0 657173619 2109923328 455428 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134549922 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1460.37
Current children cumulated vsize (KiB) 2060472



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+104.402 s]
/proc/loadavg: 15.52 14.44 9.70 17/201 29445
/proc/meminfo: memFree=17128212/36427776 swapFree=4692/1864596
[pid=29423] ppid=29421 vsize=2097164 CPUtime=1493.97
/proc/29423/stat : 29423 (ttsth-5-0) S 29421 29423 15497 0 -1 4202496 466093 0 0 0 140652 8745 0 0 20 0 17 0 657173065 2147495936 464264 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 524291 464264 95 177 0 524113 0
[pid=29423/tid=29425] ppid=29421 vsize=2097164 CPUtime=98.3
/proc/29423/task/29425/stat : 29425 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 26744 0 0 0 9768 62 0 0 20 0 17 0 657173618 2147495936 464264 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29423/tid=29426] ppid=29421 vsize=2097164 CPUtime=91.3
/proc/29423/task/29426/stat : 29426 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 16071 0 0 0 8524 606 0 0 20 0 17 0 657173618 2147495936 464264 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
[pid=29423/tid=29427] ppid=29421 vsize=2097164 CPUtime=94.65
/proc/29423/task/29427/stat : 29427 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 38126 0 0 0 9013 452 0 0 20 0 17 0 657173618 2147495936 464264 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29423/tid=29428] ppid=29421 vsize=2097164 CPUtime=93.61
/proc/29423/task/29428/stat : 29428 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 15436 0 0 0 8711 650 0 0 20 0 17 0 657173618 2147495936 464264 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29423/tid=29429] ppid=29421 vsize=2097164 CPUtime=94.91
/proc/29423/task/29429/stat : 29429 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 13949 0 0 0 8829 662 0 0 20 0 17 0 657173618 2147495936 464264 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134590129 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29423/tid=29430] ppid=29421 vsize=2097164 CPUtime=94.31
/proc/29423/task/29430/stat : 29430 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 23590 0 0 0 8903 528 0 0 20 0 17 0 657173618 2147495936 464264 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29423/tid=29431] ppid=29421 vsize=2097164 CPUtime=85.7
/proc/29423/task/29431/stat : 29431 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 34075 0 0 0 8008 562 0 0 20 0 17 0 657173618 2147495936 464265 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29423/tid=29432] ppid=29421 vsize=2097164 CPUtime=92.87
/proc/29423/task/29432/stat : 29432 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 20190 0 0 0 8653 634 0 0 20 0 17 0 657173618 2147495936 464265 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29423/tid=29433] ppid=29421 vsize=2097164 CPUtime=91.44
/proc/29423/task/29433/stat : 29433 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 21354 0 0 0 8430 714 0 0 20 0 17 0 657173618 2147495936 464265 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29423/tid=29434] ppid=29421 vsize=2097164 CPUtime=94.11
/proc/29423/task/29434/stat : 29434 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 40772 0 0 0 8891 520 0 0 20 0 17 0 657173618 2147495936 464265 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29423/tid=29435] ppid=29421 vsize=2097164 CPUtime=93.27
/proc/29423/task/29435/stat : 29435 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 35394 0 0 0 8849 478 0 0 20 0 17 0 657173619 2147495936 464265 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29423/tid=29436] ppid=29421 vsize=2097164 CPUtime=95.62
/proc/29423/task/29436/stat : 29436 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 28592 0 0 0 8920 642 0 0 20 0 17 0 657173619 2147495936 464265 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134562344 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29423/tid=29437] ppid=29421 vsize=2097164 CPUtime=95.37
/proc/29423/task/29437/stat : 29437 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 26538 0 0 0 8951 586 0 0 20 0 17 0 657173619 2147495936 464266 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29423/tid=29438] ppid=29421 vsize=2097164 CPUtime=89.44
/proc/29423/task/29438/stat : 29438 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 29149 0 0 0 8406 538 0 0 20 0 17 0 657173619 2147495936 464266 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134562380 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29423/tid=29439] ppid=29421 vsize=2097164 CPUtime=87.05
/proc/29423/task/29439/stat : 29439 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 28211 0 0 0 8189 516 0 0 20 0 17 0 657173619 2147495936 464266 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29423/tid=29440] ppid=29421 vsize=2097164 CPUtime=96.36
/proc/29423/task/29440/stat : 29440 (ttsth-5-0) R 29421 29423 15497 0 -1 4202560 32445 0 0 0 9060 576 0 0 20 0 17 0 657173619 2147495936 464266 18446744073709551615 134512640 135237372 4293358928 18446744073709551615 134562334 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1493.97
Current children cumulated vsize (KiB) 2097164

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+104.602 s]
/proc/loadavg: 15.52 14.44 9.70 17/201 29445
/proc/meminfo: memFree=17128212/36427776 swapFree=4692/1864596
[pid=29423] ppid=29421 vsize=0 CPUtime=1494.33
/proc/29423/stat : 29423 (ttsth-5-0) Z 29421 29423 15497 0 -1 4203532 466138 0 0 0 140671 8762 0 0 20 0 2 0 657173065 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/29423/statm: 0 0 0 0 0 0 0
[pid=29423/tid=29440] ppid=29421 vsize=0 CPUtime=96.53
/proc/29423/task/29440/stat : 29440 (ttsth-5-0) R 29421 29423 15497 0 -1 4203588 32447 0 0 0 9061 592 0 0 20 0 2 0 657173619 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1494.33
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 104.63
CPU time (s): 1494.35
CPU user time (s): 1406.71
CPU system time (s): 87.6375
CPU usage (%): 1428.22
Max. virtual memory (cumulated for all children) (KiB): 2097164

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1406.71
system time used= 87.6375
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 466138
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 122629
involuntary context switches= 6097

runsolver used 0.604037 second user time and 1.37208 second system time

The end

Launcher Data 

Begin job on xenhost3-49 at 2009-06-14 13:24:27
IDJOB=1780830
IDBENCH=71069
IDSOLVER=634
FILE ID=xenhost3-49/1780830-1244978667
PBS_JOBID=
Free space on /tmp= 7016 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (16 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_17_UNKNOWN.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780830-1244978667/watcher-1780830-1244978667 -o /tmp/evaluation-result-1780830-1244978667/solver-1780830-1244978667 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780830-1244978667.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 16

MD5SUM BENCH= d554330e1400d4f25a793413df9abc4e
RANDOM SEED= 1264394195

Linux xenhost3-49 2.6.27.5 #1 SMP Mon Mar 30 10:34:22 CEST 2009 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 8
initial apicid	: 8
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 24
initial apicid	: 24
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 10
initial apicid	: 10
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 26
initial apicid	: 26
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 9
initial apicid	: 9
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 25
initial apicid	: 25
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 11
initial apicid	: 11
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 27
initial apicid	: 27
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:     36427776 kB
MemFree:      18985108 kB
Buffers:        524788 kB
Cached:       14124588 kB
SwapCached:          0 kB
Active:        4171160 kB
Inactive:     10486828 kB
SwapTotal:    25398692 kB
SwapFree:     25398692 kB
Dirty:            7336 kB
Writeback:           0 kB
AnonPages:        8592 kB
Mapped:           3648 kB
Slab:           733448 kB
SReclaimable:   706628 kB
SUnreclaim:      26820 kB
PageTables:          0 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
WritebackTmp:        0 kB
CommitLimit:  43612580 kB
Committed_AS:    29736 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    275248 kB
VmallocChunk: 34359462839 kB
DirectMap4k:  99216660 kB
DirectMap2M:         0 kB

Free space on /tmp at the end= 7016 MiB
End job on xenhost3-49 at 2009-06-14 13:26:13