Trace number 1780845

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (16 threads)? (MO) 1409.45 93.1218

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_14_UNSAT.cnf
MD5SUM6d69d175921d14f1c2600aaedc59f514
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2940
Number of clauses300446
Sum of the clauses size896973
Maximum clause length15
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24737
Number of clauses of size 3295678
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data 

0.28/0.35	c Command: HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780845-1244978774.cnf 
0.28/0.35	c Using SATTIMEOUT of 10000
0.28/0.35	c Using SATRAM of 2047
0.28/0.35	c Size of subset node = 16
0.28/0.35	c Variables = 2940
0.28/0.35	c Clauses = 300446
0.28/0.35	c Literals = 896973
0.28/0.35	c Reduced size:
0.28/0.35	c Variables = 2940
0.28/0.35	c Clauses = 300446
0.28/0.35	c Literals = 896973
0.28/0.35	c a2
0.88/0.91	c a1
2.10/2.13	c Independent sub-problems = 1
2.10/2.13	c Sub-problem with 2940 variables and 300446 clauses
2.10/2.13	c using permutation method 4
2.10/2.13	c count = 1
2.10/2.13	c Ordering finished 2.020 seconds
2.10/2.13	c mapped 2.120 seconds
2.10/2.13	c permuted 2.120 seconds
2.10/2.13	c about to sort
2.10/2.20	c sorted
4.30/4.36	c clauses now 300446
4.30/4.36	c init finished 2.270 seconds
4.30/4.36	c tree built 4.340 seconds
4.30/4.36	c 
4.30/4.36	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
4.30/4.36	c ---------------------------------|----------------------------------|------------------------------------------------------
4.30/4.36	c ................................ | ..........                       |                        4.3           0.0             
4.30/4.36	c ................................ | ..........                     1 |                        4.3           0.2             
4.30/4.36	c ................................ | ..........                     2 |                        4.3           0.5             
4.30/4.36	c ................................ | ..........                     3 |                        4.3           0.7             
4.30/4.36	c ................................ | ..........                     4 |                        4.3           0.9             
4.30/4.36	c ................................ | ..........                     5 |                        4.3           1.2             
5.00/4.48	c ................................ | ..........                  1000 | 15                     5.3         187.3         5476
232.56/18.98	c ................................ | ..........                204000 | 22308                201.0        1014.8     18658755
444.81/32.30	c ................................ | ..........                308000 | 37974                401.4         767.4     36472688
649.54/45.29	c ................................ | ..........                444000 | 62171                601.4         738.3     52622099
853.26/58.08	c ................................ | ..........                561000 | 81197                801.9         699.6     67107086
1055.38/70.72	c ................................ | *.........                657000 | 95747               1000.4         656.8     80251083
1259.35/83.54	c ................................ | *.........                742000 | 105927              1202.0         617.3     93614123

Verifier Data 

sh: BIN/SAT-verifier: No such file or directory

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780845-1244978774/watcher-1780845-1244978774 -o /tmp/evaluation-result-1780845-1244978774/solver-1780845-1244978774 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780845-1244978774.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 15.52 14.44 9.70 2/184 29483
/proc/meminfo: memFree=18986728/36427776 swapFree=4388/7672
[pid=29483] ppid=29481 vsize=1540 CPUtime=0
/proc/29483/stat : 29483 (ttsth-5-0) R 29481 29483 15497 0 -1 4202496 275 0 0 0 0 0 0 0 20 0 1 0 657183735 1576960 231 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134732614 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 385 232 75 177 0 207 0

[startup+0.050022 s]
/proc/loadavg: 15.52 14.44 9.70 2/184 29483
/proc/meminfo: memFree=18986728/36427776 swapFree=4388/7672
[pid=29483] ppid=29481 vsize=4028 CPUtime=0.04
/proc/29483/stat : 29483 (ttsth-5-0) R 29481 29483 15497 0 -1 4202496 881 0 0 0 4 0 0 0 20 0 1 0 657183735 4124672 837 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134732614 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 1007 838 75 177 0 829 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 4028

[startup+0.10203 s]
/proc/loadavg: 15.52 14.44 9.70 2/184 29483
/proc/meminfo: memFree=18986728/36427776 swapFree=4388/7672
[pid=29483] ppid=29481 vsize=7232 CPUtime=0.08
/proc/29483/stat : 29483 (ttsth-5-0) R 29481 29483 15497 0 -1 4202496 1669 0 0 0 8 0 0 0 20 0 1 0 657183735 7405568 1625 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134732614 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 1808 1625 75 177 0 1630 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 7232

[startup+0.302092 s]
/proc/loadavg: 15.52 14.44 9.70 2/184 29483
/proc/meminfo: memFree=18986728/36427776 swapFree=4388/7672
[pid=29483] ppid=29481 vsize=18732 CPUtime=0.28
/proc/29483/stat : 29483 (ttsth-5-0) R 29481 29483 15497 0 -1 4202496 4552 0 0 0 26 2 0 0 20 0 1 0 657183735 19181568 4508 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134533779 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 4683 4508 75 177 0 4505 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 18732

[startup+0.702065 s]
/proc/loadavg: 15.52 14.44 9.70 2/184 29483
/proc/meminfo: memFree=18986728/36427776 swapFree=4388/7672
[pid=29483] ppid=29481 vsize=40796 CPUtime=0.68
/proc/29483/stat : 29483 (ttsth-5-0) R 29481 29483 15497 0 -1 4202496 9658 0 0 0 62 6 0 0 20 0 1 0 657183735 41775104 9613 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134680418 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 10199 9613 76 177 0 10021 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 40796

[startup+1.50216 s]
/proc/loadavg: 15.52 14.44 9.70 2/185 29484
/proc/meminfo: memFree=18946380/36427776 swapFree=4776/48356
[pid=29483] ppid=29481 vsize=40756 CPUtime=1.48
/proc/29483/stat : 29483 (ttsth-5-0) R 29481 29483 15497 0 -1 4202496 10617 0 0 0 140 8 0 0 20 0 1 0 657183735 41734144 9984 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134749343 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 10189 9984 77 177 0 10011 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 40756

[startup+3.10225 s]
/proc/loadavg: 14.36 14.22 9.66 2/185 29484
/proc/meminfo: memFree=18943604/36427776 swapFree=4900/51224
[pid=29483] ppid=29481 vsize=79012 CPUtime=3.08
/proc/29483/stat : 29483 (ttsth-5-0) R 29481 29483 15497 0 -1 4202496 20537 0 0 0 298 10 0 0 20 0 1 0 657183735 80908288 19577 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134735855 0 0 1 0 0 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 19753 19578 88 177 0 19575 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 79012

[startup+6.30276 s]
/proc/loadavg: 14.36 14.22 9.66 17/201 29500
/proc/meminfo: memFree=18859140/36427776 swapFree=4692/137532
[pid=29483] ppid=29481 vsize=278008 CPUtime=34.28
/proc/29483/stat : 29483 (ttsth-5-0) S 29481 29483 15497 0 -1 4202496 37581 0 0 0 1842 1586 0 0 20 0 17 0 657183735 284680192 36132 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 69502 36132 95 177 0 69324 0
[pid=29483/tid=29485] ppid=29481 vsize=278008 CPUtime=1.92
/proc/29483/task/29485/stat : 29485 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 1084 0 0 0 176 16 0 0 20 0 17 0 657184171 284680192 36132 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134587952 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29483/tid=29486] ppid=29481 vsize=278008 CPUtime=1.84
/proc/29483/task/29486/stat : 29486 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 509 0 0 0 96 88 0 0 20 0 17 0 657184171 284680192 36132 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29483/tid=29487] ppid=29481 vsize=278008 CPUtime=1.86
/proc/29483/task/29487/stat : 29487 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 736 0 0 0 78 108 0 0 20 0 17 0 657184171 284680192 36132 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29483/tid=29488] ppid=29481 vsize=278008 CPUtime=1.86
/proc/29483/task/29488/stat : 29488 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 423 0 0 0 74 112 0 0 20 0 17 0 657184171 284680192 36132 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29483/tid=29489] ppid=29481 vsize=278008 CPUtime=1.88
/proc/29483/task/29489/stat : 29489 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 445 0 0 0 100 88 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29483/tid=29490] ppid=29481 vsize=278008 CPUtime=1.86
/proc/29483/task/29490/stat : 29490 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 693 0 0 0 72 114 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29483/tid=29491] ppid=29481 vsize=278008 CPUtime=1.86
/proc/29483/task/29491/stat : 29491 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 437 0 0 0 80 106 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29483/tid=29492] ppid=29481 vsize=278008 CPUtime=1.86
/proc/29483/task/29492/stat : 29492 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 357 0 0 0 86 100 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29483/tid=29493] ppid=29481 vsize=278008 CPUtime=1.86
/proc/29483/task/29493/stat : 29493 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 665 0 0 0 92 94 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29483/tid=29494] ppid=29481 vsize=278008 CPUtime=1.86
/proc/29483/task/29494/stat : 29494 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 526 0 0 0 84 102 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29483/tid=29495] ppid=29481 vsize=278008 CPUtime=1.86
/proc/29483/task/29495/stat : 29495 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 356 0 0 0 84 102 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29483/tid=29496] ppid=29481 vsize=278008 CPUtime=1.88
/proc/29483/task/29496/stat : 29496 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 330 0 0 0 84 104 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29483/tid=29497] ppid=29481 vsize=278008 CPUtime=1.82
/proc/29483/task/29497/stat : 29497 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 425 0 0 0 62 120 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29483/tid=29498] ppid=29481 vsize=278008 CPUtime=1.86
/proc/29483/task/29498/stat : 29498 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 796 0 0 0 92 94 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29483/tid=29499] ppid=29481 vsize=278008 CPUtime=1.86
/proc/29483/task/29499/stat : 29499 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 528 0 0 0 68 118 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29483/tid=29500] ppid=29481 vsize=278008 CPUtime=1.84
/proc/29483/task/29500/stat : 29500 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 604 0 0 0 86 98 0 0 20 0 17 0 657184171 284680192 36133 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 34.28
Current children cumulated vsize (KiB) 278008

[startup+12.7032 s]
/proc/loadavg: 14.54 14.26 9.72 17/201 29500
/proc/meminfo: memFree=18711056/36427776 swapFree=4692/286116
[pid=29483] ppid=29481 vsize=436192 CPUtime=134.71
/proc/29483/stat : 29483 (ttsth-5-0) S 29481 29483 15497 0 -1 4202496 75287 0 0 0 9155 4316 0 0 20 0 17 0 657183735 446660608 73838 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 109048 73838 95 177 0 108870 0
[pid=29483/tid=29485] ppid=29481 vsize=436192 CPUtime=8.3
/proc/29483/task/29485/stat : 29485 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 6119 0 0 0 810 20 0 0 20 0 17 0 657184171 446660608 73838 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134566162 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29483/tid=29486] ppid=29481 vsize=436192 CPUtime=8.14
/proc/29483/task/29486/stat : 29486 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 2833 0 0 0 576 238 0 0 20 0 17 0 657184171 446660608 73838 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29483/tid=29487] ppid=29481 vsize=436192 CPUtime=8.18
/proc/29483/task/29487/stat : 29487 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 3602 0 0 0 516 302 0 0 20 0 17 0 657184171 446660608 73838 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29483/tid=29488] ppid=29481 vsize=436192 CPUtime=8.12
/proc/29483/task/29488/stat : 29488 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 1799 0 0 0 504 308 0 0 20 0 17 0 657184171 446660608 73838 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29483/tid=29489] ppid=29481 vsize=436192 CPUtime=8.16
/proc/29483/task/29489/stat : 29489 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 2882 0 0 0 548 268 0 0 20 0 17 0 657184171 446660608 73838 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29483/tid=29490] ppid=29481 vsize=436192 CPUtime=8.18
/proc/29483/task/29490/stat : 29490 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 3458 0 0 0 530 288 0 0 20 0 17 0 657184171 446660608 73838 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29483/tid=29491] ppid=29481 vsize=436192 CPUtime=8.16
/proc/29483/task/29491/stat : 29491 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 2482 0 0 0 524 292 0 0 20 0 17 0 657184171 446660608 73839 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134591065 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29483/tid=29492] ppid=29481 vsize=436192 CPUtime=8.12
/proc/29483/task/29492/stat : 29492 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 1892 0 0 0 528 284 0 0 20 0 17 0 657184171 446660608 73839 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29483/tid=29493] ppid=29481 vsize=436192 CPUtime=8.14
/proc/29483/task/29493/stat : 29493 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 3389 0 0 0 534 280 0 0 20 0 17 0 657184171 446660608 73839 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29483/tid=29494] ppid=29481 vsize=436192 CPUtime=8.16
/proc/29483/task/29494/stat : 29494 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 2128 0 0 0 548 268 0 0 20 0 17 0 657184171 446660608 73840 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29483/tid=29495] ppid=29481 vsize=436192 CPUtime=8.16
/proc/29483/task/29495/stat : 29495 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 1578 0 0 0 548 268 0 0 20 0 17 0 657184171 446660608 73840 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29483/tid=29496] ppid=29481 vsize=436192 CPUtime=8.18
/proc/29483/task/29496/stat : 29496 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 2090 0 0 0 508 310 0 0 20 0 17 0 657184171 446660608 73841 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636382 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29483/tid=29497] ppid=29481 vsize=436192 CPUtime=7.92
/proc/29483/task/29497/stat : 29497 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 2815 0 0 0 490 302 0 0 20 0 17 0 657184171 446660608 73841 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29483/tid=29498] ppid=29481 vsize=436192 CPUtime=8.14
/proc/29483/task/29498/stat : 29498 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 4378 0 0 0 558 256 0 0 20 0 17 0 657184171 446660608 73841 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29483/tid=29499] ppid=29481 vsize=436192 CPUtime=8.08
/proc/29483/task/29499/stat : 29499 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 2482 0 0 0 462 346 0 0 20 0 17 0 657184171 446660608 73841 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29483/tid=29500] ppid=29481 vsize=436192 CPUtime=8.12
/proc/29483/task/29500/stat : 29500 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 2693 0 0 0 546 266 0 0 20 0 17 0 657184171 446660608 73841 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 134.71
Current children cumulated vsize (KiB) 436192

[startup+25.5042 s]
/proc/loadavg: 14.76 14.32 9.79 16/201 29500
/proc/meminfo: memFree=18396160/36427776 swapFree=4692/600684
[pid=29483] ppid=29481 vsize=761360 CPUtime=336.96
/proc/29483/stat : 29483 (ttsth-5-0) S 29481 29483 15497 0 -1 4202496 151200 0 0 0 26534 7162 0 0 20 0 17 0 657183735 779632640 149751 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 190340 149751 95 177 0 190162 0
[pid=29483/tid=29485] ppid=29481 vsize=761360 CPUtime=21.08
/proc/29483/task/29485/stat : 29485 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 12634 0 0 0 2082 26 0 0 20 0 17 0 657184171 779632640 149751 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134732535 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29483/tid=29486] ppid=29481 vsize=761360 CPUtime=20.78
/proc/29483/task/29486/stat : 29486 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 7317 0 0 0 1664 414 0 0 20 0 17 0 657184171 779632640 149751 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29483/tid=29487] ppid=29481 vsize=761360 CPUtime=20.84
/proc/29483/task/29487/stat : 29487 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 8808 0 0 0 1602 482 0 0 20 0 17 0 657184171 779632640 149751 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134590506 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29483/tid=29488] ppid=29481 vsize=761360 CPUtime=20.7
/proc/29483/task/29488/stat : 29488 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 4680 0 0 0 1538 532 0 0 20 0 17 0 657184171 779632640 149751 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29483/tid=29489] ppid=29481 vsize=761360 CPUtime=20.82
/proc/29483/task/29489/stat : 29489 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 8231 0 0 0 1616 466 0 0 20 0 17 0 657184171 779632640 149751 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29483/tid=29490] ppid=29481 vsize=761360 CPUtime=20.86
/proc/29483/task/29490/stat : 29490 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 8319 0 0 0 1628 458 0 0 20 0 17 0 657184171 779632640 149751 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29483/tid=29491] ppid=29481 vsize=761360 CPUtime=20.78
/proc/29483/task/29491/stat : 29491 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 7112 0 0 0 1570 508 0 0 20 0 17 0 657184171 779632640 149751 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29483/tid=29492] ppid=29481 vsize=761360 CPUtime=20.74
/proc/29483/task/29492/stat : 29492 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 5822 0 0 0 1592 482 0 0 20 0 17 0 657184171 779632640 149751 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134749343 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29483/tid=29493] ppid=29481 vsize=761360 CPUtime=20.76
/proc/29483/task/29493/stat : 29493 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 8283 0 0 0 1618 458 0 0 20 0 17 0 657184171 779632640 149752 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29483/tid=29494] ppid=29481 vsize=761360 CPUtime=20.82
/proc/29483/task/29494/stat : 29494 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 6742 0 0 0 1650 432 0 0 20 0 17 0 657184171 779632640 149752 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29483/tid=29495] ppid=29481 vsize=761360 CPUtime=20.82
/proc/29483/task/29495/stat : 29495 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 4767 0 0 0 1632 450 0 0 20 0 17 0 657184171 779632640 149752 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134545968 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29483/tid=29496] ppid=29481 vsize=761360 CPUtime=20.86
/proc/29483/task/29496/stat : 29496 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 5554 0 0 0 1586 500 0 0 20 0 17 0 657184171 779632640 149752 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29483/tid=29497] ppid=29481 vsize=761360 CPUtime=20.28
/proc/29483/task/29497/stat : 29497 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 7667 0 0 0 1544 484 0 0 20 0 17 0 657184171 779632640 149752 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134551008 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29483/tid=29498] ppid=29481 vsize=761360 CPUtime=20.82
/proc/29483/task/29498/stat : 29498 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 12410 0 0 0 1650 432 0 0 20 0 17 0 657184171 779632640 149752 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29483/tid=29499] ppid=29481 vsize=761360 CPUtime=20.66
/proc/29483/task/29499/stat : 29499 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 6975 0 0 0 1492 574 0 0 20 0 17 0 657184171 779632640 149752 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29483/tid=29500] ppid=29481 vsize=761360 CPUtime=20.82
/proc/29483/task/29500/stat : 29500 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 7213 0 0 0 1642 440 0 0 20 0 17 0 657184171 779632640 149752 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 336.96
Current children cumulated vsize (KiB) 761360

[startup+51.1045 s]
/proc/loadavg: 15.18 14.45 9.95 17/201 29500
/proc/meminfo: memFree=17861156/36427776 swapFree=4692/1133692
[pid=29483] ppid=29481 vsize=1334232 CPUtime=743.42
/proc/29483/stat : 29483 (ttsth-5-0) S 29481 29483 15497 0 -1 4202496 285570 0 0 0 64722 9620 0 0 20 0 17 0 657183735 1366253568 284121 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 333558 284121 95 177 0 333380 0
[pid=29483/tid=29485] ppid=29481 vsize=1334232 CPUtime=46.68
/proc/29483/task/29485/stat : 29485 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 24806 0 0 0 4622 46 0 0 20 0 17 0 657184171 1366253568 284121 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134680226 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29483/tid=29486] ppid=29481 vsize=1334232 CPUtime=46.22
/proc/29483/task/29486/stat : 29486 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 15647 0 0 0 4068 554 0 0 20 0 17 0 657184171 1366253568 284121 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134591211 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29483/tid=29487] ppid=29481 vsize=1334232 CPUtime=46.3
/proc/29483/task/29487/stat : 29487 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 19924 0 0 0 3984 646 0 0 20 0 17 0 657184171 1366253568 284121 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134591129 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29483/tid=29488] ppid=29481 vsize=1334232 CPUtime=46.08
/proc/29483/task/29488/stat : 29488 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 10330 0 0 0 3912 696 0 0 20 0 17 0 657184171 1366253568 284121 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29483/tid=29489] ppid=29481 vsize=1334232 CPUtime=46.26
/proc/29483/task/29489/stat : 29489 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 17990 0 0 0 3982 644 0 0 20 0 17 0 657184171 1366253568 284122 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134680364 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29483/tid=29490] ppid=29481 vsize=1334232 CPUtime=46.33
/proc/29483/task/29490/stat : 29490 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 17444 0 0 0 4037 596 0 0 20 0 17 0 657184171 1366253568 284122 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134732535 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29483/tid=29491] ppid=29481 vsize=1334232 CPUtime=46.19
/proc/29483/task/29491/stat : 29491 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 13989 0 0 0 3937 682 0 0 20 0 17 0 657184171 1366253568 284122 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29483/tid=29492] ppid=29481 vsize=1334232 CPUtime=46.12
/proc/29483/task/29492/stat : 29492 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 12131 0 0 0 3946 666 0 0 20 0 17 0 657184171 1366253568 284123 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29483/tid=29493] ppid=29481 vsize=1334232 CPUtime=46.18
/proc/29483/task/29493/stat : 29493 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 16667 0 0 0 3996 622 0 0 20 0 17 0 657184171 1366253568 284123 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134680502 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29483/tid=29494] ppid=29481 vsize=1334232 CPUtime=46.27
/proc/29483/task/29494/stat : 29494 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 14942 0 0 0 4047 580 0 0 20 0 17 0 657184171 1366253568 284123 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134562272 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29483/tid=29495] ppid=29481 vsize=1334232 CPUtime=46.25
/proc/29483/task/29495/stat : 29495 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 9793 0 0 0 3997 628 0 0 20 0 17 0 657184171 1366253568 284123 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134680273 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29483/tid=29496] ppid=29481 vsize=1334232 CPUtime=46.34
/proc/29483/task/29496/stat : 29496 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 14666 0 0 0 3990 644 0 0 20 0 17 0 657184171 1366253568 284123 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29483/tid=29497] ppid=29481 vsize=1334232 CPUtime=45.18
/proc/29483/task/29497/stat : 29497 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 18627 0 0 0 3842 676 0 0 20 0 17 0 657184171 1366253568 284123 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134561428 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29483/tid=29498] ppid=29481 vsize=1334232 CPUtime=46.26
/proc/29483/task/29498/stat : 29498 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 19039 0 0 0 4046 580 0 0 20 0 17 0 657184171 1366253568 284123 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29483/tid=29499] ppid=29481 vsize=1334232 CPUtime=46
/proc/29483/task/29499/stat : 29499 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 16872 0 0 0 3838 762 0 0 20 0 17 0 657184171 1366253568 284123 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29483/tid=29500] ppid=29481 vsize=1334232 CPUtime=46.28
/proc/29483/task/29500/stat : 29500 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 14036 0 0 0 4054 574 0 0 20 0 17 0 657184171 1366253568 284123 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134591203 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 743.42
Current children cumulated vsize (KiB) 1334232



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+92.9046 s]
/proc/loadavg: 15.68 14.68 10.24 17/201 29500
/proc/meminfo: memFree=17134536/36427776 swapFree=4692/1859292
[pid=29483] ppid=29481 vsize=2096784 CPUtime=1409.09
/proc/29483/stat : 29483 (ttsth-5-0) S 29481 29483 15497 0 -1 4202496 464194 0 0 0 129334 11575 0 0 20 0 17 0 657183735 2147106816 462745 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134629544 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 524196 462745 95 177 0 524018 0
[pid=29483/tid=29485] ppid=29481 vsize=2096784 CPUtime=88.46
/proc/29483/task/29485/stat : 29485 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 39317 0 0 0 8770 76 0 0 20 0 17 0 657184171 2147106816 462746 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 4 0 0 0 0 0
[pid=29483/tid=29486] ppid=29481 vsize=2096784 CPUtime=87.88
/proc/29483/task/29486/stat : 29486 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 27577 0 0 0 8118 670 0 0 20 0 17 0 657184171 2147106816 462747 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134590245 0 0 1 0 0 0 0 -1 5 0 0 0 0 0
[pid=29483/tid=29487] ppid=29481 vsize=2096784 CPUtime=87.96
/proc/29483/task/29487/stat : 29487 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 32244 0 0 0 8014 782 0 0 20 0 17 0 657184171 2147106816 462747 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134591106 0 0 1 0 0 0 0 -1 6 0 0 0 0 0
[pid=29483/tid=29488] ppid=29481 vsize=2096784 CPUtime=87.7
/proc/29483/task/29488/stat : 29488 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 18498 0 0 0 7930 840 0 0 20 0 17 0 657184171 2147106816 462747 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134561510 0 0 1 0 0 0 0 -1 7 0 0 0 0 0
[pid=29483/tid=29489] ppid=29481 vsize=2096784 CPUtime=87.94
/proc/29483/task/29489/stat : 29489 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 28797 0 0 0 8024 770 0 0 20 0 17 0 657184171 2147106816 462747 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134680729 0 0 1 0 0 0 0 -1 8 0 0 0 0 0
[pid=29483/tid=29490] ppid=29481 vsize=2096784 CPUtime=88.03
/proc/29483/task/29490/stat : 29490 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 30459 0 0 0 8099 704 0 0 20 0 17 0 657184171 2147106816 462747 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134546026 0 0 1 0 0 0 0 -1 9 0 0 0 0 0
[pid=29483/tid=29491] ppid=29481 vsize=2096784 CPUtime=87.85
/proc/29483/task/29491/stat : 29491 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 22313 0 0 0 7963 822 0 0 20 0 17 0 657184171 2147106816 462748 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134562351 0 0 1 0 0 0 0 -1 10 0 0 0 0 0
[pid=29483/tid=29492] ppid=29481 vsize=2096784 CPUtime=87.71
/proc/29483/task/29492/stat : 29492 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 21278 0 0 0 7961 810 0 0 20 0 17 0 657184171 2147106816 462748 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134546034 0 0 1 0 0 0 0 -1 11 0 0 0 0 0
[pid=29483/tid=29493] ppid=29481 vsize=2096784 CPUtime=87.77
/proc/29483/task/29493/stat : 29493 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 27092 0 0 0 8021 756 0 0 20 0 17 0 657184171 2147106816 462748 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 12 0 0 0 0 0
[pid=29483/tid=29494] ppid=29481 vsize=2096784 CPUtime=87.96
/proc/29483/task/29494/stat : 29494 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 24788 0 0 0 8112 684 0 0 20 0 17 0 657184171 2147106816 462748 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 13 0 0 0 0 0
[pid=29483/tid=29495] ppid=29481 vsize=2096784 CPUtime=87.9
/proc/29483/task/29495/stat : 29495 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 16501 0 0 0 8046 744 0 0 20 0 17 0 657184171 2147106816 462748 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 14 0 0 0 0 0
[pid=29483/tid=29496] ppid=29481 vsize=2096784 CPUtime=88.01
/proc/29483/task/29496/stat : 29496 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 25444 0 0 0 8043 758 0 0 20 0 17 0 657184171 2147106816 462748 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 15 0 0 0 0 0
[pid=29483/tid=29497] ppid=29481 vsize=2096784 CPUtime=85.94
/proc/29483/task/29497/stat : 29497 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 34672 0 0 0 7760 834 0 0 20 0 17 0 657184171 2147106816 462749 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134590150 0 0 1 0 0 0 0 -1 0 0 0 0 0 0
[pid=29483/tid=29498] ppid=29481 vsize=2096784 CPUtime=87.91
/proc/29483/task/29498/stat : 29498 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 32763 0 0 0 8073 718 0 0 20 0 17 0 657184171 2147106816 462749 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134636641 0 0 1 0 0 0 0 -1 1 0 0 0 0 0
[pid=29483/tid=29499] ppid=29481 vsize=2096784 CPUtime=87.62
/proc/29483/task/29499/stat : 29499 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 29434 0 0 0 7860 902 0 0 20 0 17 0 657184171 2147106816 462749 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134562338 0 0 1 0 0 0 0 -1 2 0 0 0 0 0
[pid=29483/tid=29500] ppid=29481 vsize=2096784 CPUtime=87.97
/proc/29483/task/29500/stat : 29500 (ttsth-5-0) R 29481 29483 15497 0 -1 4202560 24353 0 0 0 8115 682 0 0 20 0 17 0 657184171 2147106816 462749 18446744073709551615 134512640 135237372 4291865568 18446744073709551615 134593343 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1409.09
Current children cumulated vsize (KiB) 2096784

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+93.0257 s]
/proc/loadavg: 15.68 14.68 10.24 17/201 29500
/proc/meminfo: memFree=17134536/36427776 swapFree=4692/1859292
[pid=29483] ppid=29481 vsize=0 CPUtime=1409.35
/proc/29483/stat : 29483 (ttsth-5-0) Z 29481 29483 15497 0 -1 4203532 464243 0 0 0 129350 11585 0 0 20 0 2 0 657183735 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 0 0 0 0 0 0 0
[pid=29483/tid=29500] ppid=29481 vsize=0 CPUtime=88.08
/proc/29483/task/29500/stat : 29500 (ttsth-5-0) R 29481 29483 15497 0 -1 4203588 24355 0 0 0 8116 692 0 0 20 0 2 0 657184171 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1409.35
Current children cumulated vsize (KiB) 0

[startup+93.1017 s]
/proc/loadavg: 15.68 14.68 10.24 17/201 29500
/proc/meminfo: memFree=17134536/36427776 swapFree=4692/1859292
[pid=29483] ppid=29481 vsize=0 CPUtime=1409.43
/proc/29483/stat : 29483 (ttsth-5-0) Z 29481 29483 15497 0 -1 4203532 464243 0 0 0 129350 11593 0 0 20 0 2 0 657183735 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/29483/statm: 0 0 0 0 0 0 0
[pid=29483/tid=29500] ppid=29481 vsize=0 CPUtime=88.16
/proc/29483/task/29500/stat : 29500 (ttsth-5-0) R 29481 29483 15497 0 -1 4203588 24355 0 0 0 8116 700 0 0 20 0 2 0 657184171 0 0 18446744073709551615 0 0 0 0 0 0 0 1 0 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1409.43
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 93.1218
CPU time (s): 1409.45
CPU user time (s): 1293.51
CPU system time (s): 115.943
CPU usage (%): 1513.56
Max. virtual memory (cumulated for all children) (KiB): 2096784

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1293.51
system time used= 115.943
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 464243
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 108401
involuntary context switches= 3284

runsolver used 0.448028 second user time and 1.34808 second system time

The end

Launcher Data 

Begin job on xenhost3-49 at 2009-06-14 13:26:14
IDJOB=1780845
IDBENCH=71071
IDSOLVER=634
FILE ID=xenhost3-49/1780845-1244978774
PBS_JOBID=
Free space on /tmp= 7018 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (16 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_14_UNSAT.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780845-1244978774/watcher-1780845-1244978774 -o /tmp/evaluation-result-1780845-1244978774/solver-1780845-1244978774 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 16 HOME/instance-1780845-1244978774.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 16

MD5SUM BENCH= 6d69d175921d14f1c2600aaedc59f514
RANDOM SEED= 2006737349

Linux xenhost3-49 2.6.27.5 #1 SMP Mon Mar 30 10:34:22 CEST 2009 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 8
initial apicid	: 8
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 24
initial apicid	: 24
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 10
initial apicid	: 10
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 2
cpu cores	: 1
apicid		: 26
initial apicid	: 26
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 9
initial apicid	: 9
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 1
cpu cores	: 1
apicid		: 25
initial apicid	: 25
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 0
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 2
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 11
initial apicid	: 11
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 4
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU           X7350  @ 2.93GHz
stepping	: 11
cpu MHz		: 2925.864
cache size	: 4096 KB
physical id	: 6
siblings	: 1
core id		: 3
cpu cores	: 1
apicid		: 27
initial apicid	: 27
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu de tsc msr pae mce cx8 apic sep mtrr mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 5855.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:     36427776 kB
MemFree:      18986728 kB
Buffers:        524800 kB
Cached:       14122612 kB
SwapCached:          0 kB
Active:        4170892 kB
Inactive:     10484856 kB
SwapTotal:    25398692 kB
SwapFree:     25398692 kB
Dirty:            5340 kB
Writeback:           0 kB
AnonPages:        7672 kB
Mapped:           3724 kB
Slab:           733508 kB
SReclaimable:   706644 kB
SUnreclaim:      26864 kB
PageTables:          0 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
WritebackTmp:        0 kB
CommitLimit:  43612580 kB
Committed_AS:    29616 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    275248 kB
VmallocChunk: 34359462839 kB
DirectMap4k:  99216660 kB
DirectMap2M:         0 kB

Free space on /tmp at the end= 7018 MiB
End job on xenhost3-49 at 2009-06-14 13:27:49