Trace number 1781008

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 1785.96 765.441

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_13_UNSAT.cnf
MD5SUMd4e16a803f6cd0903a2bd3e7157287b3
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2730
Number of clauses271285
Sum of the clauses size809746
Maximum clause length14
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24450
Number of clauses of size 3266804
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data 

0.40/0.41	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781008-1243685201.cnf 
0.40/0.41	c Using SATTIMEOUT of 10000
0.40/0.41	c Using SATRAM of 2047
0.40/0.41	c Size of subset node = 16
0.40/0.41	c Variables = 2730
0.40/0.41	c Clauses = 271285
0.40/0.41	c Literals = 809746
0.40/0.41	c Reduced size:
0.40/0.41	c Variables = 2730
0.40/0.41	c Clauses = 271285
0.40/0.41	c Literals = 809746
0.40/0.41	c a2
1.11/1.14	c a1
2.60/2.61	c Independent sub-problems = 1
2.60/2.61	c Sub-problem with 2730 variables and 271285 clauses
2.60/2.61	c using permutation method 4
2.60/2.61	c count = 1
2.60/2.61	c Ordering finished 2.490 seconds
2.60/2.61	c mapped 2.610 seconds
2.60/2.61	c permuted 2.610 seconds
2.60/2.61	c about to sort
2.70/2.70	c sorted
5.20/5.21	c clauses now 271285
5.20/5.21	c init finished 2.750 seconds
5.20/5.21	c tree built 5.220 seconds
5.20/5.21	c 
5.20/5.21	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
5.20/5.21	c ---------------------------------|----------------------------------|------------------------------------------------------
5.20/5.21	c ................................ | ..........                       |                        5.2           0.0             
5.20/5.21	c ................................ | ..........                     1 |                        5.2           0.2             
5.20/5.21	c ................................ | ..........                     2 |                        5.2           0.4             
5.20/5.21	c ................................ | ..........                     3 |                        5.2           0.6             
5.20/5.21	c ................................ | ..........                     4 |                        5.2           0.8             
5.20/5.21	c ................................ | ..........                     5 |                        5.2           1.0             
5.20/5.22	c ................................ | ..........                  1000 |                        5.2         191.2             
200.16/91.66	c ................................ | ..........               1070000 | 67117                200.2        5343.3     22879958
400.26/171.98	c ................................ | ..........               1626000 | 103276               400.4        4060.7     40055169
600.39/267.55	c ................................ | ..........               2110000 | 147969               600.5        3513.7     55802704
800.08/359.40	c ................................ | ..........               2698000 | 208799               800.1        3372.1     69825893
999.81/438.20	c ................................ | *.........               3091000 | 261001              1000.0        3090.8     82063548
1200.52/522.50	c ................................ | *.........               3557000 | 320825              1200.8        2962.3     93569640
1399.83/606.70	c ................................ | *.........               3987000 | 363829              1400.1        2847.7    103644403
1600.60/690.79	c ................................ | *.........               4208000 | 390995              1600.8        2628.6    113522571

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1781008-1243685201/watcher-1781008-1243685201 -o /tmp/evaluation-result-1781008-1243685201/solver-1781008-1243685201 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781008-1243685201.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 6.20 6.20 4.96 4/117 7644
/proc/meminfo: memFree=2978156/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=2196 CPUtime=0.03
/proc/7644/stat : 7644 (ttsth-5-0) R 7642 7644 10612 0 -1 4202496 431 0 0 0 3 0 0 0 19 0 1 0 1133182894 2248704 387 4294967295 134512640 135237372 3219067200 3219065724 134639534 0 0 0 0 0 0 0 17 2 0 0 0
/proc/7644/statm: 549 388 75 177 0 371 0

[startup+0.053458 s]
/proc/loadavg: 6.20 6.20 4.96 4/117 7644
/proc/meminfo: memFree=2978156/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=3284 CPUtime=0.05
/proc/7644/stat : 7644 (ttsth-5-0) R 7642 7644 10612 0 -1 4202496 720 0 0 0 5 0 0 0 21 0 1 0 1133182894 3362816 676 4294967295 134512640 135237372 3219067200 3219065996 134639534 0 0 0 0 0 0 0 17 2 0 0 0
/proc/7644/statm: 821 676 75 177 0 643 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 3284

[startup+0.103455 s]
/proc/loadavg: 6.20 6.20 4.96 4/117 7644
/proc/meminfo: memFree=2978156/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=5596 CPUtime=0.1
/proc/7644/stat : 7644 (ttsth-5-0) R 7642 7644 10612 0 -1 4202496 1262 0 0 0 10 0 0 0 21 0 1 0 1133182894 5730304 1218 4294967295 134512640 135237372 3219067200 3219065724 134639534 0 0 0 0 0 0 0 17 2 0 0 0
/proc/7644/statm: 1399 1219 75 177 0 1221 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 5596

[startup+0.303446 s]
/proc/loadavg: 6.20 6.20 4.96 4/117 7644
/proc/meminfo: memFree=2978156/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=14500 CPUtime=0.3
/proc/7644/stat : 7644 (ttsth-5-0) R 7642 7644 10612 0 -1 4202496 3431 0 0 0 30 0 0 0 22 0 1 0 1133182894 14848000 3387 4294967295 134512640 135237372 3219067200 3219065724 134639534 0 0 0 0 0 0 0 17 2 0 0 0
/proc/7644/statm: 3625 3388 75 177 0 3447 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 14500

[startup+0.703423 s]
/proc/loadavg: 6.20 6.20 4.96 4/117 7644
/proc/meminfo: memFree=2978156/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=36316 CPUtime=0.7
/proc/7644/stat : 7644 (ttsth-5-0) R 7642 7644 10612 0 -1 4202496 8511 0 0 0 66 4 0 0 24 0 1 0 1133182894 37187584 8466 4294967295 134512640 135237372 3219067200 3219065440 134680348 0 0 0 0 0 0 0 17 2 0 0 0
/proc/7644/statm: 9079 8466 76 177 0 8901 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 36316

[startup+1.50338 s]
/proc/loadavg: 6.20 6.20 4.96 4/118 7649
/proc/meminfo: memFree=2945076/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=29160 CPUtime=1.5
/proc/7644/stat : 7644 (ttsth-5-0) R 7642 7644 10612 0 -1 4202496 9974 0 0 0 146 4 0 0 25 0 1 0 1133182894 29859840 7130 4294967295 134512640 135237372 3219067200 3219066384 134735855 0 0 0 0 0 0 0 17 2 0 0 0
/proc/7644/statm: 7290 7130 77 177 0 7112 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 29160

[startup+3.1033 s]
/proc/loadavg: 6.20 6.20 4.96 4/118 7649
/proc/meminfo: memFree=2940636/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=41316 CPUtime=3.1
/proc/7644/stat : 7644 (ttsth-5-0) R 7642 7644 10612 0 -1 4202496 13231 0 0 0 305 5 0 0 25 0 1 0 1133182894 42307584 10122 4294967295 134512640 135237372 3219067200 3219045812 134732614 0 0 0 0 0 0 0 17 2 0 0 0
/proc/7644/statm: 10329 10122 88 177 0 10151 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 41316

[startup+6.30314 s]
/proc/loadavg: 5.94 6.15 4.95 7/122 7658
/proc/meminfo: memFree=2914356/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=102756 CPUtime=7.38
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 20947 0 0 0 730 8 0 0 25 0 5 0 1133182894 105222144 17379 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 25689 17379 95 177 0 25511 0
[pid=7644/tid=7655] ppid=7642 vsize=102756 CPUtime=0.48
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 248 0 0 0 48 0 0 0 25 0 5 0 1133183415 105222144 17379 4294967295 134512640 135237372 3219067200 3081812736 134680326 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=102756 CPUtime=0.61
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 549 0 0 0 60 1 0 0 25 0 5 0 1133183415 105222144 17379 4294967295 134512640 135237372 3219067200 3073399440 134680727 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=102756 CPUtime=0.44
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 517 0 0 0 43 1 0 0 25 0 5 0 1133183416 105222144 17379 4294967295 134512640 135237372 3219067200 3064943264 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=102756 CPUtime=0.63
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 407 0 0 0 63 0 0 0 25 0 5 0 1133183416 105222144 17379 4294967295 134512640 135237372 3219067200 3056610160 134680737 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7.38
Current children cumulated vsize (KiB) 102756

[startup+12.7028 s]
/proc/loadavg: 6.03 6.16 4.96 9/123 7759
/proc/meminfo: memFree=2877188/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=140492 CPUtime=23.17
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 30006 0 0 0 2307 10 0 0 25 0 5 0 1133182894 143863808 26438 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 35123 26438 95 177 0 34945 0
[pid=7644/tid=7655] ppid=7642 vsize=140492 CPUtime=4.36
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 1806 0 0 0 436 0 0 0 25 0 5 0 1133183415 143863808 26438 4294967295 134512640 135237372 3219067200 3081828048 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=140492 CPUtime=5.85
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 3247 0 0 0 583 2 0 0 25 0 5 0 1133183415 143863808 26438 4294967295 134512640 135237372 3219067200 3073402864 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=140492 CPUtime=3.05
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 2915 0 0 0 304 1 0 0 25 0 5 0 1133183416 143863808 26438 4294967295 134512640 135237372 3219067200 3064950064 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=140492 CPUtime=4.69
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 2812 0 0 0 468 1 0 0 25 0 5 0 1133183416 143863808 26438 4294967295 134512640 135237372 3219067200 3056616784 134680364 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 23.17
Current children cumulated vsize (KiB) 140492

[startup+25.5021 s]
/proc/loadavg: 6.23 6.20 4.99 8/122 7874
/proc/meminfo: memFree=2800884/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=216192 CPUtime=56.3
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 48444 0 0 0 5613 17 0 0 25 0 5 0 1133182894 221380608 44876 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 54048 44876 95 177 0 53870 0
[pid=7644/tid=7655] ppid=7642 vsize=216192 CPUtime=12.18
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 5435 0 0 0 1215 3 0 0 25 0 5 0 1133183415 221380608 44877 4294967295 134512640 135237372 3219067200 3081825408 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=216192 CPUtime=12.21
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 6433 0 0 0 1218 3 0 0 25 0 5 0 1133183415 221380608 44877 4294967295 134512640 135237372 3219067200 3073357312 134590129 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=216192 CPUtime=12.14
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 9759 0 0 0 1212 2 0 0 25 0 5 0 1133183416 221380608 44877 4294967295 134512640 135237372 3219067200 3064943408 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=216192 CPUtime=14.55
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 7592 0 0 0 1452 3 0 0 25 0 5 0 1133183416 221380608 44877 4294967295 134512640 135237372 3219067200 3056590848 134680499 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 56.3
Current children cumulated vsize (KiB) 216192

[startup+51.1108 s]
/proc/loadavg: 6.15 6.18 5.02 7/122 7912
/proc/meminfo: memFree=2682632/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=339136 CPUtime=119.23
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 78105 0 0 0 11896 27 0 0 25 0 5 0 1133182894 347275264 74537 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 84784 74537 95 177 0 84606 0
[pid=7644/tid=7655] ppid=7642 vsize=339136 CPUtime=24.65
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 9250 0 0 0 2461 4 0 0 25 0 5 0 1133183415 347275264 74537 4294967295 134512640 135237372 3219067200 3081820480 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=339136 CPUtime=25.04
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) S 7642 7644 10612 0 -1 4202560 12314 0 0 0 2501 3 0 0 25 0 5 0 1133183415 347275264 74537 4294967295 134512640 135237372 3219067200 3073369476 134634454 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=339136 CPUtime=24.87
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) S 7642 7644 10612 0 -1 4202560 17333 0 0 0 2481 6 0 0 25 0 5 0 1133183416 347275264 74537 4294967295 134512640 135237372 3219067200 3064980868 134634454 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=339136 CPUtime=39.45
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 19982 0 0 0 3937 8 0 0 25 0 5 0 1133183416 347275264 74537 4294967295 134512640 135237372 3219067200 3056590272 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 119.23
Current children cumulated vsize (KiB) 339136

[startup+102.318 s]
/proc/loadavg: 6.48 6.26 5.10 7/122 8175
/proc/meminfo: memFree=2522508/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=504180 CPUtime=221.55
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 117605 0 0 0 22105 50 0 0 25 0 5 0 1133182894 516280320 114037 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 126045 114037 95 177 0 125867 0
[pid=7644/tid=7655] ppid=7642 vsize=504180 CPUtime=50.58
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 15787 0 0 0 5049 9 0 0 25 0 5 0 1133183415 516280320 114037 4294967295 134512640 135237372 3219067200 3081824336 134680273 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=504180 CPUtime=50.77
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 23835 0 0 0 5069 8 0 0 25 0 5 0 1133183415 516280320 114037 4294967295 134512640 135237372 3219067200 3073399216 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=504180 CPUtime=50.25
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 30698 0 0 0 5014 11 0 0 25 0 5 0 1133183416 516280320 114037 4294967295 134512640 135237372 3219067200 3064983608 134519949 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=504180 CPUtime=64.73
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 28059 0 0 0 6457 16 0 0 25 0 5 0 1133183416 516280320 114037 4294967295 134512640 135237372 3219067200 3056616368 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 221.55
Current children cumulated vsize (KiB) 504180

[startup+162.315 s]
/proc/loadavg: 6.57 6.32 5.19 7/122 8451
/proc/meminfo: memFree=2313492/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=724852 CPUtime=378.38
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 170058 0 0 0 37763 75 0 0 25 0 5 0 1133182894 742248448 166490 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 181213 166490 95 177 0 181035 0
[pid=7644/tid=7655] ppid=7642 vsize=724852 CPUtime=80.25
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 25296 0 0 0 8013 12 0 0 25 0 5 0 1133183415 742248448 166490 4294967295 134512640 135237372 3219067200 3081807136 134562341 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=724852 CPUtime=99.51
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 40614 0 0 0 9932 19 0 0 25 0 5 0 1133183415 742248448 166490 4294967295 134512640 135237372 3219067200 3073381760 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=724852 CPUtime=98.95
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 48250 0 0 0 9876 19 0 0 25 0 5 0 1133183416 742248448 166490 4294967295 134512640 135237372 3219067200 3064966720 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=724852 CPUtime=94.45
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 36672 0 0 0 9426 19 0 0 25 0 5 0 1133183416 742248448 166490 4294967295 134512640 135237372 3219067200 3056639168 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 378.38
Current children cumulated vsize (KiB) 724852

[startup+222.312 s]
/proc/loadavg: 6.53 6.35 5.27 7/122 8727
/proc/meminfo: memFree=2146532/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=899320 CPUtime=508.37
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 211581 0 0 0 50734 103 0 0 25 0 5 0 1133182894 920903680 208013 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 224830 208013 95 177 0 224652 0
[pid=7644/tid=7655] ppid=7642 vsize=899320 CPUtime=110.29
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 36154 0 0 0 11006 23 0 0 25 0 5 0 1133183415 920903680 208013 4294967295 134512640 135237372 3219067200 3081807584 134749348 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=899320 CPUtime=139.68
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 50971 0 0 0 13942 26 0 0 25 0 5 0 1133183415 920903680 208013 4294967295 134512640 135237372 3219067200 3073396288 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=899320 CPUtime=128.35
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 57490 0 0 0 12811 24 0 0 25 0 5 0 1133183416 920903680 208013 4294967295 134512640 135237372 3219067200 3065002608 134562355 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=899320 CPUtime=124.83
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 47740 0 0 0 12459 24 0 0 25 0 5 0 1133183416 920903680 208013 4294967295 134512640 135237372 3219067200 3056608496 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 508.37
Current children cumulated vsize (KiB) 899320

[startup+282.309 s]
/proc/loadavg: 6.66 6.41 5.36 7/122 9002
/proc/meminfo: memFree=2002188/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=1051380 CPUtime=630.51
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 247904 0 0 0 62929 122 0 0 25 0 5 0 1133182894 1076613120 244336 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 262845 244336 95 177 0 262667 0
[pid=7644/tid=7655] ppid=7642 vsize=1051380 CPUtime=140.42
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 44105 0 0 0 14009 33 0 0 25 0 5 0 1133183415 1076613120 244336 4294967295 134512640 135237372 3219067200 3081828720 134680464 0 0 0 0 0 0 0 -1 0 0 0 0

################
# More data... #
################

/proc/meminfo: memFree=1859232/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=1199920 CPUtime=757.56
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 283383 0 0 0 75611 145 0 0 25 0 5 0 1133182894 1228718080 279815 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 299980 279815 95 177 0 299802 0
[pid=7644/tid=7655] ppid=7642 vsize=1199920 CPUtime=175.51
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 53550 0 0 0 17510 41 0 0 25 0 5 0 1133183415 1228718080 279815 4294967295 134512640 135237372 3219067200 3081823440 134562344 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=1199920 CPUtime=201.66
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 69233 0 0 0 20129 37 0 0 25 0 5 0 1133183415 1228718080 279815 4294967295 134512640 135237372 3219067200 3073379344 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=1199920 CPUtime=190.64
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 79253 0 0 0 19032 32 0 0 25 0 5 0 1133183416 1228718080 279815 4294967295 134512640 135237372 3219067200 3064978304 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=1199920 CPUtime=184.53
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 62121 0 0 0 18424 29 0 0 25 0 5 0 1133183416 1228718080 279815 4294967295 134512640 135237372 3219067200 3056592328 134519962 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 757.56
Current children cumulated vsize (KiB) 1199920

[startup+402.302 s]
/proc/loadavg: 6.56 6.46 5.50 7/122 9560
/proc/meminfo: memFree=1700672/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=1367568 CPUtime=915.35
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 323142 0 0 0 91361 174 0 0 25 0 5 0 1133182894 1400389632 319574 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 341892 319574 95 177 0 341714 0
[pid=7644/tid=7655] ppid=7642 vsize=1367568 CPUtime=218.92
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 63228 0 0 0 21843 49 0 0 25 0 5 0 1133183415 1400389632 319574 4294967295 134512640 135237372 3219067200 3081795136 134561524 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=1367568 CPUtime=231.33
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 75451 0 0 0 23094 39 0 0 25 0 5 0 1133183415 1400389632 319574 4294967295 134512640 135237372 3219067200 3073401328 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=1367568 CPUtime=233.05
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 93561 0 0 0 23265 40 0 0 25 0 5 0 1133183416 1400389632 319574 4294967295 134512640 135237372 3219067200 3064978912 134562341 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=1367568 CPUtime=226.83
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 71676 0 0 0 22643 40 0 0 25 0 5 0 1133183416 1400389632 319574 4294967295 134512640 135237372 3219067200 3056603456 134562351 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 915.35
Current children cumulated vsize (KiB) 1367568

[startup+462.309 s]
/proc/loadavg: 6.72 6.50 5.57 8/123 9813
/proc/meminfo: memFree=1577580/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=1498068 CPUtime=1053.66
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 353825 0 0 0 105182 184 0 0 25 0 5 0 1133182894 1534021632 350257 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 374517 350257 95 177 0 374339 0
[pid=7644/tid=7655] ppid=7642 vsize=1498068 CPUtime=248.72
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 70209 0 0 0 24820 52 0 0 25 0 5 0 1133183415 1534021632 350257 4294967295 134512640 135237372 3219067200 3081784368 134591102 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=1498068 CPUtime=261.63
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 81708 0 0 0 26121 42 0 0 25 0 5 0 1133183415 1534021632 350257 4294967295 134512640 135237372 3219067200 3073394752 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=1498068 CPUtime=277.26
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 103701 0 0 0 27684 42 0 0 25 0 5 0 1133183416 1534021632 350257 4294967295 134512640 135237372 3219067200 3064991072 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=1498068 CPUtime=260.83
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 78981 0 0 0 26041 42 0 0 25 0 5 0 1133183416 1534021632 350257 4294967295 134512640 135237372 3219067200 3056603760 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1053.66
Current children cumulated vsize (KiB) 1498068

[startup+522.316 s]
/proc/loadavg: 6.73 6.54 5.64 9/123 10074
/proc/meminfo: memFree=1447780/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=1635356 CPUtime=1200.3
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 386587 0 0 0 119833 197 0 0 25 0 5 0 1133182894 1674604544 383019 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 408839 383019 95 177 0 408661 0
[pid=7644/tid=7655] ppid=7642 vsize=1635356 CPUtime=293.03
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 80016 0 0 0 29246 57 0 0 25 0 5 0 1133183415 1674604544 383019 4294967295 134512640 135237372 3219067200 3081788976 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=1635356 CPUtime=295.91
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 90507 0 0 0 29547 44 0 0 25 0 5 0 1133183415 1674604544 383019 4294967295 134512640 135237372 3219067200 3073369472 134562399 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=1635356 CPUtime=307.25
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 111375 0 0 0 30678 47 0 0 25 0 5 0 1133183416 1674604544 383019 4294967295 134512640 135237372 3219067200 3064975884 134550016 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=1635356 CPUtime=298.89
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 85463 0 0 0 29846 43 0 0 25 0 5 0 1133183416 1674604544 383019 4294967295 134512640 135237372 3219067200 3056603664 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1200.3
Current children cumulated vsize (KiB) 1635356

[startup+582.313 s]
/proc/loadavg: 6.57 6.52 5.69 8/123 10289
/proc/meminfo: memFree=1327696/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=1760072 CPUtime=1344.22
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 416308 0 0 0 134214 208 0 0 25 0 5 0 1133182894 1802313728 412740 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 440018 412740 95 177 0 439840 0
[pid=7644/tid=7655] ppid=7642 vsize=1760072 CPUtime=337.37
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 87827 0 0 0 33678 59 0 0 25 0 5 0 1133183415 1802313728 412740 4294967295 134512640 135237372 3219067200 3081816972 134562272 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=1760072 CPUtime=327.31
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 99354 0 0 0 32682 49 0 0 25 0 5 0 1133183415 1802313728 412740 4294967295 134512640 135237372 3219067200 3073389280 134562401 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=1760072 CPUtime=344.19
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 120057 0 0 0 34371 48 0 0 25 0 5 0 1133183416 1802313728 412740 4294967295 134512640 135237372 3219067200 3064953536 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=1760072 CPUtime=330.13
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 89844 0 0 0 32967 46 0 0 25 0 5 0 1133183416 1802313728 412740 4294967295 134512640 135237372 3219067200 3056615568 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1344.22
Current children cumulated vsize (KiB) 1760072

[startup+642.31 s]
/proc/loadavg: 6.49 6.51 5.74 9/123 10531
/proc/meminfo: memFree=1217356/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=1877212 CPUtime=1487.89
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 443621 0 0 0 148564 225 0 0 25 0 5 0 1133182894 1922265088 440053 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 469303 440053 95 177 0 469125 0
[pid=7644/tid=7655] ppid=7642 vsize=1877212 CPUtime=370.48
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 92007 0 0 0 36985 63 0 0 25 0 5 0 1133183415 1922265088 440053 4294967295 134512640 135237372 3219067200 3081790960 134562344 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=1877212 CPUtime=362.91
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 110012 0 0 0 36238 53 0 0 25 0 5 0 1133183415 1922265088 440053 4294967295 134512640 135237372 3219067200 3073380640 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=1877212 CPUtime=378.55
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 126565 0 0 0 37804 51 0 0 25 0 5 0 1133183416 1922265088 440053 4294967295 134512640 135237372 3219067200 3064960624 134565869 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=1877212 CPUtime=370.73
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 95811 0 0 0 37021 52 0 0 25 0 5 0 1133183416 1922265088 440053 4294967295 134512640 135237372 3219067200 3056590768 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1487.89
Current children cumulated vsize (KiB) 1877212

[startup+702.307 s]
/proc/loadavg: 6.57 6.53 5.79 7/122 10766
/proc/meminfo: memFree=1111184/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=1987848 CPUtime=1629.26
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 470310 0 0 0 162685 241 0 0 25 0 5 0 1133182894 2035556352 466742 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 496962 466742 95 177 0 496784 0
[pid=7644/tid=7655] ppid=7642 vsize=1987848 CPUtime=417.62
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 95835 0 0 0 41695 67 0 0 25 0 5 0 1133183415 2035556352 466742 4294967295 134512640 135237372 3219067200 3081818688 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=1987848 CPUtime=392.91
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 117242 0 0 0 39236 55 0 0 25 0 5 0 1133183415 2035556352 466742 4294967295 134512640 135237372 3219067200 3073379616 134680273 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=1987848 CPUtime=412.7
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 135096 0 0 0 41212 58 0 0 25 0 5 0 1133183416 2035556352 466742 4294967295 134512640 135237372 3219067200 3064965760 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=1987848 CPUtime=400.81
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 102911 0 0 0 40026 55 0 0 25 0 5 0 1133183416 2035556352 466742 4294967295 134512640 135237372 3219067200 3056612704 134562344 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1629.26
Current children cumulated vsize (KiB) 1987848

[startup+762.324 s]
/proc/loadavg: 6.59 6.57 5.85 7/122 11046
/proc/meminfo: memFree=1015116/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=2089536 CPUtime=1778.34
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 494239 0 0 0 177568 266 0 0 25 0 5 0 1133182894 2139684864 490671 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 522384 490672 95 177 0 522206 0
[pid=7644/tid=7655] ppid=7642 vsize=2089536 CPUtime=463.43
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 99519 0 0 0 46270 73 0 0 25 0 5 0 1133183415 2139684864 490672 4294967295 134512640 135237372 3219067200 3081797040 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=2089536 CPUtime=422.41
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 123197 0 0 0 42181 60 0 0 25 0 5 0 1133183415 2139684864 490672 4294967295 134512640 135237372 3219067200 3073392784 134680336 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=2089536 CPUtime=449.95
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 142917 0 0 0 44926 69 0 0 25 0 5 0 1133183416 2139684864 490672 4294967295 134512640 135237372 3219067200 3064996112 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=2089536 CPUtime=437.33
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 109381 0 0 0 43675 58 0 0 25 0 5 0 1133183416 2139684864 490672 4294967295 134512640 135237372 3219067200 3056617040 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1778.34
Current children cumulated vsize (KiB) 2089536



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+765.314 s]
/proc/loadavg: 6.54 6.56 5.85 7/122 11050
/proc/meminfo: memFree=1008976/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=2096148 CPUtime=1785.84
/proc/7644/stat : 7644 (ttsth-5-0) S 7642 7644 10612 0 -1 4202496 495689 0 0 0 178316 268 0 0 25 0 5 0 1133182894 2146455552 492121 4294967295 134512640 135237372 3219067200 3219066796 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 524037 492121 95 177 0 523859 0
[pid=7644/tid=7655] ppid=7642 vsize=2096148 CPUtime=464.93
/proc/7644/task/7655/stat : 7655 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 99625 0 0 0 46420 73 0 0 25 0 5 0 1133183415 2146455552 492121 4294967295 134512640 135237372 3219067200 3081826576 134562444 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=2096148 CPUtime=423.91
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 123515 0 0 0 42330 61 0 0 25 0 5 0 1133183415 2146455552 492121 4294967295 134512640 135237372 3219067200 3073365280 134680239 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=7644/tid=7657] ppid=7642 vsize=2096148 CPUtime=452.95
/proc/7644/task/7657/stat : 7657 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 143741 0 0 0 45225 70 0 0 25 0 5 0 1133183416 2146455552 492121 4294967295 134512640 135237372 3219067200 3064991264 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=7644/tid=7658] ppid=7642 vsize=2096148 CPUtime=438.83
/proc/7644/task/7658/stat : 7658 (ttsth-5-0) R 7642 7644 10612 0 -1 4202560 109582 0 0 0 43825 58 0 0 25 0 5 0 1133183416 2146455552 492121 4294967295 134512640 135237372 3219067200 3056617056 134562294 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1785.84
Current children cumulated vsize (KiB) 2096148

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+765.434 s]
/proc/loadavg: 6.54 6.56 5.85 7/122 11050
/proc/meminfo: memFree=1008976/3368532 swapFree=1959840/1959888
[pid=7644] ppid=7642 vsize=0 CPUtime=1785.95
/proc/7644/stat : 7644 (ttsth-5-0) Z 7642 7644 10612 0 -1 4203524 495692 0 0 0 178318 277 0 0 18 0 2 0 1133182894 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/7644/statm: 0 0 0 0 0 0 0
[pid=7644/tid=7656] ppid=7642 vsize=0 CPUtime=424
/proc/7644/task/7656/stat : 7656 (ttsth-5-0) R 7642 7644 10612 0 -1 4203588 123515 0 0 0 42330 70 0 0 25 0 2 0 1133183415 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1785.95
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 765.441
CPU time (s): 1785.96
CPU user time (s): 1783.18
CPU system time (s): 2.78
CPU usage (%): 233.324
Max. virtual memory (cumulated for all children) (KiB): 2096148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1783.18
system time used= 2.78
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 495692
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 906
involuntary context switches= 54460

runsolver used 0.01 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 14:06:41
IDJOB=1781008
IDBENCH=71088
IDSOLVER=632
FILE ID=/1781008-1243685201
PBS_JOBID=
Free space on /tmp= 7977 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_13_UNSAT.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1781008-1243685201/watcher-1781008-1243685201 -o /tmp/evaluation-result-1781008-1243685201/solver-1781008-1243685201 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781008-1243685201.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= d4e16a803f6cd0903a2bd3e7157287b3
RANDOM SEED= 653105623

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.12
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2978896 kB
Buffers:        138216 kB
Cached:         124700 kB
SwapCached:          0 kB
Active:         178692 kB
Inactive:       106664 kB
HighTotal:     2489216 kB
HighFree:      2343196 kB
LowTotal:       879316 kB
LowFree:        635700 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:            5380 kB
Writeback:           0 kB
AnonPages:       22220 kB
Mapped:           8060 kB
Slab:            94700 kB
SReclaimable:    82572 kB
SUnreclaim:      12128 kB
PageTables:        768 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   123528 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 7977 MiB
End job on  at 2009-05-30 14:19:28