Trace number 1780918

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 1822.52 864.055

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_08_UNSAT.cnf
MD5SUM66aa2e18c32a02f55a810347a9702c7f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1278
Number of clauses68055
Sum of the clauses size202155
Maximum clause length9
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22148
Number of clauses of size 365884
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data 

0.08/0.10	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780918-1243684354.cnf 
0.08/0.10	c Using SATTIMEOUT of 10000
0.08/0.10	c Using SATRAM of 2047
0.08/0.10	c Size of subset node = 16
0.08/0.10	c Variables = 1278
0.08/0.10	c Clauses = 68055
0.08/0.10	c Literals = 202155
0.08/0.10	c Reduced size:
0.08/0.10	c Variables = 1278
0.08/0.10	c Clauses = 68055
0.08/0.10	c Literals = 202155
0.08/0.10	c a2
0.22/0.27	c a1
0.52/0.57	c Independent sub-problems = 1
0.52/0.57	c Sub-problem with 1278 variables and 68055 clauses
0.52/0.57	c using permutation method 4
0.52/0.57	c count = 1
0.52/0.57	c Ordering finished 0.550 seconds
0.52/0.57	c mapped 0.580 seconds
0.52/0.57	c permuted 0.580 seconds
0.52/0.57	c about to sort
0.52/0.59	c sorted
0.92/0.92	c clauses now 68055
0.92/0.92	c init finished 0.610 seconds
0.92/0.92	c tree built 0.920 seconds
0.92/0.92	c 
0.92/0.92	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
0.92/0.92	c ---------------------------------|----------------------------------|------------------------------------------------------
0.92/0.92	c ................................ | ..........                       |                        0.9           0.0             
0.92/0.92	c ................................ | ..........                     1 |                        0.9           1.1             
0.92/0.92	c ................................ | ..........                     2 |                        0.9           2.2             
0.92/0.92	c ................................ | ..........                     3 |                        0.9           3.3             
0.92/0.92	c ................................ | ..........                     4 |                        0.9           4.3             
0.92/0.92	c ................................ | ..........                     5 |                        0.9           5.4             
0.92/0.92	c ................................ | ..........                  1000 | 2                      0.9        1075.3           91
199.86/96.99	c ................................ | ..........               1326000 | 163753               200.0        6629.3     24828282
399.84/189.70	c ................................ | ..........               1973000 | 243862               400.1        4931.4     40027328
600.02/282.77	c ................................ | ..........               2622000 | 325582               600.1        4369.0     54623350
799.93/382.69	c ................................ | ..........               3070000 | 389824               800.1        3837.2     67927771
999.96/482.74	c ................................ | *.........               3627000 | 469943              1000.0        3626.9     80776562
1200.27/563.60	c ................................ | *.........               4195000 | 543993              1200.1        3495.5     94952698
1400.12/661.12	c ................................ | *.........               4601000 | 600109              1400.1        3286.1    105374330
1600.23/755.17	c ................................ | *.........               5052000 | 669358              1600.3        3156.8    114986181
1800.11/855.03	c ................................ | *.........               5528000 | 739056              1800.2        3070.8    123020519

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780918-1243684354/watcher-1780918-1243684354 -o /tmp/evaluation-result-1780918-1243684354/solver-1780918-1243684354 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780918-1243684354.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 6.08 6.20 5.15 4/113 27575
/proc/meminfo: memFree=3058948/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=1800 CPUtime=0.02
/proc/27575/stat : 27575 (ttsth-5-0) R 27573 27575 32205 0 -1 4202496 335 0 0 0 2 0 0 0 19 0 1 0 1133099380 1843200 291 4294967295 134512640 135237372 3216365216 3216363740 134639534 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27575/statm: 450 291 75 177 0 272 0

[startup+0.074112 s]
/proc/loadavg: 6.08 6.20 5.15 4/113 27575
/proc/meminfo: memFree=3058948/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=4288 CPUtime=0.08
/proc/27575/stat : 27575 (ttsth-5-0) R 27573 27575 32205 0 -1 4202496 948 0 0 0 8 0 0 0 21 0 1 0 1133099380 4390912 904 4294967295 134512640 135237372 3216365216 3216363740 134639534 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27575/statm: 1072 905 75 177 0 894 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 4288

[startup+0.114109 s]
/proc/loadavg: 6.08 6.20 5.15 4/113 27575
/proc/meminfo: memFree=3058948/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=7856 CPUtime=0.12
/proc/27575/stat : 27575 (ttsth-5-0) R 27573 27575 32205 0 -1 4202496 1830 0 0 0 9 3 0 0 21 0 1 0 1133099380 8044544 1786 4294967295 134512640 135237372 3216365216 3216364608 134749343 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27575/statm: 1964 1790 76 177 0 1786 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 7856

[startup+0.314091 s]
/proc/loadavg: 6.08 6.20 5.15 4/113 27575
/proc/meminfo: memFree=3058948/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=7376 CPUtime=0.32
/proc/27575/stat : 27575 (ttsth-5-0) R 27573 27575 32205 0 -1 4202496 2462 0 0 0 29 3 0 0 22 0 1 0 1133099380 7553024 1714 4294967295 134512640 135237372 3216365216 3216364544 134555275 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27575/statm: 1844 1714 77 177 0 1666 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 7376

[startup+0.714056 s]
/proc/loadavg: 6.08 6.20 5.15 4/113 27575
/proc/meminfo: memFree=3058948/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=14268 CPUtime=0.72
/proc/27575/stat : 27575 (ttsth-5-0) R 27573 27575 32205 0 -1 4202496 4244 0 0 0 67 5 0 0 24 0 1 0 1133099380 14610432 3429 4294967295 134512640 135237372 3216365216 3216342260 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27575/statm: 3567 3429 90 177 0 3389 0
Current children cumulated CPU time (s) 0.72
Current children cumulated vsize (KiB) 14268

[startup+1.51399 s]
/proc/loadavg: 6.08 6.20 5.15 8/118 27580
/proc/meminfo: memFree=3040152/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=58440 CPUtime=2.08
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 6827 0 0 0 201 7 0 0 25 0 5 0 1133099380 59842560 6012 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 14610 6012 95 177 0 14432 0
[pid=27575/tid=27577] ppid=27573 vsize=58440 CPUtime=0.39
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 265 0 0 0 38 1 0 0 25 0 5 0 1133099472 59842560 6012 4294967295 134512640 135237372 3216365216 3086073424 134680217 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=58440 CPUtime=0.21
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 196 0 0 0 21 0 0 0 25 0 5 0 1133099472 59842560 6012 4294967295 134512640 135237372 3216365216 3077650016 134591960 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=58440 CPUtime=0.15
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 218 0 0 0 15 0 0 0 25 0 5 0 1133099474 59842560 6012 4294967295 134512640 135237372 3216365216 3069251888 134749351 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=58440 CPUtime=0.41
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 566 0 0 0 40 1 0 0 25 0 5 0 1133099474 59842560 6012 4294967295 134512640 135237372 3216365216 3060889936 134591200 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.08
Current children cumulated vsize (KiB) 58440

[startup+3.11386 s]
/proc/loadavg: 6.08 6.20 5.15 8/118 27584
/proc/meminfo: memFree=3030940/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=71508 CPUtime=5.28
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 10167 0 0 0 519 9 0 0 25 0 5 0 1133099380 73224192 9353 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 17877 9353 95 177 0 17699 0
[pid=27575/tid=27577] ppid=27573 vsize=71508 CPUtime=1.29
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 936 0 0 0 128 1 0 0 25 0 5 0 1133099472 73224192 9353 4294967295 134512640 135237372 3216365216 3086060224 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=71508 CPUtime=0.91
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 917 0 0 0 90 1 0 0 25 0 5 0 1133099472 73224192 9353 4294967295 134512640 135237372 3216365216 3077658800 134591086 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=71508 CPUtime=0.95
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 1034 0 0 0 94 1 0 0 25 0 5 0 1133099474 73224192 9353 4294967295 134512640 135237372 3216365216 3069279664 134680326 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=71508 CPUtime=1.21
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 1699 0 0 0 120 1 0 0 25 0 5 0 1133099474 73224192 9353 4294967295 134512640 135237372 3216365216 3060898432 134588580 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.28
Current children cumulated vsize (KiB) 71508

[startup+6.31358 s]
/proc/loadavg: 6.15 6.21 5.16 7/118 27588
/proc/meminfo: memFree=3005452/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=96872 CPUtime=11.67
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 16023 0 0 0 1157 10 0 0 25 0 5 0 1133099380 99196928 15208 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 24218 15208 95 177 0 24040 0
[pid=27575/tid=27577] ppid=27573 vsize=96872 CPUtime=3.22
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 2541 0 0 0 321 1 0 0 25 0 5 0 1133099472 99196928 15208 4294967295 134512640 135237372 3216365216 3086061520 134590501 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=96872 CPUtime=2.28
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 2063 0 0 0 227 1 0 0 25 0 5 0 1133099472 99196928 15208 4294967295 134512640 135237372 3216365216 3077651760 134680503 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=96872 CPUtime=2.65
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 2453 0 0 0 263 2 0 0 25 0 5 0 1133099474 99196928 15208 4294967295 134512640 135237372 3216365216 3069267152 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=96872 CPUtime=2.6
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 3384 0 0 0 259 1 0 0 25 0 5 0 1133099474 99196928 15208 4294967295 134512640 135237372 3216365216 3060881840 134680467 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.67
Current children cumulated vsize (KiB) 96872

[startup+12.713 s]
/proc/loadavg: 6.14 6.21 5.17 7/118 27597
/proc/meminfo: memFree=2962996/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=139616 CPUtime=25.25
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 26270 0 0 0 2509 16 0 0 25 0 5 0 1133099380 142966784 25455 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 34904 25456 95 177 0 34726 0
[pid=27575/tid=27577] ppid=27573 vsize=139616 CPUtime=7.39
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 5766 0 0 0 735 4 0 0 25 0 5 0 1133099472 142966784 25456 4294967295 134512640 135237372 3216365216 3086075584 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=139616 CPUtime=5.41
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 4672 0 0 0 539 2 0 0 25 0 5 0 1133099472 142966784 25456 4294967295 134512640 135237372 3216365216 3077656752 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=139616 CPUtime=5.85
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 4022 0 0 0 582 3 0 0 25 0 5 0 1133099474 142966784 25456 4294967295 134512640 135237372 3216365216 3069251968 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=139616 CPUtime=5.68
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 6229 0 0 0 566 2 0 0 25 0 5 0 1133099474 142966784 25456 4294967295 134512640 135237372 3216365216 3060888432 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.25
Current children cumulated vsize (KiB) 139616

[startup+25.5119 s]
/proc/loadavg: 6.11 6.20 5.18 7/118 27620
/proc/meminfo: memFree=2893824/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=209876 CPUtime=57.15
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 42774 0 0 0 5687 28 0 0 25 0 5 0 1133099380 214913024 41959 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 52469 41959 95 177 0 52291 0
[pid=27575/tid=27577] ppid=27573 vsize=209876 CPUtime=18.1
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 10573 0 0 0 1802 8 0 0 25 0 5 0 1133099472 214913024 41959 4294967295 134512640 135237372 3216365216 3086052976 134562420 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=209876 CPUtime=11.51
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 7980 0 0 0 1147 4 0 0 25 0 5 0 1133099472 214913024 41959 4294967295 134512640 135237372 3216365216 3077649088 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=209876 CPUtime=14.29
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 8617 0 0 0 1425 4 0 0 25 0 5 0 1133099474 214913024 41959 4294967295 134512640 135237372 3216365216 3069253776 134589438 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=209876 CPUtime=12.33
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 10022 0 0 0 1226 7 0 0 25 0 5 0 1133099474 214913024 41959 4294967295 134512640 135237372 3216365216 3060878592 134562341 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 57.15
Current children cumulated vsize (KiB) 209876

[startup+51.1097 s]
/proc/loadavg: 6.35 6.25 5.22 8/119 27724
/proc/meminfo: memFree=2803244/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=306220 CPUtime=108.32
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 65608 0 0 0 10792 40 0 0 25 0 5 0 1133099380 313569280 64793 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 76555 64793 95 177 0 76377 0
[pid=27575/tid=27577] ppid=27573 vsize=306220 CPUtime=31.17
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 14775 0 0 0 3103 14 0 0 25 0 5 0 1133099472 313569280 64793 4294967295 134512640 135237372 3216365216 3086049280 134590285 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=306220 CPUtime=24.55
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 14596 0 0 0 2449 6 0 0 25 0 5 0 1133099472 313569280 64793 4294967295 134512640 135237372 3216365216 3077670992 134749345 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=306220 CPUtime=26.85
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 13486 0 0 0 2679 6 0 0 25 0 5 0 1133099474 313569280 64793 4294967295 134512640 135237372 3216365216 3069266752 134562328 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=306220 CPUtime=24.83
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 17169 0 0 0 2474 9 0 0 25 0 5 0 1133099474 313569280 64793 4294967295 134512640 135237372 3216365216 3060888996 134634454 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 108.32
Current children cumulated vsize (KiB) 306220

[startup+102.315 s]
/proc/loadavg: 6.35 6.27 5.28 8/118 27921
/proc/meminfo: memFree=2633932/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=480304 CPUtime=210.68
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 107376 0 0 0 21004 64 0 0 25 0 5 0 1133099380 491831296 106561 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 120076 106561 95 177 0 119898 0
[pid=27575/tid=27577] ppid=27573 vsize=480304 CPUtime=57.02
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 24140 0 0 0 5688 14 0 0 25 0 5 0 1133099472 491831296 106561 4294967295 134512640 135237372 3216365216 3086079984 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=480304 CPUtime=50.45
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 23790 0 0 0 5033 12 0 0 25 0 5 0 1133099472 491831296 106561 4294967295 134512640 135237372 3216365216 3077657104 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=480304 CPUtime=52.05
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 26870 0 0 0 5195 10 0 0 25 0 5 0 1133099474 491831296 106561 4294967295 134512640 135237372 3216365216 3069286928 134562344 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=480304 CPUtime=50.24
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 26994 0 0 0 5001 23 0 0 25 0 5 0 1133099474 491831296 106561 4294967295 134512640 135237372 3216365216 3060899600 134680727 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 210.68
Current children cumulated vsize (KiB) 480304

[startup+162.31 s]
/proc/loadavg: 6.47 6.32 5.36 7/118 28195
/proc/meminfo: memFree=2475608/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=647052 CPUtime=330.46
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 147033 0 0 0 32953 93 0 0 25 0 5 0 1133099380 662581248 146218 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 161763 146218 95 177 0 161585 0
[pid=27575/tid=27577] ppid=27573 vsize=647052 CPUtime=87.02
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 32418 0 0 0 8673 29 0 0 25 0 5 0 1133099472 662581248 146218 4294967295 134512640 135237372 3216365216 3086056912 134588158 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=647052 CPUtime=80.65
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 34792 0 0 0 8050 15 0 0 25 0 5 0 1133099472 662581248 146218 4294967295 134512640 135237372 3216365216 3077666336 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=647052 CPUtime=81.85
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 34861 0 0 0 8173 12 0 0 25 0 5 0 1133099474 662581248 146218 4294967295 134512640 135237372 3216365216 3069268248 134562273 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=647052 CPUtime=80.02
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 39380 0 0 0 7970 32 0 0 25 0 5 0 1133099474 662581248 146218 4294967295 134512640 135237372 3216365216 3060872224 134593445 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 330.46
Current children cumulated vsize (KiB) 647052

[startup+222.315 s]
/proc/loadavg: 6.51 6.36 5.43 8/118 28471
/proc/meminfo: memFree=2332196/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=797504 CPUtime=479.51
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 182594 0 0 0 47836 115 0 0 25 0 5 0 1133099380 816644096 181779 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 199376 181779 95 177 0 199198 0
[pid=27575/tid=27577] ppid=27573 vsize=797504 CPUtime=117.02
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 40603 0 0 0 11666 36 0 0 25 0 5 0 1133099472 816644096 181779 4294967295 134512640 135237372 3216365216 3086074960 134562309 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=797504 CPUtime=127.9

################
# More data... #
################

/proc/meminfo: memFree=1936940/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=1213284 CPUtime=839.31
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 281727 0 0 0 83735 196 0 0 25 0 5 0 1133099380 1242402816 280912 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 303321 280912 95 177 0 303143 0
[pid=27575/tid=27577] ppid=27573 vsize=1213284 CPUtime=207.72
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 61173 0 0 0 20720 52 0 0 25 0 5 0 1133099472 1242402816 280912 4294967295 134512640 135237372 3216365216 3086064544 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=1213284 CPUtime=217.51
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 69570 0 0 0 21721 30 0 0 25 0 5 0 1133099472 1242402816 280913 4294967295 134512640 135237372 3216365216 3077654528 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=1213284 CPUtime=213.82
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 64908 0 0 0 21340 42 0 0 25 0 5 0 1133099474 1242402816 280913 4294967295 134512640 135237372 3216365216 3069257520 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=1213284 CPUtime=199.34
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 80495 0 0 0 19867 67 0 0 25 0 5 0 1133099474 1242402816 280913 4294967295 134512640 135237372 3216365216 3060881008 134591304 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 839.31
Current children cumulated vsize (KiB) 1213284

[startup+462.314 s]
/proc/loadavg: 6.37 6.47 5.69 7/118 29586
/proc/meminfo: memFree=1809912/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=1343044 CPUtime=959.2
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 313160 0 0 0 95700 220 0 0 25 0 5 0 1133099380 1375277056 312345 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 335761 312345 95 177 0 335583 0
[pid=27575/tid=27577] ppid=27573 vsize=1343044 CPUtime=237.99
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 68415 0 0 0 23745 54 0 0 25 0 5 0 1133099472 1375277056 312345 4294967295 134512640 135237372 3216365216 3086062272 134562420 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=1343044 CPUtime=247.61
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 74819 0 0 0 24724 37 0 0 25 0 5 0 1133099472 1375277056 312345 4294967295 134512640 135237372 3216365216 3077667504 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=1343044 CPUtime=243.55
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 76825 0 0 0 24307 48 0 0 25 0 5 0 1133099474 1375277056 312345 4294967295 134512640 135237372 3216365216 3069282496 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=1343044 CPUtime=229.13
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 87519 0 0 0 22837 76 0 0 25 0 5 0 1133099474 1375277056 312345 4294967295 134512640 135237372 3216365216 3060889024 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 959.2
Current children cumulated vsize (KiB) 1343044

[startup+522.309 s]
/proc/loadavg: 6.44 6.48 5.74 7/118 29862
/proc/meminfo: memFree=1674952/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=1489160 CPUtime=1096.21
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 347796 0 0 0 109366 255 0 0 25 0 5 0 1133099380 1524899840 346981 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 372290 346981 95 177 0 372112 0
[pid=27575/tid=27577] ppid=27573 vsize=1489160 CPUtime=277.15
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 77532 0 0 0 27657 58 0 0 25 0 5 0 1133099472 1524899840 346981 4294967295 134512640 135237372 3216365216 3086054976 134562317 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=1489160 CPUtime=277.39
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 80284 0 0 0 27697 42 0 0 25 0 5 0 1133099472 1524899840 346981 4294967295 134512640 135237372 3216365216 3077665904 134562278 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=1489160 CPUtime=277.99
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 89083 0 0 0 27737 62 0 0 25 0 5 0 1133099474 1524899840 346981 4294967295 134512640 135237372 3216365216 3069282816 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=1489160 CPUtime=262.77
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 95315 0 0 0 26189 88 0 0 25 0 5 0 1133099474 1524899840 346981 4294967295 134512640 135237372 3216365216 3060895552 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1096.21
Current children cumulated vsize (KiB) 1489160

[startup+582.314 s]
/proc/loadavg: 6.31 6.44 5.77 8/118 30138
/proc/meminfo: memFree=1514332/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=1654016 CPUtime=1237.88
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 386902 0 0 0 123505 283 0 0 25 0 5 0 1133099380 1693712384 386087 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 413504 386087 95 177 0 413326 0
[pid=27575/tid=27577] ppid=27573 vsize=1654016 CPUtime=318.82
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 86727 0 0 0 31818 64 0 0 25 0 5 0 1133099472 1693712384 386087 4294967295 134512640 135237372 3216365216 3086070448 134680499 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=1654016 CPUtime=307.31
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 86292 0 0 0 30685 46 0 0 25 0 5 0 1133099472 1693712384 386087 4294967295 134512640 135237372 3216365216 3077666368 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=1654016 CPUtime=318.19
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 108005 0 0 0 31742 77 0 0 25 0 5 0 1133099474 1693712384 386087 4294967295 134512640 135237372 3216365216 3069286416 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=1654016 CPUtime=292.64
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 100296 0 0 0 29173 91 0 0 25 0 5 0 1133099474 1693712384 386087 4294967295 134512640 135237372 3216365216 3060888720 134562401 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1237.88
Current children cumulated vsize (KiB) 1654016

[startup+642.309 s]
/proc/loadavg: 6.38 6.45 5.82 7/118 30415
/proc/meminfo: memFree=1416512/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=1756976 CPUtime=1362.13
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 411302 0 0 0 135911 302 0 0 25 0 5 0 1133099380 1799143424 410487 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 439244 410487 95 177 0 439066 0
[pid=27575/tid=27577] ppid=27573 vsize=1756976 CPUtime=348.92
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 93085 0 0 0 34826 66 0 0 25 0 5 0 1133099472 1799143424 410487 4294967295 134512640 135237372 3216365216 3086077472 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=1756976 CPUtime=337.31
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 91667 0 0 0 33682 49 0 0 25 0 5 0 1133099472 1799143424 410487 4294967295 134512640 135237372 3216365216 3077665984 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=1756976 CPUtime=352.45
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 116357 0 0 0 35157 88 0 0 25 0 5 0 1133099474 1799143424 410487 4294967295 134512640 135237372 3216365216 3069287184 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=1756976 CPUtime=322.53
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 104611 0 0 0 32159 94 0 0 25 0 5 0 1133099474 1799143424 410487 4294967295 134512640 135237372 3216365216 3060887952 134562351 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1362.13
Current children cumulated vsize (KiB) 1756976

[startup+702.314 s]
/proc/loadavg: 6.61 6.51 5.88 7/118 30695
/proc/meminfo: memFree=1310364/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=1868644 CPUtime=1494.73
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 437761 0 0 0 149156 317 0 0 25 0 5 0 1133099380 1913491456 436946 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 467161 436946 95 177 0 466983 0
[pid=27575/tid=27577] ppid=27573 vsize=1868644 CPUtime=382.42
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 99009 0 0 0 38175 67 0 0 25 0 5 0 1133099472 1913491456 436946 4294967295 134512640 135237372 3216365216 3086064688 134562341 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=1868644 CPUtime=376.21
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 99812 0 0 0 37566 55 0 0 25 0 5 0 1133099472 1913491456 436946 4294967295 134512640 135237372 3216365216 3077662704 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=1868644 CPUtime=382.65
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 120025 0 0 0 38175 90 0 0 25 0 5 0 1133099474 1913491456 436946 4294967295 134512640 135237372 3216365216 3069275792 134562309 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=1868644 CPUtime=352.53
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 113333 0 0 0 35153 100 0 0 25 0 5 0 1133099474 1913491456 436946 4294967295 134512640 135237372 3216365216 3060898560 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1494.73
Current children cumulated vsize (KiB) 1868644

[startup+762.318 s]
/proc/loadavg: 6.79 6.59 5.94 8/118 30969
/proc/meminfo: memFree=1225848/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=1957068 CPUtime=1614.65
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 458837 0 0 0 161130 335 0 0 25 0 5 0 1133099380 2004037632 458022 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 489267 458022 95 177 0 489089 0
[pid=27575/tid=27577] ppid=27573 vsize=1957068 CPUtime=412.33
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 104673 0 0 0 41160 73 0 0 25 0 5 0 1133099472 2004037632 458022 4294967295 134512640 135237372 3216365216 3086055200 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=1957068 CPUtime=406.12
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 106028 0 0 0 40554 58 0 0 25 0 5 0 1133099472 2004037632 458022 4294967295 134512640 135237372 3216365216 3077666928 134562278 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=1957068 CPUtime=412.65
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 123320 0 0 0 41170 95 0 0 25 0 5 0 1133099474 2004037632 458022 4294967295 134512640 135237372 3216365216 3069268624 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=1957068 CPUtime=382.63
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 119234 0 0 0 38159 104 0 0 25 0 5 0 1133099474 2004037632 458022 4294967295 134512640 135237372 3216365216 3060887616 134562344 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1614.65
Current children cumulated vsize (KiB) 1957068

[startup+822.313 s]
/proc/loadavg: 6.49 6.54 5.97 7/118 31245
/proc/meminfo: memFree=1152956/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=2034908 CPUtime=1734.57
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 477117 0 0 0 173104 353 0 0 25 0 5 0 1133099380 2083745792 476302 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 508727 476302 95 177 0 508549 0
[pid=27575/tid=27577] ppid=27573 vsize=2034908 CPUtime=442.32
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 110326 0 0 0 44152 80 0 0 25 0 5 0 1133099472 2083745792 476302 4294967295 134512640 135237372 3216365216 3086077104 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=2034908 CPUtime=436.12
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 111177 0 0 0 43552 60 0 0 25 0 5 0 1133099472 2083745792 476302 4294967295 134512640 135237372 3216365216 3077656144 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=2034908 CPUtime=442.58
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 126842 0 0 0 44157 101 0 0 25 0 5 0 1133099474 2083745792 476302 4294967295 134512640 135237372 3216365216 3069276480 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=2034908 CPUtime=412.63
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 123190 0 0 0 41156 107 0 0 25 0 5 0 1133099474 2083745792 476302 4294967295 134512640 135237372 3216365216 3060895232 134562377 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1734.57
Current children cumulated vsize (KiB) 2034908



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+863.91 s]
/proc/loadavg: 6.72 6.60 6.01 7/118 31497
/proc/meminfo: memFree=1095460/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=2096320 CPUtime=1822.38
/proc/27575/stat : 27575 (ttsth-5-0) S 27573 27575 32205 0 -1 4202496 491434 0 0 0 181878 360 0 0 25 0 5 0 1133099380 2146631680 490619 4294967295 134512640 135237372 3216365216 3216364812 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 524080 490619 95 177 0 523902 0
[pid=27575/tid=27577] ppid=27573 vsize=2096320 CPUtime=463.42
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 115312 0 0 0 46260 82 0 0 25 0 5 0 1133099472 2146631680 490619 4294967295 134512640 135237372 3216365216 3086064144 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27575/tid=27578] ppid=27573 vsize=2096320 CPUtime=456.91
/proc/27575/task/27578/stat : 27578 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 114504 0 0 0 45629 62 0 0 25 0 5 0 1133099472 2146631680 490619 4294967295 134512640 135237372 3216365216 3077667232 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27579] ppid=27573 vsize=2096320 CPUtime=463.34
/proc/27575/task/27579/stat : 27579 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 129700 0 0 0 46231 103 0 0 25 0 5 0 1133099474 2146631680 490619 4294967295 134512640 135237372 3216365216 3069297216 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27575/tid=27580] ppid=27573 vsize=2096320 CPUtime=437.79
/proc/27575/task/27580/stat : 27580 (ttsth-5-0) R 27573 27575 32205 0 -1 4202560 126336 0 0 0 43671 108 0 0 25 0 5 0 1133099474 2146631680 490619 4294967295 134512640 135237372 3216365216 3060893392 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1822.38
Current children cumulated vsize (KiB) 2096320

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+864.03 s]
/proc/loadavg: 6.72 6.60 6.01 7/118 31497
/proc/meminfo: memFree=1095460/3368532 swapFree=1954888/1959888
[pid=27575] ppid=27573 vsize=0 CPUtime=1822.5
/proc/27575/stat : 27575 (ttsth-5-0) Z 27573 27575 32205 0 -1 4203524 491438 0 0 0 181882 368 0 0 18 0 2 0 1133099380 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27575/statm: 0 0 0 0 0 0 0
[pid=27575/tid=27577] ppid=27573 vsize=0 CPUtime=463.5
/proc/27575/task/27577/stat : 27577 (ttsth-5-0) R 27573 27575 32205 0 -1 4203588 115312 0 0 0 46260 90 0 0 25 0 2 0 1133099472 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1822.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 864.055
CPU time (s): 1822.52
CPU user time (s): 1818.82
CPU system time (s): 3.7
CPU usage (%): 210.926
Max. virtual memory (cumulated for all children) (KiB): 2096320

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1818.82
system time used= 3.7
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 491438
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 511
involuntary context switches= 73960

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 13:52:34
IDJOB=1780918
IDBENCH=71078
IDSOLVER=632
FILE ID=/1780918-1243684354
PBS_JOBID=
Free space on /tmp= 15878 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_08_UNSAT.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780918-1243684354/watcher-1780918-1243684354 -o /tmp/evaluation-result-1780918-1243684354/solver-1780918-1243684354 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780918-1243684354.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 66aa2e18c32a02f55a810347a9702c7f
RANDOM SEED= 814115963

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.43
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3059164 kB
Buffers:         77076 kB
Cached:         121276 kB
SwapCached:        720 kB
Active:         141308 kB
Inactive:        72632 kB
HighTotal:     2489216 kB
HighFree:      2348200 kB
LowTotal:       879316 kB
LowFree:        710964 kB
SwapTotal:     1959888 kB
SwapFree:      1954888 kB
Dirty:            2000 kB
Writeback:           0 kB
AnonPages:       14892 kB
Mapped:           6280 kB
Slab:            84740 kB
SReclaimable:    74904 kB
SUnreclaim:       9836 kB
PageTables:        764 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   117276 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15878 MiB
End job on  at 2009-05-30 14:07:00