Trace number 1779928

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 1100.75 563.733

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l46_lambda.cnf
MD5SUMeb4d0d02a25a8a84182ddd3b6d1fa8b5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark372.41
Satisfiable
(Un)Satisfiability was proved
Number of variables33090
Number of clauses165828
Sum of the clauses size478271
Maximum clause length9
Minimum clause length1
Number of clauses of size 14268
Number of clauses of size 241089
Number of clauses of size 397665
Number of clauses of size 415752
Number of clauses of size 56916
Number of clauses of size over 5138

Solver Data 

0.38/0.44	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779928-1243680002.cnf 
0.38/0.44	c Using SATTIMEOUT of 10000
0.38/0.44	c Using SATRAM of 2047
0.38/0.44	c Size of subset node = 16
0.38/0.44	c Variables = 33090
0.38/0.44	c Clauses = 165828
0.38/0.44	c Literals = 478271
0.38/0.44	c Reduced size:
0.38/0.44	c Variables = 33090
0.38/0.44	c Clauses = 149715
0.38/0.44	c Literals = 437828
0.38/0.44	c a2
0.78/0.82	c a1
11.38/11.44	c Independent sub-problems = 1
11.38/11.44	c Sub-problem with 27914 variables and 149715 clauses
11.38/11.44	c using permutation method 4
11.38/11.44	c count = 1
11.38/11.44	c Ordering finished 11.330 seconds
11.38/11.44	c mapped 11.400 seconds
11.38/11.44	c permuted 11.400 seconds
11.38/11.44	c about to sort
11.38/11.49	c sorted
13.88/13.99	c clauses now 149715
13.88/13.99	c init finished 11.640 seconds
13.88/13.99	c tree built 13.960 seconds
13.88/13.99	c 
13.88/13.99	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
13.88/13.99	c ---------------------------------|----------------------------------|------------------------------------------------------
13.88/13.99	c ................................ | ..........                       |                       14.0           0.0             
13.88/13.99	c ................................ | ..........                     1 |                       14.0           0.1             
13.88/13.99	c ****************................ | ..........                     2 |                       14.0           0.1            1
13.88/13.99	c ****************................ | ..........                     3 |                       14.0           0.2            1
13.88/13.99	c ****************................ | ..........                     4 |                       14.0           0.3            1
13.88/13.99	c ****************................ | ..........                     5 |                       14.0           0.4            1
13.88/13.99	c ****************................ | ..........                     6 |                       14.0           0.4            1
13.88/14.00	c ****************................ | ..........                  1000 | 3                     14.0          71.6          111
200.01/110.93	c ****************................ | ..........               2040000 | 60811                200.1       10195.9     23997932
400.47/213.34	c ****************................ | ..........               3360000 | 102166               400.2        8396.4     49155720
600.09/313.30	c ****************................ | ..........               4428000 | 135952               600.3        7376.7     72706444
800.10/413.34	c ****************................ | ..........               5255000 | 163398               800.1        6567.6     93671748
1000.04/513.40	c ****************................ | *.........               6117000 | 190021              1000.2        6115.7    110083244

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1779928-1243680002/watcher-1779928-1243680002 -o /tmp/evaluation-result-1779928-1243680002/solver-1779928-1243680002 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779928-1243680002.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB

[startup+0 s]
/proc/loadavg: 7.44 7.20 6.97 5/111 14565
/proc/meminfo: memFree=3013024/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=9592 CPUtime=0
/proc/14565/stat : 14565 (runsolver) R 14563 20065 20065 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 1 0 1132664311 9822208 13 4294967295 134512640 135670194 3213646608 3213644360 135164789 0 0 0 24578 0 0 0 17 2 0 0 0
/proc/14565/statm: 2398 13 0 283 0 2113 0
Current StackSize limit: 8192 KiB


[startup+0.143409 s]
/proc/loadavg: 7.44 7.20 6.97 5/111 14565
/proc/meminfo: memFree=3013024/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=5624 CPUtime=0.11
/proc/14565/stat : 14565 (ttsth-5-0) R 14563 14565 20065 0 -1 4202496 1268 0 0 0 9 2 0 0 21 0 1 0 1132664311 5758976 1224 4294967295 134512640 135237372 3217620960 3217619828 134886558 0 0 0 0 0 0 0 17 1 0 0 0
/proc/14565/statm: 1406 1224 75 177 0 1228 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 5624

[startup+0.213403 s]
/proc/loadavg: 7.44 7.20 6.97 5/111 14565
/proc/meminfo: memFree=3013024/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=8312 CPUtime=0.18
/proc/14565/stat : 14565 (ttsth-5-0) R 14563 14565 20065 0 -1 4202496 1942 0 0 0 16 2 0 0 21 0 1 0 1132664311 8511488 1898 4294967295 134512640 135237372 3217620960 3217619516 134685911 0 0 0 0 0 0 0 17 1 0 0 0
/proc/14565/statm: 2078 1898 75 177 0 1900 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 8312

[startup+0.313399 s]
/proc/loadavg: 7.44 7.20 6.97 5/111 14565
/proc/meminfo: memFree=3013024/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=12540 CPUtime=0.28
/proc/14565/stat : 14565 (ttsth-5-0) R 14563 14565 20065 0 -1 4202496 2916 0 0 0 26 2 0 0 21 0 1 0 1132664311 12840960 2872 4294967295 134512640 135237372 3217620960 3217620652 134534276 0 0 0 0 0 0 0 17 1 0 0 0
/proc/14565/statm: 3135 2872 75 177 0 2957 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 12540

[startup+0.713359 s]
/proc/loadavg: 7.44 7.20 6.97 5/111 14565
/proc/meminfo: memFree=3013024/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=24144 CPUtime=0.68
/proc/14565/stat : 14565 (ttsth-5-0) R 14563 14565 20065 0 -1 4202496 5766 0 0 0 64 4 0 0 22 0 1 0 1132664311 24723456 5693 4294967295 134512640 135237372 3217620960 3217619488 134680356 0 0 0 0 0 0 0 17 1 0 0 0
/proc/14565/statm: 6036 5693 76 177 0 5858 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 24144

[startup+1.5133 s]
/proc/loadavg: 7.44 7.20 6.97 5/112 14566
/proc/meminfo: memFree=2989980/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=28468 CPUtime=1.48
/proc/14565/stat : 14565 (ttsth-5-0) R 14563 14565 20065 0 -1 4202496 7449 0 0 0 143 5 0 0 25 0 1 0 1132664311 29151232 6911 4294967295 134512640 135237372 3217620960 3217620288 134557612 0 0 0 0 0 0 0 17 1 0 0 0
/proc/14565/statm: 7117 6911 77 177 0 6939 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 28468

[startup+3.11316 s]
/proc/loadavg: 7.44 7.20 6.97 5/112 14566
/proc/meminfo: memFree=2985392/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=28716 CPUtime=3.08
/proc/14565/stat : 14565 (ttsth-5-0) R 14563 14565 20065 0 -1 4202496 7462 0 0 0 303 5 0 0 25 0 1 0 1132664311 29405184 6924 4294967295 134512640 135237372 3217620960 3217620320 134600972 0 0 0 0 0 0 0 17 1 0 0 0
/proc/14565/statm: 7179 6924 77 177 0 7001 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 28716

[startup+6.3129 s]
/proc/loadavg: 7.24 7.16 6.96 6/112 14566
/proc/meminfo: memFree=2985184/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=28848 CPUtime=6.28
/proc/14565/stat : 14565 (ttsth-5-0) R 14563 14565 20065 0 -1 4202496 7524 0 0 0 623 5 0 0 25 0 1 0 1132664311 29540352 6986 4294967295 134512640 135237372 3217620960 3217620320 134600707 0 0 0 0 0 0 0 17 1 0 0 0
/proc/14565/statm: 7212 6986 77 177 0 7034 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 28848

[startup+12.7124 s]
/proc/loadavg: 6.98 7.11 6.94 5/112 14567
/proc/meminfo: memFree=2919584/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=96056 CPUtime=12.68
/proc/14565/stat : 14565 (ttsth-5-0) R 14563 14565 20065 0 -1 4202496 24515 0 0 0 1257 11 0 0 25 0 1 0 1132664311 98361344 23830 4294967295 134512640 135237372 3217620960 3217579808 134551480 0 0 0 0 0 0 0 17 1 0 0 0
/proc/14565/statm: 24014 23830 91 177 0 23836 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 96056

[startup+25.5113 s]
/proc/loadavg: 6.86 7.07 6.93 8/116 14760
/proc/meminfo: memFree=2839380/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=206764 CPUtime=34.55
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 44580 0 0 0 3435 20 0 0 25 0 5 0 1132664311 211726336 43619 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 51691 43619 95 177 0 51513 0
[pid=14565/tid=14572] ppid=14563 vsize=206764 CPUtime=5.92
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 2614 0 0 0 591 1 0 0 25 0 5 0 1132665710 211726336 43619 4294967295 134512640 135237372 3217620960 3076047228 134680502 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=206764 CPUtime=4.71
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 2547 0 0 0 469 2 0 0 25 0 5 0 1132665710 211726336 43619 4294967295 134512640 135237372 3217620960 3067881360 134681774 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=206764 CPUtime=5.21
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 3381 0 0 0 519 2 0 0 25 0 5 0 1132665710 211726336 43619 4294967295 134512640 135237372 3217620960 3059302144 134552726 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=206764 CPUtime=4.75
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 2541 0 0 0 472 3 0 0 25 0 5 0 1132665715 211726336 43619 4294967295 134512640 135237372 3217620960 3051104304 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 34.55
Current children cumulated vsize (KiB) 206764

[startup+51.1092 s]
/proc/loadavg: 6.97 7.08 6.94 8/116 14761
/proc/meminfo: memFree=2749092/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=302076 CPUtime=84.03
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 67642 0 0 0 8376 27 0 0 25 0 5 0 1132664311 309325824 66681 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 75519 66681 95 177 0 75341 0
[pid=14565/tid=14572] ppid=14563 vsize=302076 CPUtime=19.43
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 7084 0 0 0 1940 3 0 0 25 0 5 0 1132665710 309325824 66681 4294967295 134512640 135237372 3217620960 3076046704 134562454 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=302076 CPUtime=16.24
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 7227 0 0 0 1620 4 0 0 25 0 5 0 1132665710 309325824 66681 4294967295 134512640 135237372 3217620960 3067722368 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=302076 CPUtime=17.51
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 12197 0 0 0 1748 3 0 0 25 0 5 0 1132665710 309325824 66681 4294967295 134512640 135237372 3217620960 3059341712 134562320 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=302076 CPUtime=16.89
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 7637 0 0 0 1684 5 0 0 25 0 5 0 1132665715 309325824 66681 4294967295 134512640 135237372 3217620960 3050903664 134680282 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 84.03
Current children cumulated vsize (KiB) 302076

[startup+102.315 s]
/proc/loadavg: 7.15 7.11 6.95 8/116 14950
/proc/meminfo: memFree=2531048/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=525684 CPUtime=182.96
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 121549 0 0 0 18258 38 0 0 25 0 5 0 1132664311 538300416 120588 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 131421 120588 95 177 0 131243 0
[pid=14565/tid=14572] ppid=14563 vsize=525684 CPUtime=44.63
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 15744 0 0 0 4458 5 0 0 25 0 5 0 1132665710 538300416 120588 4294967295 134512640 135237372 3217620960 3076044896 134562430 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=525684 CPUtime=40.41
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 22902 0 0 0 4033 8 0 0 25 0 5 0 1132665710 538300416 120588 4294967295 134512640 135237372 3217620960 3067708064 134591529 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=525684 CPUtime=42.91
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 29490 0 0 0 4284 7 0 0 25 0 5 0 1132665710 538300416 120588 4294967295 134512640 135237372 3217620960 3059360320 134680285 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=525684 CPUtime=41.05
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 19916 0 0 0 4099 6 0 0 25 0 5 0 1132665715 538300416 120588 4294967295 134512640 135237372 3217620960 3051070288 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 182.96
Current children cumulated vsize (KiB) 525684

[startup+162.31 s]
/proc/loadavg: 7.21 7.13 6.97 8/116 15136
/proc/meminfo: memFree=2291640/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=778404 CPUtime=301.57
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 181724 0 0 0 30092 65 0 0 25 0 5 0 1132664311 797085696 180763 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 194601 180763 95 177 0 194423 0
[pid=14565/tid=14572] ppid=14563 vsize=778404 CPUtime=74.43
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 25932 0 0 0 7432 11 0 0 25 0 5 0 1132665710 797085696 180763 4294967295 134512640 135237372 3217620960 3076127328 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=778404 CPUtime=69.71
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 39074 0 0 0 6958 13 0 0 25 0 5 0 1132665710 797085696 180763 4294967295 134512640 135237372 3217620960 3067657376 134749351 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=778404 CPUtime=72.76
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 51707 0 0 0 7259 17 0 0 25 0 5 0 1132665710 797085696 180763 4294967295 134512640 135237372 3217620960 3059387472 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=778404 CPUtime=70.71
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 31514 0 0 0 7059 12 0 0 25 0 5 0 1132665715 797085696 180763 4294967295 134512640 135237372 3217620960 3050939488 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 301.57
Current children cumulated vsize (KiB) 778404

[startup+222.315 s]
/proc/loadavg: 7.51 7.24 7.01 8/116 15323
/proc/meminfo: memFree=2061616/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=1017636 CPUtime=418.44
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 238860 0 0 0 41765 79 0 0 25 0 5 0 1132664311 1042059264 237899 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 254409 237899 95 177 0 254231 0
[pid=14565/tid=14572] ppid=14563 vsize=1017636 CPUtime=103.73
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 35414 0 0 0 10360 13 0 0 25 0 5 0 1132665710 1042059264 237899 4294967295 134512640 135237372 3217620960 3076158816 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=1017636 CPUtime=99.31
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 57151 0 0 0 9913 18 0 0 25 0 5 0 1132665710 1042059264 237899 4294967295 134512640 135237372 3217620960 3067772384 134680262 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=1017636 CPUtime=101.98
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 68629 0 0 0 10175 23 0 0 25 0 5 0 1132665710 1042059264 237899 4294967295 134512640 135237372 3217620960 3059389296 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=1017636 CPUtime=99.46
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 44169 0 0 0 9933 13 0 0 25 0 5 0 1132665715 1042059264 237899 4294967295 134512640 135237372 3217620960 3050949120 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 418.44
Current children cumulated vsize (KiB) 1017636

[startup+282.31 s]
/proc/loadavg: 7.47 7.27 7.04 8/116 15512
/proc/meminfo: memFree=1837376/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=1252552 CPUtime=538.33
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 295355 0 0 0 53738 95 0 0 25 0 5 0 1132664311 1282613248 294394 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 313138 294395 95 177 0 312960 0
[pid=14565/tid=14572] ppid=14563 vsize=1252552 CPUtime=133.67
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 46827 0 0 0 13349 18 0 0 25 0 5 0 1132665710 1282613248 294395 4294967295 134512640 135237372 3217620960 3076158092 134680502 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=1252552 CPUtime=129.21
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 74034 0 0 0 12898 23 0 0 25 0 5 0 1132665710 1282613248 294395 4294967295 134512640 135237372 3217620960 3067782720 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=1252552 CPUtime=132.01
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 85335 0 0 0 13175 26 0 0 25 0 5 0 1132665710 1282613248 294395 4294967295 134512640 135237372 3217620960 3059344320 134680499 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=1252552 CPUtime=129.48
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 55663 0 0 0 12932 16 0 0 25 0 5 0 1132665715 1282613248 294395 4294967295 134512640 135237372 3217620960 3050996512 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 538.33
Current children cumulated vsize (KiB) 1252552

[startup+342.305 s]
/proc/loadavg: 7.36 7.28 7.05 8/116 15700
/proc/meminfo: memFree=1633596/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=1463140 CPUtime=658.29
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 345802 0 0 0 65722 107 0 0 25 0 5 0 1132664311 1498255360 344841 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 365785 344841 95 177 0 365607 0
[pid=14565/tid=14572] ppid=14563 vsize=1463140 CPUtime=163.73
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 57901 0 0 0 16355 18 0 0 25 0 5 0 1132665710 1498255360 344841 4294967295 134512640 135237372 3217620960 3076148736 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=1463140 CPUtime=158.81
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 90088 0 0 0 15855 26 0 0 25 0 5 0 1132665710 1498255360 344841 4294967295 134512640 135237372 3217620960 3067774128 134561428 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=1463140 CPUtime=162.05
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 99234 0 0 0 16177 28 0 0 25 0 5 0 1132665710 1498255360 344841 4294967295 134512640 135237372 3217620960 3059371488 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=1463140 CPUtime=159.74
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 65082 0 0 0 15951 23 0 0 25 0 5 0 1132665715 1498255360 344841 4294967295 134512640 135237372 3217620960 3050923152 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 658.29
Current children cumulated vsize (KiB) 1463140

[startup+402.31 s]
/proc/loadavg: 7.49 7.32 7.08 8/116 15895
/proc/meminfo: memFree=1436736/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=1673212 CPUtime=778.08
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 395222 0 0 0 77683 125 0 0 25 0 5 0 1132664311 1713369088 394261 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 418303 394261 95 177 0 418125 0
[pid=14565/tid=14572] ppid=14563 vsize=1673212 CPUtime=192.93
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 65817 0 0 0 19271 22 0 0 25 0 5 0 1132665710 1713369088 394261 4294967295 134512640 135237372 3217620960 3076119936 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=1673212 CPUtime=189.11
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 107053 0 0 0 18875 36 0 0 25 0 5 0 1132665710 1713369088 394261 4294967295 134512640 135237372 3217620960 3067724080 134562401 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=1673212 CPUtime=192.06
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 113442 0 0 0 19176 30 0 0 25 0 5 0 1132665710 1713369088 394261 4294967295 134512640 135237372 3217620960 3059344512 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=1673212 CPUtime=190.02
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 75413 0 0 0 18977 25 0 0 25 0 5 0 1132665715 1713369088 394261 4294967295 134512640 135237372 3217620960 3050899024 134680326 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 778.08
Current children cumulated vsize (KiB) 1673212

[startup+462.315 s]
/proc/loadavg: 7.31 7.30 7.09 8/116 16081
/proc/meminfo: memFree=1273804/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=1845516 CPUtime=898.04
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 435684 0 0 0 89666 138 0 0 25 0 5 0 1132664311 1889808384 434723 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 461379 434723 95 177 0 461201 0
[pid=14565/tid=14572] ppid=14563 vsize=1845516 CPUtime=223.03
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 74117 0 0 0 22279 24 0 0 25 0 5 0 1132665710 1889808384 434723 4294967295 134512640 135237372 3217620960 3076115552 134562413 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=1845516 CPUtime=219.28
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 121017 0 0 0 21888 40 0 0 25 0 5 0 1132665710 1889808384 434723 4294967295 134512640 135237372 3217620960 3067726640 134562363 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=1845516 CPUtime=221.92
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 124675 0 0 0 22156 36 0 0 25 0 5 0 1132665710 1889808384 434723 4294967295 134512640 135237372 3217620960 3059386944 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=1845516 CPUtime=219.85
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 82378 0 0 0 21959 26 0 0 25 0 5 0 1132665715 1889808384 434723 4294967295 134512640 135237372 3217620960 3051004656 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 898.04
Current children cumulated vsize (KiB) 1845516

[startup+522.31 s]
/proc/loadavg: 7.32 7.31 7.10 8/116 16268
/proc/meminfo: memFree=1126700/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=2000072 CPUtime=1018.03
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 472694 0 0 0 101646 157 0 0 25 0 5 0 1132664311 2048073728 471733 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 500018 471733 95 177 0 499840 0
[pid=14565/tid=14572] ppid=14563 vsize=2000072 CPUtime=253.13
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 81710 0 0 0 25281 32 0 0 25 0 5 0 1132665710 2048073728 471733 4294967295 134512640 135237372 3217620960 3076109952 134562334 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=2000072 CPUtime=249.18
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 131702 0 0 0 24875 43 0 0 25 0 5 0 1132665710 2048073728 471733 4294967295 134512640 135237372 3217620960 3067725968 134562344 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=2000072 CPUtime=251.91
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 134632 0 0 0 25152 39 0 0 25 0 5 0 1132665710 2048073728 471733 4294967295 134512640 135237372 3217620960 3059348672 134562344 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=2000072 CPUtime=249.85
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 91153 0 0 0 24954 31 0 0 25 0 5 0 1132665715 2048073728 471733 4294967295 134512640 135237372 3217620960 3050938864 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1018.03
Current children cumulated vsize (KiB) 2000072



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+563.607 s]
/proc/loadavg: 7.22 7.28 7.10 9/116 16456
/proc/meminfo: memFree=1033492/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=2096204 CPUtime=1100.61
/proc/14565/stat : 14565 (ttsth-5-0) S 14563 14565 20065 0 -1 4202496 495481 0 0 0 109894 167 0 0 25 0 5 0 1132664311 2146512896 494520 4294967295 134512640 135237372 3217620960 3217620556 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 524051 494520 95 177 0 523873 0
[pid=14565/tid=14572] ppid=14563 vsize=2096204 CPUtime=273.83
/proc/14565/task/14572/stat : 14572 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 86145 0 0 0 27349 34 0 0 25 0 5 0 1132665710 2146512896 494520 4294967295 134512640 135237372 3217620960 3076131552 134680237 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14573] ppid=14563 vsize=2096204 CPUtime=269.66
/proc/14565/task/14573/stat : 14573 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 139287 0 0 0 26921 45 0 0 25 0 5 0 1132665710 2146512896 494520 4294967295 134512640 135237372 3217620960 3067724624 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=2096204 CPUtime=272.41
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 140953 0 0 0 27199 42 0 0 25 0 5 0 1132665710 2146512896 494520 4294967295 134512640 135237372 3217620960 3059385216 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=14565/tid=14575] ppid=14563 vsize=2096204 CPUtime=270.75
/proc/14565/task/14575/stat : 14575 (ttsth-5-0) R 14563 14565 20065 0 -1 4202560 95599 0 0 0 27041 34 0 0 25 0 5 0 1132665715 2146512896 494520 4294967295 134512640 135237372 3217620960 3050943200 134552745 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1100.61
Current children cumulated vsize (KiB) 2096204

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+563.727 s]
/proc/loadavg: 7.22 7.28 7.10 9/116 16456
/proc/meminfo: memFree=1033492/3368532 swapFree=1953788/1959888
[pid=14565] ppid=14563 vsize=0 CPUtime=1100.75
/proc/14565/stat : 14565 (ttsth-5-0) Z 14563 14565 20065 0 -1 4203524 495485 0 0 0 109898 177 0 0 18 0 2 0 1132664311 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/14565/statm: 0 0 0 0 0 0 0
[pid=14565/tid=14574] ppid=14563 vsize=0 CPUtime=272.51
/proc/14565/task/14574/stat : 14574 (ttsth-5-0) R 14563 14565 20065 0 -1 4203588 140953 0 0 0 27199 52 0 0 25 0 2 0 1132665710 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1100.75
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 563.733
CPU time (s): 1100.75
CPU user time (s): 1098.98
CPU system time (s): 1.77
CPU usage (%): 195.261
Max. virtual memory (cumulated for all children) (KiB): 2096204

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1098.98
system time used= 1.77
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 495485
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1024
involuntary context switches= 16802

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 12:40:02
IDJOB=1779928
IDBENCH=70941
IDSOLVER=632
FILE ID=/1779928-1243680002
PBS_JOBID=
Free space on /tmp= 6474 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l46_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1779928-1243680002/watcher-1779928-1243680002 -o /tmp/evaluation-result-1779928-1243680002/solver-1779928-1243680002 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1779928-1243680002.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= eb4d0d02a25a8a84182ddd3b6d1fa8b5
RANDOM SEED= 1470882342

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.12
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3013128 kB
Buffers:        123216 kB
Cached:         115148 kB
SwapCached:       2256 kB
Active:         164468 kB
Inactive:        90864 kB
HighTotal:     2489216 kB
HighFree:      2355836 kB
LowTotal:       879316 kB
LowFree:        657292 kB
SwapTotal:     1959888 kB
SwapFree:      1953788 kB
Dirty:            3804 kB
Writeback:           0 kB
AnonPages:       16000 kB
Mapped:           5272 kB
Slab:            90796 kB
SReclaimable:    77184 kB
SUnreclaim:      13612 kB
PageTables:        668 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   112688 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 6474 MiB
End job on  at 2009-05-30 12:49:28