Trace number 1722036

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (MO) 1135.71 576.174

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_21_SAT.cnf
MD5SUM03a36a0e1b9af8e7c30a29a92e02302e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.47777
Satisfiable
(Un)Satisfiability was proved
Number of variables4466
Number of clauses542457
Sum of the clauses size1621186
Maximum clause length22
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 26774
Number of clauses of size 3535652
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data 

1.00/1.06	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1722036-1240672081.cnf 
1.00/1.06	c Using SATTIMEOUT of 1200
1.00/1.06	c Using SATRAM of 1800
1.00/1.06	c Size of subset node = 16
1.00/1.06	c Variables = 4466
1.00/1.06	c Clauses = 542457
1.00/1.06	c Literals = 1621186
1.00/1.06	c Reduced size:
1.00/1.06	c Variables = 4466
1.00/1.06	c Clauses = 542457
1.00/1.06	c Literals = 1621186
1.00/1.06	c a2
2.99/3.08	c a1
6.79/6.86	c Independent sub-problems = 1
6.79/6.86	c Sub-problem with 4466 variables and 542457 clauses
6.79/6.86	c using permutation method 4
6.79/6.86	c count = 1
6.79/6.86	c Ordering finished 6.540 seconds
6.79/6.86	c mapped 6.850 seconds
6.79/6.86	c permuted 6.850 seconds
6.79/6.86	c about to sort
6.98/7.08	c sorted
13.58/13.64	c clauses now 542457
13.58/13.64	c init finished 7.190 seconds
13.58/13.64	c tree built 13.630 seconds
13.58/13.64	c 
13.58/13.64	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
13.58/13.64	c ---------------------------------|----------------------------------|------------------------------------------------------
13.58/13.64	c ................................ | ..........                       |                       13.6           0.0             
13.58/13.64	c ................................ | ..........                     1 |                       13.6           0.1             
13.58/13.64	c ................................ | ..........                     2 |                       13.6           0.1             
13.58/13.64	c ................................ | ..........                     3 |                       13.6           0.2             
13.58/13.64	c ................................ | ..........                     4 |                       13.6           0.3             
13.58/13.64	c ................................ | ..........                     5 |                       13.6           0.4             
13.58/13.66	c ................................ | ..........                  1000 |                       13.7          73.2          258
23.92/18.85	c ................................ | ..........                129000 | 3091                  24.0        5366.1      1164349
48.06/30.97	c ................................ | ..........                363000 | 9671                  48.2        7529.6      4078608
72.02/42.92	c ................................ | ..........                517000 | 13422                 72.1        7174.6      7004535
95.97/54.91	c ................................ | ..........                666000 | 17343                 96.0        6936.8     10198918
119.91/66.93	c ................................ | *.........                864000 | 24344                120.0        7200.0     13434364
144.06/79.06	c ................................ | *.........               1062000 | 31662                144.2        7364.3     16727870
168.01/91.04	c ................................ | *.........               1216000 | 36394                168.1        7232.9     19874570
191.95/103.03	c ................................ | *.........               1359000 | 40620                192.0        7076.7     22899811
215.90/115.07	c ................................ | *.........               1495000 | 44621                216.1        6918.4     25797057
239.85/127.09	c ................................ | **........               1623000 | 47846                240.1        6760.2     28793917
264.01/139.12	c ................................ | **........               1753000 | 51558                264.1        6637.9     31713203
287.94/151.14	c ................................ | **........               1890000 | 55918                288.1        6561.1     34683071
311.90/163.16	c ................................ | **........               2007000 | 59120                312.1        6431.2     37482669
336.04/175.20	c ................................ | **........               2110000 | 61799                336.1        6277.9     39782844
360.19/187.31	c ................................ | ***.......               2223000 | 65055                360.3        6170.5     41841042
383.94/199.21	c ................................ | ***.......               2353000 | 69132                384.0        6127.1     43968135
407.90/211.27	c ................................ | ***.......               2497000 | 74580                408.1        6118.6     46826094
432.24/223.46	c ................................ | ***.......               2547000 | 75986                432.4        5890.0     48981375
456.19/235.42	c ................................ | ***.......               2590000 | 77100                456.3        5676.1     50922102
479.94/247.31	c ................................ | ****......               2663000 | 78924                480.0        5547.6     52750491
503.89/259.38	c ................................ | ****......               2833000 | 85451                504.1        5619.6     55558644
528.04/271.45	c ................................ | ****......               2919000 | 87869                528.2        5526.0     57710883
551.78/283.39	c ................................ | ****......               2977000 | 89268                552.0        5392.6     59773406
576.33/295.60	c ................................ | ****......               3091000 | 92563                576.4        5362.4     62106315
599.88/307.43	c ................................ | *****.....               3193000 | 95588                600.0        5321.3     64008143
624.03/319.59	c ................................ | *****.....               3297000 | 98230                624.3        5281.1     65841725
647.97/331.56	c ................................ | *****.....               3409000 | 101285               648.2        5259.3     67705780
672.13/343.60	c ................................ | *****.....               3472000 | 102915               672.2        5164.8     69560448
695.87/355.51	c ................................ | *****.....               3554000 | 104757               696.0        5106.2     71792337
720.03/367.67	c ................................ | ******....               3644000 | 107052               720.3        5059.1     74084068
743.78/379.56	c ................................ | ******....               3761000 | 110271               744.0        5055.0     76390593
767.92/391.64	c ................................ | ******....               3845000 | 112630               768.1        5005.7     78545029
792.47/403.90	c ................................ | ******....               3887000 | 113797               792.6        4904.1     79810019
816.02/415.70	c ................................ | ******....               3950000 | 115471               816.1        4839.8     81695299
840.17/427.80	c ................................ | *******...               4019000 | 117337               840.3        4782.8     83638924
863.72/439.69	c ................................ | *******...               4078000 | 118963               864.0        4719.7     85365103
887.86/451.80	c ................................ | *******...               4147000 | 120795               888.2        4669.0     87094621
912.22/463.93	c ................................ | *******...               4230000 | 122948               912.4        4636.0     88767002
935.96/475.82	c ................................ | *******...               4281000 | 124293               936.1        4573.0     90728029
959.92/487.85	c ................................ | ********..               4351000 | 125974               960.2        4531.5     92997700
984.06/499.90	c ................................ | ********..               4424000 | 127851               984.2        4495.0     94876305
1008.01/511.93	c ................................ | ********..               4521000 | 130579              1008.2        4484.1     96921449
1031.96/523.94	c ................................ | ********..               4611000 | 133345              1032.2        4467.2     99185845
1055.90/535.97	c ................................ | ********..               4709000 | 136266              1056.2        4458.4    101460142
1080.01/548.09	c ................................ | *********.               4782000 | 138630              1080.4        4426.3    103379183
1104.48/560.36	c ................................ | *********.               4825000 | 139782              1104.8        4367.3    104907597
1128.09/572.29	c ................................ | *********.               4857000 | 140377              1128.5        4304.1    106474231

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1722036-1240672081/watcher-1722036-1240672081 -o /tmp/evaluation-result-1722036-1240672081/solver-1722036-1240672081 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1722036-1240672081.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 32038
/proc/meminfo: memFree=1757184/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=1064 CPUtime=0
/proc/32038/stat : 32038 (ttsth-5-0) R 32036 32038 31654 0 -1 4194304 144 0 0 0 0 0 0 0 18 0 1 0 95234239 1089536 128 1992294400 134512640 135237372 4294956192 18446744073709551615 134749343 0 0 4096 0 0 0 0 17 1 0 0
/proc/32038/statm: 266 128 77 176 0 88 0

[startup+0.0308791 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 32038
/proc/meminfo: memFree=1757184/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=1988 CPUtime=0.02
/proc/32038/stat : 32038 (ttsth-5-0) R 32036 32038 31654 0 -1 4194304 392 0 0 0 2 0 0 0 18 0 1 0 95234239 2035712 376 1992294400 134512640 135237372 4294956192 18446744073709551615 134749343 0 0 4096 0 0 0 0 17 1 0 0
/proc/32038/statm: 497 376 78 176 0 319 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 1988

[startup+0.101885 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 32038
/proc/meminfo: memFree=1757184/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=4344 CPUtime=0.09
/proc/32038/stat : 32038 (ttsth-5-0) R 32036 32038 31654 0 -1 4194304 970 0 0 0 9 0 0 0 18 0 1 0 95234239 4448256 954 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/32038/statm: 1086 954 78 176 0 908 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4344

[startup+0.301905 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 32038
/proc/meminfo: memFree=1757184/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=11116 CPUtime=0.29
/proc/32038/stat : 32038 (ttsth-5-0) R 32036 32038 31654 0 -1 4194304 2642 0 0 0 28 1 0 0 19 0 1 0 95234239 11382784 2626 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/32038/statm: 2779 2627 78 176 0 2601 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 11116

[startup+0.701944 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 32038
/proc/meminfo: memFree=1757184/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=24800 CPUtime=0.69
/proc/32038/stat : 32038 (ttsth-5-0) R 32036 32038 31654 0 -1 4194304 6023 0 0 0 66 3 0 0 22 0 1 0 95234239 25395200 6007 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/32038/statm: 6200 6008 78 176 0 6022 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 24800

[startup+1.50202 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 32039
/proc/meminfo: memFree=1725112/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=73332 CPUtime=1.49
/proc/32038/stat : 32038 (ttsth-5-0) R 32036 32038 31654 0 -1 4194304 17058 0 0 0 141 8 0 0 25 0 1 0 95234239 75091968 17041 1992294400 134512640 135237372 4294956192 18446744073709551615 134680376 0 0 4096 0 0 0 0 17 1 0 0
/proc/32038/statm: 18333 17041 79 176 0 18155 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 73332

[startup+3.10218 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 32039
/proc/meminfo: memFree=1689016/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=75452 CPUtime=3.09
/proc/32038/stat : 32038 (ttsth-5-0) R 32036 32038 31654 0 -1 4194304 17080 0 0 0 301 8 0 0 25 0 1 0 95234239 77262848 17063 1992294400 134512640 135237372 4294956192 18446744073709551615 134749353 0 0 4096 0 0 0 0 17 1 0 0
/proc/32038/statm: 18863 17063 79 176 0 18685 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 75452

[startup+6.3015 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 32039
/proc/meminfo: memFree=1680064/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=77608 CPUtime=6.29
/proc/32038/stat : 32038 (ttsth-5-0) R 32036 32038 31654 0 -1 4194304 20331 0 0 0 620 9 0 0 25 0 1 0 95234239 79470592 19254 1992294400 134512640 135237372 4294956192 18446744073709551615 134599399 0 0 4096 0 0 0 0 17 1 0 0
/proc/32038/statm: 19402 19254 80 176 0 19224 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 77608

[startup+12.7011 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 32039
/proc/meminfo: memFree=1663936/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=100376 CPUtime=12.69
/proc/32038/stat : 32038 (ttsth-5-0) R 32036 32038 31654 0 -1 4194304 26496 0 0 0 1257 12 0 0 25 0 1 0 95234239 102785024 24868 1992294400 134512640 135237372 4294956192 18446744073709551615 134735855 0 0 4096 0 0 0 0 17 1 0 0
/proc/32038/statm: 25094 24868 91 176 0 24916 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 100376

[startup+25.5014 s]
/proc/loadavg: 1.15 1.03 1.01 3/67 32041
/proc/meminfo: memFree=1606192/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=173852 CPUtime=37.28
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 39678 0 0 0 3710 18 0 0 25 0 3 0 95234239 178024448 38050 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 43463 38051 98 176 0 43285 0
[pid=32038/tid=32040] ppid=32036 vsize=173852 CPUtime=11.85
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 5514 0 0 0 1182 3 0 0 21 0 3 0 95235604 178024448 38051 1992294400 134512640 135237372 4294956192 18446744073709551615 134749365 0 0 4096 0 0 0 0 -1 1 0 0
[pid=32038/tid=32041] ppid=32036 vsize=173852 CPUtime=11.79
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 6825 0 0 0 1177 2 0 0 25 0 3 0 95235604 178024448 38051 1992294400 134512640 135237372 4294956192 18446744073709551615 134552732 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 37.28
Current children cumulated vsize (KiB) 173852

[startup+51.102 s]
/proc/loadavg: 1.44 1.11 1.03 3/67 32041
/proc/meminfo: memFree=1504496/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=277260 CPUtime=88.37
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 65512 0 0 0 8804 33 0 0 25 0 3 0 95234239 283914240 63884 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 69315 63884 98 176 0 69137 0
[pid=32038/tid=32040] ppid=32036 vsize=277260 CPUtime=37.44
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 16069 0 0 0 3735 9 0 0 25 0 3 0 95235604 283914240 63884 1992294400 134512640 135237372 4294956192 18446744073709551615 134680208 0 0 4096 0 0 0 0 -1 1 0 0
[pid=32038/tid=32041] ppid=32036 vsize=277260 CPUtime=37.29
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 22103 0 0 0 3718 11 0 0 25 0 3 0 95235604 283914240 63884 1992294400 134512640 135237372 4294956192 18446744073709551615 134561428 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 88.37
Current children cumulated vsize (KiB) 277260

[startup+102.306 s]
/proc/loadavg: 1.77 1.26 1.09 3/67 32041
/proc/meminfo: memFree=1285936/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=492960 CPUtime=190.56
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 119439 0 0 0 18996 60 0 0 25 0 3 0 95234239 504791040 117811 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 123240 117811 98 176 0 123062 0
[pid=32038/tid=32040] ppid=32036 vsize=492960 CPUtime=88.63
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 41603 0 0 0 8839 24 0 0 25 0 3 0 95235604 504791040 117811 1992294400 134512640 135237372 4294956192 18446744073709551615 134590501 0 0 4096 0 0 0 0 -1 1 0 0
[pid=32038/tid=32041] ppid=32036 vsize=492960 CPUtime=88.29
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 50496 0 0 0 8806 23 0 0 25 0 3 0 95235604 504791040 117811 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 190.56
Current children cumulated vsize (KiB) 492960

[startup+162.302 s]
/proc/loadavg: 1.92 1.39 1.14 3/67 32041
/proc/meminfo: memFree=1053232/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=726664 CPUtime=310.3
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 177857 0 0 0 30943 87 0 0 25 0 3 0 95234239 744103936 176229 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 181666 176229 98 176 0 181488 0
[pid=32038/tid=32040] ppid=32036 vsize=726664 CPUtime=148.6
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 68209 0 0 0 14824 36 0 0 25 0 3 0 95235604 744103936 176229 1992294400 134512640 135237372 4294956192 18446744073709551615 134519947 0 0 4096 0 0 0 0 -1 1 0 0
[pid=32038/tid=32041] ppid=32036 vsize=726664 CPUtime=148.04
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 82308 0 0 0 14766 38 0 0 25 0 3 0 95235604 744103936 176229 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 310.3
Current children cumulated vsize (KiB) 726664

[startup+222.302 s]
/proc/loadavg: 1.97 1.50 1.19 3/67 32041
/proc/meminfo: memFree=867760/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=910552 CPUtime=430.04
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 223799 0 0 0 42892 112 0 0 25 0 3 0 95234239 932405248 222171 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 227638 222171 98 176 0 227460 0
[pid=32038/tid=32040] ppid=32036 vsize=910552 CPUtime=208.59
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 87536 0 0 0 20812 47 0 0 25 0 3 0 95235604 932405248 222171 1992294400 134512640 135237372 4294956192 18446744073709551615 134562300 0 0 4096 0 0 0 0 -1 1 0 0
[pid=32038/tid=32041] ppid=32036 vsize=910552 CPUtime=207.8
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 108923 0 0 0 20728 52 0 0 25 0 3 0 95235604 932405248 222171 1992294400 134512640 135237372 4294956192 18446744073709551615 134519954 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 430.04
Current children cumulated vsize (KiB) 910552

[startup+282.302 s]
/proc/loadavg: 1.99 1.59 1.24 3/67 32041
/proc/meminfo: memFree=696432/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=1083352 CPUtime=549.79
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 267025 0 0 0 54843 136 0 0 25 0 3 0 95234239 1109352448 265397 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 270838 265397 98 176 0 270660 0
[pid=32038/tid=32040] ppid=32036 vsize=1083352 CPUtime=268.58
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 103209 0 0 0 26801 57 0 0 25 0 3 0 95235604 1109352448 265397 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
[pid=32038/tid=32041] ppid=32036 vsize=1083352 CPUtime=267.56
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 136476 0 0 0 26690 66 0 0 25 0 3 0 95235604 1109352448 265397 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 549.79
Current children cumulated vsize (KiB) 1083352

[startup+342.302 s]
/proc/loadavg: 1.99 1.66 1.29 3/67 32041
/proc/meminfo: memFree=538096/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=1239512 CPUtime=669.53
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 306085 0 0 0 66791 162 0 0 25 0 3 0 95234239 1269260288 304457 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 309878 304457 98 176 0 309700 0
[pid=32038/tid=32040] ppid=32036 vsize=1239512 CPUtime=328.56
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 122088 0 0 0 32786 70 0 0 25 0 3 0 95235604 1269260288 304457 1992294400 134512640 135237372 4294956192 18446744073709551615 134562300 0 0 4096 0 0 0 0 -1 1 0 0
[pid=32038/tid=32041] ppid=32036 vsize=1239512 CPUtime=327.33
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 156657 0 0 0 32654 79 0 0 25 0 3 0 95235604 1269260288 304457 1992294400 134512640 135237372 4294956192 18446744073709551615 134519949 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 669.53
Current children cumulated vsize (KiB) 1239512

[startup+402.302 s]
/proc/loadavg: 1.99 1.72 1.33 3/67 32041
/proc/meminfo: memFree=372528/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=1405272 CPUtime=789.28
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 347517 0 0 0 78744 184 0 0 25 0 3 0 95234239 1438998528 345889 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 351318 345889 98 176 0 351140 0
[pid=32038/tid=32040] ppid=32036 vsize=1405272 CPUtime=388.54
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 139641 0 0 0 38774 80 0 0 25 0 3 0 95235604 1438998528 345889 1992294400 134512640 135237372 4294956192 18446744073709551615 134680467 0 0 4096 0 0 0 0 -1 1 0 0
[pid=32038/tid=32041] ppid=32036 vsize=1405272 CPUtime=387.08
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 180536 0 0 0 38618 90 0 0 25 0 3 0 95235604 1438998528 345890 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 789.28
Current children cumulated vsize (KiB) 1405272

[startup+462.302 s]
/proc/loadavg: 1.99 1.77 1.37 3/67 32041
/proc/meminfo: memFree=230192/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=1546712 CPUtime=909.02
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 382869 0 0 0 90700 202 0 0 25 0 3 0 95234239 1583833088 381241 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 386678 381241 98 176 0 386500 0
[pid=32038/tid=32040] ppid=32036 vsize=1546712 CPUtime=448.53
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 154446 0 0 0 44764 89 0 0 25 0 3 0 95235604 1583833088 381241 1992294400 134512640 135237372 4294956192 18446744073709551615 134680474 0 0 4096 0 0 0 0 -1 1 0 0
[pid=32038/tid=32041] ppid=32036 vsize=1546712 CPUtime=446.84
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 201083 0 0 0 44584 100 0 0 25 0 3 0 95235604 1583833088 381241 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 909.02
Current children cumulated vsize (KiB) 1546712

[startup+522.302 s]
/proc/loadavg: 1.99 1.81 1.40 3/67 32041
/proc/meminfo: memFree=65392/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=1713592 CPUtime=1028.77
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 424580 0 0 0 102654 223 0 0 25 0 3 0 95234239 1754718208 422952 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 428398 422953 98 176 0 428220 0
[pid=32038/tid=32040] ppid=32036 vsize=1713592 CPUtime=508.51
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 171842 0 0 0 50753 98 0 0 25 0 3 0 95235604 1754718208 422953 1992294400 134512640 135237372 4294956192 18446744073709551615 134588094 0 0 4096 0 0 0 0 -1 1 0 0
[pid=32038/tid=32041] ppid=32036 vsize=1713592 CPUtime=506.61
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 225399 0 0 0 50549 112 0 0 25 0 3 0 95235604 1754718208 422953 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1028.77
Current children cumulated vsize (KiB) 1713592



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+575.902 s]
/proc/loadavg: 2.04 1.85 1.44 3/67 32041
/proc/meminfo: memFree=15600/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=1843352 CPUtime=1135.43
/proc/32038/stat : 32038 (ttsth-5-0) S 32036 32038 31654 0 -1 4194304 457036 0 0 0 113300 243 0 0 25 0 3 0 95234239 1887592448 455408 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 460838 455408 98 176 0 460660 0
[pid=32038/tid=32040] ppid=32036 vsize=1843352 CPUtime=561.97
/proc/32038/task/32040/stat : 32040 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 183594 0 0 0 56092 105 0 0 25 0 3 0 95235604 1887592448 455408 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
[pid=32038/tid=32041] ppid=32036 vsize=1843352 CPUtime=559.81
/proc/32038/task/32041/stat : 32041 (ttsth-5-0) R 32036 32038 31654 0 -1 4194368 246102 0 0 0 55856 125 0 0 25 0 3 0 95235604 1887592448 455408 1992294400 134512640 135237372 4294956192 18446744073709551615 134749318 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1135.43
Current children cumulated vsize (KiB) 1843352

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+576.014 s]
/proc/loadavg: 2.04 1.85 1.44 3/67 32041
/proc/meminfo: memFree=15600/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=0 CPUtime=1135.54
/proc/32038/stat : 32038 (ttsth-5-0) Z 32036 32038 31654 0 -1 4195340 457038 0 0 0 113301 253 0 0 16 0 2 0 95234239 0 0 1992294400 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1135.54
Current children cumulated vsize (KiB) 0

[startup+576.103 s]
/proc/loadavg: 2.04 1.85 1.44 3/67 32041
/proc/meminfo: memFree=15600/2055920 swapFree=4192812/4192956
[pid=32038] ppid=32036 vsize=0 CPUtime=1135.63
/proc/32038/stat : 32038 (ttsth-5-0) Z 32036 32038 31654 0 -1 4195340 457038 0 0 0 113301 262 0 0 16 0 2 0 95234239 0 0 1992294400 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/32038/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1135.63
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 576.174
CPU time (s): 1135.71
CPU user time (s): 1133.02
CPU system time (s): 2.69459
CPU usage (%): 197.112
Max. virtual memory (cumulated for all children) (KiB): 1843352

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1133.02
system time used= 2.69459
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 457038
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 180
involuntary context switches= 8706

runsolver used 0.52292 second user time and 1.58376 second system time

The end

Launcher Data 

Begin job on node70 at 2009-04-25 17:08:02
IDJOB=1722036
IDBENCH=71081
IDSOLVER=549
FILE ID=node70/1722036-1240672081
PBS_JOBID= 9186593
Free space on /tmp= 66328 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_21_SAT.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1722036-1240672081/watcher-1722036-1240672081 -o /tmp/evaluation-result-1722036-1240672081/solver-1722036-1240672081 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1722036-1240672081.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= 03a36a0e1b9af8e7c30a29a92e02302e
RANDOM SEED=174704627

node70.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1757600 kB
Buffers:         19840 kB
Cached:         195040 kB
SwapCached:          0 kB
Active:          60808 kB
Inactive:       168000 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1757600 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:           10220 kB
Writeback:           0 kB
Mapped:          23704 kB
Slab:            55528 kB
Committed_AS:   287168 kB
PageTables:       1372 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66328 MiB
End job on node70 at 2009-04-25 17:17:40