Trace number 1781098

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 1301.43 331.133

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
ndhf_xits_16_UNKNOWN.cnf
MD5SUM85279cb74dedd2e1c7356e22d8e98939
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3366
Number of clauses362797
Sum of the clauses size1083511
Maximum clause length17
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 25314
Number of clauses of size 3357452
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 531

Solver Data 

0.51/0.57	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781098-1243685757.cnf 
0.51/0.57	c Using SATTIMEOUT of 10000
0.51/0.57	c Using SATRAM of 2047
0.51/0.57	c Size of subset node = 16
0.51/0.57	c Variables = 3366
0.51/0.57	c Clauses = 362797
0.51/0.57	c Literals = 1083511
0.51/0.57	c Reduced size:
0.51/0.57	c Variables = 3366
0.51/0.57	c Clauses = 362797
0.51/0.57	c Literals = 1083511
0.51/0.57	c a2
1.51/1.54	c a1
3.61/3.61	c Independent sub-problems = 1
3.61/3.61	c Sub-problem with 3366 variables and 362797 clauses
3.61/3.61	c using permutation method 4
3.61/3.61	c count = 1
3.61/3.61	c Ordering finished 3.450 seconds
3.61/3.61	c mapped 3.610 seconds
3.61/3.61	c permuted 3.610 seconds
3.61/3.61	c about to sort
3.71/3.73	c sorted
6.71/6.76	c clauses now 362797
6.71/6.76	c init finished 3.790 seconds
6.71/6.76	c tree built 6.760 seconds
6.71/6.76	c 
6.71/6.76	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
6.71/6.76	c ---------------------------------|----------------------------------|------------------------------------------------------
6.71/6.76	c ................................ | ..........                       |                        6.8           0.0             
6.71/6.76	c ................................ | ..........                     1 |                        6.8           0.1             
6.71/6.76	c ................................ | ..........                     2 |                        6.8           0.3             
6.71/6.76	c ................................ | ..........                     3 |                        6.8           0.4             
6.71/6.76	c ................................ | ..........                     4 |                        6.8           0.6             
6.71/6.76	c ................................ | ..........                     5 |                        6.8           0.7             
6.71/6.76	c ................................ | ..........                  1000 | 11                     6.8         147.9          370
199.92/55.19	c ................................ | ..........                753000 | 116647               200.2        3761.2     33415499
400.27/105.41	c ................................ | ..........               1449000 | 243422               400.3        3620.1     56062035
600.03/155.45	c ................................ | ..........               2025000 | 346126               600.2        3374.0     71923026
800.21/205.55	c ................................ | ..........               2366000 | 370995               800.4        2956.0     84739560
1000.15/255.59	c ................................ | *.........               2736000 | 400496              1000.5        2734.7    100167411
1200.05/305.68	c ................................ | *.........               3015000 | 424560              1200.4        2511.7    115184832

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1781098-1243685757/watcher-1781098-1243685757 -o /tmp/evaluation-result-1781098-1243685757/solver-1781098-1243685757 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781098-1243685757.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 3.98 4.26 3.91 3/115 23553
/proc/meminfo: memFree=2930604/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=1144 CPUtime=0
/proc/23553/stat : 23553 (ttsth-5-0) R 23551 23553 11443 0 -1 4202496 190 0 0 0 0 0 0 0 18 0 1 0 1133255494 1171456 146 4294967295 134512640 135237372 3219167568 3219167200 134536395 0 0 0 0 0 0 0 17 1 0 0 0
/proc/23553/statm: 286 146 75 177 0 108 0

[startup+0.069708 s]
/proc/loadavg: 3.98 4.26 3.91 3/115 23553
/proc/meminfo: memFree=2930604/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=4028 CPUtime=0.07
/proc/23553/stat : 23553 (ttsth-5-0) R 23551 23553 11443 0 -1 4202496 881 0 0 0 7 0 0 0 18 0 1 0 1133255494 4124672 837 4294967295 134512640 135237372 3219167568 3219166092 134639534 0 0 0 0 0 0 0 17 1 0 0 0
/proc/23553/statm: 1007 838 75 177 0 829 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 4028

[startup+0.109706 s]
/proc/loadavg: 3.98 4.26 3.91 3/115 23553
/proc/meminfo: memFree=2930604/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=5732 CPUtime=0.11
/proc/23553/stat : 23553 (ttsth-5-0) R 23551 23553 11443 0 -1 4202496 1307 0 0 0 11 0 0 0 18 0 1 0 1133255494 5869568 1263 4294967295 134512640 135237372 3219167568 3219166092 134639534 0 0 0 0 0 0 0 17 1 0 0 0
/proc/23553/statm: 1433 1263 75 177 0 1255 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 5732

[startup+0.309698 s]
/proc/loadavg: 3.98 4.26 3.91 3/115 23553
/proc/meminfo: memFree=2930604/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=14504 CPUtime=0.31
/proc/23553/stat : 23553 (ttsth-5-0) R 23551 23553 11443 0 -1 4202496 3439 0 0 0 30 1 0 0 18 0 1 0 1133255494 14852096 3395 4294967295 134512640 135237372 3219167568 3219167016 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/23553/statm: 3626 3395 75 177 0 3448 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 14504

[startup+0.709683 s]
/proc/loadavg: 3.98 4.26 3.91 3/115 23553
/proc/meminfo: memFree=2930604/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=49264 CPUtime=0.71
/proc/23553/stat : 23553 (ttsth-5-0) R 23551 23553 11443 0 -1 4202496 11477 0 0 0 68 3 0 0 18 0 1 0 1133255494 50446336 11432 4294967295 134512640 135237372 3219167568 3219166764 134519968 0 0 0 0 0 0 0 17 1 0 0 0
/proc/23553/statm: 12316 11432 76 177 0 12138 0
Current children cumulated CPU time (s) 0.71
Current children cumulated vsize (KiB) 49264

[startup+1.50965 s]
/proc/loadavg: 3.98 4.26 3.91 2/116 23554
/proc/meminfo: memFree=2885264/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=49264 CPUtime=1.51
/proc/23553/stat : 23553 (ttsth-5-0) R 23551 23553 11443 0 -1 4202496 11477 0 0 0 148 3 0 0 20 0 1 0 1133255494 50446336 11432 4294967295 134512640 135237372 3219167568 3219166464 134749345 0 0 0 0 0 0 0 17 1 0 0 0
/proc/23553/statm: 12316 11432 76 177 0 12138 0
Current children cumulated CPU time (s) 1.51
Current children cumulated vsize (KiB) 49264

[startup+3.10959 s]
/proc/loadavg: 3.98 4.26 3.91 2/116 23554
/proc/meminfo: memFree=2884352/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=52160 CPUtime=3.11
/proc/23553/stat : 23553 (ttsth-5-0) R 23551 23553 11443 0 -1 4202496 13639 0 0 0 308 3 0 0 25 0 1 0 1133255494 53411840 12884 4294967295 134512640 135237372 3219167568 3219166928 134600815 0 0 0 0 0 0 0 17 1 0 0 0
/proc/23553/statm: 13040 12884 77 177 0 12862 0
Current children cumulated CPU time (s) 3.11
Current children cumulated vsize (KiB) 52160

[startup+6.30946 s]
/proc/loadavg: 3.74 4.21 3.90 2/116 23737
/proc/meminfo: memFree=2868732/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=75052 CPUtime=6.31
/proc/23553/stat : 23553 (ttsth-5-0) R 23551 23553 11443 0 -1 4202496 19607 0 0 0 625 6 0 0 25 0 1 0 1133255494 76853248 18368 4294967295 134512640 135237372 3219167568 3219020404 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/23553/statm: 18763 18368 88 177 0 18585 0
Current children cumulated CPU time (s) 6.31
Current children cumulated vsize (KiB) 75052

[startup+12.7092 s]
/proc/loadavg: 3.84 4.22 3.90 5/120 23741
/proc/meminfo: memFree=2773336/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=205992 CPUtime=30.39
/proc/23553/stat : 23553 (ttsth-5-0) S 23551 23553 11443 0 -1 4202496 44274 0 0 0 3016 23 0 0 25 0 5 0 1133255494 210935808 42680 4294967295 134512640 135237372 3219167568 3219167164 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/23553/statm: 51498 42680 95 177 0 51320 0
[pid=23553/tid=23738] ppid=23551 vsize=205992 CPUtime=5.92
/proc/23553/task/23738/stat : 23738 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 7166 0 0 0 591 1 0 0 25 0 5 0 1133256170 210935808 42680 4294967295 134512640 135237372 3219167568 3078280864 134562413 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=23553/tid=23739] ppid=23551 vsize=205992 CPUtime=5.93
/proc/23553/task/23739/stat : 23739 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 6379 0 0 0 586 7 0 0 25 0 5 0 1133256170 210935808 42680 4294967295 134512640 135237372 3219167568 3069870288 134562380 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=23553/tid=23740] ppid=23551 vsize=205992 CPUtime=5.91
/proc/23553/task/23740/stat : 23740 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 4049 0 0 0 587 4 0 0 25 0 5 0 1133256170 210935808 42680 4294967295 134512640 135237372 3219167568 3061495584 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=23553/tid=23741] ppid=23551 vsize=205992 CPUtime=5.87
/proc/23553/task/23741/stat : 23741 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 5512 0 0 0 582 5 0 0 25 0 5 0 1133256171 210935808 42680 4294967295 134512640 135237372 3219167568 3051230716 134636641 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 30.39
Current children cumulated vsize (KiB) 205992

[startup+25.5087 s]
/proc/loadavg: 3.96 4.22 3.91 5/120 23742
/proc/meminfo: memFree=2594872/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=376836 CPUtime=81.59
/proc/23553/stat : 23553 (ttsth-5-0) S 23551 23553 11443 0 -1 4202496 86984 0 0 0 8123 36 0 0 25 0 5 0 1133255494 385880064 85390 4294967295 134512640 135237372 3219167568 3219167164 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/23553/statm: 94209 85390 95 177 0 94031 0
[pid=23553/tid=23738] ppid=23551 vsize=376836 CPUtime=18.72
/proc/23553/task/23738/stat : 23738 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 19970 0 0 0 1870 2 0 0 25 0 5 0 1133256170 385880064 85390 4294967295 134512640 135237372 3219167568 3078277168 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=23553/tid=23739] ppid=23551 vsize=376836 CPUtime=18.73
/proc/23553/task/23739/stat : 23739 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 21398 0 0 0 1862 11 0 0 25 0 5 0 1133256170 385880064 85390 4294967295 134512640 135237372 3219167568 3069865664 134680285 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=23553/tid=23740] ppid=23551 vsize=376836 CPUtime=18.71
/proc/23553/task/23740/stat : 23740 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 10870 0 0 0 1864 7 0 0 25 0 5 0 1133256170 385880064 85391 4294967295 134512640 135237372 3219167568 3061477392 134562380 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=23553/tid=23741] ppid=23551 vsize=376836 CPUtime=18.67
/proc/23553/task/23741/stat : 23741 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 13579 0 0 0 1857 10 0 0 25 0 5 0 1133256171 385880064 85391 4294967295 134512640 135237372 3219167568 3051179248 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 81.59
Current children cumulated vsize (KiB) 376836

[startup+51.1177 s]
/proc/loadavg: 4.19 4.25 3.93 5/120 23745
/proc/meminfo: memFree=2350280/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=621928 CPUtime=183.92
/proc/23553/stat : 23553 (ttsth-5-0) S 23551 23553 11443 0 -1 4202496 148246 0 0 0 18327 65 0 0 25 0 5 0 1133255494 636854272 146652 4294967295 134512640 135237372 3219167568 3219167164 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/23553/statm: 155482 146652 95 177 0 155304 0
[pid=23553/tid=23738] ppid=23551 vsize=621928 CPUtime=44.33
/proc/23553/task/23738/stat : 23738 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 36290 0 0 0 4424 9 0 0 25 0 5 0 1133256170 636854272 146652 4294967295 134512640 135237372 3219167568 3078290960 134680336 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=23553/tid=23739] ppid=23551 vsize=621928 CPUtime=44.34
/proc/23553/task/23739/stat : 23739 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 42227 0 0 0 4414 20 0 0 25 0 5 0 1133256170 636854272 146652 4294967295 134512640 135237372 3219167568 3069861232 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=23553/tid=23740] ppid=23551 vsize=621928 CPUtime=44.32
/proc/23553/task/23740/stat : 23740 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 21840 0 0 0 4423 9 0 0 25 0 5 0 1133256170 636854272 146652 4294967295 134512640 135237372 3219167568 3061380352 134562380 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=23553/tid=23741] ppid=23551 vsize=621928 CPUtime=44.17
/proc/23553/task/23741/stat : 23741 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 26721 0 0 0 4396 21 0 0 25 0 5 0 1133256171 636854272 146652 4294967295 134512640 135237372 3219167568 3051248572 134636641 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 183.92
Current children cumulated vsize (KiB) 621928

[startup+102.316 s]
/proc/loadavg: 4.42 4.30 3.96 5/120 23934
/proc/meminfo: memFree=1966860/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=999980 CPUtime=387.87
/proc/23553/stat : 23553 (ttsth-5-0) S 23551 23553 11443 0 -1 4202496 242778 0 0 0 38679 108 0 0 25 0 5 0 1133255494 1023979520 241184 4294967295 134512640 135237372 3219167568 3219167164 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/23553/statm: 249995 241184 95 177 0 249817 0
[pid=23553/tid=23738] ppid=23551 vsize=999980 CPUtime=95.5
/proc/23553/task/23738/stat : 23738 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 63466 0 0 0 9533 17 0 0 25 0 5 0 1133256170 1023979520 241184 4294967295 134512640 135237372 3219167568 3078296832 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=23553/tid=23739] ppid=23551 vsize=999980 CPUtime=94.85
/proc/23553/task/23739/stat : 23739 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 70284 0 0 0 9455 30 0 0 25 0 5 0 1133256170 1023979520 241184 4294967295 134512640 135237372 3219167568 3069868000 134562328 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=23553/tid=23740] ppid=23551 vsize=999980 CPUtime=95.5
/proc/23553/task/23740/stat : 23740 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 42330 0 0 0 9532 18 0 0 25 0 5 0 1133256170 1023979520 241184 4294967295 134512640 135237372 3219167568 3061394240 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=23553/tid=23741] ppid=23551 vsize=999980 CPUtime=95.26
/proc/23553/task/23741/stat : 23741 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 45530 0 0 0 9489 37 0 0 25 0 5 0 1133256171 1023979520 241184 4294967295 134512640 135237372 3219167568 3051229376 134562331 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 387.87
Current children cumulated vsize (KiB) 999980

[startup+162.313 s]
/proc/loadavg: 4.29 4.29 3.98 6/120 24126
/proc/meminfo: memFree=1666452/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=1301844 CPUtime=627.59
/proc/23553/stat : 23553 (ttsth-5-0) S 23551 23553 11443 0 -1 4202496 318221 0 0 0 62612 147 0 0 25 0 5 0 1133255494 1333088256 316627 4294967295 134512640 135237372 3219167568 3219167164 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/23553/statm: 325461 316627 95 177 0 325283 0
[pid=23553/tid=23738] ppid=23551 vsize=1301844 CPUtime=155.48
/proc/23553/task/23738/stat : 23738 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 78385 0 0 0 15525 23 0 0 25 0 5 0 1133256170 1333088256 316627 4294967295 134512640 135237372 3219167568 3078264928 134562430 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=23553/tid=23739] ppid=23551 vsize=1301844 CPUtime=154.74
/proc/23553/task/23739/stat : 23739 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 87949 0 0 0 15438 36 0 0 25 0 5 0 1133256170 1333088256 316627 4294967295 134512640 135237372 3219167568 3069866080 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=23553/tid=23740] ppid=23551 vsize=1301844 CPUtime=155.48
/proc/23553/task/23740/stat : 23740 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 61521 0 0 0 15523 25 0 0 25 0 5 0 1133256170 1333088256 316627 4294967295 134512640 135237372 3219167568 3061394992 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=23553/tid=23741] ppid=23551 vsize=1301844 CPUtime=155.13
/proc/23553/task/23741/stat : 23741 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 69198 0 0 0 15456 57 0 0 25 0 5 0 1133256171 1333088256 316627 4294967295 134512640 135237372 3219167568 3051269648 134562380 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 627.59
Current children cumulated vsize (KiB) 1301844

[startup+222.311 s]
/proc/loadavg: 4.37 4.31 4.00 5/120 24314
/proc/meminfo: memFree=1407068/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=1559284 CPUtime=867.38
/proc/23553/stat : 23553 (ttsth-5-0) S 23551 23553 11443 0 -1 4202496 382663 0 0 0 86555 183 0 0 25 0 5 0 1133255494 1596706816 381069 4294967295 134512640 135237372 3219167568 3219167164 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/23553/statm: 389821 381069 95 177 0 389643 0
[pid=23553/tid=23738] ppid=23551 vsize=1559284 CPUtime=215.47
/proc/23553/task/23738/stat : 23738 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 87726 0 0 0 21522 25 0 0 25 0 5 0 1133256170 1596706816 381069 4294967295 134512640 135237372 3219167568 3078291088 134561524 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=23553/tid=23739] ppid=23551 vsize=1559284 CPUtime=214.59
/proc/23553/task/23739/stat : 23739 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 104511 0 0 0 21411 48 0 0 25 0 5 0 1133256170 1596706816 381069 4294967295 134512640 135237372 3219167568 3069853920 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=23553/tid=23740] ppid=23551 vsize=1559284 CPUtime=215.48
/proc/23553/task/23740/stat : 23740 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 76432 0 0 0 21515 33 0 0 25 0 5 0 1133256170 1596706816 381069 4294967295 134512640 135237372 3219167568 3061460000 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=23553/tid=23741] ppid=23551 vsize=1559284 CPUtime=215.08
/proc/23553/task/23741/stat : 23741 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 92826 0 0 0 21437 71 0 0 25 0 5 0 1133256171 1596706816 381069 4294967295 134512640 135237372 3219167568 3051242240 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 867.38
Current children cumulated vsize (KiB) 1559284

[startup+282.308 s]
/proc/loadavg: 4.63 4.38 4.04 5/120 24502
/proc/meminfo: memFree=1122252/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=1846136 CPUtime=1106.87
/proc/23553/stat : 23553 (ttsth-5-0) S 23551 23553 11443 0 -1 4202496 454364 0 0 0 110471 216 0 0 25 0 5 0 1133255494 1890443264 452770 4294967295 134512640 135237372 3219167568 3219167164 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/23553/statm: 461534 452770 95 177 0 461356 0
[pid=23553/tid=23738] ppid=23551 vsize=1846136 CPUtime=275.46
/proc/23553/task/23738/stat : 23738 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 98560 0 0 0 27519 27 0 0 25 0 5 0 1133256170 1890443264 452770 4294967295 134512640 135237372 3219167568 3078270272 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=23553/tid=23739] ppid=23551 vsize=1846136 CPUtime=274.17
/proc/23553/task/23739/stat : 23739 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 133762 0 0 0 27356 61 0 0 25 0 5 0 1133256170 1890443264 452770 4294967295 134512640 135237372 3219167568 3069863472 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=23553/tid=23740] ppid=23551 vsize=1846136 CPUtime=275.47
/proc/23553/task/23740/stat : 23740 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 92586 0 0 0 27508 39 0 0 25 0 5 0 1133256170 1890443264 452770 4294967295 134512640 135237372 3219167568 3061446736 134562380 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=23553/tid=23741] ppid=23551 vsize=1846136 CPUtime=275.01
/proc/23553/task/23741/stat : 23741 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 108288 0 0 0 27418 83 0 0 25 0 5 0 1133256171 1890443264 452770 4294967295 134512640 135237372 3219167568 3051216108 134562323 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1106.87
Current children cumulated vsize (KiB) 1846136



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+331.007 s]
/proc/loadavg: 4.61 4.40 4.06 5/120 24688
/proc/meminfo: memFree=868116/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=2096160 CPUtime=1301.26
/proc/23553/stat : 23553 (ttsth-5-0) S 23551 23553 11443 0 -1 4202496 516846 0 0 0 129883 243 0 0 25 0 5 0 1133255494 2146467840 515252 4294967295 134512640 135237372 3219167568 3219167164 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/23553/statm: 524040 515252 95 177 0 523862 0
[pid=23553/tid=23738] ppid=23551 vsize=2096160 CPUtime=324.15
/proc/23553/task/23738/stat : 23738 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 115177 0 0 0 32385 30 0 0 25 0 5 0 1133256170 2146467840 515252 4294967295 134512640 135237372 3219167568 3078265840 134562407 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=23553/tid=23739] ppid=23551 vsize=2096160 CPUtime=322.64
/proc/23553/task/23739/stat : 23739 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 152399 0 0 0 32198 66 0 0 25 0 5 0 1133256170 2146467840 515252 4294967295 134512640 135237372 3219167568 3069867472 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=23553/tid=23740] ppid=23551 vsize=2096160 CPUtime=324.15
/proc/23553/task/23740/stat : 23740 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 108092 0 0 0 32365 50 0 0 25 0 5 0 1133256170 2146467840 515252 4294967295 134512640 135237372 3219167568 3061381424 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=23553/tid=23741] ppid=23551 vsize=2096160 CPUtime=323.57
/proc/23553/task/23741/stat : 23741 (ttsth-5-0) R 23551 23553 11443 0 -1 4202560 120010 0 0 0 32266 91 0 0 25 0 5 0 1133256171 2146467840 515252 4294967295 134512640 135237372 3219167568 3051269136 134562459 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1301.26
Current children cumulated vsize (KiB) 2096160

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+331.127 s]
/proc/loadavg: 4.61 4.40 4.06 5/120 24688
/proc/meminfo: memFree=868116/3368532 swapFree=1941392/1959888
[pid=23553] ppid=23551 vsize=0 CPUtime=1301.43
/proc/23553/stat : 23553 (ttsth-5-0) Z 23551 23553 11443 0 -1 4203524 516852 0 0 0 129890 253 0 0 18 0 2 0 1133255494 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/23553/statm: 0 0 0 0 0 0 0
[pid=23553/tid=23740] ppid=23551 vsize=0 CPUtime=324.27
/proc/23553/task/23740/stat : 23740 (ttsth-5-0) R 23551 23553 11443 0 -1 4203588 108094 0 0 0 32367 60 0 0 25 0 2 0 1133256170 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1301.43
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23553 and gives
#  childrusage.ru_utime.tv_sec=1298
#  childrusage.ru_utime.tv_usec=900000
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=530000
# CPU time returned by wait4() is 1301.43
# while last known CPU time is 1301.43
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 331.133
CPU time (s): 1301.43
CPU user time (s): 1298.9
CPU system time (s): 2.53
CPU usage (%): 393.024
Max. virtual memory (cumulated for all children) (KiB): 2096160

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1298.9
system time used= 2.53
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 516852
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 947
involuntary context switches= 23825

runsolver used 0.01 second user time and 0.01 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 14:15:57
IDJOB=1781098
IDBENCH=71096
IDSOLVER=632
FILE ID=/1781098-1243685757
PBS_JOBID=
Free space on /tmp= 15724 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/ndhf_xits_16_UNKNOWN.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1781098-1243685757/watcher-1781098-1243685757 -o /tmp/evaluation-result-1781098-1243685757/solver-1781098-1243685757 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781098-1243685757.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 85279cb74dedd2e1c7356e22d8e98939
RANDOM SEED= 975450015

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.17
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2930900 kB
Buffers:        112464 kB
Cached:         219240 kB
SwapCached:       4320 kB
Active:         210076 kB
Inactive:       131968 kB
HighTotal:     2489216 kB
HighFree:      2257276 kB
LowTotal:       879316 kB
LowFree:        673624 kB
SwapTotal:     1959888 kB
SwapFree:      1941392 kB
Dirty:            7032 kB
Writeback:           0 kB
AnonPages:        9204 kB
Mapped:           4212 kB
Slab:            85260 kB
SReclaimable:    75496 kB
SUnreclaim:       9764 kB
PageTables:        776 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   127076 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15724 MiB
End job on  at 2009-05-30 14:21:30