Trace number 1775938

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 846.53 413.529

General information on the benchmark

Nameindustrial/fuhs/hard/
AProVE07-27.cnf
MD5SUMa948576641dd03cc33abaca38a6e7e4c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2037.19
Satisfiable
(Un)Satisfiability was proved
Number of variables7729
Number of clauses29194
Sum of the clauses size77124
Maximum clause length201
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 214904
Number of clauses of size 311692
Number of clauses of size 41614
Number of clauses of size 5463
Number of clauses of size over 5520

Solver Data 

0.00/0.07	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1775938-1243672617.cnf 
0.00/0.07	c Using SATTIMEOUT of 10000
0.00/0.07	c Using SATRAM of 2047
0.00/0.07	c Size of subset node = 16
0.00/0.07	c Variables = 7729
0.00/0.07	c Clauses = 29194
0.00/0.07	c Literals = 77124
0.00/0.07	c Reduced size:
0.00/0.07	c Variables = 7729
0.00/0.07	c Clauses = 28202
0.00/0.07	c Literals = 74543
0.00/0.07	c a2
0.10/0.11	c a1
1.00/1.02	c Independent sub-problems = 1
1.00/1.02	c Sub-problem with 7503 variables and 28202 clauses
1.00/1.02	c using permutation method 4
1.00/1.02	c count = 1
1.00/1.02	c Ordering finished 1.010 seconds
1.00/1.02	c mapped 1.020 seconds
1.00/1.02	c permuted 1.020 seconds
1.00/1.02	c about to sort
1.00/1.03	c sorted
2.21/2.26	c clauses now 28202
2.21/2.26	c init finished 1.080 seconds
2.21/2.26	c tree built 2.260 seconds
2.21/2.26	c 
2.21/2.26	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
2.21/2.26	c ---------------------------------|----------------------------------|------------------------------------------------------
2.21/2.26	c ................................ | ..........                       |                        2.3           0.0             
2.21/2.26	c ................................ | ..........                     1 |                        2.3           0.4             
2.21/2.26	c ................................ | ..........                     2 |                        2.3           0.9             
2.21/2.26	c ................................ | ..........                     3 |                        2.3           1.3             
2.21/2.26	c ................................ | ..........                     4 |                        2.3           1.8             
2.21/2.26	c ................................ | ..........                     5 |                        2.3           2.2             
2.21/2.26	c ................................ | ..........                  1000 | 8                      2.3         442.5          210
2.53/2.46	c **.............................. | ..........                 37064 | 1603                   2.6       14039.4        81509
2.53/2.46	c **.............................. | ..........                 37065 | 1603                   2.6       14039.8        81530
2.53/2.50	c ****............................ | ..........                 45721 | 1976                   2.7       16809.2        86651
2.53/2.50	c ****............................ | ..........                 45722 | 1976                   2.7       16809.6        86651
2.53/2.50	c ****............................ | ..........                 45723 | 1976                   2.7       16809.9        86651
2.73/2.51	c ******.......................... | ..........                 50502 | 2173                   2.8       18297.8        89501
2.73/2.52	c ******.......................... | ..........                 50503 | 2173                   2.8       18298.2        89501
200.29/97.73	c ******.......................... | ..........               2498000 | 172560               200.3       12468.8     35644674
399.89/193.07	c ******.......................... | ..........               4184000 | 292598               400.0       10460.0     65962661
600.14/292.15	c ******.......................... | ..........               5715000 | 395354               600.2        9521.7     92492265
800.02/390.41	c ******.......................... | ..........               7108000 | 488897               800.1        8884.2    116296975

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1775938-1243672617/watcher-1775938-1243672617 -o /tmp/evaluation-result-1775938-1243672617/solver-1775938-1243672617 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1775938-1243672617.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 6.33 4.49 3.27 4/113 5202
/proc/meminfo: memFree=3168472/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=1404 CPUtime=0.01
/proc/5202/stat : 5202 (ttsth-5-0) R 5200 5202 32205 0 -1 4202496 241 0 0 0 1 0 0 0 25 0 1 0 1131925701 1437696 196 4294967295 134512640 135237372 3213888592 3213887188 134887114 0 0 0 0 0 0 0 17 2 0 0 0
/proc/5202/statm: 351 196 75 177 0 173 0

[startup+0.109049 s]
/proc/loadavg: 6.33 4.49 3.27 4/113 5202
/proc/meminfo: memFree=3168472/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=5052 CPUtime=0.1
/proc/5202/stat : 5202 (ttsth-5-0) R 5200 5202 32205 0 -1 4202496 1140 0 0 0 10 0 0 0 25 0 1 0 1131925701 5173248 1094 4294967295 134512640 135237372 3213888592 3213887696 134680336 0 0 0 0 0 0 0 17 2 0 0 0
/proc/5202/statm: 1263 1094 76 177 0 1085 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 5052

[startup+0.209035 s]
/proc/loadavg: 6.33 4.49 3.27 4/113 5202
/proc/meminfo: memFree=3168472/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=6312 CPUtime=0.2
/proc/5202/stat : 5202 (ttsth-5-0) R 5200 5202 32205 0 -1 4202496 1478 0 0 0 19 1 0 0 25 0 1 0 1131925701 6463488 1403 4294967295 134512640 135237372 3213888592 3213887952 134600781 0 0 0 0 0 0 0 17 2 0 0 0
/proc/5202/statm: 1578 1403 77 177 0 1400 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 6312

[startup+0.309026 s]
/proc/loadavg: 6.33 4.49 3.27 4/113 5202
/proc/meminfo: memFree=3168472/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=6312 CPUtime=0.3
/proc/5202/stat : 5202 (ttsth-5-0) R 5200 5202 32205 0 -1 4202496 1480 0 0 0 29 1 0 0 25 0 1 0 1131925701 6463488 1405 4294967295 134512640 135237372 3213888592 3213887920 134555272 0 0 0 0 0 0 0 17 2 0 0 0
/proc/5202/statm: 1578 1405 77 177 0 1400 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 6312

[startup+0.708991 s]
/proc/loadavg: 6.33 4.49 3.27 4/113 5202
/proc/meminfo: memFree=3168472/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=6312 CPUtime=0.7
/proc/5202/stat : 5202 (ttsth-5-0) R 5200 5202 32205 0 -1 4202496 1496 0 0 0 69 1 0 0 25 0 1 0 1131925701 6463488 1421 4294967295 134512640 135237372 3213888592 3213887720 134732614 0 0 0 0 0 0 0 17 2 0 0 0
/proc/5202/statm: 1578 1421 77 177 0 1400 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 6312

[startup+1.50892 s]
/proc/loadavg: 6.33 4.49 3.27 4/114 5203
/proc/meminfo: memFree=3144792/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=34312 CPUtime=1.5
/proc/5202/stat : 5202 (ttsth-5-0) R 5200 5202 32205 0 -1 4202496 8541 0 0 0 147 3 0 0 25 0 1 0 1131925701 35135488 8466 4294967295 134512640 135237372 3213888592 3213868016 134735855 0 0 0 0 0 0 0 17 2 0 0 0
/proc/5202/statm: 8578 8466 88 177 0 8400 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 34312

[startup+3.10879 s]
/proc/loadavg: 6.06 4.47 3.27 4/114 5207
/proc/meminfo: memFree=3129872/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=78492 CPUtime=3.93
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 11550 0 0 0 389 4 0 0 25 0 5 0 1131925701 80375808 11475 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 19623 11475 95 177 0 19445 0
Current children cumulated CPU time (s) 3.93
Current children cumulated vsize (KiB) 78492

[startup+6.30852 s]
/proc/loadavg: 6.06 4.47 3.27 7/118 5215
/proc/meminfo: memFree=3106088/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=98232 CPUtime=10.33
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 16849 0 0 0 1028 5 0 0 25 0 5 0 1131925701 100589568 16774 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 24558 16774 95 177 0 24380 0
[pid=5202/tid=5208] ppid=5200 vsize=98232 CPUtime=2.59
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 1813 0 0 0 258 1 0 0 25 0 5 0 1131925928 100589568 16774 4294967295 134512640 135237372 3213888592 3085466464 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=98232 CPUtime=1.9
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 1641 0 0 0 190 0 0 0 25 0 5 0 1131925928 100589568 16774 4294967295 134512640 135237372 3213888592 3077070944 134590250 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=98232 CPUtime=2.13
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 1615 0 0 0 212 1 0 0 25 0 5 0 1131925928 100589568 16774 4294967295 134512640 135237372 3213888592 3069103684 134636382 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=98232 CPUtime=1.45
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 1767 0 0 0 145 0 0 0 25 0 5 0 1131925930 100589568 16774 4294967295 134512640 135237372 3213888592 3060278624 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 10.33
Current children cumulated vsize (KiB) 98232

[startup+12.708 s]
/proc/loadavg: 6.05 4.52 3.30 7/118 5223
/proc/meminfo: memFree=3051308/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=155032 CPUtime=23.11
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 30758 0 0 0 2301 10 0 0 25 0 5 0 1131925701 158752768 30683 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 38758 30683 95 177 0 38580 0
[pid=5202/tid=5208] ppid=5200 vsize=155032 CPUtime=6.03
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 5271 0 0 0 601 2 0 0 25 0 5 0 1131925928 158752768 30683 4294967295 134512640 135237372 3213888592 3085582760 134519962 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=155032 CPUtime=5.13
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 5372 0 0 0 511 2 0 0 25 0 5 0 1131925928 158752768 30683 4294967295 134512640 135237372 3213888592 3077314064 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=155032 CPUtime=5.14
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 5000 0 0 0 513 1 0 0 25 0 5 0 1131925928 158752768 30683 4294967295 134512640 135237372 3213888592 3068773520 134680367 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=155032 CPUtime=4.55
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 5102 0 0 0 453 2 0 0 25 0 5 0 1131925930 158752768 30683 4294967295 134512640 135237372 3213888592 3060309408 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 23.11
Current children cumulated vsize (KiB) 155032

[startup+25.5069 s]
/proc/loadavg: 6.04 4.57 3.33 7/118 5243
/proc/meminfo: memFree=2958252/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=248868 CPUtime=48.65
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 53149 0 0 0 4846 19 0 0 25 0 5 0 1131925701 254840832 53074 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 62217 53074 95 177 0 62039 0
[pid=5202/tid=5208] ppid=5200 vsize=248868 CPUtime=12.43
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 11234 0 0 0 1241 2 0 0 25 0 5 0 1131925928 254840832 53074 4294967295 134512640 135237372 3213888592 3085586256 134566000 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=248868 CPUtime=11.52
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 10387 0 0 0 1149 3 0 0 25 0 5 0 1131925928 254840832 53074 4294967295 134512640 135237372 3213888592 3077348928 134680367 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=248868 CPUtime=11.59
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 11144 0 0 0 1153 6 0 0 25 0 5 0 1131925928 254840832 53074 4294967295 134512640 135237372 3213888592 3068783040 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=248868 CPUtime=10.85
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 10371 0 0 0 1080 5 0 0 25 0 5 0 1131925930 254840832 53074 4294967295 134512640 135237372 3213888592 3060454080 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 48.65
Current children cumulated vsize (KiB) 248868

[startup+51.1147 s]
/proc/loadavg: 6.19 4.71 3.41 9/119 5399
/proc/meminfo: memFree=2812320/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=404384 CPUtime=100.8
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 89980 0 0 0 10056 24 0 0 25 0 5 0 1131925701 414089216 89905 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 101096 89905 95 177 0 100918 0
[pid=5202/tid=5208] ppid=5200 vsize=404384 CPUtime=25.5
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 20708 0 0 0 2544 6 0 0 25 0 5 0 1131925928 414089216 89905 4294967295 134512640 135237372 3213888592 3085568368 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=404384 CPUtime=24.31
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 20907 0 0 0 2428 3 0 0 25 0 5 0 1131925928 414089216 89905 4294967295 134512640 135237372 3213888592 3077572928 134587921 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=404384 CPUtime=24.5
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 21745 0 0 0 2443 7 0 0 25 0 5 0 1131925928 414089216 89905 4294967295 134512640 135237372 3213888592 3068796672 134591433 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=404384 CPUtime=24.23
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 16607 0 0 0 2418 5 0 0 25 0 5 0 1131925930 414089216 89905 4294967295 134512640 135237372 3213888592 3060387904 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 100.8
Current children cumulated vsize (KiB) 404384

[startup+102.31 s]
/proc/loadavg: 6.34 5.02 3.58 7/118 5544
/proc/meminfo: memFree=2536744/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=690192 CPUtime=209.5
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 157919 0 0 0 20896 54 0 0 25 0 5 0 1131925701 706756608 157844 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 172548 157844 95 177 0 172370 0
[pid=5202/tid=5208] ppid=5200 vsize=690192 CPUtime=51.83
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 37682 0 0 0 5168 15 0 0 25 0 5 0 1131925928 706756608 157844 4294967295 134512640 135237372 3213888592 3085744224 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=690192 CPUtime=49.71
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 39795 0 0 0 4957 14 0 0 25 0 5 0 1131925928 706756608 157844 4294967295 134512640 135237372 3213888592 3077507840 134590938 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=690192 CPUtime=49.71
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 39370 0 0 0 4957 14 0 0 25 0 5 0 1131925928 706756608 157844 4294967295 134512640 135237372 3213888592 3068919536 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=690192 CPUtime=55.99
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 31059 0 0 0 5591 8 0 0 25 0 5 0 1131925930 706756608 157844 4294967295 134512640 135237372 3213888592 3060497968 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 209.5
Current children cumulated vsize (KiB) 690192

[startup+162.305 s]
/proc/loadavg: 6.37 5.25 3.75 7/118 5821
/proc/meminfo: memFree=2239780/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=1005892 CPUtime=333.86
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 232944 0 0 0 33306 80 0 0 25 0 5 0 1131925701 1030033408 232869 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 251473 232869 95 177 0 251295 0
[pid=5202/tid=5208] ppid=5200 vsize=1005892 CPUtime=85.88
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 56393 0 0 0 8565 23 0 0 25 0 5 0 1131925928 1030033408 232869 4294967295 134512640 135237372 3213888592 3085554480 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=1005892 CPUtime=80.71
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 56947 0 0 0 8050 21 0 0 25 0 5 0 1131925928 1030033408 232869 4294967295 134512640 135237372 3213888592 3077339872 134562281 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=1005892 CPUtime=79.01
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 63606 0 0 0 7881 20 0 0 25 0 5 0 1131925928 1030033408 232869 4294967295 134512640 135237372 3213888592 3068900064 134680491 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=1005892 CPUtime=86
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 45985 0 0 0 8587 13 0 0 25 0 5 0 1131925930 1030033408 232869 4294967295 134512640 135237372 3213888592 3060735760 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 333.86
Current children cumulated vsize (KiB) 1005892

[startup+222.32 s]
/proc/loadavg: 6.30 5.45 3.92 7/118 6102
/proc/meminfo: memFree=1952740/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=1307176 CPUtime=458.5
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 304037 0 0 0 45734 116 0 0 25 0 5 0 1131925701 1338548224 303962 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 326794 303962 95 177 0 326616 0
[pid=5202/tid=5208] ppid=5200 vsize=1307176 CPUtime=117.12
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 71697 0 0 0 11680 32 0 0 25 0 5 0 1131925928 1338548224 303962 4294967295 134512640 135237372 3213888592 3085734240 134562341 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=1307176 CPUtime=110.41
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 74088 0 0 0 11014 27 0 0 25 0 5 0 1131925928 1338548224 303962 4294967295 134512640 135237372 3213888592 3077524800 134680257 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=1307176 CPUtime=111.81
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 90753 0 0 0 11148 33 0 0 25 0 5 0 1131925928 1338548224 303962 4294967295 134512640 135237372 3213888592 3069155264 134749314 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=1307176 CPUtime=116.9
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 57486 0 0 0 11669 21 0 0 25 0 5 0 1131925930 1338548224 303962 4294967295 134512640 135237372 3213888592 3060476896 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 458.5
Current children cumulated vsize (KiB) 1307176

[startup+282.315 s]
/proc/loadavg: 6.44 5.65 4.07 7/118 6378
/proc/meminfo: memFree=1707456/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=1568880 CPUtime=580.54
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 365896 0 0 0 57916 138 0 0 25 0 5 0 1131925701 1606533120 365821 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 392220 365821 95 177 0 392042 0
[pid=5202/tid=5208] ppid=5200 vsize=1568880 CPUtime=147.65
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 85810 0 0 0 14727 38 0 0 25 0 5 0 1131925928 1606533120 365821 4294967295 134512640 135237372 3213888592 3085641616 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=1568880 CPUtime=140.61
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 92351 0 0 0 14028 33 0 0 25 0 5 0 1131925928 1606533120 365821 4294967295 134512640 135237372 3213888592 3077303824 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=1568880 CPUtime=141.51
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 108730 0 0 0 14113 38 0 0 25 0 5 0 1131925928 1606533120 365821 4294967295 134512640 135237372 3213888592 3068904032 134562328 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=1568880 CPUtime=148.51
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 68992 0 0 0 14825 26 0 0 25 0 5 0 1131925930 1606533120 365821 4294967295 134512640 135237372 3213888592 3060459888 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 580.54
Current children cumulated vsize (KiB) 1568880

[startup+342.31 s]
/proc/loadavg: 6.42 5.80 4.23 8/118 6652
/proc/meminfo: memFree=1480720/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=1804512 CPUtime=700.52
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 421940 0 0 0 69893 159 0 0 25 0 5 0 1131925701 1847820288 421865 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 451128 421865 95 177 0 450950 0
[pid=5202/tid=5208] ppid=5200 vsize=1804512 CPUtime=178.03
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 97702 0 0 0 17755 48 0 0 25 0 5 0 1131925928 1847820288 421865 4294967295 134512640 135237372 3213888592 3085630976 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=1804512 CPUtime=170.23
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 110089 0 0 0 16986 37 0 0 25 0 5 0 1131925928 1847820288 421866 4294967295 134512640 135237372 3213888592 3077253728 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=1804512 CPUtime=171.51
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 125841 0 0 0 17109 42 0 0 25 0 5 0 1131925928 1847820288 421866 4294967295 134512640 135237372 3213888592 3068918624 134562344 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=1804512 CPUtime=178.49
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 78296 0 0 0 17820 29 0 0 25 0 5 0 1131925930 1847820288 421866 4294967295 134512640 135237372 3213888592 3060415632 134680503 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 700.52
Current children cumulated vsize (KiB) 1804512

[startup+402.304 s]
/proc/loadavg: 6.44 5.92 4.36 7/118 6929
/proc/meminfo: memFree=1250240/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=2050600 CPUtime=824.25
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 480606 0 0 0 82248 177 0 0 25 0 5 0 1131925701 2099814400 480531 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 512650 480531 95 177 0 512472 0
[pid=5202/tid=5208] ppid=5200 vsize=2050600 CPUtime=208.13
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 107371 0 0 0 20763 50 0 0 25 0 5 0 1131925928 2099814400 480531 4294967295 134512640 135237372 3213888592 3085856704 134593167 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=2050600 CPUtime=203.67
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 130286 0 0 0 20322 45 0 0 25 0 5 0 1131925928 2099814400 480532 4294967295 134512640 135237372 3213888592 3077308400 134590235 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=2050600 CPUtime=201.61
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 145287 0 0 0 20114 47 0 0 25 0 5 0 1131925928 2099814400 480532 4294967295 134512640 135237372 3213888592 3069199728 134593214 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=2050600 CPUtime=208.58
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 87650 0 0 0 20826 32 0 0 25 0 5 0 1131925930 2099814400 480532 4294967295 134512640 135237372 3213888592 3060525280 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 824.25
Current children cumulated vsize (KiB) 2050600



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+413.403 s]
/proc/loadavg: 6.42 5.94 4.39 9/119 7048
/proc/meminfo: memFree=1201884/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=2096268 CPUtime=846.4
/proc/5202/stat : 5202 (ttsth-5-0) S 5200 5202 32205 0 -1 4202496 491564 0 0 0 84462 178 0 0 25 0 5 0 1131925701 2146578432 491489 4294967295 134512640 135237372 3213888592 3213888188 134629544 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 524067 491489 95 177 0 523889 0
[pid=5202/tid=5208] ppid=5200 vsize=2096268 CPUtime=213.73
/proc/5202/task/5208/stat : 5208 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 109036 0 0 0 21323 50 0 0 25 0 5 0 1131925928 2146578432 491489 4294967295 134512640 135237372 3213888592 3085629312 134749345 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5209] ppid=5200 vsize=2096268 CPUtime=209.06
/proc/5202/task/5209/stat : 5209 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 133064 0 0 0 20860 46 0 0 25 0 5 0 1131925928 2146578432 491489 4294967295 134512640 135237372 3213888592 3077470544 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=5202/tid=5210] ppid=5200 vsize=2096268 CPUtime=207.21
/proc/5202/task/5210/stat : 5210 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 150168 0 0 0 20674 47 0 0 25 0 5 0 1131925928 2146578432 491489 4294967295 134512640 135237372 3213888592 3069208704 134562363 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=2096268 CPUtime=214.14
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4202560 89283 0 0 0 21382 32 0 0 25 0 5 0 1131925930 2146578432 491489 4294967295 134512640 135237372 3213888592 3060480448 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 846.4
Current children cumulated vsize (KiB) 2096268

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+413.523 s]
/proc/loadavg: 6.42 5.94 4.39 9/119 7048
/proc/meminfo: memFree=1201884/3368532 swapFree=1954888/1959888
[pid=5202] ppid=5200 vsize=0 CPUtime=846.53
/proc/5202/stat : 5202 (ttsth-5-0) Z 5200 5202 32205 0 -1 4203524 491585 0 0 0 84465 188 0 0 18 0 2 0 1131925701 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 2 0 0 0
/proc/5202/statm: 0 0 0 0 0 0 0
[pid=5202/tid=5211] ppid=5200 vsize=0 CPUtime=214.25
/proc/5202/task/5211/stat : 5211 (ttsth-5-0) R 5200 5202 32205 0 -1 4203588 89284 0 0 0 21383 42 0 0 25 0 2 0 1131925930 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 846.53
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 5202 and gives
#  childrusage.ru_utime.tv_sec=844
#  childrusage.ru_utime.tv_usec=650000
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=880000
# CPU time returned by wait4() is 846.53
# while last known CPU time is 846.53
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 413.529
CPU time (s): 846.53
CPU user time (s): 844.65
CPU system time (s): 1.88
CPU usage (%): 204.709
Max. virtual memory (cumulated for all children) (KiB): 2096268

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 844.65
system time used= 1.88
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 491585
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1383
involuntary context switches= 15325

runsolver used 0 second user time and 0.01 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 10:36:57
IDJOB=1775938
IDBENCH=20404
IDSOLVER=632
FILE ID=/1775938-1243672617
PBS_JOBID=
Free space on /tmp= 15880 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT07/industrial/fuhs/hard/AProVE07-27.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1775938-1243672617/watcher-1775938-1243672617 -o /tmp/evaluation-result-1775938-1243672617/solver-1775938-1243672617 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1775938-1243672617.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= a948576641dd03cc33abaca38a6e7e4c
RANDOM SEED= 34436134

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.43
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3168768 kB
Buffers:         36972 kB
Cached:          67380 kB
SwapCached:        720 kB
Active:          99532 kB
Inactive:        20748 kB
HighTotal:     2489216 kB
HighFree:      2402672 kB
LowTotal:       879316 kB
LowFree:        766096 kB
SwapTotal:     1959888 kB
SwapFree:      1954888 kB
Dirty:            1392 kB
Writeback:           0 kB
AnonPages:       15228 kB
Mapped:           6256 kB
Slab:            69700 kB
SReclaimable:    59896 kB
SUnreclaim:       9804 kB
PageTables:        744 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   117276 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15880 MiB
End job on  at 2009-05-30 10:43:53