Trace number 320879

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
KCNFS SMP? (MO) 45.45 25.2382

General information on the benchmark

Nameindustrial/babic/
xinetd/itox_vc909.cnf
MD5SUM627c367c3479ca507fb4d6e8524f1677
Bench CategoryINDUST (industrial instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.895863
Satisfiable
(Un)Satisfiability was proved
Number of variables112115
Number of clauses327768
Sum of the clauses size854914
Maximum clause length3
Minimum clause length1
Number of clauses of size 17055
Number of clauses of size 2114280
Number of clauses of size 3206433
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data (download as text)

0.00/0.00	
0.00/0.00	c Computed by /tmp/evaluation/320879-1176324899/kcnfs-smp   V. 1.2
0.00/0.00	c reading file ... done
0.49/0.60	c Input file : '/tmp/evaluation/320879-1176324899/instance-320879-1176324899.cnf'
0.49/0.60	c [#vars: 112287, #clauses: 327768 , (1-3)-CNF]
0.79/0.89	c unit clauses propagate before processing (#clause: 318902)
0.79/0.89	c estimated distribution: 8 tasks
4.69/4.77	c <3988> [PID]: 3990 3991 3992 3993 3994 3995 3996
43.66/24.38	c <3988> [PID]: 3997
44.05/24.57	c real distribution: 8 tasks

Verifier Data (download as text)

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer:

Watcher Data (download as text)

runsolver version 3.2.1 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node63/watcher-320879-1176324899 -o ROOT/results/node63/solver-320879-1176324899 -C 1200 -W 2400 -M 1800 --output-limit 1,15 /tmp/evaluation/320879-1176324899/kcnfs-smp /tmp/evaluation/320879-1176324899/instance-320879-1176324899.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 0.98 3/64 3988
/proc/meminfo: memFree=1352180/2055920 swapFree=4191892/4192956
[pid=3988] ppid=3986 vsize=180916 CPUtime=0
/proc/3988/stat : 3988 (kcnfs-smp) R 3986 3988 2919 0 -1 4194304 136 0 0 0 0 0 0 0 18 0 1 0 108479888 185257984 121 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/3988/statm: 45262 122 48 160 0 45100 0

[startup+0.082941 s]
/proc/loadavg: 1.00 1.00 0.98 3/64 3988
/proc/meminfo: memFree=1352180/2055920 swapFree=4191892/4192956
[pid=3988] ppid=3986 vsize=185272 CPUtime=0.07
/proc/3988/stat : 3988 (kcnfs-smp) R 3986 3988 2919 0 -1 4194304 1205 0 0 0 7 0 0 0 18 0 1 0 108479888 189718528 1190 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134841789 0 0 4096 0 0 0 0 17 1 0 0
/proc/3988/statm: 46318 1190 48 160 0 46156 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 185272

[startup+0.102942 s]
/proc/loadavg: 1.00 1.00 0.98 3/64 3988
/proc/meminfo: memFree=1352180/2055920 swapFree=4191892/4192956
[pid=3988] ppid=3986 vsize=186328 CPUtime=0.09
/proc/3988/stat : 3988 (kcnfs-smp) R 3986 3988 2919 0 -1 4194304 1466 0 0 0 9 0 0 0 18 0 1 0 108479888 190799872 1451 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/3988/statm: 46582 1452 48 160 0 46420 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 186328

[startup+0.301963 s]
/proc/loadavg: 1.00 1.00 0.98 3/64 3988
/proc/meminfo: memFree=1352180/2055920 swapFree=4191892/4192956
[pid=3988] ppid=3986 vsize=196624 CPUtime=0.29
/proc/3988/stat : 3988 (kcnfs-smp) R 3986 3988 2919 0 -1 4194304 4045 0 0 0 28 1 0 0 19 0 1 0 108479888 201342976 4030 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134820679 0 0 4096 0 0 0 0 17 1 0 0
/proc/3988/statm: 49156 4031 48 160 0 48994 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 196624

[startup+0.703007 s]
/proc/loadavg: 1.00 1.00 0.98 3/64 3988
/proc/meminfo: memFree=1352180/2055920 swapFree=4191892/4192956
[pid=3988] ppid=3986 vsize=228392 CPUtime=0.69
/proc/3988/stat : 3988 (kcnfs-smp) R 3986 3988 2919 0 -1 4194304 17203 0 0 0 63 6 0 0 22 0 1 0 108479888 233873408 17187 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134541776 0 0 4096 0 0 0 0 17 1 0 0
/proc/3988/statm: 57098 17190 51 160 0 56936 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 228392

[startup+1.50109 s]
/proc/loadavg: 1.00 1.00 0.98 2/65 3989
/proc/meminfo: memFree=1269868/2055920 swapFree=4191892/4192956
[pid=3988] ppid=3986 vsize=227980 CPUtime=1.49
/proc/3988/stat : 3988 (kcnfs-smp) R 3986 3988 2919 0 -1 4194304 21053 0 0 0 141 8 0 0 25 0 1 0 108479888 233451520 20788 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572297 0 0 4096 0 0 0 0 17 1 0 0
/proc/3988/statm: 56995 20789 63 160 0 56833 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 227980

[startup+3.10126 s]
/proc/loadavg: 1.00 1.00 0.98 2/65 3989
/proc/meminfo: memFree=1268588/2055920 swapFree=4191892/4192956
[pid=3988] ppid=3986 vsize=227980 CPUtime=3.09
/proc/3988/stat : 3988 (kcnfs-smp) R 3986 3988 2919 0 -1 4194304 21161 0 0 0 301 8 0 0 25 0 1 0 108479888 233451520 20896 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134590028 0 0 4096 0 0 0 0 17 1 0 0
/proc/3988/statm: 56995 20896 65 160 0 56833 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 227980

[startup+6.30161 s]
/proc/loadavg: 1.00 1.00 0.98 4/67 3991
/proc/meminfo: memFree=1260892/2055920 swapFree=4191892/4192956
[pid=3988] ppid=3986 vsize=227980 CPUtime=5.48
/proc/3988/stat : 3988 (kcnfs-smp) R 3986 3988 2919 0 -1 4194304 22433 0 0 0 539 9 0 0 25 0 1 0 108479888 233451520 20926 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572638 0 0 4096 0 0 0 0 17 0 0 0
/proc/3988/statm: 56995 20926 66 160 0 56833 0
[pid=3990] ppid=3988 vsize=227980 CPUtime=1.52
/proc/3990/stat : 3990 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 968 0 0 0 152 0 0 0 25 0 1 0 108480365 233451520 20905 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134567423 0 0 4096 2 0 0 0 17 1 0 0
/proc/3990/statm: 56995 20905 65 160 0 56833 0
[pid=3991] ppid=3988 vsize=227980 CPUtime=0.79
/proc/3991/stat : 3991 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 931 0 0 0 79 0 0 0 25 0 1 0 108480365 233451520 20904 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 0 0 0
/proc/3991/statm: 56995 20904 65 160 0 56833 0
Current children cumulated CPU time (s) 7.79
Current children cumulated vsize (KiB) 683940

[startup+12.7013 s]
/proc/loadavg: 1.32 1.07 1.00 6/69 3993
/proc/meminfo: memFree=1248780/2055920 swapFree=4191892/4192956
[pid=3988] ppid=3986 vsize=227980 CPUtime=8.65
/proc/3988/stat : 3988 (kcnfs-smp) R 3986 3988 2919 0 -1 4194304 23876 0 0 0 855 10 0 0 25 0 1 0 108479888 233451520 21020 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572741 0 0 4096 0 0 0 0 17 1 0 0
/proc/3988/statm: 56995 21020 67 160 0 56833 0
[pid=3990] ppid=3988 vsize=227980 CPUtime=6.21
/proc/3990/stat : 3990 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 1100 0 0 0 621 0 0 0 25 0 1 0 108480365 233451520 20911 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572319 0 0 4096 2 0 0 0 17 1 0 0
/proc/3990/statm: 56995 20911 65 160 0 56833 0
[pid=3991] ppid=3988 vsize=227980 CPUtime=3.39
/proc/3991/stat : 3991 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 1072 0 0 0 339 0 0 0 25 0 1 0 108480365 233451520 20905 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572621 0 0 4096 0 0 0 0 17 0 0 0
/proc/3991/statm: 56995 20905 65 160 0 56833 0
[pid=3992] ppid=3988 vsize=227980 CPUtime=1.19
/proc/3992/stat : 3992 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 980 0 0 0 119 0 0 0 25 0 1 0 108480804 233451520 21015 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572834 0 0 4096 2 0 0 0 17 0 0 0
/proc/3992/statm: 56995 21015 67 160 0 56833 0
[pid=3993] ppid=3988 vsize=227980 CPUtime=1.1
/proc/3993/stat : 3993 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 629 0 0 0 110 0 0 0 25 0 1 0 108480807 233451520 21120 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134567505 0 0 4096 0 0 0 0 17 0 0 0
/proc/3993/statm: 56995 21120 71 160 0 56833 0
Current children cumulated CPU time (s) 20.54
Current children cumulated vsize (KiB) 1139900



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+25.2026 s]
/proc/loadavg: 2.60 1.36 1.10 9/73 3997
/proc/meminfo: memFree=1231788/2055920 swapFree=4191892/4192956
[pid=3988] ppid=3986 vsize=227980 CPUtime=12.22
/proc/3988/stat : 3988 (kcnfs-smp) S 3986 3988 2919 0 -1 4194304 25593 0 0 0 1210 12 0 0 25 0 1 0 108479888 233451520 21020 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134836797 0 0 4096 0 18446744071563356171 0 0 17 0 0 0
/proc/3988/statm: 56995 21020 67 160 0 56833 0
[pid=3990] ppid=3988 vsize=227980 CPUtime=9.9
/proc/3990/stat : 3990 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 1111 0 0 0 990 0 0 0 25 0 1 0 108480365 233451520 20920 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572638 0 0 4096 2 0 0 0 17 1 0 0
/proc/3990/statm: 56995 20920 65 160 0 56833 0
[pid=3991] ppid=3988 vsize=227980 CPUtime=7.49
/proc/3991/stat : 3991 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 1102 0 0 0 749 0 0 0 25 0 1 0 108480365 233451520 20913 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572812 0 0 4096 0 0 0 0 17 0 0 0
/proc/3991/statm: 56995 20913 65 160 0 56833 0
[pid=3992] ppid=3988 vsize=227980 CPUtime=5.31
/proc/3992/stat : 3992 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 1037 0 0 0 531 0 0 0 25 0 1 0 108480804 233451520 21032 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572846 0 0 4096 2 0 0 0 17 0 0 0
/proc/3992/statm: 56995 21032 67 160 0 56833 0
[pid=3993] ppid=3988 vsize=227980 CPUtime=5.23
/proc/3993/stat : 3993 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 698 0 0 0 523 0 0 0 25 0 1 0 108480807 233451520 21120 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572623 0 0 4096 0 0 0 0 17 0 0 0
/proc/3993/statm: 56995 21120 71 160 0 56833 0
[pid=3994] ppid=3988 vsize=227980 CPUtime=2.5
/proc/3994/stat : 3994 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 1076 0 0 0 250 0 0 0 25 0 1 0 108481405 233451520 21020 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572655 0 0 4096 2 0 0 0 17 0 0 0
/proc/3994/statm: 56995 21020 67 160 0 56833 0
[pid=3995] ppid=3988 vsize=227980 CPUtime=2.49
/proc/3995/stat : 3995 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 1073 0 0 0 249 0 0 0 25 0 1 0 108481406 233451520 21020 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 1 0 0
/proc/3995/statm: 56995 21020 67 160 0 56833 0
[pid=3996] ppid=3988 vsize=227980 CPUtime=0.2
/proc/3996/stat : 3996 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 890 0 0 0 20 0 0 0 25 0 1 0 108482325 233451520 21020 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572829 0 0 4096 2 0 0 0 17 1 0 0
/proc/3996/statm: 56995 21020 67 160 0 56833 0
[pid=3997] ppid=3988 vsize=227980 CPUtime=0.11
/proc/3997/stat : 3997 (kcnfs-smp) R 3988 3988 2919 0 -1 4194368 632 0 0 0 11 0 0 0 25 0 1 0 108482326 233451520 21117 18446744073709551615 134512640 135172044 4294956592 18446744073709551615 134572276 0 0 4096 0 0 0 0 17 1 0 0
/proc/3997/statm: 56995 21117 71 160 0 56833 0
Current children cumulated CPU time (s) 45.45
Current children cumulated vsize (KiB) 2051820

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 3988 and gives childrusage.ru_utime.tv_sec=12 childrusage.ru_utime.tv_usec=107159 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=132979
CPU time returned by wait4() is 12.2401
while last known CPU time is 45.45

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 25.2382
CPU time (s): 45.45
CPU user time (s): 45.33
CPU system time (s): 0.12
CPU usage (%): 180.084
Max. virtual memory (cumulated for all children) (KiB): 2051820

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 12.1072
system time used= 0.132979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25593
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 148

runsolver used 0.040993 second user time and 0.06499 second system time

The end

Launcher Data (download as text)

Begin job on node63 on Wed Apr 11 20:55:00 UTC 2007

IDJOB= 320879
IDBENCH= 20514
IDSOLVER= 112
FILE ID= node63/320879-1176324899

PBS_JOBID= 4516721

Free space on /tmp= 66556 MiB

SOLVER NAME= KCNFS SMP
BENCH NAME= HOME/pub/bench/SAT07/industrial/babic/xinetd/itox_vc909.cnf
COMMAND LINE= /tmp/evaluation/320879-1176324899/kcnfs-smp /tmp/evaluation/320879-1176324899/instance-320879-1176324899.cnf            
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node63/watcher-320879-1176324899 -o ROOT/results/node63/solver-320879-1176324899 -C 1200 -W 2400 -M 1800 --output-limit 1,15  /tmp/evaluation/320879-1176324899/kcnfs-smp /tmp/evaluation/320879-1176324899/instance-320879-1176324899.cnf            

META MD5SUM SOLVER= 23f87ccf1c743ff5b6146b444e216cd3
MD5SUM BENCH=  627c367c3479ca507fb4d6e8524f1677

RANDOM SEED= 562954290

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB

Linux node63.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.232
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1352652 kB
Buffers:         44544 kB
Cached:         500956 kB
SwapCached:        268 kB
Active:         216664 kB
Inactive:       349436 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1352652 kB
SwapTotal:     4192956 kB
SwapFree:      4191892 kB
Dirty:            9244 kB
Writeback:           0 kB
Mapped:          30164 kB
Slab:           123196 kB
Committed_AS:   120444 kB
PageTables:       1476 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66556 MiB

End job on node63 on Wed Apr 11 20:55:27 UTC 2007