Trace number 280626

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
toolbar 2007-01-12? (MO) 37.75 37.9784

General information on the benchmark

NameMaxCSP/pedigree/
sheep4r-4-3_ext.xml
MD5SUM059834bcc85163132960cf21f1c992ed
Bench CategoryN-ARY-EXT (n-ary constraints in extension)
Best result obtained on this benchmarkMOPT
Best Number of satisfied constraints3634
Best CPU time to get the best result obtained on this benchmark38.0642
Satisfiable
(Un)Satisfiability was proved
Number of variables2686
Number of constraints3635
Maximum constraint arity3
Maximum domain size10
Number of constraints which are defined in extension3635
Number of constraints which are defined in intension0
Global constraints used (with number of constraints)

Solver Data (download as text)

c 
c 
c 
c conversion script
c 
c 

translate /tmp/evaluation/280626-1169306917/unknown.xml to /tmp/evaluation/280626-1169306917/unknown.wcsp

Verifier Data (download as text)

ERROR: no interpretation found !

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node5/watcher-280626-1169306917 -o ROOT/results/node5/solver-280626-1169306917 -C 2400 -M 900 /tmp/evaluation/280626-1169306917/solver.sh /tmp/evaluation/280626-1169306917/unknown 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 1.96 2.00 2.00 5/87 25302
/proc/meminfo: memFree=882344/2055920 swapFree=4192812/4192956
[pid=25301] ppid=25299 vsize=8652 CPUtime=0
/proc/25301/stat : 25301 (solver.sh) S 25299 25301 25226 0 -1 4194304 347 0 0 0 0 0 0 0 17 0 1 0 259306494 8859648 280 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/25301/statm: 2163 280 208 79 0 156 0
[pid=25303] ppid=25301 vsize=8688 CPUtime=0
/proc/25303/stat : 25303 (solver.sh) S 25301 25301 25226 0 -1 4194368 38 0 0 0 0 0 0 0 18 0 1 0 259306494 8896512 286 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913648722 0 0 4096 73728 18446744071563648864 0 0 17 1 0 0
/proc/25303/statm: 2172 286 209 79 0 165 0
[pid=25304] ppid=25303 vsize=128 CPUtime=0
/proc/25304/stat : 25304 (id) R 25303 25301 25226 0 -1 4194304 48 0 0 0 0 0 0 0 20 0 1 0 259306494 131072 22 18446744073709551615 4194304 4211724 548682069312 18446744073709551615 226910860565 0 0 3674112 0 0 0 0 17 1 0 0
/proc/25304/statm: 32 22 16 4 0 3 0

[startup+0.103707 s]
/proc/loadavg: 1.96 2.00 2.00 5/87 25302
/proc/meminfo: memFree=882344/2055920 swapFree=4192812/4192956
[pid=25301] ppid=25299 vsize=47556 CPUtime=0.01
/proc/25301/stat : 25301 (solver.sh) S 25299 25301 25226 0 -1 4194304 846 2110 0 0 0 0 0 1 17 0 1 0 259306494 48697344 361 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/25301/statm: 11889 361 245 79 0 217 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47556

[startup+0.511751 s]
/proc/loadavg: 1.96 2.00 2.00 5/87 25302
/proc/meminfo: memFree=882344/2055920 swapFree=4192812/4192956
[pid=25301] ppid=25299 vsize=47556 CPUtime=0.01
/proc/25301/stat : 25301 (solver.sh) S 25299 25301 25226 0 -1 4194304 846 2110 0 0 0 0 0 1 17 0 1 0 259306494 48697344 361 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/25301/statm: 11889 361 245 79 0 217 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47556

[startup+1.33284 s]
/proc/loadavg: 2.04 2.01 2.00 3/89 25319
/proc/meminfo: memFree=864664/2055920 swapFree=4192812/4192956
[pid=25301] ppid=25299 vsize=47556 CPUtime=0.01
/proc/25301/stat : 25301 (solver.sh) S 25299 25301 25226 0 -1 4194304 846 2110 0 0 0 0 0 1 17 0 1 0 259306494 48697344 361 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/25301/statm: 11889 361 245 79 0 217 0
[pid=25318] ppid=25301 vsize=39616 CPUtime=0.77
/proc/25318/stat : 25318 (toolbar) S 25301 25301 25226 0 -1 4194304 9533 0 0 0 74 3 0 0 24 0 1 0 259306497 40566784 3931 18446744073709551615 134512640 135242656 4294956576 18446744073709551615 134893517 0 65536 4102 0 18446744071563356171 0 0 17 1 0 0
/proc/25318/statm: 9904 3931 52 178 0 9722 0
[pid=25319] ppid=25318 vsize=3236 CPUtime=0.5
/proc/25319/stat : 25319 (narycsp) R 25318 25301 25226 0 -1 4194304 937 0 0 0 50 0 0 0 25 0 1 0 259306576 3313664 662 18446744073709551615 134512640 135380208 4294956592 18446744073709551615 135007359 0 0 4096 512 0 0 0 17 1 0 0
/proc/25319/statm: 809 662 101 211 0 578 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 90408

[startup+2.97003 s]
/proc/loadavg: 2.04 2.01 2.00 3/89 25319
/proc/meminfo: memFree=860824/2055920 swapFree=4192812/4192956
[pid=25301] ppid=25299 vsize=47556 CPUtime=0.01
/proc/25301/stat : 25301 (solver.sh) S 25299 25301 25226 0 -1 4194304 846 2110 0 0 0 0 0 1 17 0 1 0 259306494 48697344 361 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/25301/statm: 11889 361 245 79 0 217 0
[pid=25318] ppid=25301 vsize=39616 CPUtime=0.77
/proc/25318/stat : 25318 (toolbar) S 25301 25301 25226 0 -1 4194304 9533 0 0 0 74 3 0 0 24 0 1 0 259306497 40566784 3931 18446744073709551615 134512640 135242656 4294956576 18446744073709551615 134893517 0 65536 4102 0 18446744071563356171 0 0 17 1 0 0
/proc/25318/statm: 9904 3931 52 178 0 9722 0
[pid=25319] ppid=25318 vsize=8784 CPUtime=2.12
/proc/25319/stat : 25319 (narycsp) R 25318 25301 25226 0 -1 4194304 2324 0 0 0 211 1 0 0 25 0 1 0 259306576 8994816 2049 18446744073709551615 134512640 135380208 4294956592 18446744073709551615 135007359 0 0 4096 512 0 0 0 17 1 0 0
/proc/25319/statm: 2196 2049 101 211 0 1965 0
Current children cumulated CPU time (s) 2.9
Current children cumulated vsize (KiB) 95956

[startup+6.2614 s]
/proc/loadavg: 2.04 2.01 2.00 3/89 25319
/proc/meminfo: memFree=856792/2055920 swapFree=4192812/4192956
[pid=25301] ppid=25299 vsize=47556 CPUtime=0.01
/proc/25301/stat : 25301 (solver.sh) S 25299 25301 25226 0 -1 4194304 846 2110 0 0 0 0 0 1 17 0 1 0 259306494 48697344 361 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/25301/statm: 11889 361 245 79 0 217 0
[pid=25318] ppid=25301 vsize=39616 CPUtime=0.77
/proc/25318/stat : 25318 (toolbar) S 25301 25301 25226 0 -1 4194304 9533 0 0 0 74 3 0 0 24 0 1 0 259306497 40566784 3931 18446744073709551615 134512640 135242656 4294956576 18446744073709551615 134893517 0 65536 4102 0 18446744071563356171 0 0 17 1 0 0
/proc/25318/statm: 9904 3931 52 178 0 9722 0
[pid=25319] ppid=25318 vsize=10372 CPUtime=5.4
/proc/25319/stat : 25319 (narycsp) R 25318 25301 25226 0 -1 4194304 2720 0 0 0 538 2 0 0 25 0 1 0 259306576 10620928 2445 18446744073709551615 134512640 135380208 4294956592 18446744073709551615 134528295 0 0 4096 512 0 0 0 17 1 0 0
/proc/25319/statm: 2593 2445 106 211 0 2362 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 97544

[startup+12.7201 s]
/proc/loadavg: 2.04 2.01 2.00 3/89 25319
/proc/meminfo: memFree=856792/2055920 swapFree=4192812/4192956
[pid=25301] ppid=25299 vsize=47556 CPUtime=0.01
/proc/25301/stat : 25301 (solver.sh) S 25299 25301 25226 0 -1 4194304 846 2110 0 0 0 0 0 1 17 0 1 0 259306494 48697344 361 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/25301/statm: 11889 361 245 79 0 217 0
[pid=25318] ppid=25301 vsize=39616 CPUtime=0.77
/proc/25318/stat : 25318 (toolbar) S 25301 25301 25226 0 -1 4194304 9533 0 0 0 74 3 0 0 24 0 1 0 259306497 40566784 3931 18446744073709551615 134512640 135242656 4294956576 18446744073709551615 134893517 0 65536 4102 0 18446744071563356171 0 0 17 1 0 0
/proc/25318/statm: 9904 3931 52 178 0 9722 0
[pid=25319] ppid=25318 vsize=10372 CPUtime=11.83
/proc/25319/stat : 25319 (narycsp) R 25318 25301 25226 0 -1 4194304 2725 0 0 0 1180 3 0 0 25 0 1 0 259306576 10620928 2450 18446744073709551615 134512640 135380208 4294956592 18446744073709551615 134528295 0 0 4096 512 0 0 0 17 1 0 0
/proc/25319/statm: 2593 2450 111 211 0 2362 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 97544

[startup+25.5546 s]
/proc/loadavg: 2.03 2.01 2.00 3/89 25319
/proc/meminfo: memFree=856792/2055920 swapFree=4192812/4192956
[pid=25301] ppid=25299 vsize=47556 CPUtime=0.01
/proc/25301/stat : 25301 (solver.sh) S 25299 25301 25226 0 -1 4194304 846 2110 0 0 0 0 0 1 17 0 1 0 259306494 48697344 361 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/25301/statm: 11889 361 245 79 0 217 0
[pid=25318] ppid=25301 vsize=39616 CPUtime=0.77
/proc/25318/stat : 25318 (toolbar) S 25301 25301 25226 0 -1 4194304 9533 0 0 0 74 3 0 0 24 0 1 0 259306497 40566784 3931 18446744073709551615 134512640 135242656 4294956576 18446744073709551615 134893517 0 65536 4102 0 18446744071563356171 0 0 17 1 0 0
/proc/25318/statm: 9904 3931 52 178 0 9722 0
[pid=25319] ppid=25318 vsize=10372 CPUtime=24.6
/proc/25319/stat : 25319 (narycsp) R 25318 25301 25226 0 -1 4194304 2726 0 0 0 2455 5 0 0 25 0 1 0 259306576 10620928 2451 18446744073709551615 134512640 135380208 4294956592 18446744073709551615 134528295 0 0 4096 512 0 0 0 17 1 0 0
/proc/25319/statm: 2593 2451 112 211 0 2362 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 97544



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+37.966 s]
/proc/loadavg: 2.10 2.03 2.00 3/88 25320
/proc/meminfo: memFree=93984/2055920 swapFree=4192812/4192956
[pid=25301] ppid=25299 vsize=47556 CPUtime=0.01
/proc/25301/stat : 25301 (solver.sh) S 25299 25301 25226 0 -1 4194304 846 2110 0 0 0 0 0 1 17 0 1 0 259306494 48697344 361 18446744073709551615 4194304 4520092 548682069328 18446744073709551615 226913086298 0 2 4096 73728 18446744071563181037 0 0 17 0 0 0
/proc/25301/statm: 11889 361 245 79 0 217 0
[pid=25318] ppid=25301 vsize=885688 CPUtime=37.74
/proc/25318/stat : 25318 (toolbar) R 25301 25301 25226 0 -1 4194304 206077 3119 0 0 153 84 3529 8 25 0 1 0 259306497 906944512 197188 18446744073709551615 134512640 135242656 4294956576 18446744073709551615 134884543 0 0 4096 2 0 0 0 17 1 0 0
/proc/25318/statm: 221456 197192 57 178 0 221274 0
Current children cumulated CPU time (s) 37.75
Current children cumulated vsize (KiB) 933244

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 25301 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=8998 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=23996
CPU time returned by wait4() is 0.032994
while last known CPU time is 37.75

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 37.9784
CPU time (s): 37.75
CPU user time (s): 36.82
CPU system time (s): 0.93
CPU usage (%): 99.3986
Max. virtual memory (cumulated for all children) (KiB): 933244

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.008998
system time used= 0.023996
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2956
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 57
involuntary context switches= 18

runsolver used 0.040993 s user time and 0.105983 s system time

The end

Launcher Data (download as text)

Begin job on node5 on Sat Jan 20 15:28:37 UTC 2007


IDJOB= 280626
IDBENCH= 11880
IDSOLVER= 73
FILE ID= node5/280626-1169306917

PBS_JOBID= 3609937

Free space on /tmp= 66044 MiB

SOLVER NAME= toolbar 2007-01-12
BENCH NAME= HOME/pub/bench/CPAI06/MaxCSP/pedigree/sheep4r-4-3_ext.xml
COMMAND LINE= /tmp/evaluation/280626-1169306917/solver.sh /tmp/evaluation/280626-1169306917/unknown
CONVERSION COMMAND LINE= runsolver -w ROOT/results/node5/convwatcher-280626-1169306917 -o ROOT/results/node5/conversion-280626-1169306917 -C 600 -M 900 /tmp/evaluation/280626-1169306917/translate /tmp/evaluation/280626-1169306917/unknown
CONVERSION RUNSOLVER STATUS CODE= 0
CONVERSION STATUS CODE= 0

RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node5/watcher-280626-1169306917 -o ROOT/results/node5/solver-280626-1169306917 -C 2400 -M 900  /tmp/evaluation/280626-1169306917/solver.sh /tmp/evaluation/280626-1169306917/unknown

META MD5SUM SOLVER= 0bc5e5f95d54df9daf70dab8540aecd6
MD5SUM BENCH=  059834bcc85163132960cf21f1c992ed

RANDOM SEED= 272665968

TIME LIMIT= 2400 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.240
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.240
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:        882696 kB
Buffers:         57632 kB
Cached:         973792 kB
SwapCached:          0 kB
Active:          95612 kB
Inactive:       988648 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:        882696 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            8112 kB
Writeback:           0 kB
Mapped:          73752 kB
Slab:            73600 kB
Committed_AS:  7388884 kB
PageTables:       2196 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66040 MiB



End job on node5 on Sat Jan 20 15:29:19 UTC 2007