2018 XCSP3 competition: sequential solvers tracks: solvers results per benchmarks

Result page for benchmark
MisteryShopper/
MisteryShopper-10b_c18.xml

Jump to solvers results

General information on the benchmark

NameMisteryShopper/
MisteryShopper-10b_c18.xml
MD5SUMb0a0fd8e7c9e530f6e7ba3bf5f78e329
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark0.755893
Satisfiable
(Un)Satisfiability was proved
Number of variables640
Number of constraints417
Number of domains3
Minimum domain size4
Maximum domain size40
Distribution of domain sizes[{"size":4,"count":160},{"size":5,"count":160},{"size":40,"count":320}]
Minimum variable degree2
Maximum variable degree5
Distribution of variable degrees[{"degree":2,"count":320},{"degree":3,"count":160},{"degree":4,"count":140},{"degree":5,"count":20}]
Minimum constraint arity2
Maximum constraint arity160
Distribution of constraint arities[{"arity":2,"count":320},{"arity":4,"count":80},{"arity":5,"count":4},{"arity":40,"count":8},{"arity":80,"count":4},{"arity":160,"count":1}]
Number of extensional constraints320
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":320},{"type":"allDifferent","count":88},{"type":"ordered","count":4},{"type":"lex","count":1},{"type":"channel","count":4}]
Optimization problemNO
Type of objective

Results of the different solvers on this benchmark

Solver NameTraceIDAnswerCPU timeWall clock time
Mistral-2.0 2018-06-15 (complete)4289497SAT 0.755893 0.761541
Mistral-2.0 2018-08-01 (complete)4304026SAT 0.919002 0.919934
Choco-solver 4.0.7b seq (e747e1e) (complete)4306964SAT 3.40589 1.25106
Choco-solver 4.0.7 seq (493a269) (complete)4292670SAT 3.53274 1.30301
PicatSAT 2018-06-15 (complete)4294539SAT 5.58031 5.58143
PicatSAT 2018-08-14 (complete)4309780SAT 5.84778 5.84778
PicatSAT 2018-08-02 (complete)4303440SAT 5.92051 5.92318
Concrete 3.8 2018-06-13 (complete)4294535SAT 14.996 6.61059
Concrete 3.8-SuperNG 2018-06-13 (complete)4294536SAT 16.7065 6.57946
Concrete 3.9.2 (complete)4305029SAT 18.8339 8.57404
Concrete 3.9.2-SuperNG (complete)4305030SAT 20.5318 8.81439
OscaR - Conflict Ordering with restarts 2018-08-14 (complete)4308258SAT 22.2453 17.9264
scop order+MapleCOMSPS (2018-06-13) (complete)4294541SAT 22.9949 10.1223
scop both+MapleCOMSPS (2018-06-13) (complete)4294540SAT 24.2816 10.3086
scop both+MapleCOMSPS (2018-07-31) (complete)4305757SAT 24.8333 11.1613
scop order+MapleCOMSPS (2018-07-31) (complete)4305521SAT 25.4453 11.3743
OscaR - Conflict Ordering with restarts 2018-08-17 (complete)4311994SAT 26.7828 22.5222
OscaR - Conflict Ordering with restarts 2018-07-02 (complete)4290714SAT 145.494 139.535
Sat4j-CSP 2018-07-11 (complete)4290227? 2.462 1.05152
BTD 2018.06.11_3 (complete)4294534? (NS) 0.01647 0.0166721
macht 2018.06.11 (complete)4294538? (NS) 0.016514 0.016975
BTD_12 2018-06-11_12 (complete)4294533? (NS) 0.016575 0.016933
macht 2018.07.27 (complete)4305993? (NS) 0.016658 0.0167641
BTD 2018.07.27_3 (complete)4306465? (NS) 0.016801 0.016905
BTD_12 2018.07.27_12 (complete)4306229? (NS) 0.016883 0.017265
OscaR - Conflict Ordering 2018-07-02 (complete)4290938? (TO) 2400.1 2373.21
cosoco 1.12 (complete)4294537? (TO) 2519.91 2520.01
OscaR - Conflict Ordering 2018-08-14 (complete)4307759? (TO) 2520.08 2495.91

Additionnal information

This section presents information obtained from the best job displayed in the list (i.e. solvers whose names are not hidden).

objective function:
Solution found:
<instantiation type="solution"> <list> vr[0][0] vr[0][1] vr[0][2] vr[0][3] vr[1][0] vr[1][1] vr[1][2] vr[1][3] vr[2][0] vr[2][1] vr[2][2]
vr[2][3] vr[3][0] vr[3][1] vr[3][2] vr[3][3] vr[4][0] vr[4][1] vr[4][2] vr[4][3] vr[5][0] vr[5][1] vr[5][2] vr[5][3] vr[6][0] vr[6][1]
vr[6][2] vr[6][3] vr[7][0] vr[7][1] vr[7][2] vr[7][3] vr[8][0] vr[8][1] vr[8][2] vr[8][3] vr[9][0] vr[9][1] vr[9][2] vr[9][3] vr[10][0]
vr[10][1] vr[10][2] vr[10][3] vr[11][0] vr[11][1] vr[11][2] vr[11][3] vr[12][0] vr[12][1] vr[12][2] vr[12][3] vr[13][0] vr[13][1] vr[13][2]
vr[13][3] vr[14][0] vr[14][1] vr[14][2] vr[14][3] vr[15][0] vr[15][1] vr[15][2] vr[15][3] vr[16][0] vr[16][1] vr[16][2] vr[16][3] vr[17][0]
vr[17][1] vr[17][2] vr[17][3] vr[18][0] vr[18][1] vr[18][2] vr[18][3] vr[19][0] vr[19][1] vr[19][2] vr[19][3] vr[20][0] vr[20][1] vr[20][2]
vr[20][3] vr[21][0] vr[21][1] vr[21][2] vr[21][3] vr[22][0] vr[22][1] vr[22][2] vr[22][3] vr[23][0] vr[23][1] vr[23][2] vr[23][3] vr[24][0]
vr[24][1] vr[24][2] vr[24][3] vr[25][0] vr[25][1] vr[25][2] vr[25][3] vr[26][0] vr[26][1] vr[26][2] vr[26][3] vr[27][0] vr[27][1] vr[27][2]
vr[27][3] vr[28][0] vr[28][1] vr[28][2] vr[28][3] vr[29][0] vr[29][1] vr[29][2] vr[29][3] vr[30][0] vr[30][1] vr[30][2] vr[30][3] vr[31][0]
vr[31][1] vr[31][2] vr[31][3] vr[32][0] vr[32][1] vr[32][2] vr[32][3] vr[33][0] vr[33][1] vr[33][2] vr[33][3] vr[34][0] vr[34][1] vr[34][2]
vr[34][3] vr[35][0] vr[35][1] vr[35][2] vr[35][3] vr[36][0] vr[36][1] vr[36][2] vr[36][3] vr[37][0] vr[37][1] vr[37][2] vr[37][3] vr[38][0]
vr[38][1] vr[38][2] vr[38][3] vr[39][0] vr[39][1] vr[39][2] vr[39][3] ve[0][0] ve[0][1] ve[0][2] ve[0][3] ve[1][0] ve[1][1] ve[1][2]
ve[1][3] ve[2][0] ve[2][1] ve[2][2] ve[2][3] ve[3][0] ve[3][1] ve[3][2] ve[3][3] ve[4][0] ve[4][1] ve[4][2] ve[4][3] ve[5][0] ve[5][1]
ve[5][2] ve[5][3] ve[6][0] ve[6][1] ve[6][2] ve[6][3] ve[7][0] ve[7][1] ve[7][2] ve[7][3] ve[8][0] ve[8][1] ve[8][2] ve[8][3] ve[9][0]
ve[9][1] ve[9][2] ve[9][3] ve[10][0] ve[10][1] ve[10][2] ve[10][3] ve[11][0] ve[11][1] ve[11][2] ve[11][3] ve[12][0] ve[12][1] ve[12][2]
ve[12][3] ve[13][0] ve[13][1] ve[13][2] ve[13][3] ve[14][0] ve[14][1] ve[14][2] ve[14][3] ve[15][0] ve[15][1] ve[15][2] ve[15][3] ve[16][0]
ve[16][1] ve[16][2] ve[16][3] ve[17][0] ve[17][1] ve[17][2] ve[17][3] ve[18][0] ve[18][1] ve[18][2] ve[18][3] ve[19][0] ve[19][1] ve[19][2]
ve[19][3] ve[20][0] ve[20][1] ve[20][2] ve[20][3] ve[21][0] ve[21][1] ve[21][2] ve[21][3] ve[22][0] ve[22][1] ve[22][2] ve[22][3] ve[23][0]
ve[23][1] ve[23][2] ve[23][3] ve[24][0] ve[24][1] ve[24][2] ve[24][3] ve[25][0] ve[25][1] ve[25][2] ve[25][3] ve[26][0] ve[26][1] ve[26][2]
ve[26][3] ve[27][0] ve[27][1] ve[27][2] ve[27][3] ve[28][0] ve[28][1] ve[28][2] ve[28][3] ve[29][0] ve[29][1] ve[29][2] ve[29][3] ve[30][0]
ve[30][1] ve[30][2] ve[30][3] ve[31][0] ve[31][1] ve[31][2] ve[31][3] ve[32][0] ve[32][1] ve[32][2] ve[32][3] ve[33][0] ve[33][1] ve[33][2]
ve[33][3] ve[34][0] ve[34][1] ve[34][2] ve[34][3] ve[35][0] ve[35][1] ve[35][2] ve[35][3] ve[36][0] ve[36][1] ve[36][2] ve[36][3] ve[37][0]
ve[37][1] ve[37][2] ve[37][3] ve[38][0] ve[38][1] ve[38][2] ve[38][3] ve[39][0] ve[39][1] ve[39][2] ve[39][3] gvr[0][0] gvr[0][1] gvr[0][2]
gvr[0][3] gvr[1][0] gvr[1][1] gvr[1][2] gvr[1][3] gvr[2][0] gvr[2][1] gvr[2][2] gvr[2][3] gvr[3][0] gvr[3][1] gvr[3][2] gvr[3][3] gvr[4][0]
gvr[4][1] gvr[4][2] gvr[4][3] gvr[5][0] gvr[5][1] gvr[5][2] gvr[5][3] gvr[6][0] gvr[6][1] gvr[6][2] gvr[6][3] gvr[7][0] gvr[7][1] gvr[7][2]
gvr[7][3] gvr[8][0] gvr[8][1] gvr[8][2] gvr[8][3] gvr[9][0] gvr[9][1] gvr[9][2] gvr[9][3] gvr[10][0] gvr[10][1] gvr[10][2] gvr[10][3]
gvr[11][0] gvr[11][1] gvr[11][2] gvr[11][3] gvr[12][0] gvr[12][1] gvr[12][2] gvr[12][3] gvr[13][0] gvr[13][1] gvr[13][2] gvr[13][3]
gvr[14][0] gvr[14][1] gvr[14][2] gvr[14][3] gvr[15][0] gvr[15][1] gvr[15][2] gvr[15][3] gvr[16][0] gvr[16][1] gvr[16][2] gvr[16][3]
gvr[17][0] gvr[17][1] gvr[17][2] gvr[17][3] gvr[18][0] gvr[18][1] gvr[18][2] gvr[18][3] gvr[19][0] gvr[19][1] gvr[19][2] gvr[19][3]
gvr[20][0] gvr[20][1] gvr[20][2] gvr[20][3] gvr[21][0] gvr[21][1] gvr[21][2] gvr[21][3] gvr[22][0] gvr[22][1] gvr[22][2] gvr[22][3]
gvr[23][0] gvr[23][1] gvr[23][2] gvr[23][3] gvr[24][0] gvr[24][1] gvr[24][2] gvr[24][3] gvr[25][0] gvr[25][1] gvr[25][2] gvr[25][3]
gvr[26][0] gvr[26][1] gvr[26][2] gvr[26][3] gvr[27][0] gvr[27][1] gvr[27][2] gvr[27][3] gvr[28][0] gvr[28][1] gvr[28][2] gvr[28][3]
gvr[29][0] gvr[29][1] gvr[29][2] gvr[29][3] gvr[30][0] gvr[30][1] gvr[30][2] gvr[30][3] gvr[31][0] gvr[31][1] gvr[31][2] gvr[31][3]
gvr[32][0] gvr[32][1] gvr[32][2] gvr[32][3] gvr[33][0] gvr[33][1] gvr[33][2] gvr[33][3] gvr[34][0] gvr[34][1] gvr[34][2] gvr[34][3]
gvr[35][0] gvr[35][1] gvr[35][2] gvr[35][3] gvr[36][0] gvr[36][1] gvr[36][2] gvr[36][3] gvr[37][0] gvr[37][1] gvr[37][2] gvr[37][3]
gvr[38][0] gvr[38][1] gvr[38][2] gvr[38][3] gvr[39][0] gvr[39][1] gvr[39][2] gvr[39][3] gve[0][0] gve[0][1] gve[0][2] gve[0][3] gve[1][0]
gve[1][1] gve[1][2] gve[1][3] gve[2][0] gve[2][1] gve[2][2] gve[2][3] gve[3][0] gve[3][1] gve[3][2] gve[3][3] gve[4][0] gve[4][1] gve[4][2]
gve[4][3] gve[5][0] gve[5][1] gve[5][2] gve[5][3] gve[6][0] gve[6][1] gve[6][2] gve[6][3] gve[7][0] gve[7][1] gve[7][2] gve[7][3] gve[8][0]
gve[8][1] gve[8][2] gve[8][3] gve[9][0] gve[9][1] gve[9][2] gve[9][3] gve[10][0] gve[10][1] gve[10][2] gve[10][3] gve[11][0] gve[11][1]
gve[11][2] gve[11][3] gve[12][0] gve[12][1] gve[12][2] gve[12][3] gve[13][0] gve[13][1] gve[13][2] gve[13][3] gve[14][0] gve[14][1]
gve[14][2] gve[14][3] gve[15][0] gve[15][1] gve[15][2] gve[15][3] gve[16][0] gve[16][1] gve[16][2] gve[16][3] gve[17][0] gve[17][1]
gve[17][2] gve[17][3] gve[18][0] gve[18][1] gve[18][2] gve[18][3] gve[19][0] gve[19][1] gve[19][2] gve[19][3] gve[20][0] gve[20][1]
gve[20][2] gve[20][3] gve[21][0] gve[21][1] gve[21][2] gve[21][3] gve[22][0] gve[22][1] gve[22][2] gve[22][3] gve[23][0] gve[23][1]
gve[23][2] gve[23][3] gve[24][0] gve[24][1] gve[24][2] gve[24][3] gve[25][0] gve[25][1] gve[25][2] gve[25][3] gve[26][0] gve[26][1]
gve[26][2] gve[26][3] gve[27][0] gve[27][1] gve[27][2] gve[27][3] gve[28][0] gve[28][1] gve[28][2] gve[28][3] gve[29][0] gve[29][1]
gve[29][2] gve[29][3] gve[30][0] gve[30][1] gve[30][2] gve[30][3] gve[31][0] gve[31][1] gve[31][2] gve[31][3] gve[32][0] gve[32][1]
gve[32][2] gve[32][3] gve[33][0] gve[33][1] gve[33][2] gve[33][3] gve[34][0] gve[34][1] gve[34][2] gve[34][3] gve[35][0] gve[35][1]
gve[35][2] gve[35][3] gve[36][0] gve[36][1] gve[36][2] gve[36][3] gve[37][0] gve[37][1] gve[37][2] gve[37][3] gve[38][0] gve[38][1]
gve[38][2] gve[38][3] gve[39][0] gve[39][1] gve[39][2] gve[39][3] </list> <values> 0 10 20 30 1 34 21 11 2 23 33 12 3 39 22 13 4 28 36 14 5
35 24 15 6 25 32 16 7 27 31 17 8 29 38 18 9 26 37 19 10 1 34 20 11 33 7 21 12 37 6 22 13 32 8 23 14 31 0 24 15 38 4 25 16 9 30 29 17 8 35 28
18 30 5 26 19 36 9 27 20 6 14 39 21 7 13 34 22 0 10 32 23 16 2 33 24 15 3 31 25 13 39 0 26 2 15 35 27 3 17 37 28 4 18 38 29 5 11 36 30 20 19
7 31 22 12 9 32 21 16 6 33 24 1 10 34 14 23 8 35 11 25 1 36 12 26 2 37 17 27 3 38 18 28 4 39 19 29 5 0 22 14 25 1 10 33 35 2 26 23 36 3 27
24 37 4 28 15 38 5 29 18 39 6 20 12 32 7 21 11 30 8 17 13 34 9 16 19 31 10 0 22 33 11 35 29 1 12 36 31 2 13 25 21 3 14 34 20 4 15 24 26 5 16
23 32 6 17 37 27 7 18 38 28 8 19 39 30 9 20 30 0 10 21 32 1 11 22 31 3 12 23 2 34 13 24 33 5 14 25 6 35 15 26 9 36 18 27 7 37 19 28 4 38 17
29 8 39 16 30 18 16 0 31 14 7 24 32 13 6 22 33 11 2 23 34 1 10 21 35 5 17 26 36 19 4 29 37 12 9 27 38 15 8 28 39 3 25 20 0 1 2 3 0 3 2 1 0 2
3 1 0 3 2 1 0 2 3 1 0 3 2 1 0 2 3 1 0 2 3 1 0 2 3 1 0 2 3 1 1 0 3 2 1 3 0 2 1 3 0 2 1 3 0 2 1 3 0 2 1 3 0 2 1 0 3 2 1 0 3 2 1 3 0 2 1 3 0 2
2 0 1 3 2 0 1 3 2 0 1 3 2 1 0 3 2 1 0 3 2 1 3 0 2 0 1 3 2 0 1 3 2 0 1 3 2 0 1 3 3 2 1 0 3 2 1 0 3 2 1 0 3 2 0 1 3 1 2 0 3 1 2 0 3 1 2 0 3 1
2 0 3 1 2 0 3 1 2 0 0 2 1 3 0 1 3 4 0 3 2 4 0 3 2 4 0 3 1 4 0 3 2 4 0 2 1 3 0 2 1 3 0 2 1 3 0 1 2 3 1 0 2 3 1 4 3 0 1 4 3 0 1 3 2 0 1 3 2 0
1 2 3 0 1 2 3 0 2 4 3 0 2 4 3 0 2 4 3 0 2 3 0 1 2 3 0 1 2 3 0 1 2 0 3 1 2 3 0 1 3 0 4 1 3 0 4 2 3 0 4 2 3 0 4 2 3 0 4 1 3 2 1 0 3 1 0 2 3 1
0 2 3 1 0 2 3 0 1 2 4 0 2 3 4 2 0 3 4 1 0 3 4 1 0 3 4 0 3 2 </values> </instantiation>