2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Haystacks/ Haystacks-ext-04_c18.xml	UNSAT	0.006809	0.00700191	4306436
Haystacks/ Haystacks-ext-05_c18.xml	UNSAT	0.007679	0.00806305	4306437
Dubois/ Dubois-018_c18.xml	UNSAT	0.008333	0.00850009	4306297
Dubois/ Dubois-020_c18.xml	UNSAT	0.008605	0.00873103	4306298
Dubois/ Dubois-021_c18.xml	UNSAT	0.008786	0.00915209	4306299
Dubois/ Dubois-022_c18.xml	UNSAT	0.008855	0.00910409	4306300
Dubois/ Dubois-023_c18.xml	UNSAT	0.009126	0.00931006	4306301
Dubois/ Dubois-024_c18.xml	UNSAT	0.00921	0.009407	4306302
Dubois/ Dubois-025_c18.xml	UNSAT	0.009305	0.00965697	4306303
Dubois/ Dubois-030_c18.xml	UNSAT	0.010268	0.0103971	4306304
Dubois/ Dubois-040_c18.xml	UNSAT	0.01175	0.0120069	4306305
Haystacks/ Haystacks-ext-06_c18.xml	UNSAT	0.011876	0.0120531	4306438
Dubois/ Dubois-050_c18.xml	UNSAT	0.01357	0.013867	4306306
Dubois/ Dubois-075_c18.xml	UNSAT	0.019305	0.0194619	4306307
Dubois/ Dubois-100_c18.xml	UNSAT	0.026151	0.0265441	4306308
Haystacks/ Haystacks-ext-07_c18.xml	UNSAT	0.037051	0.0374729	4306439
Langford/ LangfordBin-06_c18.xml	UNSAT	0.222294	0.222568	4306286
Haystacks/ Haystacks-ext-08_c18.xml	UNSAT	0.225521	0.225871	4306440
ColouredQueens/ ColouredQueens-06_c18.xml	UNSAT	0.593409	0.593956	4306275
Quasigroups/ QuasiGroup-7-07_c18.xml	UNSAT	0.82099	0.821152	4306354
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f12_c18.xml	UNSAT	1.25529	1.25565	4306470
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f11_c18.xml	UNSAT	1.25718	1.26158	4306474
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f10_c18.xml	UNSAT	1.27878	1.27935	4306473
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f09_c18.xml	UNSAT	1.61725	1.6177	4306476
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f08_c18.xml	UNSAT	1.6511	1.65153	4306479
Haystacks/ Haystacks-ext-09_c18.xml	UNSAT	1.80173	1.80219	4306441
Subisomorphism/ Subisomorphism-g34-g36_c18.xml	UNSAT	3.46719	3.47045	4306406
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f07_c18.xml	UNSAT	3.99894	3.99924	4306469
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f06_c18.xml	UNSAT	6.55107	6.5568	4306471
Quasigroups/ QuasiGroup-4-07_c18.xml	UNSAT	9.07372	9.07853	4306346
Haystacks/ Haystacks-ext-10_c18.xml	UNSAT	16.9926	16.9926	4306442
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f05_c18.xml	UNSAT	20.2564	20.2623	4306478
Quasigroups/ QuasiGroup-7-08_c18.xml	UNSAT	40.323	40.3355	4306355
Subisomorphism/ Subisomorphism-g17-g42_c18.xml	UNSAT	44.1483	44.1599	4306402
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f04_c18.xml	UNSAT	59.096	59.1209	4306475
Haystacks/ Haystacks-ext-11_c18.xml	UNSAT	184.419	184.431	4306443
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f03_c18.xml	UNSAT	216.376	216.412	4306472
Subisomorphism/ Subisomorphism-g11-g30_c18.xml	UNSAT	285.595	285.589	4306399
MagicHexagon/ MagicHexagon-04-0017_c18.xml	UNSAT	352.424	352.467	4306310
Crossword/ Crossword-m18-ogd2008-vg-16-17_c18.xml	UNSAT	368.785	368.791	4306435
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f02_c18.xml	UNSAT	624.897	624.947	4306480
Subisomorphism/ Subisomorphism-g11-g44_c18.xml	UNSAT	1183.38	1183.47	4306400
Rlfap/Rlfap-dec-scens11/ Rlfap-scen-11-f01_c18.xml	UNSAT	1216.92	1216.9	4306477
Quasigroups/ QuasiGroup-4-08_c18.xml	UNSAT	1572.09	1572.1	4306347
Haystacks/ Haystacks-ext-12_c18.xml	UNSAT	2260.86	2261.01	4306444

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-05_c18.xml	SAT	0.006697	0.00698704	4306274
Eternity/ Eternity-04-04_c18.xml	SAT	0.010296	0.0103901	4306320
ColouredQueens/ ColouredQueens-07_c18.xml	SAT	0.015771	0.016042	4306276
GracefulGraph/ GracefulGraph-K03-P03_c18.xml	SAT	0.016549	0.0166409	4306336
Crossword/ Crossword-m18-ogd2008-vg-04-05_c18.xml	SAT	0.045678	0.04602	4306423
Eternity/ Eternity-05-05_c18.xml	SAT	0.083876	0.0842071	4306321
Crossword/ Crossword-m18-ogd2008-vg-05-06_c18.xml	SAT	0.119659	0.124234	4306424
Langford/ LangfordBin-07_c18.xml	SAT	0.154764	0.159449	4306287
Crossword/ Crossword-m18-ogd2008-vg-06-07_c18.xml	SAT	0.271753	0.276377	4306425
Frb/ frb-30-15-1_c18.xml	SAT	0.35943	0.359547	4306407
GracefulGraph/ GracefulGraph-K04-P02_c18.xml	SAT	0.390235	0.390633	4306337
GracefulGraph/ GracefulGraph-K02-P09_c18.xml	SAT	1.12126	1.12148	4306335
Quasigroups/ QuasiGroup-4-09_c18.xml	SAT	1.15209	1.15637	4306348
Subisomorphism/ Subisomorphism-g08-g43_c18.xml	SAT	1.21334	1.21356	4306396
Eternity/ Eternity-10-04_c18.xml	SAT	1.76746	1.76783	4306326
PseudoBoolean-dec/ Pb-robin08_c18.xml	SAT	2.31517	2.31685	4306453
Langford/ LangfordBin-08_c18.xml	SAT	3.18402	3.189	4306288
Eternity/ Eternity-06-06_c18.xml	SAT	3.5373	3.5377	4306322
Frb/ frb-35-17-1_c18.xml	SAT	7.27582	7.27607	4306408
Quasigroups/ QuasiGroup-7-09_c18.xml	SAT	14.3008	14.3026	4306356
PseudoBoolean-dec/ Pb-robin10_c18.xml	SAT	23.1432	23.1435	4306454
Frb/ frb-40-19-1-mgd_c18.xml	SAT	26.835	26.8352	4306409
Crossword/ Crossword-m18-ogd2008-vg-07-08_c18.xml	SAT	40.0171	40.0222	4306426
MagicHexagon/ MagicHexagon-04-0003_c18.xml	SAT	41.3111	41.3204	4306309
MagicHexagon/ MagicHexagon-04-m004_c18.xml	SAT	255.752	255.788	4306311
Eternity/ Eternity-07-07_c18.xml	SAT	341.085	341.082	4306323
GracefulGraph/ GracefulGraph-K04-P03_c18.xml	SAT	426.527	426.519	4306338
GracefulGraph/ GracefulGraph-K05-P02_c18.xml	SAT	438.617	438.608	4306340
Eternity/ Eternity-10-05_c18.xml	SAT	1294.02	1294.12	4306327
GracefulGraph/ GracefulGraph-K04-P04_c18.xml	SAT	1955.42	1955.37	4306339
Subisomorphism/ Subisomorphism-g17-g37_c18.xml	SAT	2194.48	2194.52	4306401

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
ColouredQueens/ ColouredQueens-13_c18.xml	?	2520.01	2519.92	4306282
Langford/ LangfordBin-13_c18.xml	?	2520.01	2519.94	4306293
Langford/ LangfordBin-09_c18.xml	?	2520.01	2519.92	4306289
PseudoBoolean-dec/ Pb-chnl15-16_c18.xml	?	2520.01	2519.93	4306447
Langford/ LangfordBin-14_c18.xml	?	2520.01	2519.93	4306294
ColouredQueens/ ColouredQueens-15_c18.xml	?	2520.01	2519.92	4306284
ColouredQueens/ ColouredQueens-09_c18.xml	?	2520.01	2519.94	4306278
ColouredQueens/ ColouredQueens-14_c18.xml	?	2520.01	2519.99	4306283
Quasigroups/ QuasiGroup-7-10_c18.xml	?	2520.01	2519.88	4306357
Quasigroups/ QuasiGroup-7-12_c18.xml	?	2520.02	2519.87	4306358
Subisomorphism/ Subisomorphism-g10-g23_c18.xml	?	2520.02	2519.94	4306397
Subisomorphism/ Subisomorphism-g10-g27_c18.xml	?	2520.02	2519.95	4306398
GracefulGraph/ GracefulGraph-K06-P03_c18.xml	?	2520.02	2519.95	4306343
Quasigroups/ QuasiGroup-7-14_c18.xml	?	2520.03	2519.88	4306359
Frb/ frb-45-21-1_c18.xml	?	2520.04	2519.9	4306410
Quasigroups/ QuasiGroup-4-10_c18.xml	?	2520.05	2519.9	4306349

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
CarSequencing/ CarSequencing-dingbas_c18.xml	? (NS)	0.006467	0.00654201	4306273
SportsScheduling/ SportsScheduling-08_c18.xml	? (NS)	0.007389	0.00757294	4306386
MisteryShopper/ MisteryShopper-04_c18.xml	? (NS)	0.00741	0.00780296	4306459
Bibd/ Bibd-sum-07-03-01_c18.xml	? (NS)	0.008385	0.00881406	4306251
CarSequencing/ CarSequencing-04-72_c18.xml	? (NS)	0.008486	0.00862812	4306257
CarSequencing/ CarSequencing-06-76_c18.xml	? (NS)	0.00851	0.00865509	4306258
SportsScheduling/ SportsScheduling-10_c18.xml	? (NS)	0.008629	0.00882091	4306387
MisteryShopper/ MisteryShopper-10a_c18.xml	? (NS)	0.010667	0.0110899	4306464
CarSequencing/ CarSequencing-60-02_c18.xml	? (NS)	0.010774	0.0109079	4306260
SportsScheduling/ SportsScheduling-12_c18.xml	? (NS)	0.010817	0.0111271	4306388
MisteryShopper/ MisteryShopper-06a_c18.xml	? (NS)	0.010866	0.0110749	4306460
CarSequencing/ CarSequencing-75-02_c18.xml	? (NS)	0.010895	0.011048	4306266
CarSequencing/ CarSequencing-75-01_c18.xml	? (NS)	0.010985	0.011138	4306265
CarSequencing/ CarSequencing-65-02_c18.xml	? (NS)	0.011011	0.0112519	4306262
CarSequencing/ CarSequencing-85-02_c18.xml	? (NS)	0.011014	0.0112461	4306270
CarSequencing/ CarSequencing-90-02_c18.xml	? (NS)	0.011046	0.011177	4306272
CarSequencing/ CarSequencing-80-02_c18.xml	? (NS)	0.011049	0.0112379	4306268
CarSequencing/ CarSequencing-60-01_c18.xml	? (NS)	0.011067	0.0111959	4306259
CarSequencing/ CarSequencing-70-02_c18.xml	? (NS)	0.011085	0.0112179	4306264
CarSequencing/ CarSequencing-65-01_c18.xml	? (NS)	0.011086	0.0113081	4306261
CarSequencing/ CarSequencing-85-01_c18.xml	? (NS)	0.0111	0.011339	4306269
CarSequencing/ CarSequencing-80-01_c18.xml	? (NS)	0.011115	0.011318	4306267
CarSequencing/ CarSequencing-90-01_c18.xml	? (NS)	0.011142	0.011236	4306271
StripPacking/ StripPacking-1b_c18.xml	? (NS)	0.011289	0.011564	4306375
CarSequencing/ CarSequencing-70-01_c18.xml	? (NS)	0.011345	0.011493	4306263
StripPacking/ StripPacking-1a_c18.xml	? (NS)	0.012168	0.012364	4306374
SportsScheduling/ SportsScheduling-14_c18.xml	? (NS)	0.014051	0.014201	4306389
StripPacking/ StripPacking-C1P3_c18.xml	? (NS)	0.014283	0.0146519	4306378
StripPacking/ StripPacking-C1P1_c18.xml	? (NS)	0.014361	0.014673	4306376
StripPacking/ StripPacking-C1P2_c18.xml	? (NS)	0.014748	0.0149119	4306377
MisteryShopper/ MisteryShopper-06b_c18.xml	? (NS)	0.015421	0.015697	4306461
StripPacking/ StripPacking-T1c_c18.xml	? (NS)	0.0161	0.0163759	4306384
StripPacking/ StripPacking-T1a_c18.xml	? (NS)	0.016101	0.0163091	4306383
StripPacking/ StripPacking-N1c_c18.xml	? (NS)	0.016117	0.0163641	4306382
StripPacking/ StripPacking-N1b_c18.xml	? (NS)	0.01612	0.0163071	4306381
StripPacking/ StripPacking-N1a_c18.xml	? (NS)	0.016122	0.01643	4306380
StripPacking/ StripPacking-T1d_c18.xml	? (NS)	0.016223	0.0163819	4306385
MisteryShopper/ MisteryShopper-10b_c18.xml	? (NS)	0.016801	0.016905	4306465
SportsScheduling/ SportsScheduling-16_c18.xml	? (NS)	0.018833	0.019023	4306390
StripPacking/ StripPacking-C2P1_c18.xml	? (NS)	0.018975	0.01923	4306379
MisteryShopper/ MisteryShopper-06c_c18.xml	? (NS)	0.02254	0.0227029	4306462
SportsScheduling/ SportsScheduling-18_c18.xml	? (NS)	0.028011	0.02817	4306391
Bibd/ Bibd-sc-07-03-01_c18.xml	? (NS)	0.02863	0.0288789	4306245
MisteryShopper/ MisteryShopper-10c_c18.xml	? (NS)	0.028855	0.029155	4306466
MisteryShopper/ MisteryShopper-06d_c18.xml	? (NS)	0.034319	0.0344999	4306463
MisteryShopper/ MisteryShopper-12_c18.xml	? (NS)	0.03775	0.0380061	4306468
SportsScheduling/ SportsScheduling-20_c18.xml	? (NS)	0.039078	0.0393201	4306392
MisteryShopper/ MisteryShopper-10d_c18.xml	? (NS)	0.049131	0.0496761	4306467
SportsScheduling/ SportsScheduling-22_c18.xml	? (NS)	0.054962	0.055137	4306393
Bibd/ Bibd-sum-12-06-05_c18.xml	? (NS)	0.06758	0.0678671	4306254
SportsScheduling/ SportsScheduling-24_c18.xml	? (NS)	0.083776	0.0838649	4306394
SportsScheduling/ SportsScheduling-26_c18.xml	? (NS)	0.114511	0.114765	4306395
SocialGolfers/ SocialGolfers-4-4-4-cp_c18.xml	? (NS)	0.152223	0.152368	4306362
SocialGolfers/ SocialGolfers-4-4-5-cp_c18.xml	? (NS)	0.255028	0.256401	4306363
Bibd/ Bibd-sc-12-06-05_c18.xml	? (NS)	0.30756	0.309222	4306248
SocialGolfers/ SocialGolfers-4-4-6-cp_c18.xml	? (NS)	0.3892	0.389421	4306364
Bibd/ Bibd-sum-09-03-09_c18.xml	? (NS)	0.428811	0.433761	4306252
SocialGolfers/ SocialGolfers-4-4-7-cp_c18.xml	? (NS)	0.556944	0.557219	4306365
SocialGolfers/ SocialGolfers-5-5-5-cp_c18.xml	? (NS)	0.672444	0.677079	4306366
Bibd/ Bibd-sum-10-03-08_c18.xml	? (NS)	0.762544	0.767235	4306253
SocialGolfers/ SocialGolfers-5-5-6-cp_c18.xml	? (NS)	1.05626	1.05648	4306367
Bibd/ Bibd-sum-22-033-12-08-04_c18.xml	? (NS)	1.2662	1.27111	4306255
Bibd/ Bibd-sc-09-03-09_c18.xml	? (NS)	1.27724	1.27893	4306246
SocialGolfers/ SocialGolfers-5-5-7-cp_c18.xml	? (NS)	1.55334	1.55386	4306368
Bibd/ Bibd-sc-10-03-08_c18.xml	? (NS)	2.09233	2.09794	4306247
SocialGolfers/ SocialGolfers-5-5-8-cp_c18.xml	? (NS)	2.20208	2.20371	4306369
SocialGolfers/ SocialGolfers-6-6-6-cp_c18.xml	? (NS)	2.55066	3.13901	4306370
Bibd/ Bibd-sc-22-033-12-08-04_c18.xml	? (NS)	3.14586	3.15297	4306249
SocialGolfers/ SocialGolfers-6-6-7-cp_c18.xml	? (NS)	3.89618	3.89682	4306371
SocialGolfers/ SocialGolfers-6-6-8-cp_c18.xml	? (NS)	5.74958	5.75023	4306372
SocialGolfers/ SocialGolfers-6-6-9-cp_c18.xml	? (NS)	8.39927	8.40982	4306373
Bibd/ Bibd-sum-34-085-30-12-10_c18.xml	? (NS)	104.006	104.031	4306256
Bibd/ Bibd-sc-34-085-30-12-10_c18.xml	? (NS)	166.715	166.782	4306250

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Langford/ LangfordBin-15_c18.xml	? (TO)	2519.74	2520.01	4306295
Crossword/ Crossword-m18-ogd2008-vg-15-16_c18.xml	? (TO)	2519.78	2520.01	4306434
MagicHexagon/ MagicHexagon-06-m001_c18.xml	? (TO)	2519.8	2520.01	4306315
PseudoBoolean-dec/ Pb-robin16_c18.xml	? (TO)	2519.81	2520.01	4306457
Eternity/ Eternity-11-11_c18.xml	? (TO)	2519.83	2520.01	4306330
Eternity/ Eternity-12-12_c18.xml	? (TO)	2519.83	2520.01	4306331
ColouredQueens/ ColouredQueens-10_c18.xml	? (TO)	2519.84	2520	4306279
GracefulGraph/ GracefulGraph-K06-P02_c18.xml	? (TO)	2519.84	2520.01	4306342
ColouredQueens/ ColouredQueens-16_c18.xml	? (TO)	2519.84	2520	4306285
Langford/ LangfordBin-11_c18.xml	? (TO)	2519.84	2520.01	4306291
PseudoBoolean-dec/ Pb-chnl30-31_c18.xml	? (TO)	2519.84	2520.01	4306449
PseudoBoolean-dec/ Pb-fpga45-45-sat_c18.xml	? (TO)	2519.85	2520	4306452
PseudoBoolean-dec/ Pb-robin12_c18.xml	? (TO)	2519.86	2520.01	4306455
Crossword/ Crossword-m18-ogd2008-vg-13-14_c18.xml	? (TO)	2519.88	2520.01	4306432
Eternity/ Eternity-10-06_c18.xml	? (TO)	2519.89	2520.01	4306328
Quasigroups/ QuasiGroup-4-14_c18.xml	? (TO)	2519.89	2520.01	4306351
Crossword/ Crossword-m18-ogd2008-vg-12-13_c18.xml	? (TO)	2519.91	2520.01	4306431
Subisomorphism/ Subisomorphism-g29-g50_c18.xml	? (TO)	2519.91	2520.01	4306405
Quasigroups/ QuasiGroup-7-20_c18.xml	? (TO)	2519.94	2520.01	4306361
PseudoBoolean-dec/ Pb-chnl50-51_c18.xml	? (TO)	2519.95	2520.01	4306450
ColouredQueens/ ColouredQueens-12_c18.xml	? (TO)	2519.95	2520.01	4306281
Quasigroups/ QuasiGroup-4-12_c18.xml	? (TO)	2519.95	2520.01	4306350
PseudoBoolean-dec/ Pb-robin18_c18.xml	? (TO)	2519.95	2520.01	4306458
Subisomorphism/ Subisomorphism-g19-g45_c18.xml	? (TO)	2519.95	2520.01	4306404
Crossword/ Crossword-m18-ogd2008-vg-10-11_c18.xml	? (TO)	2519.96	2520.01	4306429
ColouredQueens/ ColouredQueens-11_c18.xml	? (TO)	2519.96	2520.01	4306280
GracefulGraph/ GracefulGraph-K07-P02_c18.xml	? (TO)	2519.96	2520.01	4306344
Langford/ LangfordBin-10_c18.xml	? (TO)	2519.96	2520.01	4306290
Haystacks/ Haystacks-ext-13_c18.xml	? (TO)	2519.96	2520	4306445
Crossword/ Crossword-m18-ogd2008-vg-08-09_c18.xml	? (TO)	2519.96	2520.01	4306427
Quasigroups/ QuasiGroup-4-20_c18.xml	? (TO)	2519.96	2520.01	4306353
Eternity/ Eternity-14-14_c18.xml	? (TO)	2519.96	2520	4306333
Langford/ LangfordBin-12_c18.xml	? (TO)	2519.97	2520	4306292
PseudoBoolean-dec/ Pb-chnl10-11_c18.xml	? (TO)	2519.97	2520.01	4306446
Eternity/ Eternity-15-15_c18.xml	? (TO)	2519.97	2520.01	4306334
Langford/ LangfordBin-16_c18.xml	? (TO)	2519.97	2520.01	4306296
PseudoBoolean-dec/ Pb-chnl20-21_c18.xml	? (TO)	2519.97	2520.01	4306448
MagicHexagon/ MagicHexagon-07-0002_c18.xml	? (TO)	2519.97	2520.01	4306316
ColouredQueens/ ColouredQueens-08_c18.xml	? (TO)	2519.98	2520.01	4306277
Quasigroups/ QuasiGroup-4-16_c18.xml	? (TO)	2519.98	2520.01	4306352
MagicHexagon/ MagicHexagon-08-m009_c18.xml	? (TO)	2519.98	2520.01	4306319
GracefulGraph/ GracefulGraph-K05-P03_c18.xml	? (TO)	2519.98	2520.01	4306341
GracefulGraph/ GracefulGraph-K07-P03_c18.xml	? (TO)	2519.99	2520.01	4306345
MagicHexagon/ MagicHexagon-05-0006_c18.xml	? (TO)	2519.99	2520.01	4306312
Eternity/ Eternity-08-08_c18.xml	? (TO)	2519.99	2520.01	4306324
MagicHexagon/ MagicHexagon-08-0006_c18.xml	? (TO)	2519.99	2520.01	4306318
Eternity/ Eternity-10-10_c18.xml	? (TO)	2520	2520.01	4306329
Frb/ frb-59-26-1-mgd_c18.xml	? (TO)	2520	2520.01	4306420
Frb/ frb-50-23-1-mgd_c18.xml	? (TO)	2520	2520.01	4306411
Frb/ frb-53-24-3-mgd_c18.xml	? (TO)	2520.01	2520.01	4306416
Frb/ frb-59-26-2-mgd_c18.xml	? (TO)	2520.01	2519.9	4306421
Frb/ frb-56-25-3-mgd_c18.xml	? (TO)	2520.01	2520.01	4306419
Frb/ frb-56-25-1-mgd_c18.xml	? (TO)	2520.02	2519.9	4306417
Quasigroups/ QuasiGroup-7-16_c18.xml	? (TO)	2520.03	2519.9	4306360
Frb/ frb-50-23-3-mgd_c18.xml	? (TO)	2520.03	2519.9	4306413
Frb/ frb-50-23-2-mgd_c18.xml	? (TO)	2520.03	2519.9	4306412
Crossword/ Crossword-m18-ogd2008-vg-11-12_c18.xml	? (TO)	2520.04	2520.01	4306430
Eternity/ Eternity-09-09_c18.xml	? (TO)	2520.04	2520.01	4306325
Crossword/ Crossword-m18-ogd2008-vg-14-15_c18.xml	? (TO)	2520.04	2520.01	4306433
Eternity/ Eternity-13-13_c18.xml	? (TO)	2520.04	2520	4306332
MagicHexagon/ MagicHexagon-05-m003_c18.xml	? (TO)	2520.04	2519.9	4306313
Frb/ frb-53-24-2-mgd_c18.xml	? (TO)	2520.04	2519.9	4306415
Frb/ frb-53-24-1-mgd_c18.xml	? (TO)	2520.05	2519.9	4306414
Frb/ frb-56-25-2-mgd_c18.xml	? (TO)	2520.06	2520.01	4306418
MagicHexagon/ MagicHexagon-06-0010_c18.xml	? (TO)	2520.06	2519.9	4306314
Frb/ frb-59-26-3-mgd_c18.xml	? (TO)	2520.06	2519.9	4306422
Subisomorphism/ Subisomorphism-g19-g43_c18.xml	? (TO)	2520.07	2520.01	4306403
PseudoBoolean-dec/ Pb-robin14_c18.xml	? (TO)	2520.07	2520.01	4306456
Crossword/ Crossword-m18-ogd2008-vg-09-10_c18.xml	? (TO)	2520.08	2520.01	4306428
PseudoBoolean-dec/ Pb-fpga25-25-sat_c18.xml	? (TO)	2520.08	2520.01	4306451
MagicHexagon/ MagicHexagon-07-m011_c18.xml	? (TO)	2520.11	2520.01	4306317

2018 XCSP3 competition: sequential solvers tracks: benchmarks results per solver

Result page for solver BTD 2018.07.27_3 (complete)

Category "decision problem" (CSP)

Solver proved unsatisfiability (UNSATISFIABLE) (45 runs) [Show/Hide]

Solver found a solution (SATISFIABLE) for a SAT/UNSAT instance (31 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (16 runs) [Show/Hide]

Solver does not handle one of the constraint (73 runs) [Show/Hide]

Solver timed out (no solution given) (71 runs) [Show/Hide]