2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-4-30-2.xml	UNSAT		93.5668	89.2246	4406373

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
PseudoBoolean/PseudoBoolean-opt-bgr/ Pb-bgr-04.xml	OPT	6	1.08393	0.548478	4406342
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P347-Q487.xml	OPT	347	1.36162	0.643339	4406322
PseudoBoolean/PseudoBoolean-opt-factor/ Pb-factor-S9-P211-Q347.xml	OPT	211	1.55382	0.703026	4406332
Fastfood/Fastfood-m1-s1/ Fastfood-ff82.xml	OPT	7	1.9544	0.799399	4406333
Tpp/Tpp-zinc-s1/ Tpp-4-3-20-1.xml	OPT	126	2.05353	0.821063	4406459
Fastfood/Fastfood-m1-s1/ Fastfood-ff34.xml	OPT	2	2.29145	0.948554	4406343
Tpp/Tpp-zinc-s1/ Tpp-5-3-20-1.xml	OPT	141	2.54491	0.979999	4406462
StillLife/StillLife-m1-s1/ StillLife-04-09.xml	OPT	20	2.70782	1.07251	4406323
Opd/Opd-sum-small/ Opd-10-037-014.xml	OPT	5	2.75092	1.27892	4406407
Tpp/Tpp-zinc-s1/ Tpp-6-3-20-1.xml	OPT	131	2.7699	1.05835	4406465
Tpp/Tpp-zinc-s1/ Tpp-3-5-30-1.xml	OPT	171	2.78751	1.06395	4406441
PseudoBoolean/PseudoBoolean-opt-routing/ Pb-routing-s3-3-3-5.xml	OPT	34	2.89414	1.1807	4406346
Tpp/Tpp-zinc-s1/ Tpp-4-5-20-1.xml	OPT	115	3.17038	1.20416	4406370
Tpp/Tpp-zinc-s1/ Tpp-6-3-30-1.xml	OPT	164	3.45507	1.24996	4406431
Tpp/Tpp-zinc-s1/ Tpp-7-3-20-1.xml	OPT	125	3.52772	1.87352	4406386
Tpp/Tpp-zinc-s1/ Tpp-6-5-20-1.xml	OPT	102	3.54092	1.32782	4406393
Opd/Opd-sum-large/ Opd-16-035-010.xml	OPT	3	3.67757	1.81188	4406389
Opd/Opd-sum-small/ Opd-10-031-009.xml	OPT	2	3.78622	1.9297	4406525
StillLife/StillLife-m1-s1/ StillLife-05-09.xml	OPT	26	3.84833	1.66408	4406345
Tpp/Tpp-zinc-s1/ Tpp-7-3-30-1.xml	OPT	147	3.89594	1.55476	4406469
Tpp/Tpp-zinc-s1/ Tpp-4-5-30-1.xml	OPT	140	3.89772	1.53598	4406425
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-jnh210.xml	OPT	88	3.9315	1.67422	4406336
Opd/Opd-sum-small/ Opd-11-011-005.xml	OPT	2	3.96388	1.82495	4406400
Tpp/Tpp-zinc-s1/ Tpp-7-5-20-1.xml	OPT	105	4.19648	1.56774	4406419
Opd/Opd-sum-small/ Opd-10-038-010.xml	OPT	2	4.37498	1.97245	4406437
Opd/Opd-sum-large/ Opd-03-350-100.xml	OPT	0	4.63208	2.12399	4406451
StillLife/StillLife-m1-s1/ StillLife-03-14.xml	OPT	22	4.78559	1.92928	4406334
Opd/Opd-sum-small/ Opd-09-024-008.xml	OPT	2	4.89511	2.416	4406456
Tpp/Tpp-zinc-s1/ Tpp-5-5-30-1.xml	OPT	165	4.91506	1.80736	4406436
GraphColoring/GraphColoring-m1-mono/ GraphColoring-ash608GPIA.xml	OPT	3	5.04785	2.03317	4406329
Tpp/Tpp-zinc-s1/ Tpp-6-5-30-1.xml	OPT	132	5.20864	2.02859	4406470
Tpp/Tpp-zinc-s1/ Tpp-7-5-30-1.xml	OPT	124	5.44595	2.14676	4406445
Opd/Opd-sum-large/ Opd-15-035-010.xml	OPT	3	6.16104	3.51781	4406413
GraphColoring/GraphColoring-m1-mono/ GraphColoring-will199GPIA.xml	OPT	6	6.59216	2.64181	4406330
Opd/Opd-sum-small/ Opd-10-015-006.xml	OPT	2	6.60088	4.21015	4406394
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-18-3-6-8.xml	OPT	32	7.10772	3.56253	4406380
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-3.xml	OPT	88	7.47359	4.51331	4406325
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05c.xml	OPT	4	8.23962	3.63961	4406404
Fastfood/Fastfood-m1-s1/ Fastfood-ff87.xml	OPT	307	8.70241	4.82938	4406324
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05d.xml	OPT	4	8.75828	3.57329	4406396
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-018.xml	OPT	25	10.0468	7.35872	4406350
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15a.xml	OPT	4948	10.3012	6.51385	4406461
Opd/Opd-sum-large/ Opd-04-350-100.xml	OPT	9	10.3495	6.74991	4406471
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-0.xml	OPT	54	12.0941	6.25465	4406518
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-30-15-1.xml	OPT	7	12.1362	6.63335	4406349
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbo-30-15-1.xml	OPT	7	13.1447	7.27173	4406335
PeacableArmies/ PeacableArmies-m2-07_c18.xml	OPT	7	13.523	10.146	4406468
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-20-4-5-8.xml	OPT	20	13.7083	9.46347	4406390
Fastfood/Fastfood-m1-s1/ Fastfood-ff65.xml	OPT	63	15.0145	10.2132	4406337
Mario/ Mario-zinc-s1/Mario-t-hard-1.xml	OPT	4783	16.1746	13.0485	4406472
Mario/ Mario-zinc-s1/Mario-t-hard-5.xml	OPT	4482	16.4329	13.335	4406453
StillLife/StillLife-m1-s1/ StillLife-04-14.xml	OPT	30	16.7855	13.6336	4406422
StillLife/StillLife-m1-s1/ StillLife-05-11.xml	OPT	32	17.0876	14.4621	4406427
Fastfood/Fastfood-m1-s1/ Fastfood-ff61.xml	OPT	152	17.6289	13.2612	4406347
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-0.xml	OPT	65	17.6591	13.5922	4406415
Mario/ Mario-zinc-s1/Mario-t-hard-2.xml	OPT	4850	17.9325	14.9057	4406442
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbp-15-15-1.xml	OPT	4	18.1364	13.6019	4406395
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbp-15-15-1.xml	OPT	4	18.703	13.7594	4406388
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-019.xml	OPT	29	19.3211	16.3576	4406433
Opd/Opd-sum-small/ Opd-15-015-004.xml	OPT	1	19.6112	17.0765	4406408
Rlfap/Rlfap-opt/ Rlfap-graph-10-opt_c18.xml	OPT	394	19.7799	12.0877	4406447
Fastfood/Fastfood-m1-s1/ Fastfood-ff62.xml	OPT	125	22.2114	17.5759	4406327
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-020.xml	OPT	26	23.2079	20.1676	4406403
Fastfood/Fastfood-m1-s1/ Fastfood-ff85.xml	OPT	566	23.5649	19.1085	4406344
Opd/Opd-sum-small/ Opd-10-032-009.xml	OPT	2	24.3303	20.6184	4406362
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-7.xml	OPT	56	25.4211	21.1733	4406513
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-8.xml	OPT	60	26.7654	23.135	4406341
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-5.xml	OPT	67	32.3513	28.5947	4406464
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-021.xml	OPT	26	32.4843	28.6358	4406397
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-15-1.xml	OPT	10	33.2354	27.4757	4406414
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-15-1.xml	OPT	10	33.4692	27.8433	4406438
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-2.xml	OPT	53	33.6249	29.6924	4406516
Fastfood/Fastfood-m1-s1/ Fastfood-ff60.xml	OPT	192	33.8615	28.7177	4406338
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr15c.xml	OPT	4752	34.0539	29.9277	4406410
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-0.xml	OPT	41	34.2796	29.9611	4406512
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-8.xml	OPT	63	35.9576	31.2954	4406359
PeacableArmies/ PeacableArmies-m1-07_c18.xml	OPT	7	37.9262	34.8429	4406443
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-4.xml	OPT	35	38.3375	34.0899	4406515
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-3.xml	OPT	80	40.9991	36.9068	4406357
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-6.xml	OPT	79	47.7083	43.2501	4406511
Fastfood/Fastfood-m1-s1/ Fastfood-ff59.xml	OPT	242	48.2269	43.3423	4406331
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-1.xml	OPT	89	50.4403	46.2553	4406517
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-par16-3.xml	OPT	1015	59.6859	55.9161	4406355
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-5.xml	OPT	57	62.0919	56.9119	4406369
QueenAttacking/QueenAttacking-m1-s1/ QueenAttacking-07.xml	OPT	0	63.996	57.8276	4406466
GolombRuler/ GolombRuler-a3v18-nodv-09_c18.xml	OPT	44	66.2047	62.6397	4406458
GolombRuler/ GolombRuler-a3v18-09_c18.xml	OPT	44	67.907	63.6236	4406409
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr18a.xml	OPT	5549	71.4873	67.2844	4406467
Fastfood/Fastfood-m1-s1/ Fastfood-ff76.xml	OPT	310	73.7358	69.4071	4406381
Tal/ Tal-03_c18.xml	OPT	96	75.1542	67.3538	4406429
StillLife/StillLife-m1-s1/ StillLife-05-12.xml	OPT	34	77.0728	74.6106	4406444
GraphColoring/GraphColoring-m1-mono/ GraphColoring-myciel5.xml	OPT	5	80.1446	77.3835	4406402
Tal/ Tal-05_c18.xml	OPT	16	80.3334	74.673	4406474
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-esc16e.xml	OPT	14	88.0732	84.5367	4406328
Warehouse/Warehouse-m1-s1/ Warehouse-cap081.xml	OPT	804126	93.9522	90.8987	4406448
Warehouse/Warehouse-m1-s1/ Warehouse-cap101.xml	OPT	804126	94.0261	90.4563	4406439
Fastfood/Fastfood-m1-s1/ Fastfood-ff73.xml	OPT	582	94.1698	89.6452	4406372
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-25-5-5-9.xml	OPT	65	98.4162	93.825	4406510
Mario/Mario-zinc-s1/ Mario-n-medium-3.xml	OPT	943	99.9501	94.8124	4406435
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-28-4-7-3.xml	OPT	77	100.565	96.1442	4406509
Mario/Mario-zinc-s1/ Mario-n-medium-5.xml	OPT	771	117.646	111.982	4406430
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-01.xml	OPT	1128	124.738	121.164	4406326
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-tai10a.xml	OPT	67514	127.895	124.153	4406501
Mario/Mario-zinc-s1/ Mario-n-medium-4.xml	OPT	832	133.532	126.69	4406428
StillLife/StillLife-m1-s1/ StillLife-04-15.xml	OPT	32	137.122	133.672	4406411
Vrp/Vrp-zinc-s1/ Vrp-P-n16-k8.xml	OPT	450	138.159	134.616	4406392
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-46-08.xml	OPT	75	148.244	141.231	4406487
PseudoBoolean/PseudoBoolean-opt-mps/ Pb-mps-v2-20-10-lseu.xml	OPT	1120	154.646	151.09	4406371
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-1.xml	OPT	2	163.587	160.378	4406503
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-scr15.xml	OPT	25570	170.158	165.721	4406399
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-pb-30-15-1.xml	OPT	14	171.898	165.782	4406522
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-pb-30-15-1.xml	OPT	14	173.808	168.233	4406615
PrizeCollecting/PrizeCollecting-jok-s1/ PrizeCollecting-24-4-6-6.xml	OPT	25	179.628	174.153	4406514
Knapsack/Knapsack-m1-s40/ Knapsack-40-150-08.xml	OPT	887	183.608	178.995	4406339
PizzaVoucher/ PizzaVoucher-12a_c18.xml	OPT	40	194.8	190.063	4406418
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-1.xml	OPT	262	200.337	191.932	4406348
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-chr22a.xml	OPT	3078	207.319	203.483	4406354
Mario/Mario-zinc-s1/ Mario-n-medium-2.xml	OPT	1053	208.192	203.895	4406527
Ramsey/Ramsey-int-s1/ Ramsey-int-13.xml	OPT	2	223.935	97.6456	4406446
GraphColoring/GraphColoring-m1-mono/ GraphColoring-david.xml	OPT	10	288.961	285.681	4406351
Fastfood/Fastfood-m1-s1/ Fastfood-ff50.xml	OPT	624	329.09	323.796	4406352
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-8.xml	OPT	353	389.109	381.535	4406405
GolombRuler/GolombRuler-a3-s1/ GolombRuler-10-a3.xml	OPT	55	390.818	386.369	4406452
StillLife/StillLife-m1-s1/ StillLife-07-10.xml	OPT	39	392.871	388.237	4406480
PseudoBoolean/PseudoBoolean-opt-marketSplit/ Pb-msplit-opt-4-30-3.xml	OPT	2	394.577	388.947	4406502
GolombRuler/GolombRuler-a4-s1/ GolombRuler-09-a4.xml	OPT	44	396.544	391.761	4406455
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-30-30-1.xml	OPT	3	400.05	392.749	4406523
NurseRostering/ NurseRostering-01_c18.xml	OPT	607	409.805	405.591	4406340
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4k.xml	OPT	3	415.07	410.414	4406544
Cutstock/Cutstock-zinc-s1/ Cutstock-t13-4.xml	OPT	48	420.518	415.738	4406457
StillLife/StillLife-m1-s1/ StillLife-05-14.xml	OPT	40	425.501	420.586	4406484
StillLife/StillLife-wst-s1/ StillLife-wastage-10.xml	OPT	54	427.12	420.321	4406363
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32b3.xml	OPT	331	431.514	427.016	4406507
GraphColoring/GraphColoring-m1-mono/ GraphColoring-2-fullins-5.xml	OPT	6	482.417	476.596	4406424
StillLife/StillLife-m1-s1/ StillLife-08-09.xml	OPT	40	541.253	536.215	4406479
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-9.xml	OPT	476	557.359	549.638	4406538
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-30-30-1.xml	OPT	3	557.518	551.113	4406519
StillLife/StillLife-m1-s1/ StillLife-05-15.xml	OPT	43	577.311	572.299	4406483
StillLife/StillLife-m1-s1/ StillLife-06-11.xml	OPT	34	591.966	586.865	4406482
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-ii32e3.xml	OPT	310	599.632	594.836	4406506
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbop-10-20-1.xml	OPT	5	684.23	678.361	4406520
GraphColoring/GraphColoring-m1-mono/ GraphColoring-4-insertions-3.xml	OPT	3	784.133	778.802	4406533
Fastfood/Fastfood-m1-s1/ Fastfood-ff18.xml	OPT	1143	789.058	783.778	4406364
OpenStacks/OpenStacks-m1c-s1/ OpenStacks-m1c-wbop-10-20-1.xml	OPT	5	804.555	797.693	4406524
PseudoBoolean/PseudoBoolean-opt-dimacs/ Pb-hanoi4.xml	OPT	718	827.902	822.689	4406508
Cutstock/Cutstock-zinc-s1/ Cutstock-t08-0.xml	OPT	579	853.878	847.692	4406539
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-00.xml	OPT	960	936.797	921.366	4406383
StillLife/StillLife-m1-s1/ StillLife-06-12.xml	OPT	38	951.217	944.298	4406481
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-5.xml	OPT	312	986.681	974.097	4406384
PseudoBoolean/PseudoBoolean-opt-logicSynthesis/ Pb-logic-m100-100-30-30-r.xml	OPT	5	1002.42	997.707	4406504
Fastfood/Fastfood-m1-s1/ Fastfood-ff21.xml	OPT	583	1018.76	1013.03	4406398
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-03.xml	OPT	1109	1110.68	1095.61	4406367
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-9.xml	OPT	326	1151.85	1137.54	4406423
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-09.xml	OPT	1241	1186.27	1169.56	4406530
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-11.xml	OPT	1049	1211.16	1192.78	4406356
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-06.xml	OPT	1079	1230.14	1212.54	4406375
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-05.xml	OPT	98	1275.76	1266.97	4406497
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-05.xml	OPT	1105	1286.38	1268.16	4406391
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-17.xml	OPT	992	1321.34	1302.55	4406358
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-16.xml	OPT	1429	1423.17	1405.06	4406365
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-6.xml	OPT	303	1459.33	1439.55	4406374
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-4.xml	OPT	326	1470.03	1451.39	4406406
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-07.xml	OPT	1070	1474.91	1455.96	4406366
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-04.xml	OPT	1289	1500.15	1480.63	4406377
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-3.xml	OPT	310	1526.56	1508.02	4406387
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-2.xml	OPT	102	1613.58	1607.81	4406420
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-14.xml	OPT	1121	1624.05	1605.55	4406528
GraphColoring/GraphColoring-m1-mono/ GraphColoring-5-fullins-4.xml	OPT	8	1665.45	1657.64	4406368
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-01.xml	OPT	103	1743.78	1737.49	4406493
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-11.xml	OPT	76	1763.32	1756.59	4406417
Ramsey/Ramsey-m1-s1/ Ramsey-13.xml	OPT	2	1848.86	1835.97	4406379
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-17.xml	OPT	85	1906.1	1899.63	4406376
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-02.xml	OPT	1003	2005.12	1983.17	4406531
GolombRuler/ GolombRuler-a3v18-10_c18.xml	OPT	55	2121.46	2114.23	4406416
GolombRuler/ GolombRuler-a3v18-nodv-10_c18.xml	OPT	55	2153.24	2145.86	4406385
Fastfood/Fastfood-m1-s1/ Fastfood-ff56.xml	OPT	1664	2211.25	2204.97	4406534
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-45-01.xml	OPT	82	2313.99	2306.59	4406494
Scheduling/Scheduling-os-taillard/ Taillard-os-05-05-0.xml	OPT	300	2339.56	2311.78	4406426

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
GraphColoring/GraphColoring-m1-mono/ GraphColoring-school1.xml	SAT (TO)	13	2400.02	2392.61	4406566
GolombRuler/GolombRuler-a3-s1/ GolombRuler-14-a3.xml	SAT (TO)	138	2400.03	2392.91	4406620
GraphColoring/GraphColoring-m1-fixed/ GraphColoring-qwhopt-o33-h381-bal-1.xml	SAT (TO)	33	2400.03	2390.42	4406581
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-kra30b.xml	SAT (TO)	47490	2400.03	2392.61	4406602
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-6.xml	SAT (TO)	89	2400.03	2394.52	4406537
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-02.xml	SAT (TO)	90	2400.04	2393.51	4406498
Rcpsp/Rcpsp-m1-j90/ Rcpsp-j90-06-08.xml	SAT (TO)	68	2400.04	2391.02	4406486
Ramsey/Ramsey-m1-s1/ Ramsey-14.xml	SAT (TO)	3	2400.04	2389.03	4406449
GraphColoring/GraphColoring-m1-mono/ GraphColoring-zeroin-i-1.xml	SAT (TO)	48	2400.04	2375.63	4406619
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-41-06.xml	SAT (TO)	114	2400.04	2391.81	4406500
Ramsey/Ramsey-m1-s1/ Ramsey-45.xml	SAT (TO)	5	2400.04	2389.92	4406578
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-11.xml	SAT (TO)	119	2400.04	2393.61	4406573
Vrp/Vrp-zinc-s1/ Vrp-P-n40-k5.xml	SAT (TO)	514	2400.04	2385.91	4406583
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-031.xml	SAT (TO)	71	2400.04	2392.32	4406621
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-03.xml	SAT (TO)	148	2400.04	2391.02	4406488
TravellingSalesman/TravellingSalesman-m1-n35/ TravellingSalesman-35-30-07.xml	SAT (TO)	168	2400.04	2392.62	4406577
OpenStacks/ OpenStacks-m1-s1/OpenStacks-m1-gp-050-1.xml	SAT (TO)	45	2400.04	2389.81	4406440
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4n.xml	SAT (TO)	3	2400.05	2389.02	4406542
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n1c1w4m.xml	SAT (TO)	2	2400.05	2389.03	4406543
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-090.xml	SAT (TO)	989	2400.05	2392.51	4406549
Rlfap/Rlfap-opt/ Rlfap-graph-08-opt_c18.xml	SAT (TO)	22	2400.05	2388.31	4406608
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-41-06.xml	SAT (TO)	107	2400.05	2392.61	4406495
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-08.xml	SAT (TO)	505	2400.05	2393.02	4406579
Auction/Auction-sum/ Auction-sum-decay300_c18.xml	SAT (TO)	2106819	2400.05	2354.72	4406582
Opd/Opd-sum-small/ Opd-19-020-009.xml	SAT (TO)	5	2400.05	2392.32	4406584
TravellingSalesman/TravellingSalesman-m1-n25/ TravellingSalesman-25-30-03.xml	SAT (TO)	130	2400.05	2393.71	4406601
GolombRuler/ GolombRuler-a3v18-13_c18.xml	SAT (TO)	115	2400.05	2392.31	4406618
Cutstock/Cutstock-zinc-s1/ Cutstock-t14-9.xml	SAT (TO)	787	2400.05	2392.71	4406535
OpenStacks/OpenStacks-m1-s1/ OpenStacks-m1-wbo-15-30-1.xml	SAT (TO)	4	2400.06	2393.21	4406521
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-078.xml	SAT (TO)	659	2400.06	2393.12	4406616
Opd/Opd-sum-small/ Opd-10-030-009.xml	SAT (TO)	3	2400.06	2387.15	4406526
Rlfap/Rlfap-opt/ Rlfap-graph-05-opt_c18.xml	SAT (TO)	11031	2400.06	2391.41	4406551
Scheduling/Scheduling-os-taillard/ Taillard-os-10-10-6.xml	SAT (TO)	643	2400.06	2382.42	4406592
Rlfap/Rlfap-opt/ Rlfap-scen-09-opt_c18.xml	SAT (TO)	18575	2400.06	2387.63	4406600
GolombRuler/ GolombRuler-a3v18-11_c18.xml	SAT (TO)	74	2400.07	2391.71	4406610
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-086.xml	SAT (TO)	999	2400.07	2392.32	4406593
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-00.xml	SAT (TO)	93	2400.07	2390.43	4406478
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-12.xml	SAT (TO)	105	2400.07	2389.41	4406476
GolombRuler/GolombRuler-a4-s1/ GolombRuler-11-a4.xml	SAT (TO)	74	2400.07	2391.71	4406603
Cutstock/Cutstock-zinc-s1/ Cutstock-t03-4.xml	SAT (TO)	19	2400.07	2394.41	4406572
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-1.xml	SAT (TO)	148	2400.07	2393.51	4406463
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-053.xml	SAT (TO)	318	2400.07	2394.41	4406568
TravellingSalesman/TravellingSalesman-m1-n150/ TravellingSalesman-150-50-13.xml	SAT (TO)	999	2400.08	2390.91	4406574
GraphColoring/GraphColoring-m1-mono/ GraphColoring-homer.xml	SAT (TO)	12	2400.08	2384.62	4406401
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-10.xml	SAT (TO)	104	2400.08	2391.92	4406477
Knapsack/Knapsack-m1-s50/ Knapsack-50-200-13.xml	SAT (TO)	1427	2400.08	2376.31	4406529
TravellingSalesman/TravellingSalesman-m1-n100/ TravellingSalesman-100-50-02.xml	SAT (TO)	469	2400.08	2393.82	4406562
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-088.xml	SAT (TO)	812	2400.08	2392.41	4406605
Rcpsp/Rcpsp-m1-j120/ Rcpsp-j120-43-06.xml	SAT (TO)	98	2400.08	2393.21	4406499
SteelMillSlab/ SteelMillSlab-bench_9_11.xml	SAT (TO)	382	2400.08	2388.74	4406590
QuadraticAssignment/QuadraticAssignment-m1-s1/ QuadraticAssignment-lipa50a.xml	SAT (TO)	31118	2400.08	2391.71	4406597
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-08-10.xml	SAT (TO)	3	2400.08	2390.83	4406540
Cutstock/Cutstock-zinc-s1/ Cutstock-t09-7.xml	SAT (TO)	161	2400.08	2394.02	4406536
Fapp/Fapp-m2s/ Fapp-m2s-17-0300_c18.xml	SAT (TO)	360841782	2400.08	2378.54	4406434
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-19.xml	SAT (TO)	140	2400.08	2393.61	4406576
ChessboardColoration/ChessboardColoration-int-s1/ ChessboardColoration-int-09-09.xml	SAT (TO)	3	2400.08	2391.83	4406432
BusScheduling/BusScheduling-cnt-s1/ BusScheduling-cnt-r2.xml	SAT (TO)	16	2400.09	2390.03	4406557
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-05.xml	SAT (TO)	89	2400.09	2392.22	4406492
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-072.xml	SAT (TO)	636	2400.09	2393.41	4406612
SteelMillSlab/ SteelMillSlab-bench_5_11.xml	SAT (TO)	432	2400.09	2389.63	4406595
ChessboardColoration/ChessboardColoration-m1-s2/ ChessboardColoration-08-10.xml	SAT (TO)	3	2400.09	2386.16	4406460
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-37-01.xml	SAT (TO)	98	2400.09	2392.21	4406489
StillLife/StillLife-m1-s1/ StillLife-10-14.xml	SAT (TO)	72	2400.09	2385.82	4406554
OpenStacks/ OpenStacks-m1c-s1/OpenStacks-m1c-gp-050-1.xml	SAT (TO)	45	2400.1	2390.03	4406421
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-26-09.xml	SAT (TO)	66	2400.1	2391.71	4406490
Bacp/Bacp-m2/ Bacp-m2-12b_c18.xml	SAT (TO)	18	2400.1	2389.02	4406563
Rcpsp/Rcpsp-m1-j60/ Rcpsp-j60-21-07.xml	SAT (TO)	104	2400.1	2391.41	4406491
Rcpsp/Rcpsp-m1-j30/ Rcpsp-j30-29-07.xml	SAT (TO)	76	2400.1	2392.31	4406496
TravellingSalesman/TravellingSalesman-m1-n30/ TravellingSalesman-30-30-00.xml	SAT (TO)	126	2400.1	2393.12	4406609
SteelMillSlab/ SteelMillSlab-bench_10_9.xml	SAT (TO)	142	2400.11	2389.84	4406586
LowAutocorrelation/LowAutocorrelation-m1-s1/ LowAutocorrelation-033.xml	SAT (TO)	92	2400.11	2393.72	4406567
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-25a.xml	SAT (TO)	24	2400.11	2387.22	4406606
Vrp/Vrp-zinc-s1/ Vrp-A-n38-k5.xml	SAT (TO)	770	2400.11	2383.23	4406591
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-14.xml	SAT (TO)	91	2400.11	2390.32	4406475
Cutstock/Cutstock-zinc-s1/ Cutstock-t15-0.xml	SAT (TO)	130	2400.11	2392.52	4406454
Fapp/Fapp-m2s/ Fapp-m2s-18-0350_c18.xml	SAT (TO)	223939309	2400.11	2379.74	4406382
GraphColoring/GraphColoring-m1-mono/ GraphColoring-lei450-05b.xml	SAT (TO)	7	2400.11	2390.92	4406532
Scheduling/Scheduling-os-taillard/ Taillard-os-07-07-8.xml	SAT (TO)	464	2400.12	2373.42	4406485
Fapp/Fapp-m2s/ Fapp-m2s-21-0500_c18.xml	SAT (TO)	176050071	2400.12	2381.05	4406353
SteelMillSlab/ SteelMillSlab-bench_11_1.xml	SAT (TO)	260	2400.12	2389.04	4406546
SteelMillSlab/ SteelMillSlab-bench_15_2.xml	SAT (TO)	132	2400.13	2389.73	4406565
Auction/Auction-sum/ Auction-sum-matching040_c18.xml	SAT (TO)	12968875	2400.13	2378.94	4406571
Fapp/Fapp-ext/ Fapp-ext-05-0350_c18.xml	SAT (TO)	521763735	2400.14	2266.16	4406547
Fapp/Fapp-m2s/ Fapp-m2s-20-0420_c18.xml	SAT (TO)	558946160	2400.14	2375.63	4406412
ChessboardColoration/ChessboardColoration-m1-s1/ ChessboardColoration-09-09.xml	SAT (TO)	3	2400.15	2385.84	4406450
SteelMillSlab/ SteelMillSlab-bench_17_11.xml	SAT (TO)	25	2400.17	2389.26	4406585
TravellingSalesman/TravellingSalesman-m1-n15/ TravellingSalesman-15-30-04.xml	SAT (TO)	116	2400.19	2388.64	4406378
SteelMillSlab/ SteelMillSlab-bench_19_19.xml	SAT (TO)	31	2400.19	2389.06	4406588

Benchmark Name	Answer	objective function	CPU time	Wall clock time	TraceID
BinPacking/BinPacking-tab-sw120/ BinPacking-tab-sw120-75.xml	?		122.009	47.2182	4406555
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-05-07.xml	?		323.207	129.521	4406360

Benchmark Name	Answer	CPU time	Wall clock time	TraceID
Opd/Opd-sum-large/ Opd-09-350-100.xml	? (TO)	2400.02	2394.41	4406598
NurseRostering/ NurseRostering-18_c18.xml	? (TO)	2400.03	2389.03	4406604
Cutstock/Cutstock-zinc-s1/ Cutstock-t10-4.xml	? (TO)	2400.03	2393.12	4406614
Scheduling/Scheduling-fs-taillard/ Taillard-fs-200-10-1.xml	? (TO)	2400.03	2388.41	4406545
SteelMillSlab/ SteelMillSlab-bench_13_6.xml	? (TO)	2400.04	2390.92	4406575
SteelMillSlab/ SteelMillSlab-bench_14_1.xml	? (TO)	2400.04	2391.32	4406569
GolombRuler/GolombRuler-a3-s1/ GolombRuler-28-a3.xml	? (TO)	2400.05	2394.81	4406607
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n3c3w2d.xml	? (TO)	2400.05	2396.12	4406559
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu1000-02.xml	? (TO)	2400.05	2388.23	4406556
PseudoBoolean/ PseudoBoolean-opt-fx/Pb-fx84.xml	? (TO)	2400.05	2394.42	4406505
SteelMillSlab/ SteelMillSlab-bench_3_12.xml	? (TO)	2400.05	2390.42	4406580
SteelMillSlab/ SteelMillSlab-bench_16_2.xml	? (TO)	2400.05	2391.32	4406570
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n4c1w2b.xml	? (TO)	2400.06	2393.91	4406548
SteelMillSlab/ SteelMillSlab-bench_20_8.xml	? (TO)	2400.06	2391.03	4406587
Scheduling/Scheduling-js-taillard/ Taillard-js-050-15-1.xml	? (TO)	2400.07	2391.52	4406564
BinPacking/BinPacking-sum-skj1/ BinPacking-sum-n2c3w1r.xml	? (TO)	2400.08	2395.21	4406560
SteelMillSlab/ SteelMillSlab-bench_9_13.xml	? (TO)	2400.08	2390.22	4406589
Scheduling/Scheduling-js-taillard/ Taillard-js-030-15-2.xml	? (TO)	2400.09	2391.12	4406613
BinPacking/ BinPacking-mdd-fu/BinPacking-mdd-fu0120-05.xml	? (TO)	2400.09	2388.81	4406552
Scheduling/Scheduling-os-taillard/ Taillard-os-15-15-5.xml	? (TO)	2400.09	2390.13	4406599
BinPacking/ BinPacking-tab-fu/BinPacking-tab-fu0120-04.xml	? (TO)	2400.09	2391.03	4406550
BinPacking/BinPacking-sum-sw100/ BinPacking-sum-sw100-01.xml	? (TO)	2400.1	2393.91	4406553
BinPacking/BinPacking-sum-s28/ BinPacking-sum-s28-195.xml	? (TO)	2400.1	2395.81	4406561
ChessboardColoration/ChessboardColoration-int-s2/ ChessboardColoration-int-11-13.xml	? (TO)	2400.1	2390.54	4406617
TemplateDesign/ TemplateDesign-m2-herbs_c18.xml	? (TO)	2400.1	2393.12	4406473
SteelMillSlab/ SteelMillSlab-bench_12_14.xml	? (TO)	2400.1	2389.82	4406596
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n2w4b2r1.xml	? (TO)	2400.11	2395.12	4406558
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w4b1r5.xml	? (TO)	2400.11	2379.44	4406541
BinPacking/BinPacking-sum-skj2/ BinPacking-sum-n1w1b1r5.xml	? (TO)	2400.11	2389.14	4406361
SteelMillSlab/ SteelMillSlab-bench_13_19.xml	? (TO)	2400.12	2391.03	4406594
Scheduling/Scheduling-js-taillard/ Taillard-js-100-20-6.xml	? (TO)	2400.12	2389.02	4406611

2019 XCSP3 competition: fast COP track (sequential and parallel solvers): benchmarks results per solver

Result page for solver choco-solver 2019-09-24 (complete)

Category "optimization problem" (COP)

Solver proved unsatisfiability (UNSATISFIABLE) (1 run) [Show/Hide]

Solver found optimum (OPTIMUM FOUND) (178 runs) [Show/Hide]

Solver timed out but found at least a solution (88 runs) [Show/Hide]

Solver didn't decide (UNKNOWN) (2 runs) [Show/Hide]

Solver timed out (no solution given) (31 runs) [Show/Hide]