CSP 2008 Competition: results by benchmark

Results by benchmark for category global constraints (GLOBAL), subcategory problems with patterns

This page displays the results of the different solvers for each benchmark for category global constraints (GLOBAL), subcategory problems with patterns

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
cpHydra k_10
cpHydra k_40
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-13_glb.xml	SAT TT=0.011	SAT TT=0.795 CHECKS=605 NODES=473	SAT TT=0.985 CHECKS=104 NODES=124	SAT TT=0.044	SAT TT=0.015 CHECKS=1084	SAT TT=0.012 CHECKS=1270	SAT TT=0.566 ASSIGNMENTS=4	SAT TT=0.515 ASSIGNMENTS=4	SAT TT=0.023 ASSIGNMENTS=29 CHECKS=3051	SAT TT=0.023 ASSIGNMENTS=29 CHECKS=3051	SAT TT=0.011 ASSIGNMENTS=39 CHECKS=3739	SAT TT=0.16 ASSIGNMENTS=4003 CHECKS=297875	SAT TT=0.368	SAT TT=0.02 ASSIGNMENTS=240 CHECKS=14646	SAT TT=0.016 ASSIGNMENTS=97 CHECKS=12613	SAT TT=1.181	SAT TT=1.134	SAT TT=1.102
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-31_glb.xml	SAT TT=0.022	SAT TT=0.866 CHECKS=350 NODES=448	SAT TT=0.807 CHECKS=103 NODES=181	SAT TT=0.051	SAT TT=0.046 CHECKS=15542	SAT TT=0.024 CHECKS=4648	SAT TT=0.708 ASSIGNMENTS=11	SAT TT=0.738 ASSIGNMENTS=9	SAT TT=0.045 ASSIGNMENTS=412 CHECKS=42094	SAT TT=0.045 ASSIGNMENTS=412 CHECKS=42094	SAT TT=0.022 ASSIGNMENTS=227 CHECKS=24344	SAT TT=0.045 ASSIGNMENTS=941 CHECKS=67526	SAT TT=0.407	SAT TT=0.029 ASSIGNMENTS=396 CHECKS=29043	SAT TT=0.022 ASSIGNMENTS=233 CHECKS=23280	SAT TT=1.005	SAT TT=1.051	SAT TT=1.179
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-33_glb.xml	SAT TT=0.012	SAT TT=0.927 CHECKS=1309 NODES=751	SAT TT=0.941 CHECKS=1218 NODES=763	SAT TT=0.049	SAT TT=0.15 CHECKS=72043	SAT TT=0.173 CHECKS=86937	SAT TT=0.91 ASSIGNMENTS=7	SAT TT=0.853 ASSIGNMENTS=7	SAT TT=0.025 ASSIGNMENTS=66 CHECKS=5560	SAT TT=0.024 ASSIGNMENTS=66 CHECKS=5560	SAT TT=0.012 ASSIGNMENTS=55 CHECKS=5105	SAT TT=0.166 ASSIGNMENTS=4017 CHECKS=296163	SAT TT=0.432	SAT TT=0.041 ASSIGNMENTS=635 CHECKS=52962	SAT TT=0.035 ASSIGNMENTS=398 CHECKS=45862	SAT TT=1.282	SAT TT=1.264	SAT TT=1.073
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-63_glb.xml	SAT TT=0.026	SAT TT=0.842 CHECKS=1816 NODES=849	SAT TT=0.977 CHECKS=907 NODES=669	SAT TT=0.046	SAT TT=0.05 CHECKS=22866	SAT TT=0.051 CHECKS=22331	SAT TT=0.711 ASSIGNMENTS=4	SAT TT=0.691 ASSIGNMENTS=6	SAT TT=0.045 ASSIGNMENTS=417 CHECKS=52336	SAT TT=0.046 ASSIGNMENTS=417 CHECKS=52336	SAT TT=0.037 ASSIGNMENTS=494 CHECKS=58735	SAT TT=0.165 ASSIGNMENTS=4205 CHECKS=314230	SAT TT=0.37	SAT TT=0.026 ASSIGNMENTS=350 CHECKS=25978	SAT TT=0.039 ASSIGNMENTS=457 CHECKS=62340	SAT TT=1.12	SAT TT=1.136	SAT TT=1.158
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-67_glb.xml	SAT TT=0.015	SAT TT=0.831 CHECKS=1875 NODES=908	SAT TT=0.862 CHECKS=30 NODES=0	SAT TT=0.062	SAT TT=0.018 CHECKS=3678	SAT TT=0.015 CHECKS=1862	SAT TT=0.538 ASSIGNMENTS=2	SAT TT=0.545 ASSIGNMENTS=4	SAT TT=0.036 ASSIGNMENTS=225 CHECKS=30433	SAT TT=0.039 ASSIGNMENTS=225 CHECKS=30433	SAT TT=0.032 ASSIGNMENTS=313 CHECKS=48192	SAT TT=0.173 ASSIGNMENTS=3812 CHECKS=314521	SAT TT=0.367	SAT TT=0.023 ASSIGNMENTS=308 CHECKS=19180	SAT TT=0.028 ASSIGNMENTS=287 CHECKS=37196	SAT TT=1.068	SAT TT=1.135	SAT TT=1.174
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-75_glb.xml	SAT TT=0.013	SAT TT=0.794 CHECKS=831 NODES=611	SAT TT=0.794 CHECKS=30 NODES=109	SAT TT=0.049	SAT TT=0.041 CHECKS=13519	SAT TT=0.056 CHECKS=18452	SAT TT=0.857 ASSIGNMENTS=20	SAT TT=0.914 ASSIGNMENTS=7	SAT TT=0.024 ASSIGNMENTS=63 CHECKS=4047	SAT TT=0.021 ASSIGNMENTS=63 CHECKS=4047	SAT TT=0.013 ASSIGNMENTS=97 CHECKS=6552	SAT TT=0.054 ASSIGNMENTS=1380 CHECKS=83090	SAT TT=0.391	SAT TT=0.022 ASSIGNMENTS=345 CHECKS=15863	SAT TT=0.013 ASSIGNMENTS=50 CHECKS=5097	SAT TT=0.99	SAT TT=1.329	SAT TT=1.352
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-82_glb.xml	SAT TT=0.014	SAT TT=0.843 CHECKS=1451 NODES=754	SAT TT=0.805 CHECKS=281 NODES=283	SAT TT=0.047	SAT TT=0.02 CHECKS=3223	SAT TT=0.026 CHECKS=5864	SAT TT=0.751 ASSIGNMENTS=8	SAT TT=0.829 ASSIGNMENTS=14	SAT TT=0.026 ASSIGNMENTS=106 CHECKS=7593	SAT TT=0.025 ASSIGNMENTS=106 CHECKS=7593	SAT TT=0.015 ASSIGNMENTS=133 CHECKS=9470	SAT TT=0.014 ASSIGNMENTS=105 CHECKS=8546	SAT TT=0.384	SAT TT=0.039 ASSIGNMENTS=682 CHECKS=48368	SAT TT=0.023 ASSIGNMENTS=264 CHECKS=26101	SAT TT=1.04	SAT TT=1.09	SAT TT=1.082
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-83_glb.xml	SAT TT=0.047	SAT TT=0.824 CHECKS=949 NODES=599	SAT TT=0.946 CHECKS=1836 NODES=987	SAT TT=0.047	SAT TT=0.104 CHECKS=34417	SAT TT=0.072 CHECKS=25778	SAT TT=0.937 ASSIGNMENTS=12	SAT TT=0.778 ASSIGNMENTS=10	SAT TT=0.056 ASSIGNMENTS=586 CHECKS=69930	SAT TT=0.058 ASSIGNMENTS=586 CHECKS=69930	SAT TT=0.171 ASSIGNMENTS=2621 CHECKS=312912	SAT TT=0.191 ASSIGNMENTS=4210 CHECKS=363591	SAT TT=0.393	SAT TT=0.133 ASSIGNMENTS=1795 CHECKS=203463	SAT TT=0.078 ASSIGNMENTS=1015 CHECKS=135933	SAT TT=1.081	SAT TT=1.089	SAT TT=1.122
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-98_glb.xml	SAT TT=0.015	SAT TT=0.899 CHECKS=804 NODES=444	SAT TT=0.815 CHECKS=86 NODES=127	SAT TT=0.046	SAT TT=0.051 CHECKS=24996	SAT TT=0.057 CHECKS=26060	SAT TT=0.695 ASSIGNMENTS=5	SAT TT=0.661 ASSIGNMENTS=5	SAT TT=0.026 ASSIGNMENTS=98 CHECKS=10798	SAT TT=0.026 ASSIGNMENTS=98 CHECKS=10798	SAT TT=0.015 ASSIGNMENTS=86 CHECKS=8090	SAT TT=0.158 ASSIGNMENTS=4090 CHECKS=326420	SAT TT=0.348	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=16923	SAT TT=0.024 ASSIGNMENTS=353 CHECKS=34721	SAT TT=0.971	SAT TT=1.09	SAT TT=1.125
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-99_glb.xml	SAT TT=0.016	SAT TT=0.872 CHECKS=663 NODES=553	SAT TT=0.827 CHECKS=453 NODES=390	SAT TT=0.045	SAT TT=0.017 CHECKS=3084	SAT TT=0.021 CHECKS=3953	SAT TT=0.726 ASSIGNMENTS=12	SAT TT=0.827 ASSIGNMENTS=11	SAT TT=0.058 ASSIGNMENTS=589 CHECKS=71306	SAT TT=0.061 ASSIGNMENTS=589 CHECKS=71306	SAT TT=0.042 ASSIGNMENTS=619 CHECKS=61863	SAT TT=0.164 ASSIGNMENTS=4554 CHECKS=284551	SAT TT=0.37	SAT TT=0.032 ASSIGNMENTS=422 CHECKS=28156	SAT TT=0.016 ASSIGNMENTS=113 CHECKS=11789	SAT TT=0.979	SAT TT=1.096	SAT TT=1.093
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-0_glb.xml	SAT TT=0.032	SAT TT=1.125 CHECKS=8200 NODES=3370	SAT TT=0.963 CHECKS=1707 NODES=911	SAT TT=0.072	SAT TT=0.032 CHECKS=6410	SAT TT=0.109 CHECKS=32391	SAT TT=1.099 ASSIGNMENTS=51	SAT TT=1.114 ASSIGNMENTS=21	SAT TT=0.077 ASSIGNMENTS=729 CHECKS=94465	SAT TT=0.075 ASSIGNMENTS=729 CHECKS=94465	SAT TT=0.043 ASSIGNMENTS=540 CHECKS=58273	SAT TT=0.255 ASSIGNMENTS=5357 CHECKS=485477	SAT TT=0.456	SAT TT=0.042 ASSIGNMENTS=572 CHECKS=42287	SAT TT=0.334 ASSIGNMENTS=4125 CHECKS=610270	SAT TT=1.832	SAT TT=1.347	SAT TT=1.513
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-14_glb.xml	SAT TT=0.033	SAT TT=2.037 CHECKS=46818 NODES=14371	SAT TT=1.569 CHECKS=21560 NODES=7151	SAT TT=0.315	SAT TT=0.034 CHECKS=10457	SAT TT=0.033 CHECKS=9951	SAT TT=0.795 ASSIGNMENTS=3	SAT TT=0.796 ASSIGNMENTS=5	SAT TT=0.557 ASSIGNMENTS=6973 CHECKS=1000420	SAT TT=0.535 ASSIGNMENTS=6973 CHECKS=1000420	SAT TT=0.705 ASSIGNMENTS=10076 CHECKS=1433040	SAT TT=0.871 ASSIGNMENTS=14860 CHECKS=1850530	SAT TT=0.419	SAT TT=2.839 ASSIGNMENTS=33027 CHECKS=4457020	SAT TT=0.803 ASSIGNMENTS=10657 CHECKS=1666760	SAT TT=1.604	SAT TT=1.324	SAT TT=1.321
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-2_glb.xml	SAT TT=0.054	SAT TT=1.516 CHECKS=23233 NODES=8227	SAT TT=4.688 CHECKS=210427 NODES=50965	SAT TT=0.073	SAT TT=0.054 CHECKS=14796	SAT TT=0.161 CHECKS=50028	SAT TT=0.997 ASSIGNMENTS=21	SAT TT=1.096 ASSIGNMENTS=57	SAT TT=0.422 ASSIGNMENTS=5596 CHECKS=775727	SAT TT=0.431 ASSIGNMENTS=5596 CHECKS=775727	SAT TT=0.072 ASSIGNMENTS=1027 CHECKS=129429	SAT TT=0.97 ASSIGNMENTS=15796 CHECKS=1924050	SAT TT=0.451	SAT TT=47.082 ASSIGNMENTS=542471 CHECKS=73789300	SAT TT=0.412 ASSIGNMENTS=6621 CHECKS=854464	SAT TT=1.68	SAT TT=1.343	SAT TT=1.433
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-37_glb.xml	SAT TT=0.03	SAT TT=1.155 CHECKS=9137 NODES=3380	SAT TT=1.078 CHECKS=1291 NODES=824	SAT TT=0.204	SAT TT=0.131 CHECKS=69241	SAT TT=0.165 CHECKS=79226	SAT TT=0.985 ASSIGNMENTS=4	SAT TT=1.223 ASSIGNMENTS=3	SAT TT=0.227 ASSIGNMENTS=3055 CHECKS=396741	SAT TT=0.234 ASSIGNMENTS=3055 CHECKS=396741	SAT TT=0.091 ASSIGNMENTS=1053 CHECKS=147109	SAT TT=0.333 ASSIGNMENTS=6833 CHECKS=613945	SAT TT=0.468	SAT TT=0.932 ASSIGNMENTS=9362 CHECKS=1351360	SAT TT=0.03 ASSIGNMENTS=326 CHECKS=35440	SAT TT=1.63	SAT TT=1.311	SAT TT=1.419
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-40_glb.xml	SAT TT=0.032	SAT TT=1.052 CHECKS=5783 NODES=3281	SAT TT=0.96 CHECKS=1098 NODES=704	SAT TT=0.12	SAT TT=0.042 CHECKS=12005	SAT TT=0.046 CHECKS=12438	SAT TT=0.984 ASSIGNMENTS=50	SAT TT=0.978 ASSIGNMENTS=17	SAT TT=0.046 ASSIGNMENTS=452 CHECKS=42336	SAT TT=0.047 ASSIGNMENTS=452 CHECKS=42336	SAT TT=0.171 ASSIGNMENTS=2480 CHECKS=307072	SAT TT=0.387 ASSIGNMENTS=8952 CHECKS=772976	SAT TT=0.48	SAT TT=0.079 ASSIGNMENTS=1107 CHECKS=90985	SAT TT=0.032 ASSIGNMENTS=285 CHECKS=37150	SAT TT=1.797	SAT TT=1.214	SAT TT=1.602
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-47_glb.xml	SAT TT=0.06	SAT TT=2.802 CHECKS=100871 NODES=25432	SAT TT=1.597 CHECKS=36628 NODES=9699	SAT TT=0.783	SAT TT=0.073 CHECKS=25326	SAT TT=0.06 CHECKS=20080	SAT TT=1.089 ASSIGNMENTS=3	SAT TT=0.957 ASSIGNMENTS=3	SAT TT=8.541 ASSIGNMENTS=3	SAT TT=8.524 ASSIGNMENTS=3	SAT TT=2.935 ASSIGNMENTS=39543 CHECKS=5759730	SAT TT=1.779 ASSIGNMENTS=29320 CHECKS=3779510	SAT TT=0.445	SAT TT=1.082 ASSIGNMENTS=12425 CHECKS=1708670	SAT TT=1.493 ASSIGNMENTS=22097 CHECKS=3156010	SAT TT=1.722	SAT TT=1.233	SAT TT=1.476
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-64_glb.xml	SAT TT=0.034	SAT TT=0.811 CHECKS=577 NODES=421	SAT TT=1.834 CHECKS=31564 NODES=10411	SAT TT=0.351	SAT TT=0.051 CHECKS=14407	SAT TT=0.061 CHECKS=16291	SAT TT=0.935 ASSIGNMENTS=6	SAT TT=1.003 ASSIGNMENTS=11	SAT TT=0.07 ASSIGNMENTS=645 CHECKS=88705	SAT TT=0.072 ASSIGNMENTS=645 CHECKS=88705	SAT TT=0.034 ASSIGNMENTS=290 CHECKS=39106	SAT TT=0.208 ASSIGNMENTS=5575 CHECKS=410786	SAT TT=0.489	SAT TT=0.404 ASSIGNMENTS=5230 CHECKS=618761	SAT TT=2.73 ASSIGNMENTS=42387 CHECKS=5744570	SAT TT=1.819	SAT TT=1.477	SAT TT=1.457
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-65_glb.xml	SAT TT=0.021	SAT TT=0.834 CHECKS=483 NODES=395	SAT TT=1.34 CHECKS=8037 NODES=3198	SAT TT=0.125	SAT TT=0.022 CHECKS=4510	SAT TT=0.021 CHECKS=4259	SAT TT=0.605 ASSIGNMENTS=2	SAT TT=0.64 ASSIGNMENTS=2	SAT TT=0.464 ASSIGNMENTS=5236 CHECKS=861749	SAT TT=0.449 ASSIGNMENTS=5236 CHECKS=861749	SAT TT=0.338 ASSIGNMENTS=3910 CHECKS=649668	SAT TT=0.28 ASSIGNMENTS=5656 CHECKS=549370	SAT TT=0.406	SAT TT=0.453 ASSIGNMENTS=5252 CHECKS=734925	SAT TT=0.177 ASSIGNMENTS=2243 CHECKS=337703	SAT TT=1.39	SAT TT=1.423	SAT TT=1.249
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-89_glb.xml	SAT TT=0.03	SAT TT=0.92 CHECKS=1822 NODES=1168	SAT TT=1.012 CHECKS=425 NODES=369	SAT TT=0.534	SAT TT=0.184 CHECKS=68187	SAT TT=0.174 CHECKS=66523	SAT TT=1.075 ASSIGNMENTS=7	SAT TT=1.082 ASSIGNMENTS=11	SAT TT=0.03 ASSIGNMENTS=168 CHECKS=14460	SAT TT=0.032 ASSIGNMENTS=168 CHECKS=14460	SAT TT=0.039 ASSIGNMENTS=534 CHECKS=50005	SAT TT=0.229 ASSIGNMENTS=5783 CHECKS=456240	SAT TT=0.456	SAT TT=1.651 ASSIGNMENTS=23564 CHECKS=2666620	SAT TT=0.195 ASSIGNMENTS=3214 CHECKS=393093	SAT TT=1.486	SAT TT=1.347	SAT TT=1.329
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-91_glb.xml	SAT TT=0.146	SAT TT=2.734 CHECKS=86161 NODES=25073	SAT TT=1.521 CHECKS=19571 NODES=6672	SAT TT=0.188	SAT TT=0.146 CHECKS=72860	SAT TT=0.151 CHECKS=73186	SAT TT=0.941 ASSIGNMENTS=4	SAT TT=1.091 ASSIGNMENTS=7	SAT TT=0.305 ASSIGNMENTS=3730 CHECKS=553543	SAT TT=0.299 ASSIGNMENTS=3730 CHECKS=553543	SAT TT=0.25 ASSIGNMENTS=3243 CHECKS=476810	SAT TT=0.896 ASSIGNMENTS=13992 CHECKS=1781910	SAT TT=0.525	SAT TT=0.508 ASSIGNMENTS=5410 CHECKS=812856	SAT TT=0.186 ASSIGNMENTS=2697 CHECKS=376476	SAT TT=1.714	SAT TT=1.278	SAT TT=1.323
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/cjss/ normalized-ft06x2-54.xml	UNSAT TT=3.277	? TT=0.64	? TT=0.635	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=1139.59 CHECKS=426796000	? (TO) TT=1800.03	? (TO) TT=1800.11	UNSAT TT=632.041 ASSIGNMENTS=905883 CHECKS=1753910000	UNSAT TT=666.989 ASSIGNMENTS=905883 CHECKS=1753910000	UNSAT TT=456.612 ASSIGNMENTS=608537 CHECKS=1228740000	UNSAT TT=290.169 ASSIGNMENTS=419689 CHECKS=797346000	? (exit code) TT=0.262	UNSAT TT=911.449 ASSIGNMENTS=1158090 CHECKS=2193450000	UNSAT TT=672.608 ASSIGNMENTS=905883 CHECKS=1753910000	? TT=2.184	UNSAT TT=3.277	UNSAT TT=3.737
csp/cjss/ normalized-ft06x2-55.xml	SAT TT=2.567	? TT=0.629	? TT=0.632	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1751.04 CHECKS=644056000	SAT TT=262.589 ASSIGNMENTS=261438	? (TO) TT=1800.1	SAT TT=20.305 ASSIGNMENTS=20109 CHECKS=30608300	SAT TT=20.16 ASSIGNMENTS=20109 CHECKS=30608300	SAT TT=532.763 ASSIGNMENTS=661201 CHECKS=1520070000	SAT TT=43.993 ASSIGNMENTS=70949 CHECKS=122017000	? (exit code) TT=0.249	SAT TT=6.54 ASSIGNMENTS=8683 CHECKS=13029400	SAT TT=12.56 ASSIGNMENTS=20109 CHECKS=30608300	? TT=2.276	SAT TT=2.567	SAT TT=3.19
csp/cjss/ normalized-ft06x3-54.xml	UNSAT TT=112.238	? TT=0.695	? TT=0.721	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (exit code) TT=0.27	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=2.576	UNSAT TT=119.279	UNSAT TT=112.238
csp/cjss/ normalized-ft06x3-55.xml	SAT TT=3.2	? TT=0.674	? TT=0.716	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (exit code) TT=0.286	SAT TT=22.595 ASSIGNMENTS=125238 CHECKS=63478500	? (TO) TT=1800.05	? TT=2.413	SAT TT=3.2	SAT TT=4.154
csp/cjss/ normalized-ft10x2-837.xml		? TT=6.844	? TT=6.733	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? (exit code) TT=0.448	? (TO) TT=1800.15	? (TO) TT=1800.16	? TT=154.766	? (TO) TT=1800.06	? (TO) TT=1800.09
csp/cjss/ normalized-ft10x3-838.xml		? TT=7.55	? TT=7.018	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.14	? (TO) TT=1800.11	? (exit code) TT=0.378	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=196.677	? TT=361.4	? TT=360.371
csp/cjss/ normalized-la03x2-593.xml		? TT=2.927	? TT=2.463	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (exit code) TT=0.357	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=35.177	? (TO) TT=1800	? (TO) TT=1800.09
csp/cjss/ normalized-la03x3-590.xml		? TT=2.54	? TT=2.521	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (exit code) TT=0.3	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=50.704	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/cjss/ normalized-la04x2-572.xml		? TT=2.814	? TT=2.291	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (exit code) TT=0.407	? (TO) TT=1800.13	? (TO) TT=1800.12	? TT=35.263	? (TO) TT=1800.03	? (TO) TT=1800
csp/cjss/ normalized-la04x3-570.xml		? TT=2.35	? TT=2.91	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.09	? (exit code) TT=0.29	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=47.058	? (TO) TT=1800.02	? (TO) TT=1800.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpsp/ normalized-rcpsp20-02.xml	SAT TT=0.018	? TT=0.564	? TT=0.564	SAT TT=0.086	SAT TT=17.753 CHECKS=1728000	SAT TT=23.326 CHECKS=1896140	SAT TT=1.657 ASSIGNMENTS=552	SAT TT=1.893 ASSIGNMENTS=418	SAT TT=0.03 ASSIGNMENTS=33 CHECKS=12898	SAT TT=0.028 ASSIGNMENTS=33 CHECKS=12898	SAT TT=0.023 ASSIGNMENTS=47 CHECKS=22138	SAT TT=0.387 ASSIGNMENTS=2439 CHECKS=764119	? (exit code) TT=0.243	SAT TT=0.54 ASSIGNMENTS=1594 CHECKS=894739	SAT TT=0.018 ASSIGNMENTS=24 CHECKS=12850	? TT=1.544	SAT TT=1.035	SAT TT=1.139
csp/rcpsp/ normalized-rcpsp20-03.xml	SAT TT=0.014	? TT=0.607	? TT=0.577	SAT TT=0.112	SAT TT=44.222 CHECKS=5317180	SAT TT=55.307 CHECKS=6889230	SAT TT=2.505 ASSIGNMENTS=1618	SAT TT=1.868 ASSIGNMENTS=359	SAT TT=0.024 ASSIGNMENTS=10 CHECKS=5773	SAT TT=0.027 ASSIGNMENTS=10 CHECKS=5773	SAT TT=0.015 ASSIGNMENTS=10 CHECKS=5773	SAT TT=0.34 ASSIGNMENTS=1979 CHECKS=664822	? (exit code) TT=0.242	SAT TT=0.07 ASSIGNMENTS=244 CHECKS=94006	SAT TT=0.014 ASSIGNMENTS=10 CHECKS=5772	? TT=1.551	SAT TT=1.044	SAT TT=1.157
csp/rcpsp/ normalized-rcpsp20-04.xml	SAT TT=0.024	? TT=0.577	? TT=0.572	SAT TT=0.033	SAT TT=0.07 CHECKS=4805	SAT TT=0.077 CHECKS=5180	SAT TT=1.09 ASSIGNMENTS=15	SAT TT=1.101 ASSIGNMENTS=14	SAT TT=0.037 ASSIGNMENTS=58 CHECKS=23102	SAT TT=0.038 ASSIGNMENTS=58 CHECKS=23102	SAT TT=0.043 ASSIGNMENTS=96 CHECKS=50100	SAT TT=0.024 ASSIGNMENTS=60 CHECKS=21642	? (exit code) TT=0.25	SAT TT=0.027 ASSIGNMENTS=42 CHECKS=19265	SAT TT=0.027 ASSIGNMENTS=69 CHECKS=24516	? TT=1.544	SAT TT=1.234	SAT TT=1.182
csp/rcpsp/ normalized-rcpsp20-05.xml	UNSAT TT=1.781	? TT=0.658	? TT=0.587	UNSAT TT=42.675	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=431.253 ASSIGNMENTS=310330	UNSAT TT=86.768 ASSIGNMENTS=41130	UNSAT TT=60.215 ASSIGNMENTS=119552 CHECKS=121788000	UNSAT TT=60.298 ASSIGNMENTS=119552 CHECKS=121788000	UNSAT TT=12.551 ASSIGNMENTS=31165 CHECKS=28385600	UNSAT TT=12.95 ASSIGNMENTS=35053 CHECKS=29509700	? (exit code) TT=0.244	UNSAT TT=151.037 ASSIGNMENTS=363794 CHECKS=285065000	UNSAT TT=51.321 ASSIGNMENTS=119552 CHECKS=121788000	? TT=1.558	UNSAT TT=1.781	UNSAT TT=2.107
csp/rcpsp/ normalized-rcpsp20-06.xml	SAT TT=0.017	? TT=0.575	? TT=0.626	SAT TT=0.037	SAT TT=0.152 CHECKS=11569	SAT TT=0.15 CHECKS=10930	SAT TT=1.192 ASSIGNMENTS=13	SAT TT=1.228 ASSIGNMENTS=20	SAT TT=0.036 ASSIGNMENTS=49 CHECKS=24906	SAT TT=0.037 ASSIGNMENTS=49 CHECKS=24906	SAT TT=0.017 ASSIGNMENTS=19 CHECKS=9496	SAT TT=0.038 ASSIGNMENTS=203 CHECKS=59117	? (exit code) TT=0.237	SAT TT=0.035 ASSIGNMENTS=129 CHECKS=37879	SAT TT=0.054 ASSIGNMENTS=185 CHECKS=89356	? TT=1.568	SAT TT=0.978	SAT TT=1.057
csp/rcpsp/ normalized-rcpsp20-07.xml	SAT TT=1.214	? TT=0.59	? TT=0.576	SAT TT=53.797	SAT TT=1378.08 CHECKS=115648000	SAT TT=628.479 CHECKS=72095100	SAT TT=362.468 ASSIGNMENTS=355416	SAT TT=16.177 ASSIGNMENTS=8035	SAT TT=14.861 ASSIGNMENTS=19081 CHECKS=20231300	SAT TT=16.182 ASSIGNMENTS=19081 CHECKS=20231300	SAT TT=3.967 ASSIGNMENTS=10692 CHECKS=9147700	SAT TT=2.411 ASSIGNMENTS=9015 CHECKS=5440870	? (exit code) TT=0.256	SAT TT=19.988 ASSIGNMENTS=44093 CHECKS=38624600	SAT TT=8.27 ASSIGNMENTS=19081 CHECKS=20231300	? TT=1.484	SAT TT=1.221	SAT TT=1.214
csp/rcpsp/ normalized-rcpsp20-08.xml	SAT TT=0.039	? TT=0.663	? TT=0.57	SAT TT=0.156	SAT TT=40.418 CHECKS=6014840	SAT TT=51.637 CHECKS=7224470	SAT TT=432.165 ASSIGNMENTS=337207	SAT TT=1.644 ASSIGNMENTS=261	SAT TT=0.07 ASSIGNMENTS=197 CHECKS=92702	SAT TT=0.069 ASSIGNMENTS=197 CHECKS=92702	SAT TT=0.386 ASSIGNMENTS=1715 CHECKS=791008	SAT TT=0.039 ASSIGNMENTS=229 CHECKS=51341	? (exit code) TT=0.262	SAT TT=0.044 ASSIGNMENTS=124 CHECKS=43935	SAT TT=0.084 ASSIGNMENTS=398 CHECKS=154380	? TT=1.627	SAT TT=1.169	SAT TT=1.09
csp/rcpsp/ normalized-rcpsp20-09.xml	SAT TT=0.013	? TT=0.681	? TT=0.592	SAT TT=0.036	SAT TT=11.191 CHECKS=1317040	SAT TT=20.684 CHECKS=2340310	SAT TT=1.017 ASSIGNMENTS=14	SAT TT=0.994 ASSIGNMENTS=12	SAT TT=0.025 ASSIGNMENTS=15 CHECKS=4529	SAT TT=0.024 ASSIGNMENTS=15 CHECKS=4529	SAT TT=0.013 ASSIGNMENTS=15 CHECKS=4529	SAT TT=0.061 ASSIGNMENTS=435 CHECKS=96479	? (exit code) TT=0.241	SAT TT=0.106 ASSIGNMENTS=508 CHECKS=138283	SAT TT=0.015 ASSIGNMENTS=16 CHECKS=4626	? TT=1.487	SAT TT=1.136	SAT TT=0.991
csp/rcpsp/ normalized-rcpsp20-10.xml	SAT TT=0.016	? TT=0.623	? TT=0.589	SAT TT=0.043	SAT TT=57.809 CHECKS=5407500	SAT TT=38.002 CHECKS=3712770	SAT TT=1.187 ASSIGNMENTS=185	SAT TT=1.821 ASSIGNMENTS=339	SAT TT=0.044 ASSIGNMENTS=96 CHECKS=44033	SAT TT=0.046 ASSIGNMENTS=96 CHECKS=44033	SAT TT=0.016 ASSIGNMENTS=16 CHECKS=10619	SAT TT=0.08 ASSIGNMENTS=481 CHECKS=145266	? (exit code) TT=0.267	SAT TT=0.288 ASSIGNMENTS=1038 CHECKS=478768	SAT TT=0.182 ASSIGNMENTS=822 CHECKS=357629	? TT=1.485	SAT TT=0.935	SAT TT=1.046
csp/rcpsp/ normalized-rcpsp20-11.xml	SAT TT=0.014	? TT=0.578	? TT=0.571	SAT TT=0.031	SAT TT=0.362 CHECKS=43204	SAT TT=0.545 CHECKS=63747	SAT TT=1.042 ASSIGNMENTS=14	SAT TT=1.142 ASSIGNMENTS=11	SAT TT=0.026 ASSIGNMENTS=14 CHECKS=5460	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=5460	SAT TT=0.014 ASSIGNMENTS=14 CHECKS=5641	SAT TT=0.02 ASSIGNMENTS=91 CHECKS=17669	? (exit code) TT=0.234	SAT TT=0.016 ASSIGNMENTS=32 CHECKS=5335	SAT TT=0.014 ASSIGNMENTS=14 CHECKS=5459	? TT=1.496	SAT TT=0.938	SAT TT=0.992
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpsp/ normalized-rcpsp20-12.xml	SAT TT=0.015	? TT=0.622	? TT=0.572	SAT TT=0.296	SAT TT=26.713 CHECKS=2853920	SAT TT=44.043 CHECKS=4644370	SAT TT=22.359 ASSIGNMENTS=15201	SAT TT=1.11 ASSIGNMENTS=42	SAT TT=0.043 ASSIGNMENTS=79 CHECKS=39014	SAT TT=0.044 ASSIGNMENTS=79 CHECKS=39014	SAT TT=0.03 ASSIGNMENTS=66 CHECKS=45107	SAT TT=0.015 ASSIGNMENTS=17 CHECKS=8119	? (exit code) TT=0.237	SAT TT=0.147 ASSIGNMENTS=444 CHECKS=201752	SAT TT=0.115 ASSIGNMENTS=428 CHECKS=225682	? TT=1.44	SAT TT=1.031	SAT TT=1.109
csp/rcpsp/ normalized-rcpsp20-13.xml	SAT TT=0.015	? TT=0.646	? TT=0.567	SAT TT=0.123	SAT TT=36.575 CHECKS=3396260	SAT TT=363.908 CHECKS=41559000	SAT TT=1.862 ASSIGNMENTS=668	SAT TT=1.179 ASSIGNMENTS=88	SAT TT=0.027 ASSIGNMENTS=9 CHECKS=6810	SAT TT=0.028 ASSIGNMENTS=9 CHECKS=6810	SAT TT=0.017 ASSIGNMENTS=9 CHECKS=6810	SAT TT=0.25 ASSIGNMENTS=1451 CHECKS=507323	? (exit code) TT=0.239	SAT TT=0.077 ASSIGNMENTS=298 CHECKS=102588	SAT TT=0.015 ASSIGNMENTS=9 CHECKS=6810	? TT=1.504	SAT TT=1.034	SAT TT=1.304
csp/rcpsp/ normalized-rcpsp20-14.xml	SAT TT=0.018	? TT=0.653	? TT=0.606	SAT TT=0.078	SAT TT=25.279 CHECKS=2619440	SAT TT=20.145 CHECKS=1824480	SAT TT=1.079 ASSIGNMENTS=21	SAT TT=240.205 ASSIGNMENTS=87434	SAT TT=0.029 ASSIGNMENTS=16 CHECKS=11627	SAT TT=0.028 ASSIGNMENTS=16 CHECKS=11627	SAT TT=0.018 ASSIGNMENTS=18 CHECKS=10768	SAT TT=0.136 ASSIGNMENTS=629 CHECKS=254975	? (exit code) TT=0.259	SAT TT=0.448 ASSIGNMENTS=1212 CHECKS=715846	SAT TT=0.02 ASSIGNMENTS=15 CHECKS=11624	? TT=1.52	SAT TT=1.134	SAT TT=1.284
csp/rcpsp/ normalized-rcpsp20-15.xml	SAT TT=0.025	? TT=0.648	? TT=0.618	SAT TT=0.055	SAT TT=27.719 CHECKS=3258710	SAT TT=18.725 CHECKS=2668780	SAT TT=1.019 ASSIGNMENTS=57	SAT TT=1.061 ASSIGNMENTS=15	SAT TT=0.064 ASSIGNMENTS=281 CHECKS=74780	SAT TT=0.064 ASSIGNMENTS=281 CHECKS=74780	SAT TT=0.025 ASSIGNMENTS=72 CHECKS=29475	SAT TT=0.057 ASSIGNMENTS=358 CHECKS=92046	? (exit code) TT=0.265	SAT TT=0.07 ASSIGNMENTS=231 CHECKS=90855	SAT TT=0.04 ASSIGNMENTS=158 CHECKS=58035	? TT=1.382	SAT TT=1.133	SAT TT=0.993
csp/rcpsp/ normalized-rcpsp20-16.xml	SAT TT=0.223	? TT=0.568	? TT=0.565	SAT TT=9.963	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=1.184 ASSIGNMENTS=122	SAT TT=10.928 ASSIGNMENTS=5822	SAT TT=0.463 ASSIGNMENTS=1746 CHECKS=972557	SAT TT=0.459 ASSIGNMENTS=1746 CHECKS=972557	SAT TT=0.443 ASSIGNMENTS=1683 CHECKS=985083	SAT TT=1.177 ASSIGNMENTS=6525 CHECKS=2447120	? (exit code) TT=0.238	SAT TT=1.283 ASSIGNMENTS=3733 CHECKS=2235760	SAT TT=0.223 ASSIGNMENTS=914 CHECKS=458166	? TT=1.582	SAT TT=0.979	SAT TT=1.157
csp/rcpsp/ normalized-rcpsp20-17.xml	SAT TT=0.016	? TT=0.649	? TT=0.66	SAT TT=0.104	SAT TT=30.833 CHECKS=2368000	SAT TT=46.824 CHECKS=3717250	SAT TT=2.516 ASSIGNMENTS=1731	SAT TT=1.142 ASSIGNMENTS=100	SAT TT=0.117 ASSIGNMENTS=474 CHECKS=181870	SAT TT=0.12 ASSIGNMENTS=474 CHECKS=181870	SAT TT=0.056 ASSIGNMENTS=304 CHECKS=83609	SAT TT=0.021 ASSIGNMENTS=92 CHECKS=14055	? (exit code) TT=0.267	SAT TT=0.016 ASSIGNMENTS=24 CHECKS=7341	SAT TT=0.088 ASSIGNMENTS=479 CHECKS=174009	? TT=1.561	SAT TT=0.952	SAT TT=1.211
csp/rcpsp/ normalized-rcpsp20-18.xml	SAT TT=0.121	? TT=0.644	? TT=0.604	SAT TT=4.897	SAT TT=14.114 CHECKS=1294140	SAT TT=28.329 CHECKS=2732310	SAT TT=29.158 ASSIGNMENTS=13637	SAT TT=2.201 ASSIGNMENTS=396	SAT TT=7.804 ASSIGNMENTS=675 CHECKS=417672	SAT TT=7.893 ASSIGNMENTS=675 CHECKS=417672	SAT TT=1.565 ASSIGNMENTS=4234 CHECKS=3553420	SAT TT=1.02 ASSIGNMENTS=5481 CHECKS=2258950	? (exit code) TT=0.261	SAT TT=0.121 ASSIGNMENTS=425 CHECKS=175223	SAT TT=0.19 ASSIGNMENTS=675 CHECKS=417672	? TT=1.444	SAT TT=1.07	SAT TT=1.127
csp/rcpsp/ normalized-rcpsp20-19.xml	SAT TT=0.011	? TT=0.626	? TT=0.599	SAT TT=0.032	SAT TT=0.774 CHECKS=88580	SAT TT=1.171 CHECKS=132778	SAT TT=1.129 ASSIGNMENTS=18	SAT TT=1.083 ASSIGNMENTS=16	SAT TT=0.024 ASSIGNMENTS=26 CHECKS=3956	SAT TT=0.023 ASSIGNMENTS=26 CHECKS=3956	SAT TT=0.012 ASSIGNMENTS=26 CHECKS=3956	SAT TT=0.013 ASSIGNMENTS=21 CHECKS=4288	? (exit code) TT=0.255	SAT TT=0.016 ASSIGNMENTS=57 CHECKS=11053	SAT TT=0.011 ASSIGNMENTS=19 CHECKS=3912	? TT=1.419	SAT TT=0.928	SAT TT=1.032
csp/rcpsp/ normalized-rcpsp20-20.xml	SAT TT=0.059	? TT=0.647	? TT=0.567	SAT TT=0.059	SAT TT=45.27 CHECKS=4555590	SAT TT=39.861 CHECKS=3591780	SAT TT=1.854 ASSIGNMENTS=629	SAT TT=1.782 ASSIGNMENTS=317	SAT TT=0.107 ASSIGNMENTS=388 CHECKS=178404	SAT TT=0.109 ASSIGNMENTS=388 CHECKS=178404	SAT TT=0.098 ASSIGNMENTS=339 CHECKS=176851	SAT TT=0.901 ASSIGNMENTS=5728 CHECKS=1799150	? (exit code) TT=0.255	SAT TT=0.108 ASSIGNMENTS=439 CHECKS=152393	SAT TT=0.184 ASSIGNMENTS=858 CHECKS=349606	? TT=1.476	SAT TT=0.985	SAT TT=1.047
csp/rcpsp/ normalized-rcpsp25-21.xml	SAT TT=0.046	? TT=0.618	? TT=0.649	SAT TT=0.385	SAT TT=524.925 CHECKS=61435700	? (TO) TT=1800.04	SAT TT=1085.06 ASSIGNMENTS=615889	SAT TT=138.558 ASSIGNMENTS=56950	SAT TT=0.057 ASSIGNMENTS=46 CHECKS=38293	SAT TT=0.057 ASSIGNMENTS=46 CHECKS=38293	SAT TT=0.085 ASSIGNMENTS=145 CHECKS=108299	SAT TT=11.662 ASSIGNMENTS=22587 CHECKS=21836600	? (exit code) TT=0.295	SAT TT=14.97 ASSIGNMENTS=21007 CHECKS=23393300	SAT TT=0.046 ASSIGNMENTS=46 CHECKS=38292	? TT=1.87	SAT TT=1.317	SAT TT=1.511
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpsp/ normalized-rcpsp25-22.xml	SAT TT=0.037	? TT=0.655	? TT=0.624	SAT TT=39.622	SAT TT=89.171 CHECKS=7531270	SAT TT=55.126 CHECKS=4100980	SAT TT=778.92 ASSIGNMENTS=365461	SAT TT=646.443 ASSIGNMENTS=268173	SAT TT=0.044 ASSIGNMENTS=23 CHECKS=21850	SAT TT=0.046 ASSIGNMENTS=23 CHECKS=21850	SAT TT=0.037 ASSIGNMENTS=28 CHECKS=27672	SAT TT=0.446 ASSIGNMENTS=1941 CHECKS=807613	? (exit code) TT=0.291	SAT TT=0.258 ASSIGNMENTS=466 CHECKS=365000	SAT TT=0.273 ASSIGNMENTS=556 CHECKS=496579	? TT=1.718	SAT TT=1.285	SAT TT=1.771
csp/rcpsp/ normalized-rcpsp25-23.xml	SAT TT=0.062	? TT=0.617	? TT=0.65	SAT TT=327.981	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=939.428 ASSIGNMENTS=752609	SAT TT=17.269 ASSIGNMENTS=5459	SAT TT=7.997 ASSIGNMENTS=1223 CHECKS=1108950	SAT TT=7.993 ASSIGNMENTS=1223 CHECKS=1108950	SAT TT=0.161 ASSIGNMENTS=351 CHECKS=277224	SAT TT=2.492 ASSIGNMENTS=7603 CHECKS=5044820	? (exit code) TT=0.281	SAT TT=0.062 ASSIGNMENTS=119 CHECKS=63266	SAT TT=0.537 ASSIGNMENTS=1223 CHECKS=1108950	? TT=1.78	SAT TT=1.305	SAT TT=1.473
csp/rcpsp/ normalized-rcpsp25-24.xml	SAT TT=0.026	? TT=0.634	? TT=0.634	SAT TT=0.041	SAT TT=44.029 CHECKS=3450380	SAT TT=41.997 CHECKS=3258180	SAT TT=1.468 ASSIGNMENTS=42	SAT TT=1.871 ASSIGNMENTS=232	SAT TT=0.037 ASSIGNMENTS=11 CHECKS=15096	SAT TT=0.034 ASSIGNMENTS=11 CHECKS=15096	SAT TT=0.028 ASSIGNMENTS=18 CHECKS=16665	SAT TT=0.055 ASSIGNMENTS=120 CHECKS=72703	? (exit code) TT=0.279	SAT TT=0.039 ASSIGNMENTS=48 CHECKS=26912	SAT TT=0.026 ASSIGNMENTS=11 CHECKS=15096	? TT=1.932	SAT TT=1.197	SAT TT=1.34
csp/rcpsp/ normalized-rcpsp25-25.xml	SAT TT=0.07	? TT=0.623	? TT=0.629	SAT TT=11.042	SAT TT=55.258 CHECKS=6158690	SAT TT=691.151 CHECKS=66774200	SAT TT=30.641 ASSIGNMENTS=20829	SAT TT=1.72 ASSIGNMENTS=17	SAT TT=0.113 ASSIGNMENTS=209 CHECKS=207368	SAT TT=0.12 ASSIGNMENTS=209 CHECKS=207368	SAT TT=0.098 ASSIGNMENTS=181 CHECKS=173402	SAT TT=0.222 ASSIGNMENTS=1076 CHECKS=428582	? (exit code) TT=0.292	SAT TT=0.106 ASSIGNMENTS=184 CHECKS=127981	SAT TT=0.07 ASSIGNMENTS=154 CHECKS=106757	? TT=1.882	SAT TT=1.259	SAT TT=1.36
csp/rcpsp/ normalized-rcpsp25-26.xml	SAT TT=0.033	? TT=0.621	? TT=0.624	SAT TT=0.04	SAT TT=0.313 CHECKS=38296	SAT TT=0.301 CHECKS=38051	SAT TT=1.579 ASSIGNMENTS=20	SAT TT=141.085 ASSIGNMENTS=84703	SAT TT=0.044 ASSIGNMENTS=16 CHECKS=19679	SAT TT=0.043 ASSIGNMENTS=16 CHECKS=19679	SAT TT=0.034 ASSIGNMENTS=16 CHECKS=19679	SAT TT=0.109 ASSIGNMENTS=598 CHECKS=156274	? (exit code) TT=0.278	SAT TT=0.05 ASSIGNMENTS=58 CHECKS=31322	SAT TT=0.033 ASSIGNMENTS=17 CHECKS=19697	? TT=1.725	SAT TT=1.396	SAT TT=1.675
csp/rcpsp/ normalized-rcpsp25-27.xml	SAT TT=0.029	? TT=0.694	? TT=0.645	SAT TT=0.045	SAT TT=15.283 CHECKS=1605190	SAT TT=18.318 CHECKS=1628350	SAT TT=1.723 ASSIGNMENTS=20	SAT TT=1.637 ASSIGNMENTS=20	SAT TT=0.04 ASSIGNMENTS=18 CHECKS=16336	SAT TT=0.042 ASSIGNMENTS=18 CHECKS=16336	SAT TT=0.029 ASSIGNMENTS=18 CHECKS=16336	SAT TT=0.064 ASSIGNMENTS=279 CHECKS=88059	? (exit code) TT=0.296	SAT TT=0.237 ASSIGNMENTS=440 CHECKS=331445	SAT TT=0.029 ASSIGNMENTS=19 CHECKS=16215	? TT=1.867	SAT TT=1.301	SAT TT=1.466
csp/rcpsp/ normalized-rcpsp25-28.xml	SAT TT=0.024	? TT=0.696	? TT=0.67	SAT TT=1.528	SAT TT=26.199 CHECKS=2891850	SAT TT=40.778 CHECKS=4505620	SAT TT=7.674 ASSIGNMENTS=3975	SAT TT=3.151 ASSIGNMENTS=1073	SAT TT=0.035 ASSIGNMENTS=10 CHECKS=12949	SAT TT=0.034 ASSIGNMENTS=10 CHECKS=12949	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=14487	SAT TT=0.063 ASSIGNMENTS=228 CHECKS=93784	? (exit code) TT=0.314	SAT TT=0.138 ASSIGNMENTS=270 CHECKS=179297	SAT TT=0.024 ASSIGNMENTS=10 CHECKS=12949	? TT=1.86	SAT TT=1.195	SAT TT=1.337
csp/rcpsp/ normalized-rcpsp25-29.xml	SAT TT=0.078	? TT=0.656	? TT=0.682	SAT TT=0.078	SAT TT=72.512 CHECKS=6468660	SAT TT=401.969 CHECKS=48069300	SAT TT=7.828 ASSIGNMENTS=3891	SAT TT=4.054 ASSIGNMENTS=1021	SAT TT=1.002 ASSIGNMENTS=1996 CHECKS=1888550	SAT TT=0.926 ASSIGNMENTS=1996 CHECKS=1888550	SAT TT=0.166 ASSIGNMENTS=292 CHECKS=303390	SAT TT=0.339 ASSIGNMENTS=1291 CHECKS=640586	? (exit code) TT=0.274	SAT TT=0.452 ASSIGNMENTS=768 CHECKS=693547	SAT TT=0.241 ASSIGNMENTS=502 CHECKS=459864	? TT=1.786	SAT TT=1.538	SAT TT=1.667
csp/rcpsp/ normalized-rcpsp25-30.xml	SAT TT=0.04	? TT=0.62	? TT=0.621	SAT TT=0.04	SAT TT=40.539 CHECKS=4524180	SAT TT=55.257 CHECKS=5337870	SAT TT=5.862 ASSIGNMENTS=2580	SAT TT=4.02 ASSIGNMENTS=1113	SAT TT=0.094 ASSIGNMENTS=166 CHECKS=134785	SAT TT=0.093 ASSIGNMENTS=166 CHECKS=134785	SAT TT=0.114 ASSIGNMENTS=283 CHECKS=185294	SAT TT=0.137 ASSIGNMENTS=567 CHECKS=230194	? (exit code) TT=0.295	SAT TT=0.075 ASSIGNMENTS=156 CHECKS=80790	SAT TT=0.114 ASSIGNMENTS=280 CHECKS=204847	? TT=1.724	SAT TT=1.233	SAT TT=1.334
csp/rcpsp/ normalized-rcpsp25-31.xml	SAT TT=0.142	? TT=0.699	? TT=0.766	SAT TT=0.142	SAT TT=754.859 CHECKS=47128500	SAT TT=235.647 CHECKS=23504000	SAT TT=3.143 ASSIGNMENTS=1631	SAT TT=6.043 ASSIGNMENTS=1991	SAT TT=0.264 ASSIGNMENTS=510 CHECKS=510649	SAT TT=0.265 ASSIGNMENTS=510 CHECKS=510649	SAT TT=0.194 ASSIGNMENTS=460 CHECKS=393248	SAT TT=2.595 ASSIGNMENTS=8568 CHECKS=5794460	? (exit code) TT=0.315	SAT TT=0.569 ASSIGNMENTS=1059 CHECKS=973692	SAT TT=0.912 ASSIGNMENTS=1907 CHECKS=2071760	? TT=1.686	SAT TT=1.4	SAT TT=1.501
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpsp/ normalized-rcpsp25-32.xml	SAT TT=2.786	? TT=0.637	? TT=0.638	SAT TT=153.183	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=354.866 ASSIGNMENTS=356826	SAT TT=517.693 ASSIGNMENTS=250056	SAT TT=50.696 ASSIGNMENTS=57994 CHECKS=93533900	SAT TT=50.152 ASSIGNMENTS=57994 CHECKS=93533900	SAT TT=62.493 ASSIGNMENTS=91450 CHECKS=133333000	SAT TT=32.986 ASSIGNMENTS=50176 CHECKS=71033800	? (exit code) TT=0.285	SAT TT=403.671 ASSIGNMENTS=524676 CHECKS=717575000	SAT TT=42.683 ASSIGNMENTS=57994 CHECKS=93533900	? TT=1.872	SAT TT=2.786	SAT TT=3.618
csp/rcpsp/ normalized-rcpsp25-33.xml	SAT TT=0.022	? TT=0.631	? TT=0.701	SAT TT=27.216	SAT TT=25.129 CHECKS=1909240	SAT TT=34.812 CHECKS=2775470	SAT TT=118.892 ASSIGNMENTS=73144	SAT TT=1.397 ASSIGNMENTS=106	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=16506	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=16506	SAT TT=0.022 ASSIGNMENTS=23 CHECKS=14433	SAT TT=0.028 ASSIGNMENTS=63 CHECKS=24510	? (exit code) TT=0.287	SAT TT=0.029 ASSIGNMENTS=58 CHECKS=23241	SAT TT=0.024 ASSIGNMENTS=29 CHECKS=16506	? TT=1.824	SAT TT=1.093	SAT TT=1.145
csp/rcpsp/ normalized-rcpsp25-34.xml	SAT TT=0.042	? TT=0.701	? TT=0.622	SAT TT=2.97	SAT TT=34.745 CHECKS=2751540	SAT TT=36.703 CHECKS=3148470	SAT TT=77.259 ASSIGNMENTS=24965	SAT TT=1.779 ASSIGNMENTS=17	SAT TT=0.054 ASSIGNMENTS=24 CHECKS=33928	SAT TT=0.053 ASSIGNMENTS=24 CHECKS=33928	SAT TT=0.057 ASSIGNMENTS=45 CHECKS=61063	SAT TT=0.075 ASSIGNMENTS=188 CHECKS=100520	? (exit code) TT=0.267	SAT TT=0.138 ASSIGNMENTS=167 CHECKS=176459	SAT TT=0.042 ASSIGNMENTS=24 CHECKS=33928	? TT=1.677	SAT TT=1.396	SAT TT=1.672
csp/rcpsp/ normalized-rcpsp25-35.xml	SAT TT=0.028	? TT=0.619	? TT=0.644	SAT TT=0.056	SAT TT=24.866 CHECKS=3617760	SAT TT=19.658 CHECKS=2448860	SAT TT=1.443 ASSIGNMENTS=65	SAT TT=1.487 ASSIGNMENTS=9	SAT TT=0.041 ASSIGNMENTS=26 CHECKS=24187	SAT TT=0.04 ASSIGNMENTS=26 CHECKS=24187	SAT TT=0.047 ASSIGNMENTS=61 CHECKS=59581	SAT TT=0.035 ASSIGNMENTS=78 CHECKS=35453	? (exit code) TT=0.294	SAT TT=0.028 ASSIGNMENTS=33 CHECKS=13434	SAT TT=0.028 ASSIGNMENTS=28 CHECKS=26842	? TT=1.792	SAT TT=1.148	SAT TT=1.244
csp/rcpsp/ normalized-rcpsp25-36.xml	SAT TT=0.028	? TT=0.665	? TT=0.615	SAT TT=0.055	SAT TT=30.838 CHECKS=2921200	SAT TT=52.845 CHECKS=4787250	SAT TT=37.569 ASSIGNMENTS=24940	SAT TT=1.514 ASSIGNMENTS=159	SAT TT=0.125 ASSIGNMENTS=300 CHECKS=191145	SAT TT=0.124 ASSIGNMENTS=300 CHECKS=191145	SAT TT=0.032 ASSIGNMENTS=53 CHECKS=33517	SAT TT=0.067 ASSIGNMENTS=254 CHECKS=99099	? (exit code) TT=0.289	SAT TT=0.028 ASSIGNMENTS=40 CHECKS=19150	SAT TT=0.051 ASSIGNMENTS=116 CHECKS=72461	? TT=1.841	SAT TT=1.341	SAT TT=1.318
csp/rcpsp/ normalized-rcpsp25-37.xml	SAT TT=0.123	? TT=0.783	? TT=0.645	SAT TT=45.349	SAT TT=35.69 CHECKS=3376760	SAT TT=239.516 CHECKS=26658200	SAT TT=380.415 ASSIGNMENTS=416757	SAT TT=1.629 ASSIGNMENTS=63	SAT TT=0.506 ASSIGNMENTS=970 CHECKS=928680	SAT TT=0.465 ASSIGNMENTS=970 CHECKS=928680	SAT TT=0.379 ASSIGNMENTS=783 CHECKS=671823	SAT TT=0.123 ASSIGNMENTS=451 CHECKS=195940	? (exit code) TT=0.291	SAT TT=2.147 ASSIGNMENTS=3191 CHECKS=3766060	SAT TT=0.455 ASSIGNMENTS=937 CHECKS=888087	? TT=1.781	SAT TT=1.295	SAT TT=1.494
csp/rcpsp/ normalized-rcpsp25-38.xml	SAT TT=0.038	? TT=0.652	? TT=0.652	SAT TT=0.408	SAT TT=21.786 CHECKS=1973000	SAT TT=124.771 CHECKS=12218000	SAT TT=1.513 ASSIGNMENTS=58	SAT TT=1.35 ASSIGNMENTS=25	SAT TT=0.054 ASSIGNMENTS=87 CHECKS=43497	SAT TT=0.055 ASSIGNMENTS=87 CHECKS=43497	SAT TT=0.038 ASSIGNMENTS=68 CHECKS=38144	SAT TT=0.098 ASSIGNMENTS=352 CHECKS=149775	? (exit code) TT=0.293	SAT TT=0.041 ASSIGNMENTS=65 CHECKS=32496	SAT TT=0.323 ASSIGNMENTS=872 CHECKS=606455	? TT=1.677	SAT TT=1.431	SAT TT=1.397
csp/rcpsp/ normalized-rcpsp25-39.xml	SAT TT=1.159	? TT=0.618	? TT=0.616	SAT TT=193.39	SAT TT=115.577 CHECKS=13354700	? (TO) TT=1800.1	SAT TT=52.77 ASSIGNMENTS=67692	SAT TT=44.148 ASSIGNMENTS=28917	SAT TT=9.164 ASSIGNMENTS=3989 CHECKS=3836740	SAT TT=9.721 ASSIGNMENTS=3989 CHECKS=3836740	SAT TT=1.159 ASSIGNMENTS=2484 CHECKS=2427650	SAT TT=4.658 ASSIGNMENTS=12660 CHECKS=9676070	? (exit code) TT=0.311	SAT TT=12.103 ASSIGNMENTS=20925 CHECKS=23176700	SAT TT=1.778 ASSIGNMENTS=3989 CHECKS=3836740	? TT=1.685	SAT TT=1.523	SAT TT=1.401
csp/rcpsp/ normalized-rcpsp25-40.xml	SAT TT=0.095	? TT=0.622	? TT=0.618	SAT TT=0.095	SAT TT=97.913 CHECKS=11061000	SAT TT=101.941 CHECKS=13901600	SAT TT=1.702 ASSIGNMENTS=136	SAT TT=59.765 ASSIGNMENTS=21361	SAT TT=0.544 ASSIGNMENTS=1250 CHECKS=1043960	SAT TT=0.556 ASSIGNMENTS=1250 CHECKS=1043960	SAT TT=0.875 ASSIGNMENTS=1617 CHECKS=1913130	SAT TT=1.644 ASSIGNMENTS=5906 CHECKS=3416490	? (exit code) TT=0.299	SAT TT=0.298 ASSIGNMENTS=630 CHECKS=430688	SAT TT=1.077 ASSIGNMENTS=2216 CHECKS=2337940	? TT=1.874	SAT TT=1.516	SAT TT=1.533
csp/rcpspTighter/ normalized-rcpsptight20-02.xml	UNSAT TT=0.009	? TT=0.571	? TT=0.6	UNSAT TT=3.86	UNSAT TT=0.01 CHECKS=246	UNSAT TT=0.009 CHECKS=246	UNSAT TT=0.627 ASSIGNMENTS=0	UNSAT TT=0.637 ASSIGNMENTS=0	UNSAT TT=0.863 ASSIGNMENTS=2149 CHECKS=1346700	UNSAT TT=0.684 ASSIGNMENTS=2149 CHECKS=1346700	UNSAT TT=0.678 ASSIGNMENTS=2158 CHECKS=1391260	UNSAT TT=2.778 ASSIGNMENTS=10715 CHECKS=5598410	? (exit code) TT=0.238	UNSAT TT=5.778 ASSIGNMENTS=16343 CHECKS=9870710	UNSAT TT=1.995 ASSIGNMENTS=6119 CHECKS=4144010	? TT=1.555	UNSAT TT=1.13	UNSAT TT=1.222
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpspTighter/ normalized-rcpsptight20-03.xml	UNSAT TT=0.622	? TT=0.642	? TT=0.665	UNSAT TT=1.783	UNSAT TT=358.739 CHECKS=30539700	UNSAT TT=137.954 CHECKS=18405800	UNSAT TT=17.806 ASSIGNMENTS=14656	UNSAT TT=14.245 ASSIGNMENTS=4830	UNSAT TT=0.745 ASSIGNMENTS=1990 CHECKS=1524820	UNSAT TT=0.745 ASSIGNMENTS=1990 CHECKS=1524820	UNSAT TT=0.622 ASSIGNMENTS=1679 CHECKS=1296090	UNSAT TT=1.708 ASSIGNMENTS=7398 CHECKS=3320540	? (exit code) TT=0.24	UNSAT TT=3.462 ASSIGNMENTS=8118 CHECKS=6164510	UNSAT TT=3.52 ASSIGNMENTS=8996 CHECKS=7520210	? TT=1.503	UNSAT TT=1.043	UNSAT TT=1.144
csp/rcpspTighter/ normalized-rcpsptight20-04.xml	SAT TT=0.018	? TT=0.602	? TT=0.571	SAT TT=0.032	SAT TT=0.036 CHECKS=1871	SAT TT=0.037 CHECKS=1918	SAT TT=1.146 ASSIGNMENTS=9	SAT TT=1.094 ASSIGNMENTS=12	SAT TT=0.123 ASSIGNMENTS=339 CHECKS=203742	SAT TT=0.124 ASSIGNMENTS=339 CHECKS=203742	SAT TT=0.146 ASSIGNMENTS=371 CHECKS=273792	SAT TT=0.018 ASSIGNMENTS=5 CHECKS=7194	? (exit code) TT=0.267	SAT TT=0.065 ASSIGNMENTS=143 CHECKS=79682	SAT TT=0.09 ASSIGNMENTS=275 CHECKS=174354	? TT=1.532	SAT TT=1.124	SAT TT=1.186
csp/rcpspTighter/ normalized-rcpsptight20-05.xml	UNSAT TT=0.009	? TT=0.702	? TT=0.57	UNSAT TT=4.668	UNSAT TT=0.009 CHECKS=247	UNSAT TT=0.01 CHECKS=247	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.607 ASSIGNMENTS=0	UNSAT TT=11.942 ASSIGNMENTS=10752 CHECKS=10533300	UNSAT TT=12.056 ASSIGNMENTS=10752 CHECKS=10533300	UNSAT TT=1.349 ASSIGNMENTS=3104 CHECKS=3122430	UNSAT TT=2.539 ASSIGNMENTS=8551 CHECKS=5643780	? (exit code) TT=0.248	UNSAT TT=6.378 ASSIGNMENTS=14995 CHECKS=13109700	UNSAT TT=4.492 ASSIGNMENTS=10752 CHECKS=10533300	? TT=1.448	UNSAT TT=1.087	UNSAT TT=1.182
csp/rcpspTighter/ normalized-rcpsptight20-06.xml	UNSAT TT=0.009	? TT=0.604	? TT=0.604	UNSAT TT=0.169	UNSAT TT=0.011 CHECKS=248	UNSAT TT=0.009 CHECKS=248	UNSAT TT=0.575 ASSIGNMENTS=0	UNSAT TT=0.687 ASSIGNMENTS=0	UNSAT TT=0.112 ASSIGNMENTS=341 CHECKS=201134	UNSAT TT=0.115 ASSIGNMENTS=341 CHECKS=201134	UNSAT TT=0.127 ASSIGNMENTS=373 CHECKS=255543	UNSAT TT=0.71 ASSIGNMENTS=4652 CHECKS=1485000	? (exit code) TT=0.254	UNSAT TT=0.203 ASSIGNMENTS=701 CHECKS=342151	UNSAT TT=0.138 ASSIGNMENTS=506 CHECKS=276645	? TT=1.45	UNSAT TT=0.959	UNSAT TT=1.214
csp/rcpspTighter/ normalized-rcpsptight20-07.xml	UNSAT TT=0.009	? TT=0.598	? TT=0.574	UNSAT TT=4.622	UNSAT TT=0.009 CHECKS=218	UNSAT TT=0.009 CHECKS=218	UNSAT TT=0.663 ASSIGNMENTS=0	UNSAT TT=0.611 ASSIGNMENTS=0	UNSAT TT=0.454 ASSIGNMENTS=1127 CHECKS=987048	UNSAT TT=0.455 ASSIGNMENTS=1127 CHECKS=987048	UNSAT TT=0.331 ASSIGNMENTS=865 CHECKS=709562	UNSAT TT=1.059 ASSIGNMENTS=5039 CHECKS=2334830	? (exit code) TT=0.238	UNSAT TT=0.838 ASSIGNMENTS=1965 CHECKS=1367040	UNSAT TT=0.529 ASSIGNMENTS=1547 CHECKS=1289090	? TT=1.595	UNSAT TT=1.207	UNSAT TT=1.116
csp/rcpspTighter/ normalized-rcpsptight20-08.xml	UNSAT TT=0.01	? TT=0.608	? TT=0.573	UNSAT TT=48.397	UNSAT TT=0.01 CHECKS=277	UNSAT TT=0.01 CHECKS=277	UNSAT TT=0.579 ASSIGNMENTS=0	UNSAT TT=0.577 ASSIGNMENTS=0	UNSAT TT=1.245 ASSIGNMENTS=4371 CHECKS=2816320	UNSAT TT=1.349 ASSIGNMENTS=4371 CHECKS=2816320	UNSAT TT=1.4 ASSIGNMENTS=5029 CHECKS=2892720	UNSAT TT=1.992 ASSIGNMENTS=10211 CHECKS=4028150	? (exit code) TT=0.254	UNSAT TT=7.198 ASSIGNMENTS=19550 CHECKS=10771700	UNSAT TT=4.446 ASSIGNMENTS=14870 CHECKS=9352280	? TT=1.468	UNSAT TT=1.086	UNSAT TT=1.086
csp/rcpspTighter/ normalized-rcpsptight20-09.xml	UNSAT TT=0.009	? TT=0.627	? TT=0.572	UNSAT TT=3.997	UNSAT TT=0.011 CHECKS=213	UNSAT TT=0.009 CHECKS=213	UNSAT TT=0.573 ASSIGNMENTS=0	UNSAT TT=0.562 ASSIGNMENTS=0	UNSAT TT=0.419 ASSIGNMENTS=1553 CHECKS=859950	UNSAT TT=0.416 ASSIGNMENTS=1553 CHECKS=859950	UNSAT TT=0.473 ASSIGNMENTS=1727 CHECKS=989460	UNSAT TT=0.928 ASSIGNMENTS=5950 CHECKS=1917450	? (exit code) TT=0.251	UNSAT TT=2.504 ASSIGNMENTS=8305 CHECKS=4450540	UNSAT TT=1.706 ASSIGNMENTS=6289 CHECKS=3769650	? TT=1.489	UNSAT TT=0.973	UNSAT TT=1.016
csp/rcpspTighter/ normalized-rcpsptight20-10.xml	UNSAT TT=0.011	? TT=0.603	? TT=0.571	UNSAT TT=6.005	UNSAT TT=0.012 CHECKS=230	UNSAT TT=0.011 CHECKS=230	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=0.606 ASSIGNMENTS=0	UNSAT TT=0.399 ASSIGNMENTS=1347 CHECKS=795448	UNSAT TT=0.4 ASSIGNMENTS=1347 CHECKS=795448	UNSAT TT=0.126 ASSIGNMENTS=414 CHECKS=230758	UNSAT TT=0.763 ASSIGNMENTS=4647 CHECKS=1565350	? (exit code) TT=0.264	UNSAT TT=2.008 ASSIGNMENTS=6179 CHECKS=3551660	UNSAT TT=0.447 ASSIGNMENTS=1517 CHECKS=916548	? TT=1.574	UNSAT TT=0.905	UNSAT TT=1.027
csp/rcpspTighter/ normalized-rcpsptight20-11.xml	UNSAT TT=0.01	? TT=0.63	? TT=0.569	UNSAT TT=0.031	UNSAT TT=0.011 CHECKS=215	UNSAT TT=0.01 CHECKS=215	UNSAT TT=0.586 ASSIGNMENTS=0	UNSAT TT=0.564 ASSIGNMENTS=0	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=2139	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=2139	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=2139	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=2139	? (exit code) TT=0.243	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=2139	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=2139	? TT=1.382	UNSAT TT=0.902	UNSAT TT=1.152
csp/rcpspTighter/ normalized-rcpsptight20-12.xml	UNSAT TT=0.378	? TT=0.601	? TT=0.571	UNSAT TT=360.739	? (TO) TT=1800.09	UNSAT TT=1497.48 CHECKS=143044000	? (TO) TT=1800.13	UNSAT TT=33.188 ASSIGNMENTS=10909	UNSAT TT=0.473 ASSIGNMENTS=1350 CHECKS=995059	UNSAT TT=0.473 ASSIGNMENTS=1350 CHECKS=995059	UNSAT TT=0.378 ASSIGNMENTS=1171 CHECKS=812811	UNSAT TT=1.43 ASSIGNMENTS=6857 CHECKS=3195300	? (exit code) TT=0.24	UNSAT TT=1.752 ASSIGNMENTS=4782 CHECKS=3240570	UNSAT TT=0.822 ASSIGNMENTS=2545 CHECKS=1778320	? TT=1.408	UNSAT TT=1.037	UNSAT TT=1.121
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpspTighter/ normalized-rcpsptight20-13.xml	UNSAT TT=0.011	? TT=0.579	? TT=0.573	UNSAT TT=1.565	UNSAT TT=0.011 CHECKS=226	UNSAT TT=0.011 CHECKS=226	UNSAT TT=0.608 ASSIGNMENTS=0	UNSAT TT=0.623 ASSIGNMENTS=0	UNSAT TT=0.378 ASSIGNMENTS=990 CHECKS=742881	UNSAT TT=0.377 ASSIGNMENTS=990 CHECKS=742881	UNSAT TT=0.329 ASSIGNMENTS=928 CHECKS=654981	UNSAT TT=1.07 ASSIGNMENTS=5070 CHECKS=2298150	? (exit code) TT=0.253	UNSAT TT=0.968 ASSIGNMENTS=2732 CHECKS=1691540	UNSAT TT=0.683 ASSIGNMENTS=2049 CHECKS=1437140	? TT=1.612	UNSAT TT=1.057	UNSAT TT=1.164
csp/rcpspTighter/ normalized-rcpsptight20-14.xml	UNSAT TT=0.012	? TT=0.645	? TT=0.653	UNSAT TT=58.555	UNSAT TT=0.012 CHECKS=225	UNSAT TT=0.013 CHECKS=225	UNSAT TT=0.627 ASSIGNMENTS=0	UNSAT TT=0.567 ASSIGNMENTS=0	UNSAT TT=47.232 ASSIGNMENTS=83072 CHECKS=90499300	UNSAT TT=43.95 ASSIGNMENTS=83072 CHECKS=90499300	UNSAT TT=17.166 ASSIGNMENTS=39150 CHECKS=38472600	UNSAT TT=10.696 ASSIGNMENTS=26150 CHECKS=23527900	? (exit code) TT=0.254	UNSAT TT=58.299 ASSIGNMENTS=131083 CHECKS=102933000	UNSAT TT=40.054 ASSIGNMENTS=83072 CHECKS=90499300	? TT=1.42	UNSAT TT=1.779	UNSAT TT=2.128
csp/rcpspTighter/ normalized-rcpsptight20-15.xml	UNSAT TT=0.01	? TT=0.568	? TT=0.605	UNSAT TT=0.038	UNSAT TT=0.01 CHECKS=240	UNSAT TT=0.011 CHECKS=240	UNSAT TT=0.638 ASSIGNMENTS=0	UNSAT TT=0.609 ASSIGNMENTS=0	UNSAT TT=0.026 ASSIGNMENTS=12 CHECKS=8222	UNSAT TT=0.025 ASSIGNMENTS=12 CHECKS=8222	UNSAT TT=0.015 ASSIGNMENTS=5 CHECKS=6400	UNSAT TT=0.039 ASSIGNMENTS=236 CHECKS=63116	? (exit code) TT=0.256	UNSAT TT=0.018 ASSIGNMENTS=30 CHECKS=9311	UNSAT TT=0.015 ASSIGNMENTS=12 CHECKS=8222	? TT=1.014	UNSAT TT=0.924	UNSAT TT=1.009
csp/rcpspTighter/ normalized-rcpsptight20-16.xml	UNSAT TT=0.008	? TT=0.647	? TT=0.588	UNSAT TT=890.343	UNSAT TT=0.01 CHECKS=250	UNSAT TT=0.008 CHECKS=250	UNSAT TT=0.614 ASSIGNMENTS=0	UNSAT TT=0.578 ASSIGNMENTS=0	UNSAT TT=0.74 ASSIGNMENTS=2546 CHECKS=1635260	UNSAT TT=0.702 ASSIGNMENTS=2546 CHECKS=1635260	UNSAT TT=0.732 ASSIGNMENTS=2379 CHECKS=1595740	UNSAT TT=1.478 ASSIGNMENTS=7635 CHECKS=3248930	? (exit code) TT=0.238	UNSAT TT=4.186 ASSIGNMENTS=10733 CHECKS=6369890	UNSAT TT=2.878 ASSIGNMENTS=10060 CHECKS=7030450	? TT=1.471	UNSAT TT=1.276	UNSAT TT=1.178
csp/rcpspTighter/ normalized-rcpsptight20-17.xml	UNSAT TT=0.008	? TT=0.566	? TT=0.6	? (TO) TT=1800.05	UNSAT TT=0.013 CHECKS=210	UNSAT TT=0.008 CHECKS=210	UNSAT TT=0.594 ASSIGNMENTS=0	UNSAT TT=0.606 ASSIGNMENTS=0	UNSAT TT=17.723 ASSIGNMENTS=41717 CHECKS=23392900	UNSAT TT=16.944 ASSIGNMENTS=41717 CHECKS=23392900	UNSAT TT=2.322 ASSIGNMENTS=9138 CHECKS=5301430	UNSAT TT=2.379 ASSIGNMENTS=13029 CHECKS=5076460	? (exit code) TT=0.261	UNSAT TT=7.451 ASSIGNMENTS=25495 CHECKS=13748300	UNSAT TT=10.28 ASSIGNMENTS=41717 CHECKS=23392900	? TT=1.417	UNSAT TT=1.404	UNSAT TT=1.37
csp/rcpspTighter/ normalized-rcpsptight20-18.xml	UNSAT TT=0.009	? TT=0.581	? TT=0.563	UNSAT TT=1.298	UNSAT TT=0.011 CHECKS=257	UNSAT TT=0.009 CHECKS=257	UNSAT TT=0.604 ASSIGNMENTS=0	UNSAT TT=0.585 ASSIGNMENTS=0	UNSAT TT=0.473 ASSIGNMENTS=1335 CHECKS=1118440	UNSAT TT=0.506 ASSIGNMENTS=1335 CHECKS=1118440	UNSAT TT=0.469 ASSIGNMENTS=1362 CHECKS=1000200	UNSAT TT=1.545 ASSIGNMENTS=6632 CHECKS=3429010	? (exit code) TT=0.261	UNSAT TT=3.593 ASSIGNMENTS=8379 CHECKS=6772690	UNSAT TT=1.013 ASSIGNMENTS=3050 CHECKS=2479690	? TT=1.576	UNSAT TT=1.193	UNSAT TT=1.129
csp/rcpspTighter/ normalized-rcpsptight20-19.xml	UNSAT TT=0.009	? TT=0.57	? TT=0.627	UNSAT TT=0.464	UNSAT TT=0.009 CHECKS=230	UNSAT TT=0.01 CHECKS=230	UNSAT TT=0.606 ASSIGNMENTS=0	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.146 ASSIGNMENTS=631 CHECKS=259758	UNSAT TT=0.148 ASSIGNMENTS=631 CHECKS=259758	UNSAT TT=0.038 ASSIGNMENTS=160 CHECKS=56431	UNSAT TT=0.605 ASSIGNMENTS=5242 CHECKS=1196920	? (exit code) TT=0.265	UNSAT TT=0.377 ASSIGNMENTS=1678 CHECKS=618857	UNSAT TT=0.218 ASSIGNMENTS=1044 CHECKS=448902	? TT=1.433	UNSAT TT=0.943	UNSAT TT=0.96
csp/rcpspTighter/ normalized-rcpsptight20-20.xml	UNSAT TT=0.009	? TT=0.646	? TT=0.605	UNSAT TT=0.69	UNSAT TT=0.01 CHECKS=230	UNSAT TT=0.009 CHECKS=230	UNSAT TT=0.694 ASSIGNMENTS=0	UNSAT TT=0.667 ASSIGNMENTS=0	UNSAT TT=0.156 ASSIGNMENTS=513 CHECKS=271265	UNSAT TT=0.158 ASSIGNMENTS=513 CHECKS=271265	UNSAT TT=0.261 ASSIGNMENTS=1010 CHECKS=493879	UNSAT TT=0.742 ASSIGNMENTS=4854 CHECKS=1413300	? (exit code) TT=0.24	UNSAT TT=4.065 ASSIGNMENTS=14236 CHECKS=6596280	UNSAT TT=0.596 ASSIGNMENTS=2636 CHECKS=1233850	? TT=1.395	UNSAT TT=0.977	UNSAT TT=1.09
csp/rcpspTighter/ normalized-rcpsptight25-21.xml	UNSAT TT=1.582	? TT=0.618	? TT=0.658	UNSAT TT=165.342	UNSAT TT=1024.31 CHECKS=124745000	UNSAT TT=279.737 CHECKS=35391900	? (TO) TT=1800.09	UNSAT TT=124.767 ASSIGNMENTS=51580	UNSAT TT=36.136 ASSIGNMENTS=44154 CHECKS=53054200	UNSAT TT=36.079 ASSIGNMENTS=44154 CHECKS=53054200	UNSAT TT=7.577 ASSIGNMENTS=11566 CHECKS=13992300	UNSAT TT=7.176 ASSIGNMENTS=15324 CHECKS=13974100	? (exit code) TT=0.289	UNSAT TT=17.453 ASSIGNMENTS=23570 CHECKS=26682500	UNSAT TT=28.983 ASSIGNMENTS=44154 CHECKS=53054200	? TT=1.674	UNSAT TT=1.582	UNSAT TT=1.751
csp/rcpspTighter/ normalized-rcpsptight25-22.xml	UNSAT TT=1.281	? TT=0.653	? TT=0.675	UNSAT TT=130.297	UNSAT TT=522.494 CHECKS=56652200	UNSAT TT=369.766 CHECKS=38111400	? (TO) TT=1800.13	UNSAT TT=20.196 ASSIGNMENTS=7897	UNSAT TT=1.3 ASSIGNMENTS=2305 CHECKS=2617790	UNSAT TT=1.3 ASSIGNMENTS=2305 CHECKS=2617790	UNSAT TT=1.521 ASSIGNMENTS=2794 CHECKS=3377970	UNSAT TT=2.346 ASSIGNMENTS=7408 CHECKS=4783310	? (exit code) TT=0.291	UNSAT TT=6.268 ASSIGNMENTS=9610 CHECKS=11026500	UNSAT TT=7.59 ASSIGNMENTS=13034 CHECKS=16029000	? TT=1.826	UNSAT TT=1.416	UNSAT TT=1.724
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpspTighter/ normalized-rcpsptight25-23.xml	UNSAT TT=0.013	? TT=0.623	? TT=0.607	UNSAT TT=13.507	UNSAT TT=0.014 CHECKS=493	UNSAT TT=0.013 CHECKS=493	UNSAT TT=0.804 ASSIGNMENTS=0	UNSAT TT=0.852 ASSIGNMENTS=0	UNSAT TT=1.354 ASSIGNMENTS=2630 CHECKS=2682530	UNSAT TT=1.261 ASSIGNMENTS=2630 CHECKS=2682530	UNSAT TT=0.82 ASSIGNMENTS=1473 CHECKS=1642750	UNSAT TT=2.859 ASSIGNMENTS=7862 CHECKS=5780540	? (exit code) TT=0.281	UNSAT TT=4.912 ASSIGNMENTS=8501 CHECKS=7822730	UNSAT TT=4.882 ASSIGNMENTS=9382 CHECKS=9871950	? TT=1.704	UNSAT TT=1.238	UNSAT TT=1.408
csp/rcpspTighter/ normalized-rcpsptight25-24.xml	UNSAT TT=0.045	? TT=0.631	? TT=0.619	UNSAT TT=0.118	UNSAT TT=34.83 CHECKS=2647760	UNSAT TT=57.778 CHECKS=4111820	UNSAT TT=0.918 ASSIGNMENTS=0	UNSAT TT=0.936 ASSIGNMENTS=0	UNSAT TT=0.051 ASSIGNMENTS=56 CHECKS=45500	UNSAT TT=0.053 ASSIGNMENTS=56 CHECKS=45500	UNSAT TT=0.045 ASSIGNMENTS=47 CHECKS=49495	UNSAT TT=0.37 ASSIGNMENTS=1569 CHECKS=671862	? (exit code) TT=0.307	UNSAT TT=0.066 ASSIGNMENTS=106 CHECKS=69924	UNSAT TT=0.126 ASSIGNMENTS=331 CHECKS=193789	? TT=1.874	UNSAT TT=1.097	UNSAT TT=1.486
csp/rcpspTighter/ normalized-rcpsptight25-25.xml	UNSAT TT=0.183	? TT=0.697	? TT=0.648	UNSAT TT=5.193	UNSAT TT=50.448 CHECKS=6528180	UNSAT TT=83.712 CHECKS=10654400	UNSAT TT=305.717 ASSIGNMENTS=380349	UNSAT TT=1.639 ASSIGNMENTS=33	UNSAT TT=0.208 ASSIGNMENTS=443 CHECKS=386142	UNSAT TT=0.207 ASSIGNMENTS=443 CHECKS=386142	UNSAT TT=0.183 ASSIGNMENTS=363 CHECKS=361543	UNSAT TT=1.154 ASSIGNMENTS=5069 CHECKS=2430940	? (exit code) TT=0.294	UNSAT TT=0.583 ASSIGNMENTS=916 CHECKS=915314	UNSAT TT=0.302 ASSIGNMENTS=660 CHECKS=637124	? TT=1.895	UNSAT TT=1.225	UNSAT TT=1.348
csp/rcpspTighter/ normalized-rcpsptight25-26.xml	UNSAT TT=0.413	? TT=0.621	? TT=0.7	UNSAT TT=1.931	UNSAT TT=35.061 CHECKS=2423480	UNSAT TT=6.517 CHECKS=503636	UNSAT TT=24.002 ASSIGNMENTS=21423	UNSAT TT=7.375 ASSIGNMENTS=3557	UNSAT TT=0.464 ASSIGNMENTS=1022 CHECKS=948375	UNSAT TT=0.457 ASSIGNMENTS=1022 CHECKS=948375	UNSAT TT=0.413 ASSIGNMENTS=959 CHECKS=872617	UNSAT TT=0.867 ASSIGNMENTS=6003 CHECKS=1706480	? (exit code) TT=0.292	UNSAT TT=1.081 ASSIGNMENTS=1884 CHECKS=1798710	UNSAT TT=0.511 ASSIGNMENTS=1081 CHECKS=1066660	? TT=1.691	UNSAT TT=1.439	UNSAT TT=1.506
csp/rcpspTighter/ normalized-rcpsptight25-27.xml	SAT TT=0.04	? TT=0.618	? TT=0.701	SAT TT=0.043	SAT TT=20.193 CHECKS=2602030	SAT TT=32.935 CHECKS=3887640	SAT TT=46.967 ASSIGNMENTS=45072	SAT TT=1.887 ASSIGNMENTS=83	SAT TT=0.174 ASSIGNMENTS=533 CHECKS=228742	SAT TT=0.174 ASSIGNMENTS=533 CHECKS=228742	SAT TT=0.136 ASSIGNMENTS=422 CHECKS=193478	SAT TT=0.167 ASSIGNMENTS=707 CHECKS=328456	? (exit code) TT=0.277	SAT TT=0.658 ASSIGNMENTS=1213 CHECKS=1033990	SAT TT=0.04 ASSIGNMENTS=73 CHECKS=35229	? TT=1.711	SAT TT=1.276	SAT TT=1.499
csp/rcpspTighter/ normalized-rcpsptight25-28.xml	UNSAT TT=0.22	? TT=0.613	? TT=0.656	UNSAT TT=6.118	UNSAT TT=37.698 CHECKS=4040560	UNSAT TT=55.535 CHECKS=6128380	UNSAT TT=1.409 ASSIGNMENTS=0	UNSAT TT=1.425 ASSIGNMENTS=0	UNSAT TT=0.23 ASSIGNMENTS=527 CHECKS=464291	UNSAT TT=0.22 ASSIGNMENTS=527 CHECKS=464291	UNSAT TT=0.274 ASSIGNMENTS=648 CHECKS=562360	UNSAT TT=1.058 ASSIGNMENTS=4804 CHECKS=2222340	? (exit code) TT=0.3	UNSAT TT=0.362 ASSIGNMENTS=646 CHECKS=639591	UNSAT TT=0.558 ASSIGNMENTS=1266 CHECKS=1245730	? TT=1.789	UNSAT TT=1.182	UNSAT TT=1.328
csp/rcpspTighter/ normalized-rcpsptight25-29.xml	UNSAT TT=0.111	? TT=0.639	? TT=0.652	UNSAT TT=6.694	UNSAT TT=0.194 CHECKS=22095	UNSAT TT=0.201 CHECKS=24535	UNSAT TT=1.049 ASSIGNMENTS=0	UNSAT TT=0.999 ASSIGNMENTS=0	UNSAT TT=0.158 ASSIGNMENTS=311 CHECKS=299211	UNSAT TT=0.17 ASSIGNMENTS=311 CHECKS=299211	UNSAT TT=0.111 ASSIGNMENTS=172 CHECKS=191480	UNSAT TT=1.093 ASSIGNMENTS=4512 CHECKS=2320050	? (exit code) TT=0.313	UNSAT TT=0.398 ASSIGNMENTS=578 CHECKS=657591	UNSAT TT=0.385 ASSIGNMENTS=758 CHECKS=761699	? TT=1.702	UNSAT TT=1.236	UNSAT TT=1.556
csp/rcpspTighter/ normalized-rcpsptight25-30.xml	UNSAT TT=0.013	? TT=0.617	? TT=0.675	UNSAT TT=8.634	UNSAT TT=0.015 CHECKS=462	UNSAT TT=0.013 CHECKS=462	UNSAT TT=516.952 ASSIGNMENTS=281079	UNSAT TT=13.51 ASSIGNMENTS=5717	UNSAT TT=0.069 ASSIGNMENTS=88 CHECKS=87821	UNSAT TT=0.07 ASSIGNMENTS=88 CHECKS=87821	UNSAT TT=0.069 ASSIGNMENTS=134 CHECKS=99985	UNSAT TT=0.721 ASSIGNMENTS=4347 CHECKS=1490140	? (exit code) TT=0.292	UNSAT TT=0.051 ASSIGNMENTS=72 CHECKS=52610	UNSAT TT=0.044 ASSIGNMENTS=58 CHECKS=53257	? TT=1.836	UNSAT TT=1.072	UNSAT TT=1.29
csp/rcpspTighter/ normalized-rcpsptight25-31.xml	UNSAT TT=0.253	? TT=0.617	? TT=0.669	UNSAT TT=136.625	UNSAT TT=0.318 CHECKS=38039	UNSAT TT=6.776 CHECKS=776137	UNSAT TT=337.519 ASSIGNMENTS=238842	UNSAT TT=1.726 ASSIGNMENTS=49	UNSAT TT=0.377 ASSIGNMENTS=862 CHECKS=766131	UNSAT TT=0.346 ASSIGNMENTS=862 CHECKS=766131	UNSAT TT=0.253 ASSIGNMENTS=565 CHECKS=501782	UNSAT TT=1.259 ASSIGNMENTS=5554 CHECKS=2703900	? (exit code) TT=0.278	UNSAT TT=0.591 ASSIGNMENTS=978 CHECKS=1032880	UNSAT TT=0.427 ASSIGNMENTS=1026 CHECKS=918625	? TT=1.691	UNSAT TT=1.25	UNSAT TT=1.493
csp/rcpspTighter/ normalized-rcpsptight25-32.xml	UNSAT TT=3.603	? TT=0.782	? TT=0.651	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.13	UNSAT TT=1402.84 ASSIGNMENTS=793823	UNSAT TT=443.906 ASSIGNMENTS=589966 CHECKS=973239000	UNSAT TT=460.695 ASSIGNMENTS=589966 CHECKS=973239000	UNSAT TT=109.784 ASSIGNMENTS=148178 CHECKS=243031000	UNSAT TT=88.227 ASSIGNMENTS=130886 CHECKS=189384000	? (exit code) TT=0.292	UNSAT TT=705.517 ASSIGNMENTS=941338 CHECKS=1217110000	UNSAT TT=407.283 ASSIGNMENTS=589966 CHECKS=973239000	? TT=1.692	UNSAT TT=3.868	UNSAT TT=3.603
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rcpspTighter/ normalized-rcpsptight25-33.xml	UNSAT TT=0.064	? TT=0.636	? TT=0.664	UNSAT TT=615.771	UNSAT TT=40.5 CHECKS=3260480	UNSAT TT=56.132 CHECKS=3910690	UNSAT TT=1774.08 ASSIGNMENTS=1114790	UNSAT TT=1.391 ASSIGNMENTS=50	UNSAT TT=0.065 ASSIGNMENTS=140 CHECKS=80853	UNSAT TT=0.064 ASSIGNMENTS=140 CHECKS=80853	UNSAT TT=0.089 ASSIGNMENTS=240 CHECKS=145899	UNSAT TT=0.662 ASSIGNMENTS=4124 CHECKS=1395860	? (exit code) TT=0.318	UNSAT TT=0.104 ASSIGNMENTS=258 CHECKS=121939	UNSAT TT=0.066 ASSIGNMENTS=220 CHECKS=100304	? TT=1.794	UNSAT TT=1.071	UNSAT TT=1.262
csp/rcpspTighter/ normalized-rcpsptight25-34.xml	UNSAT TT=0.061	? TT=0.649	? TT=0.624	UNSAT TT=0.885	UNSAT TT=105.482 CHECKS=6531350	UNSAT TT=163.729 CHECKS=11945500	UNSAT TT=1.019 ASSIGNMENTS=0	UNSAT TT=1.027 ASSIGNMENTS=0	UNSAT TT=0.08 ASSIGNMENTS=76 CHECKS=95132	UNSAT TT=0.08 ASSIGNMENTS=76 CHECKS=95132	UNSAT TT=0.066 ASSIGNMENTS=58 CHECKS=80555	UNSAT TT=0.323 ASSIGNMENTS=992 CHECKS=598518	? (exit code) TT=0.294	UNSAT TT=0.084 ASSIGNMENTS=72 CHECKS=95960	UNSAT TT=0.061 ASSIGNMENTS=55 CHECKS=89873	? TT=1.827	UNSAT TT=1.3	UNSAT TT=1.597
csp/rcpspTighter/ normalized-rcpsptight25-35.xml	UNSAT TT=0.063	? TT=0.649	? TT=0.643	UNSAT TT=0.19	UNSAT TT=41.317 CHECKS=5634690	UNSAT TT=47.298 CHECKS=6923900	UNSAT TT=1.037 ASSIGNMENTS=0	UNSAT TT=1.064 ASSIGNMENTS=0	UNSAT TT=0.063 ASSIGNMENTS=77 CHECKS=66713	UNSAT TT=0.064 ASSIGNMENTS=77 CHECKS=66713	UNSAT TT=0.084 ASSIGNMENTS=142 CHECKS=139446	UNSAT TT=0.965 ASSIGNMENTS=3999 CHECKS=1885680	? (exit code) TT=0.296	UNSAT TT=0.068 ASSIGNMENTS=108 CHECKS=86090	UNSAT TT=0.169 ASSIGNMENTS=359 CHECKS=303514	? TT=1.671	UNSAT TT=1.144	UNSAT TT=1.26
csp/rcpspTighter/ normalized-rcpsptight25-36.xml	UNSAT TT=0.026	? TT=0.678	? TT=0.624	UNSAT TT=0.504	UNSAT TT=34.99 CHECKS=3430370	UNSAT TT=37.264 CHECKS=3983100	UNSAT TT=1.194 ASSIGNMENTS=11	UNSAT TT=1.106 ASSIGNMENTS=3	UNSAT TT=0.05 ASSIGNMENTS=65 CHECKS=47228	UNSAT TT=0.053 ASSIGNMENTS=65 CHECKS=47228	UNSAT TT=0.026 ASSIGNMENTS=30 CHECKS=24646	UNSAT TT=0.415 ASSIGNMENTS=2130 CHECKS=756362	? (exit code) TT=0.297	UNSAT TT=0.037 ASSIGNMENTS=52 CHECKS=34504	UNSAT TT=0.044 ASSIGNMENTS=85 CHECKS=55637	? TT=1.68	UNSAT TT=1.099	UNSAT TT=1.245
csp/rcpspTighter/ normalized-rcpsptight25-37.xml	UNSAT TT=0.069	? TT=0.698	? TT=0.669	UNSAT TT=0.833	UNSAT TT=0.131 CHECKS=11505	UNSAT TT=0.151 CHECKS=11535	UNSAT TT=0.952 ASSIGNMENTS=0	UNSAT TT=1.02 ASSIGNMENTS=0	UNSAT TT=0.08 ASSIGNMENTS=89 CHECKS=88964	UNSAT TT=0.078 ASSIGNMENTS=89 CHECKS=88964	UNSAT TT=0.069 ASSIGNMENTS=103 CHECKS=93938	UNSAT TT=0.722 ASSIGNMENTS=2751 CHECKS=1312100	? (exit code) TT=0.31	UNSAT TT=0.109 ASSIGNMENTS=162 CHECKS=134322	UNSAT TT=0.089 ASSIGNMENTS=146 CHECKS=130827	? TT=1.71	UNSAT TT=1.302	UNSAT TT=1.638
csp/rcpspTighter/ normalized-rcpsptight25-38.xml	UNSAT TT=1.243	? TT=0.608	? TT=0.61	UNSAT TT=249.56	? (TO) TT=1800.03	UNSAT TT=680.022 CHECKS=58899000	? (TO) TT=1800.11	UNSAT TT=11.292 ASSIGNMENTS=3174	UNSAT TT=11.25 ASSIGNMENTS=7157 CHECKS=7611830	UNSAT TT=10.612 ASSIGNMENTS=7157 CHECKS=7611830	UNSAT TT=2.071 ASSIGNMENTS=4319 CHECKS=4153920	UNSAT TT=2.871 ASSIGNMENTS=9007 CHECKS=5509230	? (exit code) TT=0.304	UNSAT TT=6.067 ASSIGNMENTS=10039 CHECKS=9213400	UNSAT TT=3.714 ASSIGNMENTS=7157 CHECKS=7611830	? TT=1.702	UNSAT TT=1.243	UNSAT TT=1.404
csp/rcpspTighter/ normalized-rcpsptight25-39.xml	UNSAT TT=0.011	? TT=0.635	? TT=0.655	? (TO) TT=1800.08	UNSAT TT=0.014 CHECKS=471	UNSAT TT=0.011 CHECKS=471	UNSAT TT=0.735 ASSIGNMENTS=0	UNSAT TT=0.806 ASSIGNMENTS=0	UNSAT TT=1.401 ASSIGNMENTS=3042 CHECKS=3073840	UNSAT TT=13.801 ASSIGNMENTS=11924 CHECKS=13528200	UNSAT TT=1.554 ASSIGNMENTS=3003 CHECKS=3352220	UNSAT TT=2.21 ASSIGNMENTS=7101 CHECKS=4713580	? (exit code) TT=0.318	UNSAT TT=8.021 ASSIGNMENTS=13169 CHECKS=14465600	UNSAT TT=6.224 ASSIGNMENTS=11924 CHECKS=13528200	? TT=1.672	UNSAT TT=1.234	UNSAT TT=1.408
csp/rcpspTighter/ normalized-rcpsptight25-40.xml	UNSAT TT=1.685	? TT=0.703	? TT=0.624	UNSAT TT=156.548	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=1720.13 ASSIGNMENTS=1006120	UNSAT TT=527.112 ASSIGNMENTS=206029	UNSAT TT=19.879 ASSIGNMENTS=18084 CHECKS=29092100	UNSAT TT=18.286 ASSIGNMENTS=18084 CHECKS=29092100	UNSAT TT=4.757 ASSIGNMENTS=7457 CHECKS=10836300	UNSAT TT=4.857 ASSIGNMENTS=11796 CHECKS=10914700	? (exit code) TT=0.288	UNSAT TT=62.392 ASSIGNMENTS=74721 CHECKS=110836000	UNSAT TT=12.38 ASSIGNMENTS=18084 CHECKS=29092100	? TT=1.865	UNSAT TT=1.685	UNSAT TT=1.745

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	20	20	95	90	92	94	98	100	100	100	100	20	101	100	20	102	102
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	20	20	95	90	92	94	98	100	100	100	100	20	101	100	20	102	102
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	6	10	17	0	0	2	2	27	6	0	6	21	0	8	3
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0