Benchmark

non-incremental/QF_IDL/schedulingIDL/tai_20x20_3_mkspan1257.smt2

Solving scheduling problems from http://bach.istc.kobe-u.ac.jp/csp2sat/ by dicotomic search.
Benchmark
Size534646
Compressed Size44533
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 534638
Compressed Size44521
Max. Term Depth5
Asserts 1
Declared Functions0
Declared Constants401
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 or7600 and1 let1
-30800 <=16000 >=400

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.60 (2/5) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌
OpenSMT OpenSMT-SMT-COMP-2010 default sat ✅ 30.40420
OpenSMT-SMT-COMP-2011 default sat ✅ 27.04360
veriT veriT-SMT-COMP-2010 default unknown ❌
veriT-SMT-COMP-2011 default unknown ❌
veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 6.22975
Z3-SMT-COMP-2011 default sat ✅ 6.15813
SMT-COMP 2014 0.50 (2/4) CVC4 CVC4 f7118b2 default unknown ❌ 2399.12000 2400.01000
veriT veriT-smtcomp2014 default unknown ❌ 2399.02000 2400.04000
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 2.28494 2.27765
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 7.20249 7.19290
SMT-COMP 2015 0.60 (2/5) CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.91000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.94000
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unknown ❌ 2400.02000 2792.06000
veriT veriT default unknown ❌ 2400.01000 2401.03000
Yices2 Yices default sat ✅ 2.70983 2.70959
Z3 z3 4.4.0 default sat ✅ 7.41036 7.41287
SMT-COMP 2016 0.60 (2/5) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.03000 2401.36000
SMTInterpol smtinterpol-2.1-258-g92ab3df default unknown ❌ 2400.13000 2694.40000
veriT veriT-dev default unknown ❌ 2400.05000 2401.43000
Yices2 Yices-2.4.2 default sat ✅ 3.46905 3.47095
Z3 z3-4.4.1 default sat ✅ 9.34605 9.35345
SMT-COMP 2017 0.60 (2/5) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.01300 599.95500
SMTInterpol SMTInterpol default unknown ❌ 600.05800 690.63000
veriT veriT-2017-06-17 default unknown ❌ 600.06600 343.01700
Yices2 Yices2-Main default sat ✅ 6.65085 6.65044
Z3 z3-4.5.0 default sat ✅ 10.71360 10.71160
SMT-COMP 2018 0.57 (3/7) CVC4 CVC4-experimental-idl-2_default sat ✅ 164.23800 164.22100
master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.10000 1199.90000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.08000 1199.93000
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unknown ❌ 1200.09000 1361.66000
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.02000 1199.97000
veriT veriT_default unknown ❌ 1200.03000 1199.94000
Yices2 Yices 2.6.0_default sat ✅ 2.58225 2.58214
Z3 z3-4.7.1_default sat ✅ 9.56273 9.56241
SMT-COMP 2020 0.57 (3/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 1199.89000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.90000
Par4 Par4-wrapped-sq_default sat ✅ 4.33281 16.92000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.11000 1222.20000
veriT veriT_default unknown ❌ 1200.03000 1199.96000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 4.07174 4.07145
Z3 z3-4.8.8_default sat ✅ 7.94663 7.94637
z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 6.39595 6.39626
SMT-COMP 2021 0.50 (4/8) cvc5 cvc5-fixed_default unknown ❌ 1200.03000 1199.90000
MathSAT mathsat-5.6.6_default unknown ❌ 1200.03000 1199.67000
OpenSMT OpenSMT-fixed_default sat ✅ 77.99000 77.98590
Par4 Par4-wrapped-sq_default sat ✅ 3.39165 13.27000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.13000 1218.57000
veriT veriT_default unknown ❌ 1200.02000 1200.02000
YicesLS YicesLS_0611_1448_default sat ✅ 3.32196 3.29000
Z3 z3-4.8.11_default sat ✅ 10.33540 10.33490
SMT-COMP 2022 0.50 (3/6) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.10000 1199.90000
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.02000 1199.89000
Par4 Par4-wrapped-sq_default sat ✅ 3.08190 11.85000
veriT veriT_default unknown ❌ 1200.10000 1199.94000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 2.92947 2.92930
Z3 z3-4.8.17_default sat ✅ 14.54660 14.54750
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.01000 1199.74000
OpenSMT OpenSMT a78dcf01_default sat ✅ 115.43200 115.40100
Par4 Par4-wrapped-sq_default sat ✅ 2.89647 11.19000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.02000 1219.88000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 2.68023 2.68027
Z3++ Z3++_sq_0526_default sat ✅ 9.75547 9.75462
SMT-COMP 2024 0.40 (3/5) cvc5 cvc5 unknown ❌ 1201.74739 1200.38557
OpenSMT OpenSMT sat ✅ 67.80682 67.69749
SMTInterpol SMTInterpol unknown ❌ 1201.71993 1225.49505
Yices2 Yices2 sat ✅ 1.86274 1.76280
Z3alpha Z3-alpha sat ✅ 7.45726 7.35266
SMT-COMP 2025 0.33 (4/6) cvc5 cvc5 unknown ❌ 1201.78866 1200.99572
OpenSMT OpenSMT sat ✅ 74.50090 74.35918
SMTInterpol SMTInterpol unknown ❌ 1201.34708 1225.62501
Yices2 Yices2 sat ✅ 1.66440 1.54143
Z3alpha Z3-alpha sat ✅ 12.62329 48.86413
Z3 Z3-alpha-base sat ✅ 7.37971 7.24990