Benchmark

non-incremental/QF_RDL/skdmxa2/skdmxa-3x3-9.base.cvc.smt2 

Benchmarks from a specification developed by Kazuhiro Ogata (ogata@jaist.ac.jp). 
Translated into CVC format by Leonardo de Moura.

This benchmark was automatically translated into SMT-LIB format from
CVC format using CVC Lite
Benchmark
Size847260
Compressed Size105280
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2006-08-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 847252
Compressed Size105291
Max. Term Depth5311
Asserts 1
Declared Functions0
Declared Constants4612
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite2511 not2145 or890 and28401
=10563 let266 -9813 <1515
<=840

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2006 0.38 (5/8) ARIO Ario 1.2 unsat ✅ 269.70000 —
Barcelogic Barcelogic 1.1 unsat ✅ 11.80000 —
Barcelogic 1.0 (2005 winner) unsat ✅ 655.20000 —
CVC3 CVC3 unknown ❌ 190.60000 —
ExtSAT ExtSAT 1.1 unsat ✅ 33.10000 —
HTP HTP unknown ❌ 155.90000 —
HTP patched (hors-concours) unknown ❌ 155.50000 —
Jat Jat timeout ✅ 1207.00000 —
MathSAT MathSAT 3.4 unsat ✅ 998.00000 —
Yices Yices 1.0 unsat ✅ 4.20000 —
SMT-COMP 2007 0.20 (4/5) Argo-Lib ArgoLib v3.5 unknown ❌ — —
Barcelogic Barcelogic 1.2 unsat ✅ 20.90000 —
MathSAT MathSAT 4.0 unsat ✅ 6.70000 —
Yices Yices 1.0 unsat ✅ 3.80000 —
Yices 1.0.10 unsat ✅ 3.70000 —
Z3 Z3 0.1 unsat ✅ 2.60000 —
SMT-COMP 2008 0.14 (6/7) Barcelogic Barcelogic 1.3 unsat ✅ 15.70000 —
CVC3 CVC3-1.5 unknown ❌ 1801.00000 —
MathSAT MathSAT-4.2 unsat ✅ 4.50000 —
Sateen sateen-2.1.1 unsat ✅ 2.00000 —
Yices2 Yices2 (proto c) unsat ✅ 0.60000 —
Yices Yices 1.0.10 unsat ✅ 5.90000 —
Z3 Z3.2 unsat ✅ 3.00000 —
SMT-COMP 2009 0.17 (5/6) CVC3 CVC3 2.0 unknown ❌ 900.00000 —
MathSAT MathSAT 4.3 unsat ✅ 1.80000 —
OpenSMT OpenSMT 0.2 unsat ✅ 2.90000 —
veriT veriT 200907 unsat ✅ 6.60000 —
Yices2 Yices 2 proto unsat ✅ 0.20000 —
Z3 Z3.2 unsat ✅ 1.30000 —
SMT-COMP 2010 0.20 (4/5) CVC3 CVC3 2.3 unknown ❌ 1200.10000 —
OpenSMT OpenSMT-1.0-alpha unsat ✅ 8.40000 —
veriT veriT 201007 unsat ✅ 10.80000 —
Yices2 Yices 2 proto unsat ✅ 0.30000 —
Z3 Z3.2 unsat ✅ 5.40000 —
SMT-COMP 2011 0.14 (6/7) CVC3 CVC3 v2.4 unknown ❌ 1200.10000 —
CVC4 CVC4 1.0rc.2026 unsat ✅ 40.40000 —
MathSAT MathSAT5 unsat ✅ 8.70000 —
OpenSMT opensmt unsat ✅ 39.60000 —
OpenSMT-1.0-alpha unsat ✅ 8.30000 —
veriT veriT unsat ✅ 33.70000 —
Yices2 smtlib2parser+Yices 1.0.29 unsat ✅ 8.70000 —
Z3 Z3 unsat ✅ 5.10000 —
SMT Evaluation 2013 0.20 (4/5) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.75366 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.75506 —
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 5.35878 —
OpenSMT-SMT-COMP-2011 default unsat ✅ 19.91400 —
veriT veriT-SMT-COMP-2010 default unsat ✅ 9.06895 —
veriT-SMT-COMP-2011 default unsat ✅ 13.24610 —
veriT-SMT-EVAL-2013 default unsat ✅ 2.03215 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 2.06942 —
Z3-SMT-COMP-2011 default unsat ✅ 1.13370 —
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 6.21188 6.20406
veriT veriT-smtcomp2014 default unsat ✅ 0.94246 0.93386
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.25477 0.24596
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1.74444 1.74473
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 6.20775 6.20906
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 6.09154 6.09207
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 17.08670 27.04590
veriT veriT default unsat ✅ 0.98168 0.98085
Yices2 Yices default unsat ✅ 0.27614 0.27496
Z3 z3 4.4.0 default unsat ✅ 2.39703 2.39764
SMT-COMP 2016 0.14 (6/7) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 6.25261 6.25636
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 6.36251 6.36617
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 16.03860 27.58890
Toysmt toysmt default unknown ❌ 617.33400 617.54000
veriT veriT-dev default unsat ✅ 0.57219 0.57248
Yices2 Yices-2.4.2 default unsat ✅ 0.24528 0.24573
Z3 z3-4.4.1 default unsat ✅ 2.18290 4.29543
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 6.63228 6.62535
SMTInterpol SMTInterpol default unsat ✅ 18.72970 36.85840
veriT veriT-2017-06-17 default unsat ✅ 0.66095 0.66006
Yices2 Yices2-Main default unsat ✅ 0.22429 0.22146
Z3 z3-4.5.0 default unsat ✅ 2.38954 2.38928
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 8.13765 8.13748
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 2.83513 2.83619
OpenSMT opensmt2_default unsat ✅ 6.05172 6.05145
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 30.27150 46.53100
SMT-RAT SMTRAT-Rat-final_default unsat ✅ 1102.52000 1102.36000
veriT veriT_default unsat ✅ 0.66400 0.66395
Yices2 Yices 2.6.0_default unsat ✅ 0.27109 0.27100
Z3 z3-4.7.1_default unsat ✅ 2.39364 2.39351
SMT-COMP 2019 CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 7.33832 7.33814
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 18.68090 33.46790
veriT veriT-wrapped-sq_default unsat ✅ 0.65444 0.65470
Yices2 Yices 2.6.0_default unsat ✅ 0.23008 0.22964
Yices 2.6.2-wrapped-sq_default unsat ✅ 0.23345 0.23348
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 2.37344 2.37347
SMT-COMP 2020 CVC4 CVC4-sq-final_default unsat ✅ 7.92204 7.92194
MathSAT MathSAT5_default.sh unsat ✅ 2.13512 2.13502
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 13.03020 27.16740
veriT veriT_default unsat ✅ 1.58107 1.58140
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.23839 0.23829
Z3 z3-4.8.8_default unsat ✅ 1.96191 1.96169
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 2.47964 2.47945
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 28.85230 49.68450
veriT veriT_default unsat ✅ 0.64516 0.64532
Z3 z3-4.8.11_default unsat ✅ 6.97740 4.21465
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 12.59820 12.59840
MathSAT MathSAT-5.6.8_default unsat ✅ 1.99730 1.99694
veriT veriT_default unsat ✅ 0.60573 0.60586
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.23881 0.23861
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.29801 0.28469
Z3 z3-4.8.17_default unsat ✅ 2.24143 2.24225
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 6.78638 6.78102
OpenSMT OpenSMT a78dcf01_default unsat ✅ 309.07500 308.93400
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 23.71560 44.95030
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.22880 0.22876
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.23137 0.23131
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.22643 0.22638
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 7.97293 7.86878
OpenSMT OpenSMT unsat ✅ 256.22268 256.06917
SMTInterpol SMTInterpol unsat ✅ 18.11848 41.86671
Yices2 Yices2 unsat ✅ 0.39991 0.30017
Z3alpha Z3-alpha unsat ✅ 2.79645 2.69653
SMT-COMP 2025 cvc5 cvc5 unsat ✅ 3.79329 3.66764
OpenSMT OpenSMT unsat ✅ 189.87476 189.70287
SMTInterpol SMTInterpol unsat ✅ 20.39871 36.76604
Yices2 Yices2 unsat ✅ 0.41252 0.28533
Z3alpha Z3-alpha unsat ✅ 2.93692 9.84036
Z3 Z3-alpha-base unsat ✅ 1.95296 1.83538