Benchmark

non-incremental/UF/sledgehammer/QEpres/uf.727606.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size20046
Compressed Size3278
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 20038
Compressed Size3289
Max. Term Depth10
Asserts 135
Declared Functions46
Declared Constants52
Declared Sorts 58
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true4 false21 ite1 not35
or11 and15 =>111 =346
forall131 exists6 let14

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 2401.92000 2402.05000
CVC4 CVC4 f7118b2 default unsat ✅ 20.59800 20.59290
veriT veriT-smtcomp2014 default unsat ✅ 29.30830 29.31150
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.23498 0.22697
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2402.05000 2402.48000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.34338 0.33995
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.34231 0.33995
veriT veriT default unsat ✅ 0.46319 0.46193
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.90000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.67924 0.67976
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.09002 0.09047
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.10806 0.07764
veriT veriT-dev default unsat ✅ 0.09018 0.09043
Z3 z3-4.4.1 default unknown ❌ 251.05000 251.11900
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.58842 0.58732
Vampire vampire4.2-smt vampire unsat ✅ 0.13045 0.12876
veriT veriT-2017-06-17 default unsat ✅ 0.18439 0.18375
Z3 z3-4.5.0 default unknown ❌ 393.87100 393.75700
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.54426 0.54438
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.15438 0.07832
veriT veriT_default unsat ✅ 0.13110 0.13130
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.97000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 9.38938 37.01000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.35229 0.35264
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.34886 0.34901
Par4 Par4-wrapped-sq_default unsat ✅ 0.20583 0.01194
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2594.31000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.42107 3.40878
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.15455 3.42562
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.40775 3.36354
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.51436 0.49366
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.08237 0.08208
veriT veriT-wrapped-sq_default unsat ✅ 0.19040 0.19048
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 276.48000 276.43000
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 8.70720 34.48000
CVC4 CVC4-sq-final_default unsat ✅ 0.56820 0.56826
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.56672 0.56708
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1245.51000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.27392 3.42076
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.09859 0.09840
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.08829 0.08817
veriT veriT_default unsat ✅ 180.23900 180.20200
veriT+vite_default unsat ✅ 5.12512 5.12606
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1200.04000
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.50949 0.50981
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 12.28200 47.31840
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 20.30580 25.53790
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.06649 5.15870
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.11800 0.11762
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.10048 0.10021
veriT veriT_default unsat ✅ 0.07386 0.07418
Z3 z3-4.8.11_default unknown ❌ 1200.04000 1199.86000
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 0.42737 0.30846
iProver iProver v3.9.3 unsat ✅ 26.98269 99.24564
SMTInterpol SMTInterpol unknown ❌ 1201.87627 2510.97097
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.94807 4.12538
Yices2 Yices2 unknown ❌ 1201.40641 1200.99196