Benchmark

non-incremental/UF/sledgehammer/QEpres/uf.1044771.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size75209
Compressed Size11381
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 75201
Compressed Size11343
Max. Term Depth11
Asserts 481
Declared Functions126
Declared Constants113
Declared Sorts 141
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false42 ite5 not99
or17 and79 =>382 =1214
forall522 exists39 let103

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.14901 0.14098
CVC4 CVC4 f7118b2 default unsat ✅ 0.18457 0.17297
veriT veriT-smtcomp2014 default unsat ✅ 0.06267 0.05399
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09734 0.08599
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.14030 0.13998
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.19137 0.18897
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.19326 0.19097
veriT veriT default unsat ✅ 0.07371 0.07299
Z3 z3 4.4.0 default unsat ✅ 0.10908 0.10898
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.21998 0.22027
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.31245 0.31332
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.19089 0.09645
veriT veriT-dev default unsat ✅ 0.04316 0.04332
Z3 z3-4.4.1 default unsat ✅ 0.11362 0.11495
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.22401 0.22348
Vampire vampire4.2-smt vampire unsat ✅ 0.12579 0.12471
veriT veriT-2017-06-17 default unsat ✅ 0.05991 0.05924
Z3 z3-4.5.0 default unsat ✅ 0.11991 0.11938
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.23847 0.23870
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.07639 4.11000
veriT veriT_default unsat ✅ 0.06143 0.06168
Z3 z3-4.7.1_default unsat ✅ 0.13071 0.13066
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.18562 0.18696
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.24340 0.24377
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.24283 0.24312
Par4 Par4-wrapped-sq_default unsat ✅ 0.07219 0.00656
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2459.90000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.37061 3.77411
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.12673 3.58073
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.52515 3.74113
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.83763 2.97703
vampire-4.3-smt_vampire_smtcomp unsat ✅ 2.05719 7.93000
veriT veriT-wrapped-sq_default unsat ✅ 0.06560 0.06600
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.13734 0.13731
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.20602 0.20038
CVC4 CVC4-sq-final_default unsat ✅ 0.27904 0.27936
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.24276 0.24310
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.12000 1235.71000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.42298 3.89770
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.15413 0.15215
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.76436 6.56000
veriT veriT_default unsat ✅ 0.05491 0.05527
veriT+vite_default unsat ✅ 0.05414 0.05448
Z3 z3-4.8.8_default unsat ✅ 0.14409 0.14404
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.28458 0.28492
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 14.83270 56.52000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.02000 3260.30000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.99658 5.38034
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.25325 0.19996
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.23832 0.24106
veriT veriT_default unsat ✅ 0.04880 0.04908
Z3 z3-4.8.11_default unsat ✅ 0.13984 0.13875
SMT-COMP 2022 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.28146 0.28173
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.27442 0.27488
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.80769 5.02695
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.29306 0.23617
veriT veriT_default unsat ✅ 0.05015 0.05055
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.06149 0.06145
Z3 z3-4.8.17_default unsat ✅ 0.13591 0.13769
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.35816 0.25866
iProver iProver v3.9 unsat ✅ 3.88639 12.14761
SMTInterpol SMTInterpol unknown ❌ 1202.71879 2534.84200
Yices2 Yices2 unsat ✅ 0.24148 0.14206
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.41593 0.29428
iProver iProver v3.9.3 unsat ✅ 1.35484 4.22029
SMTInterpol SMTInterpol unknown ❌ 844.73865 3017.40337
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.97119 4.15937
Yices2 Yices2 unsat ✅ 0.30212 0.17454