Benchmark

non-incremental/UF/sledgehammer/QEpres/uf.1041819.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size75226
Compressed Size11379
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 75218
Compressed Size11343
Max. Term Depth11
Asserts 481
Declared Functions126
Declared Constants113
Declared Sorts 141
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false42 ite5 not99
or18 and79 =>382 =1215
forall522 exists39 let103

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.15346 0.14498
CVC4 CVC4 f7118b2 default unsat ✅ 0.18716 0.17597
veriT veriT-smtcomp2014 default unsat ✅ 0.05753 0.05599
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 1164.24000 1164.51000
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.14203 0.14098
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.19058 0.18797
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.19198 0.18897
veriT veriT default unsat ✅ 0.07369 0.07299
Z3 z3 4.4.0 default unknown ❌ 358.56700 358.68100
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.21943 0.21976
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.32455 0.32629
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.18840 0.09958
veriT veriT-dev default unsat ✅ 0.04616 0.04679
Z3 z3-4.4.1 default unknown ❌ 335.03300 335.17600
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.22523 0.22368
Vampire vampire4.2-smt vampire unsat ✅ 0.11059 0.11066
veriT veriT-2017-06-17 default unsat ✅ 0.06178 0.06112
Z3 z3-4.5.0 default unsat ✅ 0.66681 0.66614
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.24054 0.24076
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1.48037 5.53000
veriT veriT_default unsat ✅ 0.06306 0.06332
Z3 z3-4.7.1_default unknown ❌ 405.13000 405.11200
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.22314 0.22360
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.24125 0.24146
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.24216 0.24246
Par4 Par4-wrapped-sq_default unsat ✅ 0.07930 0.00588
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2402.34000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.55354 3.89180
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.24379 3.56444
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.47546 3.85693
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.67632 2.23000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.83284 2.94000
veriT veriT-wrapped-sq_default unsat ✅ 0.07186 0.07222
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 356.70200 356.62500
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.24125 0.23584
CVC4 CVC4-sq-final_default unsat ✅ 0.28099 0.28120
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.24330 0.24361
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 4166.25000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.54056 3.87656
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.32175 0.16736
vampire-4.3-smt_vampire_smtcomp unsat ✅ 2.22951 8.34000
veriT veriT_default unsat ✅ 0.05514 0.05549
veriT+vite_default unsat ✅ 0.05363 0.05390
Z3 z3-4.8.8_default unknown ❌ 249.63300 249.60100
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.28456 0.28492
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.27737 0.27790
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.05094 4.96372
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.31527 0.18544
veriT veriT_default unsat ✅ 0.05398 0.05436
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.04384 0.04381
Z3 z3-4.8.17_default unknown ❌ 236.19700 236.17500
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.24917 0.24978
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.27803 0.27855
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.65146 5.32000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 3863.19000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.95696 4.94045
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.25539 0.19536
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.09745 0.09741
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.42860 0.30135
iProver iProver v3.9.3 unsat ✅ 4.40615 14.06680
SMTInterpol SMTInterpol unknown ❌ 934.71661 3121.33780
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.98983 4.26047
Yices2 Yices2 unsat ✅ 0.31414 0.19648