Benchmark

non-incremental/UF/sledgehammer/NS_Shared/uf.848730.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size94613
Compressed Size14311
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 94605
Compressed Size14382
Max. Term Depth20
Asserts 471
Declared Functions201
Declared Constants140
Declared Sorts 214
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false33 ite1 not139
or38 and24 =>427 =1088
forall469 exists12 let252

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2401.93000 2402.08000
CVC4 CVC4 f7118b2 default unsat ✅ 20.59020 20.58290
veriT veriT-smtcomp2014 default unknown ❌ 2399.22000 2400.09000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.30366 0.29396
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2402.38000 2402.67000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.24094 0.23796
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.23666 0.23396
veriT veriT default unknown ❌ 2400.01000 2400.48000
Z3 z3 4.4.0 default unsat ✅ 0.37242 0.36794
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.27794 0.27834
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 44.16470 44.40140
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 16.19000 64.20000
veriT veriT-dev default unsat ✅ 0.05771 0.05791
Z3 z3-4.4.1 default unsat ✅ 0.15742 0.15882
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.31574 0.31496
Vampire vampire4.2-smt vampire unsat ✅ 8.70491 34.09000
veriT veriT-2017-06-17 default unsat ✅ 6.06117 6.06061
Z3 z3-4.5.0 default unsat ✅ 0.16598 0.16588
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.31705 0.31702
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1084.04000 4312.10000
veriT veriT_default unsat ✅ 6.07942 6.07916
Z3 z3-4.7.1_default unsat ✅ 0.55407 0.55391
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 2.04665 7.79000
CVC4 CVC4-sq-final_default unsat ✅ 0.34972 0.35002
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.30453 0.30488
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.10000 1265.23000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.49964 3.83808
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 46.01220 182.37000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 370.24900 1470.34000
veriT veriT_default unsat ✅ 0.08146 0.08172
veriT+vite_default unsat ✅ 0.08025 0.08057
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1199.75000
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.35855 0.35877
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.35045 0.35096
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.91082 10.17180
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 46.64580 184.75000
veriT veriT_default unsat ✅ 0.07310 0.07347
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.88000
Z3 z3-4.8.17_default unsat ✅ 0.18105 0.18310
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.35826 0.35876
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.37959 0.38013
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.06000 4434.71000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.02000 1249.24000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 6.57613 5.21889
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 37.13350 147.07000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.89000
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 unsat ✅ 0.49318 0.36940
iProver iProver v3.9.3 unknown ❌ 1201.75300 4781.61358
SMTInterpol SMTInterpol unknown ❌ 1201.78840 1702.79192
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.97285 4.05897
Yices2 Yices2 unknown ❌ 1201.36943 1201.08269