Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.1148354.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size56310
Compressed Size8562
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 56302
Compressed Size8569
Max. Term Depth14
Asserts 292
Declared Functions86
Declared Constants86
Declared Sorts 93
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3 false31 ite10 not74
or9 and50 =>357 =818
forall335 exists25 let92

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.11520 0.10698
CVC4 CVC4 f7118b2 default unsat ✅ 0.50500 0.49392
veriT veriT-smtcomp2014 default unsat ✅ 0.07413 0.06499
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.06601 0.05799
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.10736 0.10698
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.14124 0.13898
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.14057 0.13798
veriT veriT default unsat ✅ 0.09717 0.09599
Z3 z3 4.4.0 default unsat ✅ 0.08994 0.08998
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.17000 0.17032
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.31270 0.31420
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.42254 0.32982
veriT veriT-dev default unsat ✅ 0.03725 0.03746
Z3 z3-4.4.1 default unsat ✅ 0.07986 0.08119
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.17221 0.17141
Vampire vampire4.2-smt vampire unsat ✅ 0.87428 3.30000
veriT veriT-2017-06-17 default unsat ✅ 0.05723 0.05736
Z3 z3-4.5.0 default unsat ✅ 0.08746 0.08659
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.18648 0.18665
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.65812 2.17000
veriT veriT_default unsat ✅ 0.06078 0.06105
Z3 z3-4.7.1_default unsat ✅ 0.09575 0.09570
SMT-COMP 2021 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.21779 0.21801
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 1.78401 5.57491
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 1.13614 3.20449
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.81742 5.23319
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.37678 0.31128
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.34711 0.28190
veriT veriT_default unsat ✅ 0.04240 0.04274
Z3 z3-4.8.11_default unsat ✅ 0.09458 0.09453
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.18615 0.18668
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.20786 0.20840
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.64937 4.89000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 248.75600 526.85500
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.02685 5.02177
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.36355 0.36544
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.03000 1199.85000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.34799 0.24860
iProver iProver v3.9 unsat ✅ 1.88287 4.50953
SMTInterpol SMTInterpol unknown ❌ 445.61763 1510.99705
Yices2 Yices2 unknown ❌ 1201.27498 1201.00804
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 0.38178 0.26002
iProver iProver v3.9.3 unsat ✅ 1.88505 5.02842
SMTInterpol SMTInterpol unknown ❌ 234.28493 831.51590
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.98341 4.10933
Yices2 Yices2 unknown ❌ 1201.41299 1201.14892