Benchmark

non-incremental/UF/sledgehammer/Hoare/uf.939362.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size18463
Compressed Size3213
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 18455
Compressed Size3229
Max. Term Depth13
Asserts 119
Declared Functions30
Declared Constants44
Declared Sorts 36
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false22 ite4 not26
or8 and14 =>77 =292
forall130 exists4 let31

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2401.82000 2402.58000
CVC4 CVC4 f7118b2 default unsat ✅ 70.53450 70.53130
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.04000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.05000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.44000 2402.81000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 40.59630 40.59880
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 40.58150 40.58280
veriT veriT default unknown ❌ 2400.01000 2400.97000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.89000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 49.41240 44.03770
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 34.48920 34.65520
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 3.18015 12.48000
veriT veriT-dev default unknown ❌ 2400.09000 2401.41000
Z3 z3-4.4.1 default unknown ❌ 2400.12000 2401.14000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 42.90220 42.68910
Vampire vampire4.2-smt vampire unsat ✅ 0.72556 2.76000
veriT veriT-2017-06-17 default unsat ✅ 0.05041 0.04942
Z3 z3-4.5.0 default unknown ❌ 600.02200 599.88000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 126.91000 120.84200
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 13.57920 53.67000
veriT veriT_default unsat ✅ 0.04686 0.04707
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1199.69000
SMT-COMP 2020 0.57 (3/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.07000 4763.56000
CVC4 CVC4-sq-final_default unsat ✅ 125.89100 120.82100
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 249.50200 241.14300
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.06000 2646.64000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.42422 3.51331
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 10.89280 42.88000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 12.06120 47.21000
veriT veriT_default unsat ✅ 0.24042 0.24073
veriT+vite_default unsat ✅ 1.21207 1.21236
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.85000
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 125.90900 120.68800
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1150.44000 4554.27000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 7.59357 17.94380
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.07281 5.13380
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 10.95220 43.18000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 10.54020 41.64000
veriT veriT_default unsat ✅ 1.05469 1.05524
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.83000