Benchmark

non-incremental/UF/sledgehammer/Hoare/smtlib.668095.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size1141
Compressed Size496
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1133
Compressed Size494
Max. Term Depth6
Asserts 4
Declared Functions7
Declared Constants7
Declared Sorts 8
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false1 not3 and1 =8
forall2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01181 0.00300
CVC4 CVC4 f7118b2 default sat ✅ 0.02128 0.01700
veriT veriT-smtcomp2014 default unknown ❌ 0.01133 0.00300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.02239 0.01500
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00823 0.00400
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.01789 0.01400
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.01846 0.01400
veriT veriT default unknown ❌ 0.00835 0.00200
Z3 z3 4.4.0 default sat ✅ 0.03731 0.03699
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.07322 0.07555
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.69965 9.75145
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.04606 0.04049
veriT veriT-dev default unknown ❌ 0.04717 0.05276
Z3 z3-4.4.1 default sat ✅ 0.03802 0.03924
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 0.09858 0.09940
Vampire vampire4.2-smt vampire sat ✅ 0.04246 0.03808
veriT veriT-2017-06-17 default unknown ❌ 0.06808 0.08034
Z3 z3-4.5.0 default sat ✅ 0.04374 0.04300
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.10051 0.10212
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.10680 0.13096
veriT veriT_default unknown ❌ 0.06949 0.07686
Z3 z3-4.7.1_default sat ✅ 0.05121 0.05112
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 0.04302 0.11502
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.14637 0.14834
master-2018-06-10-b19c840-competition-default_default sat ✅ 0.12061 0.12276
Par4 Par4-wrapped-sq_default sat ✅ 0.06174 0.00571
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default sat ✅ 0.29074 0.39838
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.31043 3.25355
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.04913 3.25039
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.32382 3.27630
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 0.06421 0.06454
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.06339 0.06376
veriT veriT-wrapped-sq_default unknown ❌ 0.08859 0.09996
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.05550 0.05547
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 0.04410 0.12160
CVC4 CVC4-sq-final_default sat ✅ 0.14824 0.14540
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.13819 0.14057
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 0.39570 0.60918
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.38420 3.41806
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.07315 0.08265
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.10939 0.13369
veriT veriT_default unknown ❌ 1200.04000 1199.95000
veriT+vite_default unknown ❌ 1200.02000 1199.88000
Z3 z3-4.8.8_default sat ✅ 0.04722 0.04718
SMT-COMP 2023 0.17 (5/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.18360 0.16303
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.71969 0.33787
iProver iProver-3.8-fix_iprover_SMT sat ✅ 0.65140 0.35248
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 0.42137 0.65503
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.73160 4.84427
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.05158 0.05154
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.01160 0.00416
SMT-COMP 2024 cvc5 cvc5 sat ✅ 0.31388 0.21543
iProver iProver v3.9 sat ✅ 0.84471 0.50245
SMTInterpol SMTInterpol sat ✅ 0.43296 0.49954
Yices2 Yices2 sat ✅ 0.25575 0.15549