Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1469410.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size33190
Compressed Size4916
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 33182
Compressed Size4927
Max. Term Depth14
Asserts 117
Declared Functions85
Declared Constants22
Declared Sorts 70
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false54 not5 or2
and3 =>337 =412 forall151
exists17 let54

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.68714 0.67890
CVC4 CVC4 f7118b2 default sat ✅ 43.64990 43.63540
veriT veriT-smtcomp2014 default unknown ❌ 110.42100 110.43500
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.01000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.90910 0.90886
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 21.61740 21.60770
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 21.61060 21.60770
veriT veriT default unknown ❌ 1189.90000 1190.01000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.85000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 312.59200 304.77800
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 16.06660 16.14710
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 14.43940 57.12000
veriT veriT-dev default unknown ❌ 2400.08000 2401.42000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.25000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 477.66800 475.45000
Vampire vampire4.2-smt vampire sat ✅ 2.90156 11.41000
veriT veriT-2017-06-17 default unknown ❌ 600.06700 599.97000
Z3 z3-4.5.0 default unknown ❌ 600.02300 600.00000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 490.97100 514.41100
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 74.39630 295.72000
veriT veriT_default unknown ❌ 1200.09000 1199.97000
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1200.04000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.04000 9531.57000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 979.87600 972.99600
master-2018-06-10-b19c840-competition-default_default sat ✅ 501.18900 497.92900
Par4 Par4-wrapped-sq_default sat ✅ 504.10800 1507.99000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2404.29000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.36534 3.43580
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.10314 3.42707
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.46738 3.52585
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 60.05700 238.32000
vampire-4.3-smt_vampire_smtcomp sat ✅ 36.12940 143.08200
veriT veriT-wrapped-sq_default unknown ❌ 2400.04000 2399.77000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 333.08200 333.01900
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default sat ✅ 539.05200 535.94200
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.06000 4747.79000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 1237.84000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.99835 4.99773
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 41.90460 165.67000
vampire_smt_4.5_vampire_smtcomp sat ✅ 41.45880 164.35000
veriT veriT_default unknown ❌ 1200.03000 1199.82000
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.77000
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 561.78500 554.77200
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 569.41700 569.19900
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.05000 4747.89000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.13000 4118.36000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.83349 4.86401
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 36.15580 143.31000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.97000