Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1097873.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size109878
Compressed Size13253
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 109870
Compressed Size13322
Max. Term Depth15
Asserts 437
Declared Functions153
Declared Constants93
Declared Sorts 174
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false164 not104 or2 and31
=>668 =1110 forall546 exists27
let162

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 1884.96000 1885.21000
CVC4 CVC4 f7118b2 default unsat ✅ 2.99186 2.98155
veriT veriT-smtcomp2014 default unknown ❌ 195.55800 195.54600
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.12131 0.11398
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2403.77000 2404.32000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.24983 0.24696
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.24954 0.24696
veriT veriT default unknown ❌ 2128.60000 2129.11000
Z3 z3 4.4.0 default unsat ✅ 0.13396 0.13398
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.29776 0.29843
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 102.69300 103.17500
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 14.45600 57.12000
veriT veriT-dev default unsat ✅ 20.14810 20.16030
Z3 z3-4.4.1 default unsat ✅ 0.13270 0.13402
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.29137 0.29085
Vampire vampire4.2-smt vampire unsat ✅ 0.65930 2.40000
veriT veriT-2017-06-17 default unsat ✅ 1.03535 1.03409
Z3 z3-4.5.0 default unsat ✅ 0.13612 0.13533
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.32564 0.32584
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 424.91000 1690.53000
veriT veriT_default unsat ✅ 1.10687 1.10699
Z3 z3-4.7.1_default unsat ✅ 0.14464 0.14453
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.59607 0.59657
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.32553 0.32571
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.32992 0.33020
Par4 Par4-wrapped-sq_default unsat ✅ 0.15480 0.00643
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.07000 2909.82000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.55149 3.77822
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.13970 3.51769
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.52966 3.69586
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 4.02581 15.47000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 443.07700 1760.22000
veriT veriT-wrapped-sq_default unsat ✅ 1.06797 1.06779
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.15021 0.15022
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.30460 0.30494
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.25559 0.25556
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.91931 5.12565
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 1.03454 3.66000
veriT veriT_default unsat ✅ 1.53089 1.53142
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.01000 1199.84000
Z3 z3-4.8.17_default unsat ✅ 0.15965 0.16143
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.18960 0.19022
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.25552 0.25597
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.08000 4665.60000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.12000 1254.41000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.79799 4.99222
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.86445 3.10000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1200.04000