Benchmark

non-incremental/UF/sledgehammer/NS_Shared/smtlib.779139.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size10568
Compressed Size2077
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status None
Size 10560
Compressed Size2109
Max. Term Depth10
Asserts 59
Declared Functions28
Declared Constants19
Declared Sorts 25
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false6 ite2 not16 or12
and21 =>24 =160 forall56
exists6 let24

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 1.00 (0/6) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.07800 456.93100
Vampire vampire4.2-smt vampire unknown ❌ 600.06400 2307.22000
veriT veriT-2017-06-17 default unknown ❌ 600.03400 599.91200
Z3 z3-4.5.0 default unknown ❌ 600.01400 599.93000
SMT-COMP 2018 1.00 (0/6) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1193.81000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.06000 4774.55000
veriT veriT_default unknown ❌ 1200.02000 1199.81000
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1199.93000
SMT-COMP 2019 1.00 (0/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.06000 9537.07000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.10000 2347.83000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 2400.09000 2420.81000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.04000 7191.17000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.05000 2445.57000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.35681 3.40490
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.13215 3.40395
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.39885 3.40985
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.11000 9558.04000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 2400.10000 9538.67000
veriT veriT-wrapped-sq_default unknown ❌ 2400.03000 2399.94000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 631.48600 631.35300
SMT-COMP 2022 1.00 (0/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 1169.04000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.12000 1190.36000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.83728 4.62071
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.05000 4778.53000
veriT veriT_default unknown ❌ 1200.09000 1199.90000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.05000 1199.87000
Z3 z3-4.8.17_default unknown ❌ 454.84200 454.74700
SMT-COMP 2023 1.00 (0/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.12000 1128.25000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.11000 1183.62000
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.10000 4744.34000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.08000 4286.94000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.77940 4.61267
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.05000 4774.68000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.83000