Benchmark

non-incremental/UF/sledgehammer/NS_Shared/uf.657306.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size93341
Compressed Size14068
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 93333
Compressed Size14081
Max. Term Depth20
Asserts 483
Declared Functions213
Declared Constants153
Declared Sorts 226
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false41 ite5 not124
or30 and30 =>400 =1065
forall488 exists13 let229

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.71061 0.70889
CVC4 CVC4 f7118b2 default unsat ✅ 20.55660 20.54390
veriT veriT-smtcomp2014 default unsat ✅ 0.62366 0.61491
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.81000 2400.04000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unsat ✅ 1.99170 1.99170
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.27996 0.27696
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.27927 0.27696
veriT veriT default unknown ❌ 2400.01000 2400.34000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.66000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.30790 0.30829
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 42.88630 43.09960
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 14.02150 55.47000
veriT veriT-dev default unsat ✅ 0.26592 0.26628
Z3 z3-4.4.1 default unknown ❌ 878.63500 879.19000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.27840 0.27898
Vampire vampire4.2-smt vampire unsat ✅ 7.20850 28.07000
veriT veriT-2017-06-17 default unsat ✅ 6.07027 6.06871
Z3 z3-4.5.0 default unknown ❌ 600.01300 599.71000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.30164 0.30121
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 222.41000 883.49000
veriT veriT_default unsat ✅ 6.08193 6.08218
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.76000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 1.29839 4.76000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.30187 0.30222
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.30671 0.30693
Par4 Par4-wrapped-sq_default unsat ✅ 0.32177 0.00639
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.10000 2405.07000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.44965 3.84458
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.16607 3.60728
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.24798 3.67424
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 40.01440 158.04000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 178.92400 710.73000
veriT veriT-wrapped-sq_default unsat ✅ 6.08858 6.08737
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 1887.46000 1886.97000
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.30064 0.30120
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.34069 0.34124
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.05000 4437.38000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.12000 1313.65000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.87364 4.97899
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 30.49650 120.92000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1200.02000
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 unsat ✅ 0.48735 0.35412
iProver iProver v3.9.3 unknown ❌ 1201.75244 4783.18668
SMTInterpol SMTInterpol unknown ❌ 1201.78628 1702.76905
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.01969 4.30695
Yices2 Yices2 unknown ❌ 1201.45170 1201.20533