Benchmark

non-incremental/UFLIA/sledgehammer/StrongNorm/smtlib.881382.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size24808
Compressed Size4528
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status None
Size 24800
Compressed Size4549
Max. Term Depth15
Asserts 145
Declared Functions38
Declared Constants34
Declared Sorts 39
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false44 ite8 not33 or9
and28 =>126 =305 forall163
exists13 let34 Int2 +23
-5 <14 <=1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 1.00 (0/4) CVC3 CVC3 default unknown ❌ 0.01664 0.00800
CVC4 CVC4 f7118b2 default unknown ❌ 2399.91000 2400.05000
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.10000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2068.89000 2069.65000
SMT-COMP 2015 1.00 (0/4) CVC3 CVC3 default unknown ❌ 0.00931 0.00900
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.46000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.51000
veriT veriT default unknown ❌ 2400.01000 2401.02000
Z3 z3 4.4.0 default unknown ❌ 1245.78000 1245.97000
SMT-COMP 2016 0.75 (1/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.03000 2310.96000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 377.25400 379.21000
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 64.53430 255.65000
veriT veriT-dev default unknown ❌ 2400.08000 2581.40000
Z3 z3-4.4.1 default unknown ❌ 822.74800 823.00100
SMT-COMP 2017 0.75 (1/4) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.03200 587.96000
Vampire vampire4.2-smt vampire unsat ✅ 98.68190 392.25000
veriT veriT-2017-06-17 default unknown ❌ 600.04900 599.96200
Z3 z3-4.5.0 default unknown ❌ 600.05800 599.76000
SMT-COMP 2018 0.75 (1/4) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1184.84000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 37.79970 150.11000
veriT veriT_default unknown ❌ 1200.12000 1259.95000
Z3 z3-4.7.1_default unknown ❌ 797.36800 797.05600
SMT-COMP 2021 0.88 (1/8) CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1188.36000
cvc5 cvc5-fixed_default unknown ❌ 1200.09000 270.80900
Par4 Par4-wrapped-sq_default unknown ❌ 1200.10000 3578.49000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.07000 4269.22000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.89125 4.77266
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.08000 4741.95000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 260.68300 1034.33000
veriT veriT_default unknown ❌ 1200.11000 1199.93000
Z3 z3-4.8.11_default unknown ❌ 435.72800 435.57000
z3-4.8.8_default unknown ❌ 451.35900 451.32000
SMT-COMP 2024 1.00 (0/3) cvc5 cvc5 unknown ❌ 1201.71700 1201.09250
iProver iProver v3.9 unknown ❌ 1201.74643 4742.25122
SMTInterpol SMTInterpol unknown ❌ 1183.34128 4435.87703
SMT-COMP 2025 1.00 (0/4) cvc5 cvc5 unknown ❌ 1201.77029 1201.04514
iProver iProver v3.9.3 unknown ❌ 1201.79586 4761.55018
SMTInterpol SMTInterpol unknown ❌ 309.92922 1154.19705
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.96903 4.19611