Benchmark

non-incremental/UFLIA/sledgehammer/StrongNorm/smtlib.848464.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size95278
Compressed Size16243
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 95270
Compressed Size16212
Max. Term Depth15
Asserts 497
Declared Functions233
Declared Constants226
Declared Sorts 246
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false80 ite26 not61 or31
and124 =>281 =1099 forall515
exists41 let152 Int2 +23
-4 <12 <=1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01830 0.01000
CVC4 CVC4 f7118b2 default unsat ✅ 0.19311 0.18297
veriT veriT-smtcomp2014 default unsat ✅ 0.07586 0.06599
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09097 0.08199
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01289 0.01200
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.20258 0.19997
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.20139 0.19897
veriT veriT default unsat ✅ 0.09322 0.09198
Z3 z3 4.4.0 default unsat ✅ 0.10744 0.10698
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.24098 0.24137
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 5.52107 5.54649
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.87830 3.28000
veriT veriT-dev default unsat ✅ 0.05438 0.05465
Z3 z3-4.4.1 default unknown ❌ 0.08838 0.08983
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.24807 0.24686
Vampire vampire4.2-smt vampire unsat ✅ 5.31942 20.90000
veriT veriT-2017-06-17 default unsat ✅ 0.08552 0.08526
Z3 z3-4.5.0 default unsat ✅ 0.11937 0.11773
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.27218 0.27237
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 21.57000 85.54000
veriT veriT_default unsat ✅ 0.09287 0.09308
Z3 z3-4.7.1_default unsat ✅ 0.12176 0.12170
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.18061 0.18049
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.27716 0.27750
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.27866 0.27898
Par4 Par4-wrapped-sq_default unsat ✅ 0.10479 0.00565
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2439.68000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.68933 4.03740
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.13279 3.66660
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.53804 4.01416
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 13.32920 52.31000
veriT veriT-wrapped-sq_default unsat ✅ 0.09669 0.09692
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.12834 0.12834
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.20146 0.20019
CVC4 CVC4-sq-final_default unsat ✅ 0.32126 0.32159
Par4 Par4-wrapped-sq_default unsat ✅ 0.11196 0.00904
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.10000 1224.76000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.55294 3.90726
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 3.76901 14.52000
veriT veriT_default unsat ✅ 0.10242 0.10278
veriT+vite_default unsat ✅ 0.06448 0.06480
Z3 z3-4.8.8_default unsat ✅ 0.13899 0.13894
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.32091 0.32123
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.33017 0.33072
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.95849 5.27589
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 4.34591 16.87000
veriT veriT_default unsat ✅ 0.07487 0.07526
Z3 z3-4.8.17_default unsat ✅ 0.12748 0.12924
SMT-COMP 2023 0.40 (3/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.27106 0.27158
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.33000 0.33061
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 90.25530 349.50000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.10000 3542.30000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.99088 5.20774
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 3.34135 13.12000
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 0.38575 0.28580
iProver iProver v3.9 unsat ✅ 10.45463 33.67455
SMTInterpol SMTInterpol unknown ❌ 1202.71812 4341.67330
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.40776 0.29011
iProver iProver v3.9.3 unsat ✅ 10.42777 33.43353
SMTInterpol SMTInterpol unknown ❌ 640.84084 2369.12730
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.99381 4.13450