Benchmark

non-incremental/UFLIA/sledgehammer/NS_Shared/smtlib.781192.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size86441
Compressed Size11947
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 86433
Compressed Size11983
Max. Term Depth13
Asserts 475
Declared Functions113
Declared Constants118
Declared Sorts 125
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false84 ite21 not138 or28
and119 =>448 =1234 forall550
exists94 let155 Int2 +1
<1 <=1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01704 0.00900
CVC4 CVC4 f7118b2 default unsat ✅ 0.18784 0.17597
veriT veriT-smtcomp2014 default unsat ✅ 0.06682 0.05799
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.02000 2400.01000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01076 0.01000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.17344 0.17097
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.16806 0.16497
veriT veriT default unsat ✅ 0.08282 0.08199
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.87000
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.24240 0.24288
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 28.53990 28.68140
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 10.87250 43.02130
veriT veriT-dev default unsat ✅ 0.04894 0.04923
Z3 z3-4.4.1 default unknown ❌ 2400.10000 2401.33000
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.24478 0.24408
Vampire vampire4.2-smt vampire unsat ✅ 7.74131 30.41000
veriT veriT-2017-06-17 default unsat ✅ 0.05676 0.05636
Z3 z3-4.5.0 default unknown ❌ 600.09400 599.86000
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.26196 0.26203
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 8.32545 32.71000
veriT veriT_default unsat ✅ 0.06189 0.06213
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1199.93000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.16633 0.16807
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.26392 0.26428
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.26716 0.26742
Par4 Par4-wrapped-sq_default unsat ✅ 0.07352 0.00575
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2402.96000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.32180 3.80694
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.15594 3.62794
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.52469 3.73822
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 19.03020 75.02000
veriT veriT-wrapped-sq_default unsat ✅ 0.06722 0.06762
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 1162.34000 1162.27000
SMT-COMP 2020 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.18278 0.18238
CVC4 CVC4-sq-final_default unsat ✅ 0.30936 0.30964
Par4 Par4-wrapped-sq_default unsat ✅ 0.08356 0.00634
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.04000 1212.87000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.42326 3.88488
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 3.69188 14.49000
veriT veriT_default unsat ✅ 0.06667 0.06703
veriT+vite_default unsat ✅ 0.05620 0.05653
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.71000
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 0.30892 0.30926
cvc5 cvc5-fixed_default unsat ✅ 0.26329 0.26383
Par4 Par4-wrapped-sq_default unsat ✅ 0.08088 0.00987
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 122.71500 292.38900
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.94218 5.04262
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 12.33770 48.07860
vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.70517 6.56000
veriT veriT_default unsat ✅ 0.06328 0.06364
Z3 z3-4.8.11_default unknown ❌ 1200.12000 1200.04000
z3-4.8.8_default unknown ❌ 1200.08000 1199.83000
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 0.31127 0.31159
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.30249 0.30234
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.72772 4.84632
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 5.12781 19.97000
veriT veriT_default unsat ✅ 0.06449 0.06487
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.78000
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.39238 0.27459
iProver iProver v3.9.3 unsat ✅ 31.98106 116.28281
SMTInterpol SMTInterpol unknown ❌ 784.18002 2972.10727
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.92971 4.20838