Benchmark

non-incremental/UFLIA/sledgehammer/FFT/smtlib.551876.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size45108
Compressed Size6080
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 45100
Compressed Size6083
Max. Term Depth14
Asserts 330
Declared Functions21
Declared Constants40
Declared Sorts 23
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false30 ite5 not41
or10 and30 =>154 =682
forall346 exists18 let149 Int2
+8 <5 <=7

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01659 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 39.28910 39.28900
veriT veriT-smtcomp2014 default unsat ✅ 347.41200 347.52500
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1.78519 1.77673
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00937 0.00900
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 17.73450 17.73930
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 17.57480 17.57930
veriT veriT default unknown ❌ 2400.01000 2400.87000
Z3 z3 4.4.0 default unsat ✅ 1.96267 1.96370
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 226.58700 221.48100
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 1000.06000 1004.85000
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 995.60200 3318.52000
veriT veriT-dev default unsat ✅ 219.34700 219.47800
Z3 z3-4.4.1 default unsat ✅ 2.31226 2.31502
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 17.25480 17.25500
Vampire vampire4.2-smt vampire unknown ❌ 600.06100 2333.32000
veriT veriT-2017-06-17 default unsat ✅ 12.90250 12.89000
Z3 z3-4.5.0 default unsat ✅ 2.85568 2.85566
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 14.36490 14.36470
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.09000 4774.07000
veriT veriT_default unsat ✅ 0.18115 0.18140
Z3 z3-4.7.1_default unsat ✅ 2.05404 2.05374
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 791.53600 3143.78000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 10.11820 10.11810
master-2018-06-10-b19c840-competition-default_default unsat ✅ 11.39240 11.39240
Par4 Par4-wrapped-sq_default unsat ✅ 0.22655 0.00591
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2407.04000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.43980 3.39834
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.16152 3.37778
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.31551 3.36091
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.03000 8894.23000
veriT veriT-wrapped-sq_default unsat ✅ 0.20406 0.20438
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 2.05657 2.05643
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 11.61310 11.61230
cvc5 cvc5-fixed_default unsat ✅ 16.55610 16.55290
Par4 Par4-wrapped-sq_default unsat ✅ 0.21754 0.00634
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.09000 4226.60000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.84300 4.65271
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.08000 4739.67000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.11000 4773.76000
veriT veriT_default unsat ✅ 9.17162 9.17177
Z3 z3-4.8.11_default unsat ✅ 1.54386 1.54240
z3-4.8.8_default unsat ✅ 1.54242 1.54223
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 11.43520 11.43560
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 98.68160 98.64100
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.82040 4.66865
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.05000 4780.67000
veriT veriT_default unsat ✅ 5.63977 5.63928
Z3 z3-4.8.17_default unsat ✅ 1.63483 1.63655
SMT-COMP 2023 0.80 (1/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 8.72360 8.72331
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 9.23121 9.23008
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.08000 4689.16000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.07000 4125.01000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.85525 4.86046
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.09000 4768.53000
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 7.61960 7.51954
iProver iProver v3.9 unsat ✅ 818.52743 3225.21220
SMTInterpol SMTInterpol unknown ❌ 1025.40953 3861.24080
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 4.13360 4.01147
iProver iProver v3.9.3 unknown ❌ 1201.79568 4761.93585
SMTInterpol SMTInterpol unknown ❌ 1023.78907 3963.94803
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.92699 3.86516