Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.802230.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size6430
Compressed Size1309
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK—
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 6422
Compressed Size1316
Max. Term Depth10
Asserts 40
Declared Functions8
Declared Constants18
Declared Sorts 7
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false8 ite6 not5 and6
=>12 =32 forall14 let25
Int19 +60 -27 *27
<16 <=8

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00898 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 0.07060 0.06799
veriT veriT-smtcomp2014 default unsat ✅ 0.14032 0.13198
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 526.94500 526.94300
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00876 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 20.63060 20.63690
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 20.54960 20.55190
veriT veriT default unsat ✅ 0.10325 0.10198
Z3 z3 4.4.0 default unknown ❌ 516.50800 516.71700
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.20210 2.20358
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.46784 2.47996
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.07268 0.06460
veriT veriT-dev default unsat ✅ 0.12207 0.12260
Z3 z3-4.4.1 default unknown ❌ 1010.16000 652.36400
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.29857 0.29833
Vampire vampire4.2-smt vampire unsat ✅ 3.54567 13.84000
veriT veriT-2017-06-17 default unsat ✅ 0.17570 0.17589
Z3 z3-4.5.0 default unknown ❌ 600.01300 599.64000
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.34868 0.34883
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.12401 0.16478
veriT veriT_default unsat ✅ 0.01276 0.01297
Z3 z3-4.7.1_default unknown ❌ 1200.09000 1160.48000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.04856 0.05016
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.16160 0.16194
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.26977 0.27002
Par4 Par4-wrapped-sq_default unsat ✅ 0.02578 0.00649
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.02000 2485.92000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.36340 3.27053
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.02293 3.33740
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.40142 3.40674
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.15835 0.15617
veriT veriT-wrapped-sq_default unsat ✅ 0.01650 0.01682
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 142.51800 142.50800
SMT-COMP 2020 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.03866 0.03927
CVC4 CVC4-sq-final_default unsat ✅ 17.36910 17.36960
Par4 Par4-wrapped-sq_default unsat ✅ 0.65745 1.79000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 0.73324 1.70887
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.38908 3.46391
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.17599 0.10102
veriT veriT_default unsat ✅ 0.01702 0.01735
veriT+vite_default unsat ✅ 0.01553 0.01587
Z3 z3-4.8.8_default unsat ✅ 0.04717 0.04710
SMT-COMP 2021 0.12 (7/8) CVC4 CVC4-sq-final_default unsat ✅ 7.52173 7.52232
cvc5 cvc5-fixed_default unsat ✅ 1.24758 1.24804
Par4 Par4-wrapped-sq_default unsat ✅ 0.02454 0.00619
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 0.81605 1.99928
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.85397 4.80945
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.11496 0.11082
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.17801 0.10178
veriT veriT_default unsat ✅ 0.01619 0.01656
Z3 z3-4.8.11_default unsat ✅ 0.03224 0.03220
z3-4.8.8_default unsat ✅ 0.04790 0.04787
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 1.09605 1.09641
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.16223 1.16270
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.97954 5.18071
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 0.23992 0.25122
veriT veriT_default unsat ✅ 0.01589 0.01629
Z3 z3-4.8.17_default unsat ✅ 0.03495 0.03676
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.18064 0.18119
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.28541 0.28586
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.15149 3.44000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 0.90388 2.28326
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.79259 5.01324
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.16751 0.11017
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.47408 0.37463
iProver iProver v3.9 unsat ✅ 0.88248 1.27448
SMTInterpol SMTInterpol unsat ✅ 0.92169 2.14692
SMT-COMP 2025 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.48053 0.36005
iProver iProver v3.9.3 unsat ✅ 0.88337 1.19412
SMTInterpol SMTInterpol unsat ✅ 1.06411 2.46718
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.72560 4.02374