Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.745135.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size5456
Compressed Size1283
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 5448
Compressed Size1295
Max. Term Depth11
Asserts 37
Declared Functions7
Declared Constants18
Declared Sorts 7
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false8 ite4 not5 and5
=>13 =30 forall16 let19
Int23 +43 -25 *27
<15 <=6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01656 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 91.55100 91.53010
veriT veriT-smtcomp2014 default unsat ✅ 0.15157 0.13798
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 1177.72000 1177.74000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00872 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.15770 0.15498
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.15391 0.15098
veriT veriT default unsat ✅ 0.05083 0.04999
Z3 z3 4.4.0 default unknown ❌ 189.75900 189.77000
SMT-COMP 2016 0.50 (2/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 234.95000 212.99100
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 1000.09000 1004.98000
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 995.61600 3322.38000
veriT veriT-dev default unsat ✅ 0.35376 0.35423
Z3 z3-4.4.1 default unknown ❌ 199.48600 199.49100
SMT-COMP 2017 0.75 (1/4) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.03500 591.49400
Vampire vampire4.2-smt vampire unknown ❌ 600.07900 2332.03000
veriT veriT-2017-06-17 default unsat ✅ 0.08122 0.08044
Z3 z3-4.5.0 default unknown ❌ 208.09500 208.06400
SMT-COMP 2018 0.50 (2/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 305.84400 300.81000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.06000 4773.90000
veriT veriT_default unsat ✅ 0.18363 0.18391
Z3 z3-4.7.1_default unknown ❌ 209.92000 209.92400
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.07857 0.07926
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 385.26200 374.68400
master-2018-06-10-b19c840-competition-default_default unsat ✅ 199.42100 196.08600
Par4 Par4-wrapped-sq_default unsat ✅ 0.03994 0.00648
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 2657.57000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.29885 3.12705
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.15169 3.33353
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.33810 3.39604
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.10000 9536.75000
veriT veriT-wrapped-sq_default unsat ✅ 0.03027 0.03057
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 203.57900 203.54100
SMT-COMP 2022 0.67 (2/6) CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 1194.07000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.09000 1196.56000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.95005 4.80677
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 781.91300 3111.94000
veriT veriT_default unsat ✅ 0.03294 0.03329
Z3 z3-4.8.17_default unknown ❌ 1185.05000 679.47200
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 300.49832 300.33136
iProver iProver v3.9 unsat ✅ 1184.84166 4691.98889
SMTInterpol SMTInterpol unknown ❌ 1201.72036 1236.65809