Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.771190.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size41684
Compressed Size6206
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 41676
Compressed Size6250
Max. Term Depth11
Asserts 278
Declared Functions12
Declared Constants30
Declared Sorts 14
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false19 ite31 not63
or15 and45 =>220 =484
forall238 exists3 let153 Int312
+111 -91 *56 <125
<=55

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.75 (1/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 93.72720 92.28350
Vampire vampire4.2-smt vampire unknown ❌ 600.07100 2333.87000
veriT veriT-2017-06-17 default unknown ❌ 600.02100 599.99400
Z3 z3-4.5.0 default unknown ❌ 600.06200 599.93000
SMT-COMP 2018 0.75 (1/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 92.20530 91.62870
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.07000 4774.30000
veriT veriT_default unknown ❌ 1200.04000 1199.98000
Z3 z3-4.7.1_default unknown ❌ 1200.06000 1199.86000
SMT-COMP 2019 0.75 (2/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.04000 8790.70000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 123.96600 123.61200
master-2018-06-10-b19c840-competition-default_default unsat ✅ 91.94260 91.26170
Par4 Par4-wrapped-sq_default unsat ✅ 92.34400 275.78000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2752.34000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.36215 3.38717
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.03695 3.28842
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.48518 3.24275
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.07000 9573.68000
veriT veriT-wrapped-sq_default unknown ❌ 2400.09000 2399.91000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.03000 2399.59000
SMT-COMP 2020 0.75 (2/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.06000 4767.73000
CVC4 CVC4-sq-final_default unsat ✅ 93.34140 92.69010
Par4 Par4-wrapped-sq_default unsat ✅ 72.67910 217.27000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.07000 1474.52000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.39482 3.44481
Vampire vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.06000 4743.42000
veriT veriT_default unknown ❌ 1200.05000 1200.06000
veriT+vite_default unknown ❌ 1200.01000 1199.95000
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1199.79000
SMT-COMP 2021 0.75 (2/8) CVC4 CVC4-sq-final_default unsat ✅ 92.88850 91.86600
cvc5 cvc5-fixed_default unknown ❌ 1200.04000 60.13640
Par4 Par4-wrapped-sq_default unsat ✅ 92.78150 277.50000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.03000 1399.40000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.09056 5.43094
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.03000 4740.98000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.08000 4767.23000
veriT veriT_default unknown ❌ 1200.06000 1224.99000
Z3 z3-4.8.11_default unknown ❌ 1200.03000 1199.80000
z3-4.8.8_default unknown ❌ 1200.07000 1199.82000
SMT-COMP 2023 0.80 (1/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 123.74600 122.47100
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 124.04400 123.15400
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.14000 4742.95000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 3536.77000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.83645 4.73409
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.04000 4785.90000