Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.746975.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size42714
Compressed Size6586
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK—
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 42706
Compressed Size6640
Max. Term Depth12
Asserts 294
Declared Functions15
Declared Constants23
Declared Sorts 11
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false14 ite33 not45 or18
and28 =>199 =496 forall258
exists6 let153 Int366 +136
-120 *61 <100 <=55

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.02038 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 300.33200 300.26400
veriT veriT-smtcomp2014 default unsat ✅ 435.67400 435.85000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.01000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00884 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 40.35530 40.36390
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 40.36540 40.38090
veriT veriT default unsat ✅ 421.52400 421.69700
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.99000
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.15956 0.15987
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 20.34850 20.44530
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.62828 0.45329
veriT veriT-dev default unsat ✅ 229.03600 229.16200
Z3 z3-4.4.1 default unknown ❌ 2400.08000 2401.63000
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.16892 0.16858
Vampire vampire4.2-smt vampire unsat ✅ 11.59810 46.00000
veriT veriT-2017-06-17 default unsat ✅ 18.31120 18.30930
Z3 z3-4.5.0 default unknown ❌ 195.05300 194.92700
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.17089 0.17111
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 9.60789 38.04000
veriT veriT_default unsat ✅ 0.12080 0.12105
Z3 z3-4.7.1_default unknown ❌ 178.62200 178.58900
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.78294 2.98000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.91435 0.91465
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.17281 0.17284
Par4 Par4-wrapped-sq_default unsat ✅ 0.18670 0.00628
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2461.63000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.21925 3.31972
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.13937 3.37083
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.45468 3.36360
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 82.52190 326.97000
veriT veriT-wrapped-sq_default unsat ✅ 0.18446 0.18481
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 227.14600 227.12400
SMT-COMP 2020 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 1.82882 7.14000
CVC4 CVC4-sq-final_default unsat ✅ 3.12634 3.12650
Par4 Par4-wrapped-sq_default unsat ✅ 0.16121 0.00840
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.11000 3673.01000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.36040 3.54947
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 76.11690 301.86000
veriT veriT_default unsat ✅ 0.12600 0.12636
veriT+vite_default unsat ✅ 0.06854 0.06887
Z3 z3-4.8.8_default unknown ❌ 195.38500 195.35000
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 1.12748 1.12773
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.87514 0.87345
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.03226 5.75442
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 770.99400 3060.84000
veriT veriT_default unsat ✅ 9.80543 9.80635
Z3 z3-4.8.17_default unknown ❌ 227.43200 227.42300
SMT-COMP 2023 0.40 (3/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.61893 0.61930
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.99559 0.99590
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 95.24000 372.07000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.10000 1670.26000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.79964 4.67941
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 385.04900 1529.72000
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 unsat ✅ 0.48161 0.38197
iProver iProver v3.9 unsat ✅ 1076.14888 4262.44291
SMTInterpol SMTInterpol unknown ❌ 1202.72397 2245.68658