Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.796149.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size9352
Compressed Size1846
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 9344
Compressed Size1829
Max. Term Depth10
Asserts 70
Declared Functions9
Declared Constants19
Declared Sorts 7
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false12 ite12 not13 or1
and6 =>56 =97 forall38
exists1 let32 Int76 +65
-36 *34 <36 <=10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01641 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 20.12540 20.12990
veriT veriT-smtcomp2014 default unsat ✅ 0.01791 0.00900
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 410.97400 410.99400
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00887 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.17505 0.17297
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.17798 0.17497
veriT veriT default unsat ✅ 0.21752 0.21697
Z3 z3 4.4.0 default unknown ❌ 404.55100 404.71700
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.03837 0.03855
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.38351 2.39487
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.06689 0.06535
veriT veriT-dev default unsat ✅ 0.01223 0.01134
Z3 z3-4.4.1 default unknown ❌ 712.24000 380.25000
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.04322 0.04319
Vampire vampire4.2-smt vampire unsat ✅ 0.06191 0.06013
veriT veriT-2017-06-17 default unsat ✅ 0.01218 0.01170
Z3 z3-4.5.0 default unknown ❌ 600.02600 599.69000
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.03541 0.03561
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.16545 0.15941
veriT veriT_default unsat ✅ 0.01326 0.01351
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1081.80000
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.06338 0.06529
CVC4 CVC4-sq-final_default unsat ✅ 0.04549 0.04578
Par4 Par4-wrapped-sq_default unsat ✅ 0.02823 0.01041
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 0.51972 0.93896
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.39535 3.43852
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.23427 0.23391
veriT veriT_default unsat ✅ 0.01727 0.01755
veriT+vite_default unsat ✅ 0.01582 0.01618
Z3 z3-4.8.8_default unknown ❌ 1200.01000 953.85000
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 0.05365 0.05394
cvc5 cvc5-fixed_default unsat ✅ 0.04988 0.05033
Par4 Par4-wrapped-sq_default unsat ✅ 0.02653 0.00618
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 0.45652 0.73230
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.87504 4.71237
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.11750 0.11797
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.05330 0.05312
veriT veriT_default unsat ✅ 0.01716 0.01754
Z3 z3-4.8.11_default unknown ❌ 854.77600 553.88700
z3-4.8.8_default unknown ❌ 1200.04000 963.64000
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.04667 0.04711
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.09572 0.09612
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 0.65059 1.62000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 0.56694 1.17111
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 92.70390 5.04105
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.05970 0.06023