Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.913088.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size913
Compressed Size450
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 905
Compressed Size446
Max. Term Depth9
Asserts 5
Declared Functions2
Declared Constants5
Declared Sorts 4
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not2 =>3 =5 forall3
Int2 +1 -1 <1
<=2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01615 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 0.02323 0.00900
veriT veriT-smtcomp2014 default unsat ✅ 0.01156 0.00300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.02269 0.01400
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00862 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.01213 0.01000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.01264 0.01000
veriT veriT default unsat ✅ 0.00819 0.00200
Z3 z3 4.4.0 default unsat ✅ 0.03782 0.03799
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.01391 0.01408
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 7.92348 7.95931
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.06952 0.09324
veriT veriT-dev default unsat ✅ 0.01236 0.00845
Z3 z3-4.4.1 default unsat ✅ 0.03683 0.03812
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.01405 0.01358
Vampire vampire4.2-smt vampire unsat ✅ 0.06725 0.13526
veriT veriT-2017-06-17 default unsat ✅ 0.00918 0.00827
Z3 z3-4.5.0 default unsat ✅ 0.04249 0.04180
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.01403 0.01426
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.96830 3.67000
veriT veriT_default unsat ✅ 0.00812 0.00838
Z3 z3-4.7.1_default unsat ✅ 0.05003 0.04997
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.02908 0.02898
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.01920 0.01955
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.01674 0.01704
Par4 Par4-wrapped-sq_default unsat ✅ 0.02411 0.00559
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 0.33054 0.47363
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.45725 3.36617
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.05746 3.35668
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.46906 3.31385
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.43160 0.64785
veriT veriT-wrapped-sq_default unsat ✅ 0.01210 0.01241
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.05463 0.05463
SMT-COMP 2021 0.12 (7/8) CVC4 CVC4-sq-final_default unsat ✅ 0.01886 0.01915
cvc5 cvc5-fixed_default unsat ✅ 0.02217 0.02270
Par4 Par4-wrapped-sq_default unsat ✅ 0.02032 0.00613
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 0.45012 0.67060
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.95081 4.58551
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.09194 0.14030
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.21650 0.43639
veriT veriT_default unsat ✅ 0.01145 0.01180
Z3 z3-4.8.11_default unsat ✅ 0.03357 0.03349
z3-4.8.8_default unsat ✅ 0.08317 0.08169
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.22359 0.12398
iProver iProver v3.9 unsat ✅ 11.90899 40.28520
SMTInterpol SMTInterpol unsat ✅ 0.49971 0.58282