Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.807902.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size6460
Compressed Size1477
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK—
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 6452
Compressed Size1489
Max. Term Depth12
Asserts 38
Declared Functions8
Declared Constants18
Declared Sorts 7
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false6 ite3 not5 and3
=>11 =30 forall14 let28
Int19 +64 -23 *20
<14 <=5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00899 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 40.85180 40.84780
veriT veriT-smtcomp2014 default unsat ✅ 0.89428 0.88587
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 1089.80000 1089.61000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00879 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.10898 2.10668
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.02931 2.02769
veriT veriT default unsat ✅ 0.42715 0.42593
Z3 z3 4.4.0 default unknown ❌ 228.99300 229.10800
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.03347 0.03369
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.38547 2.39574
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.06056 0.04967
veriT veriT-dev default unsat ✅ 0.01111 0.00905
Z3 z3-4.4.1 default unknown ❌ 235.16000 235.17300
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.03503 0.03467
Vampire vampire4.2-smt vampire unsat ✅ 0.06298 0.05998
veriT veriT-2017-06-17 default unsat ✅ 0.00979 0.00973
Z3 z3-4.5.0 default unknown ❌ 236.25500 236.10900
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.03919 0.03936
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.09805 0.15222
veriT veriT_default unsat ✅ 1.59116 1.59130
Z3 z3-4.7.1_default unknown ❌ 225.66100 225.53500
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.04184 0.04250
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.04267 0.04307
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.03936 0.03960
Par4 Par4-wrapped-sq_default unsat ✅ 0.03287 0.00580
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.07000 2495.33000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.36807 3.46681
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.24828 3.47601
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.12348 3.32995
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.14099 0.13631
veriT veriT-wrapped-sq_default unsat ✅ 0.02418 0.02451
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 234.09700 233.96200
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.05375 0.05557
CVC4 CVC4-sq-final_default unsat ✅ 0.04858 0.04884
Par4 Par4-wrapped-sq_default unsat ✅ 0.03167 0.01109
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 0.56887 1.09256
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.44005 3.44755
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.10204 0.10271
veriT veriT_default unsat ✅ 0.01726 0.01759
veriT+vite_default unsat ✅ 0.01561 0.01597
Z3 z3-4.8.8_default unknown ❌ 197.35100 197.34900
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 0.04959 0.04988
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.10699 0.10751
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.01868 4.70683
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.18082 0.10531
veriT veriT_default unsat ✅ 0.01446 0.01483
Z3 z3-4.8.17_default unknown ❌ 189.69500 189.66900
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.04578 0.04634
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.10643 0.10682
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 0.65491 0.23852
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 0.62696 1.30432
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.97893 4.83498
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.16509 0.10392
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.26260 0.16286
iProver iProver v3.9 unsat ✅ 0.86092 0.99435
SMTInterpol SMTInterpol unsat ✅ 0.66474 1.21728