Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.632444.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size24638
Compressed Size3865
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 24630
Compressed Size3879
Max. Term Depth14
Asserts 149
Declared Functions14
Declared Constants13
Declared Sorts 11
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite15 not37 or6 and11
=>139 =269 forall144 exists3
let86 Int283 +35 -57
*14 <64 <=13

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01652 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 0.06539 0.06299
veriT veriT-smtcomp2014 default unsat ✅ 0.02931 0.02000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.21000 2400.07000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00884 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.06890 0.06699
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.06946 0.06699
veriT veriT default unsat ✅ 0.02556 0.02500
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.94000
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.08347 0.08373
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.88364 2.89669
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.67544 2.39000
veriT veriT-dev default unsat ✅ 0.02062 0.02093
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.32000
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.08537 0.08443
Vampire vampire4.2-smt vampire unsat ✅ 0.40935 0.40695
veriT veriT-2017-06-17 default unsat ✅ 0.04023 0.03988
Z3 z3-4.5.0 default unsat ✅ 1.39664 1.39580
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.09398 0.09420
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 226.70200 900.67000
veriT veriT_default unsat ✅ 0.04089 0.04112
Z3 z3-4.7.1_default unsat ✅ 0.07120 0.07112
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 0.11455 0.11485
cvc5 cvc5-fixed_default unsat ✅ 0.10251 0.10297
Par4 Par4-wrapped-sq_default unsat ✅ 0.05361 0.00750
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.03000 4261.77000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.79711 4.84979
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.18869 0.18780
vampire_smt_4.5_vampire_smtcomp unsat ✅ 2.69522 10.29000
veriT veriT_default unsat ✅ 0.02540 0.02578
Z3 z3-4.8.11_default unknown ❌ 502.51800 502.53200
z3-4.8.8_default unknown ❌ 434.17500 434.11100
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.11548 0.11584
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.14121 0.14178
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.02859 5.34821
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.41507 0.22655
veriT veriT_default unsat ✅ 0.02626 0.02662
Z3 z3-4.8.17_default unsat ✅ 52.47590 52.47620
SMT-COMP 2023 0.40 (3/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.09373 0.09434
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.13963 0.14020
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.65264 4.62611
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.10000 1388.61000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.04008 4.76108
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.32716 0.17817
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.29922 0.18537
iProver iProver v3.9.3 unsat ✅ 25.46871 90.51542
SMTInterpol SMTInterpol unknown ❌ 979.22553 3065.02698
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.91232 3.98994