Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.806804.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size41646
Compressed Size6484
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 41638
Compressed Size6499
Max. Term Depth12
Asserts 289
Declared Functions16
Declared Constants24
Declared Sorts 12
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false16 ite33 not56 or14
and38 =>204 =505 forall249
exists6 let160 Int351 +148
-101 *52 <98 <=41

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01876 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 40.46800 40.46680
veriT veriT-smtcomp2014 default unsat ✅ 16.54300 16.54850
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.04000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00873 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 20.31740 20.32090
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 20.30520 20.30890
veriT veriT default unsat ✅ 3.24440 3.24451
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.98000
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.12688 0.12716
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 39.53030 39.70410
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.94291 3.62000
veriT veriT-dev default unsat ✅ 0.02593 0.02613
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2401.59000
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.13077 0.13033
Vampire vampire4.2-smt vampire unsat ✅ 0.35986 0.35942
veriT veriT-2017-06-17 default unsat ✅ 0.02803 0.02771
Z3 z3-4.5.0 default unknown ❌ 241.96900 241.81600
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.13999 0.14024
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 229.97400 913.45000
veriT veriT_default unsat ✅ 1.44554 1.44566
Z3 z3-4.7.1_default unknown ❌ 263.23500 263.23800
SMT-COMP 2021 0.25 (6/8) CVC4 CVC4-sq-final_default unsat ✅ 0.17344 0.17375
cvc5 cvc5-fixed_default unsat ✅ 0.14751 0.14793
Par4 Par4-wrapped-sq_default unsat ✅ 0.15813 0.01035
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 2.10898 6.09618
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.75548 4.99517
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 4.17344 16.19000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.56559 5.89000
veriT veriT_default unsat ✅ 1.88730 1.88771
Z3 z3-4.8.11_default unknown ❌ 175.42800 175.37200
z3-4.8.8_default unknown ❌ 183.00500 182.96600
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.12899 0.12954
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.27277 0.27333
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 0.65214 1.77000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 1.94984 5.71806
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.97066 4.68057
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.84485 2.96000
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.30569 0.20594
iProver iProver v3.9 unsat ✅ 0.86718 1.44612
SMTInterpol SMTInterpol unsat ✅ 2.86323 8.23718