Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.645213.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size45893
Compressed Size6838
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 45885
Compressed Size6861
Max. Term Depth14
Asserts 286
Declared Functions17
Declared Constants17
Declared Sorts 11
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false2 ite21 not51 or15
and36 =>329 =449 forall281
exists6 let157 Int489 +89
-108 *36 <197 <=102

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.01692 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 0.14043 0.12898
veriT veriT-smtcomp2014 default unsat ✅ 0.04769 0.03899
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.06129 0.05999
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00870 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.14831 0.14598
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.14667 0.14398
veriT veriT default unsat ✅ 0.04936 0.04799
Z3 z3 4.4.0 default unsat ✅ 0.08432 0.08399
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.16825 0.16852
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 1.97161 1.98465
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.13328 0.13287
veriT veriT-dev default unsat ✅ 0.03344 0.03372
Z3 z3-4.4.1 default unsat ✅ 0.08485 0.08606
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.17214 0.17078
Vampire vampire4.2-smt vampire unsat ✅ 0.17834 0.17793
veriT veriT-2017-06-17 default unsat ✅ 0.05368 0.05201
Z3 z3-4.5.0 default unsat ✅ 0.09074 0.09034
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.18841 0.18858
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 34.48960 137.12000
veriT veriT_default unsat ✅ 0.06066 0.06081
Z3 z3-4.7.1_default unsat ✅ 0.09721 0.09713
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.14318 0.13969
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.19778 0.19811
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.19328 0.19358
Par4 Par4-wrapped-sq_default unsat ✅ 0.07233 0.00788
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.11000 2414.58000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.31392 3.42619
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.12541 3.35916
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.33803 3.35072
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 2.58847 10.00000
veriT veriT-wrapped-sq_default unsat ✅ 0.06418 0.06454
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.10232 0.10233