Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.631403.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size45961
Compressed Size6890
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 45953
Compressed Size6903
Max. Term Depth14
Asserts 287
Declared Functions17
Declared Constants15
Declared Sorts 11
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite21 not52 or15 and24
=>329 =443 forall284 exists4
let161 Int483 +87 -106
*31 <199 <=103

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01634 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 0.12801 0.11598
veriT veriT-smtcomp2014 default unsat ✅ 0.04373 0.03499
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.21000 2400.03000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00883 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.12681 0.12398
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.12468 0.12198
veriT veriT default unsat ✅ 0.04504 0.04399
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.92000
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.15156 0.15187
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 3.49689 3.51317
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 2.23043 8.72000
veriT veriT-dev default unsat ✅ 0.03025 0.03052
Z3 z3-4.4.1 default unknown ❌ 2400.04000 2401.58000
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.15487 0.15467
Vampire vampire4.2-smt vampire unsat ✅ 3.78585 14.26000
veriT veriT-2017-06-17 default unsat ✅ 0.05408 0.05363
Z3 z3-4.5.0 default unknown ❌ 244.83200 244.74200
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.17373 0.17395
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 241.83600 961.46000
veriT veriT_default unsat ✅ 0.05288 0.05314
Z3 z3-4.7.1_default unsat ✅ 0.09281 0.09273
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.11339 0.11380
CVC4 CVC4-sq-final_default unsat ✅ 0.20739 0.20769
Par4 Par4-wrapped-sq_default unsat ✅ 0.06658 0.00598
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1354.66000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.25113 3.58325
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.23776 0.23746
veriT veriT_default unsat ✅ 0.05929 0.05960
veriT+vite_default unsat ✅ 0.03699 0.03734
Z3 z3-4.8.8_default unsat ✅ 0.25490 0.25481
SMT-COMP 2025 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.36313 0.24191
iProver iProver v3.9.3 unsat ✅ 30.48698 111.75892
SMTInterpol SMTInterpol unknown ❌ 1201.58691 1803.57217
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.88698 3.86383