Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.598292.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size616
Compressed Size382
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 608
Compressed Size375
Max. Term Depth6
Asserts 3
Declared Functions1
Declared Constants3
Declared Sorts 1
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not4 =>3 =4 forall1
Int1 <=2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01654 0.00800
CVC4 CVC4 f7118b2 default sat ✅ 0.08766 0.06599
veriT veriT-smtcomp2014 default unknown ❌ 0.01150 0.00300
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.02247 0.01500
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00862 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.01677 0.01300
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.01655 0.01300
veriT veriT default unknown ❌ 0.00995 0.00200
Z3 z3 4.4.0 default sat ✅ 0.03816 0.03799
SMT-COMP 2016 0.50 (2/4) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.07633 0.07788
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 995.40600 1000.76000
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 999.40800 3917.39000
veriT veriT-dev default unknown ❌ 0.04899 0.05702
Z3 z3-4.4.1 default sat ✅ 0.03656 0.03800
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default sat ✅ 0.86119 0.16303
Vampire vampire4.2-smt vampire unknown ❌ 600.07600 2284.74000
veriT veriT-2017-06-17 default unknown ❌ 0.07460 0.08732
Z3 z3-4.5.0 default sat ✅ 0.04445 0.04301
SMT-COMP 2018 0.50 (2/4) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.10597 0.10758
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 21.28420 84.45750
veriT veriT_default unknown ❌ 0.07526 0.08351
Z3 z3-4.7.1_default sat ✅ 0.05150 0.05144
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 0.28991 0.14412
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.14231 0.14465
master-2018-06-10-b19c840-competition-default_default sat ✅ 0.13227 0.13459
Par4 Par4-wrapped-sq_default sat ✅ 0.06064 0.00596
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default sat ✅ 0.30337 0.39925
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.35620 3.34954
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.24797 3.31054
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.24303 3.24751
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.12000 9515.61000
veriT veriT-wrapped-sq_default unknown ❌ 0.09793 0.11026
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.05469 0.05468
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 0.22643 0.17353
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.25546 0.22408
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.07000 4753.61000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 0.41779 0.63334
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.95680 4.77313
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.02000 4789.04000
SMT-COMP 2024 0.33 (2/3) cvc5 cvc5 sat ✅ 0.34490 0.24578
iProver iProver v3.9 unknown ❌ 1201.74604 4746.54836
SMTInterpol SMTInterpol sat ✅ 0.43217 0.45301