Benchmark

non-incremental/UFNIA/sledgehammer/TwoSquares/z3.813029.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size1439
Compressed Size576
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1431
Compressed Size585
Max. Term Depth7
Asserts 8
Declared Functions3
Declared Constants6
Declared Sorts 5
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1 not4 or1 =>3
=10 forall6 let2 Int7
+4 -3 *4 <4
<=1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2401.64000 2402.10000
CVC4 CVC4 f7118b2 default unsat ✅ 0.03569 0.02600
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.01816 0.00900
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.16657 0.16597
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 20.86980 20.87380
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 20.90320 20.90780
Z3 z3 4.4.0 default unsat ✅ 0.03337 0.03199
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 23.08980 20.41930
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 25.12040 25.24770
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 7.90885 30.99000
Z3 z3-4.4.1 default unsat ✅ 0.03350 0.03477
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 23.08010 20.46460
Vampire vampire4.2-smt vampire unsat ✅ 0.07426 0.11299
Z3 z3-4.5.0 default unsat ✅ 0.03513 0.03429
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.02888 0.02909
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 553.40400 2200.84000
Z3 z3-4.7.1_default unsat ✅ 0.03781 0.03777
SMT-COMP 2019 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.07759 0.07887
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.03500 0.03536
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 0.03658 0.03670
Par4 Par4-wrapped-sq_default unsat ✅ 0.01788 0.00574
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.36349 3.33768
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.45025 3.30422
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 85.38540 339.17000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 568.32300 2252.96000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.03947 0.03947
z3-4.7.1_default unsat ✅ 0.03858 0.03855
SMT-COMP 2020 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.05558 0.05545
CVC4 CVC4-sq-final_default unsat ✅ 0.03386 0.03415
Par4 Par4-wrapped-sq_default unsat ✅ 0.01804 0.00622
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.39439 3.28100
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.13064 0.13237
vampire-4.3-smt_vampire_smtcomp unsat ✅ 181.89100 720.58000
Z3 z3-4.8.8_default unsat ✅ 0.03541 0.03534
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.03496 0.03626
cvc5 cvc5-fixed_default unsat ✅ 0.02688 0.02748
Par4 Par4-wrapped-sq_default unsat ✅ 0.01822 0.00628
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.38544 0.57719
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 5.65274 5.17961
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.15968 0.23616
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.13819 0.14000
Z3 z3-4.8.11_default unsat ✅ 0.02013 0.02008
SMT-COMP 2022 0.20 (4/5) CVC4 CVC4-sq-final_default unsat ✅ 0.03539 0.03567
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.14534 0.14571
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.85707 4.74232
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.18679 0.25664
Z3 z3-4.8.17_default unsat ✅ 0.02108 0.02289
SMT-COMP 2023 0.50 (2/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.05366 0.05418
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.14547 0.14605
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.07000 4750.13000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.85056 4.79460
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.20131 0.28744