Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.655306.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size66721
Compressed Size9278
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 66713
Compressed Size9233
Max. Term Depth15
Asserts 328
Declared Functions165
Declared Constants21
Declared Sorts 98
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false150 ite6 not38 or20
and48 =>609 =1051 forall488
exists22 let92

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 23.49310 23.48780
Vampire vampire4.2-smt vampire unsat ✅ 0.10981 0.10887
veriT veriT-2017-06-17 default unknown ❌ 600.05400 599.99000
Z3 z3-4.5.0 default unknown ❌ 600.10500 599.96000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 306.35900 304.12200
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.65154 0.33176
veriT veriT_default unknown ❌ 1200.02000 1229.84000
Z3 z3-4.7.1_default unknown ❌ 1200.08000 1200.01000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.06000 9535.21000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 904.78700 901.77500
master-2018-06-10-b19c840-competition-default_default unsat ✅ 452.67900 451.63600
Par4 Par4-wrapped-sq_default unsat ✅ 453.24000 1357.44000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.05000 2625.51000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.36419 3.74869
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.20105 3.35308
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.43613 3.74324
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.70241 2.21000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.46080 0.45492
veriT veriT-wrapped-sq_default unknown ❌ 2396.92000 2396.55000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 304.95200 304.93200
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 452.71800 451.59200
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 1.30076 4.06000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 93.12170 108.36300
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.10068 5.11002
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.18168 0.18044
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.14305 0.14099
veriT veriT_default unknown ❌ 1200.05000 1199.82000
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.87000
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 32.60975 32.50988
iProver iProver v3.9 unsat ✅ 2.34837 7.09996
SMTInterpol SMTInterpol unsat ✅ 541.73104 572.08088
Yices2 Yices2 unsat ✅ 27.77325 27.66320
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 42.92048 42.78529
iProver iProver v3.9.3 unsat ✅ 1.84539 5.13842
SMTInterpol SMTInterpol unknown ❌ 580.67894 1902.99523
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.93457 3.89003
Yices2 Yices2 unsat ✅ 0.96568 0.84600