Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.726129.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size77635
Compressed Size11942
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 77627
Compressed Size11938
Max. Term Depth15
Asserts 480
Declared Functions162
Declared Constants89
Declared Sorts 109
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true12 false115 ite21 not104
or30 and87 =>407 =1210
distinct4 forall519 exists33 let104

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2400.97000 2401.47000
CVC4 CVC4 f7118b2 default unsat ✅ 690.74000 690.53500
veriT veriT-smtcomp2014 default unknown ❌ 2399.61000 2400.04000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.71000 2400.06000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2400.95000 2401.73000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 70.76970 70.78720
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 70.81410 70.80620
veriT veriT default unknown ❌ 2400.01000 2401.04000
Z3 z3 4.4.0 default unsat ✅ 1.15625 1.15682
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.33191 3.33432
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 990.98200 997.14300
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 1001.38000 3608.30000
veriT veriT-dev default unsat ✅ 20.13120 20.13930
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.06000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 90.56930 90.50090
Vampire vampire4.2-smt vampire unknown ❌ 600.04300 1842.54000
veriT veriT-2017-06-17 default unsat ✅ 0.42337 0.42174
Z3 z3-4.5.0 default unknown ❌ 600.02000 599.81000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 76.45990 76.45440
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.10000 4767.87000
veriT veriT_default unsat ✅ 1050.85000 1050.74000
Z3 z3-4.7.1_default unknown ❌ 1200.10000 1199.95000
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default unsat ✅ 90.64430 90.65080
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.09000 4746.07000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.08000 1757.05000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.07786 5.15705
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 52.35470 207.33000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 52.07970 206.39000
veriT veriT_default unsat ✅ 341.79000 341.79000
Z3 z3-4.8.11_default unknown ❌ 1200.08000 1199.90000
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 124.55000 120.71100
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 120.65400 120.59100
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.06000 4716.77000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 3158.70000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.97720 4.84484
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 39.87310 157.79000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.01000 1199.96000
SMT-COMP 2024 0.75 (1/4) cvc5 cvc5 unsat ✅ 120.44324 120.33911
iProver iProver v3.9 unknown ❌ 1201.74097 4766.12246
SMTInterpol SMTInterpol unknown ❌ 1202.74699 2817.27249
Yices2 Yices2 unknown ❌ 1201.52796 1201.13050
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 unsat ✅ 120.49410 120.36564
iProver iProver v3.9.3 unknown ❌ 1201.79459 4781.26590
SMTInterpol SMTInterpol unknown ❌ 566.40084 2003.51760
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.03064 4.46392
Yices2 Yices2 unknown ❌ 1201.43657 1201.18506