Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.669282.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size84903
Compressed Size11427
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 84895
Compressed Size11436
Max. Term Depth15
Asserts 376
Declared Functions278
Declared Constants166
Declared Sorts 313
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true9 false120 ite8 not57
or6 and12 =>577 =970
forall478 exists12 let18

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unsat ✅ 0.59118 0.58291
CVC4 CVC4 f7118b2 default unsat ✅ 5.02971 5.01824
veriT veriT-smtcomp2014 default unknown ❌ 587.04100 587.27400
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.41000 2400.07000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unsat ✅ 0.71089 0.71089
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.27531 0.27296
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.27392 0.27096
veriT veriT default unknown ❌ 2381.57000 2382.31000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.76000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.31749 0.31782
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 85.66140 86.07380
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 20.39990 80.72000
veriT veriT-dev default unknown ❌ 2400.10000 2401.28000
Z3 z3-4.4.1 default unknown ❌ 2400.11000 2400.80000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.26359 0.26210
Vampire vampire4.2-smt vampire unsat ✅ 9.33550 36.84000
veriT veriT-2017-06-17 default unsat ✅ 0.17616 0.17572
Z3 z3-4.5.0 default unknown ❌ 600.10700 600.01000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.27970 0.27992
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.05000 4772.85000
veriT veriT_default unsat ✅ 0.20093 0.20116
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.83000
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 461.73100 452.61200
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 485.56400 481.95200
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 7.02706 5.04099
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 15.44350 61.11000
veriT veriT_default unsat ✅ 1.18569 1.18612
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.93000
Z3 z3-4.8.17_default unknown ❌ 1200.11000 1199.78000
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.22605 0.22656
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.28483 0.28547
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.08000 4738.59000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.04000 1637.67000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.93783 4.98845
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 784.96600 3118.59000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.89000
SMT-COMP 2024 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.35645 0.25673
iProver iProver v3.9 unknown ❌ 1201.72401 4769.73072
SMTInterpol SMTInterpol unknown ❌ 1201.71403 1245.78696
Yices2 Yices2 unknown ❌ 1201.38299 1200.76146