Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.808329.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size94103
Compressed Size15640
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 94095
Compressed Size15646
Max. Term Depth15
Asserts 169
Declared Functions769
Declared Constants285
Declared Sorts 898
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false388 ite7 not159 or2
and5 =>702 =539 forall170
exists2 let8

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2400.29000 2400.95000
CVC4 CVC4 f7118b2 default sat ✅ 510.38400 510.34500
veriT veriT-smtcomp2014 default unknown ❌ 486.38400 486.54000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.06000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2400.96000 2401.76000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 22.20670 22.20860
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 22.13040 22.12760
veriT veriT default unknown ❌ 2400.01000 2400.79000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.90000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 315.09400 305.91000
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 15.13930 15.21390
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 18.97830 75.17000
veriT veriT-dev default unknown ❌ 2400.03000 2401.33000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.38000
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 470.30200 469.56400
Vampire vampire4.2-smt vampire sat ✅ 23.34590 92.68280
veriT veriT-2017-06-17 default unknown ❌ 600.04600 599.95000
Z3 z3-4.5.0 default unknown ❌ 600.02000 600.02700
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 499.54800 498.40900
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 11.90900 47.14000
veriT veriT_default unknown ❌ 1200.03000 1199.87000
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.86000
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default sat ✅ 499.93900 498.59000
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.09000 4515.67000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 1547.19000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.11217 6.04624
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 43.76140 172.88800
vampire_smt_4.5_vampire_smtcomp sat ✅ 39.67660 157.19000
veriT veriT_default unknown ❌ 1200.04000 1199.88000
Z3 z3-4.8.11_default unknown ❌ 1200.03000 1199.77000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 496.66200 495.26600
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 525.74400 554.80000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.10139 6.00072
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 46.88480 185.77000
veriT veriT_default unknown ❌ 1200.06000 1199.92000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.04000 1199.90000
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.85000
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 533.42100 526.06800
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 524.91100 524.11600
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.11000 4748.39000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.10000 1288.71000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.08018 5.71882
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 38.45220 152.06000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.01000 1199.85000