Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.704291.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size80357
Compressed Size12549
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 80349
Compressed Size12570
Max. Term Depth15
Asserts 474
Declared Functions235
Declared Constants82
Declared Sorts 162
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true12 false170 ite21 not122
or30 and81 =>502 =1191
distinct5 forall510 exists33 let98

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.19057 0.18297
CVC4 CVC4 f7118b2 default unsat ✅ 0.42960 0.41894
veriT veriT-smtcomp2014 default unknown ❌ 2399.61000 2400.04000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09718 0.08899
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.23215 0.23196
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.25112 0.24896
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.25446 0.25196
veriT veriT default unknown ❌ 2400.01000 2400.86000
Z3 z3 4.4.0 default unsat ✅ 0.10418 0.10398
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.35699 0.35741
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 81.39700 81.76260
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 12.93690 51.20000
veriT veriT-dev default unsat ✅ 0.10538 0.10557
Z3 z3-4.4.1 default unsat ✅ 0.12191 0.12326
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.26551 0.26568
Vampire vampire4.2-smt vampire unsat ✅ 35.42350 139.78000
veriT veriT-2017-06-17 default unsat ✅ 0.34055 0.33806
Z3 z3-4.5.0 default unsat ✅ 0.11947 0.11855
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.29957 0.29978
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 5.30819 20.78000
veriT veriT_default unsat ✅ 0.33119 0.33145
Z3 z3-4.7.1_default unsat ✅ 0.11445 0.11439
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.30721 0.30754
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.30182 0.30241
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.81664 4.98526
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 1.62050 5.89000
veriT veriT_default unsat ✅ 0.11807 0.11660
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.93000
Z3 z3-4.8.17_default unsat ✅ 0.12805 0.13020
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 0.37512 0.27545
iProver iProver v3.9 unsat ✅ 408.21371 1611.63918
SMTInterpol SMTInterpol unknown ❌ 1202.71976 1500.78335
Yices2 Yices2 unknown ❌ 1201.48452 1201.36059
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 0.45343 0.32799
iProver iProver v3.9.3 unsat ✅ 403.23399 1597.47910
SMTInterpol SMTInterpol unknown ❌ 1201.89001 3370.39682
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.13706 4.67538
Yices2 Yices2 unknown ❌ 1201.63935 1201.24500