Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.680112.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size84206
Compressed Size11646
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 84198
Compressed Size11636
Max. Term Depth15
Asserts 376
Declared Functions277
Declared Constants171
Declared Sorts 313
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true9 false124 ite8 not62
or6 and12 =>572 =961
forall466 exists12 let18

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unsat ✅ 0.54428 0.53592
CVC4 CVC4 f7118b2 default unsat ✅ 0.32462 0.31295
veriT veriT-smtcomp2014 default unknown ❌ 721.96400 722.18400
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.51000 2400.03000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unsat ✅ 0.77672 0.77688
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.57447 0.57191
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.57824 0.56691
veriT veriT default unknown ❌ 2400.01000 2400.50000
Z3 z3 4.4.0 default unknown ❌ 1509.57000 1510.08000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.36131 0.36182
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 4.39895 4.41985
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 4.91291 19.32000
veriT veriT-dev default unknown ❌ 2400.03000 2401.34000
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2400.40000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 40.65090 40.64690
Vampire vampire4.2-smt vampire unsat ✅ 2.84894 11.13000
veriT veriT-2017-06-17 default unsat ✅ 0.21183 0.21142
Z3 z3-4.5.0 default unknown ❌ 600.02300 599.81000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 459.40700 452.75500
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 237.04900 942.67000
veriT veriT_default unsat ✅ 0.25838 0.25862
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.90000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 3.62677 14.12000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 915.28000 903.40800
master-2018-06-10-b19c840-competition-default_default unsat ✅ 458.87500 452.53500
Par4 Par4-wrapped-sq_default unsat ✅ 0.28853 0.00648
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.05000 2405.16000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.39435 4.01429
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.28991 3.54084
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.43329 3.96846
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 11.98530 47.23000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 244.03200 966.49000
veriT veriT-wrapped-sq_default unsat ✅ 0.22831 0.22866
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 1167.52000 1167.15000
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 461.56400 452.56900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 486.31600 482.09000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.16818 5.65737
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 3.94931 15.36000
veriT veriT_default unsat ✅ 1.21260 1.21301
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.11000 1200.01000
Z3 z3-4.8.17_default unknown ❌ 1021.29000 1020.89000
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 172.04900 166.72000
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 484.68400 481.99300
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.05000 4749.60000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.10000 1249.43000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.88218 5.24652
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 11.45750 45.11000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.03000 1199.94000
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 unsat ✅ 480.91798 480.74419
iProver iProver v3.9.3 unknown ❌ 1201.79493 4781.44190
SMTInterpol SMTInterpol unknown ❌ 1201.34711 1266.57053
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.96549 4.03427
Yices2 Yices2 unknown ❌ 1201.60895 1201.28822