Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.764935.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size113558
Compressed Size17154
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 113550
Compressed Size17156
Max. Term Depth15
Asserts 484
Declared Functions446
Declared Constants268
Declared Sorts 504
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true14 false139 ite6 not110
or46 and90 =>563 =1460
forall651 exists57 let32

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unsat ✅ 17.41830 17.41840
CVC4 CVC4 f7118b2 default unsat ✅ 1.13726 1.13483
veriT veriT-smtcomp2014 default unknown ❌ 74.25580 74.27570
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2369.71000 2369.81000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unsat ✅ 28.13600 28.14670
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.25171 0.24896
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.25058 0.24796
veriT veriT default unknown ❌ 1170.27000 1170.69000
Z3 z3 4.4.0 default unknown ❌ 1107.62000 1107.13000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.60704 0.60748
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.41857 0.42008
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.71315 2.41000
veriT veriT-dev default unsat ✅ 20.11460 20.12560
Z3 z3-4.4.1 default unknown ❌ 522.08000 522.21200
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 21.66380 21.65540
Vampire vampire4.2-smt vampire unsat ✅ 0.57270 1.61000
veriT veriT-2017-06-17 default unsat ✅ 0.32553 0.32388
Z3 z3-4.5.0 default unknown ❌ 368.33800 368.17000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 27.51080 27.51130
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1139.85000 4531.80000
veriT veriT_default unsat ✅ 0.32971 0.32994
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.91000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.46991 0.46914
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.55908 0.55925
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.56295 0.56321
Par4 Par4-wrapped-sq_default unsat ✅ 0.35102 0.00585
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.07000 2794.02000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.56753 4.28979
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.05983 3.65136
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.57627 4.14292
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 52.64730 208.48000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1149.20000 4560.57000
veriT veriT-wrapped-sq_default unsat ✅ 0.34444 0.34482
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 265.84000 265.84100
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 75.29010 75.24260
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 121.27300 150.87300
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.22882 5.60760
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 44.62700 176.99000
veriT veriT_default unsat ✅ 1.08750 1.08739
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.10000 1200.00000
Z3 z3-4.8.17_default unknown ❌ 563.56700 563.48800
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.69346 7.25149
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 99.04070 98.91820
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 105.76200 457.51000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1245.97000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.89346 5.39808
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 36.48490 144.76000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1200.03000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 2.09644 1.99685
iProver iProver v3.9 unknown ❌ 1201.72885 4764.83863
SMTInterpol SMTInterpol unknown ❌ 1201.71138 1243.57697
Yices2 Yices2 unsat ✅ 226.34676 226.20681