Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.792027.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size101136
Compressed Size14063
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 101128
Compressed Size14103
Max. Term Depth15
Asserts 500
Declared Functions281
Declared Constants182
Declared Sorts 316
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true15 false149 ite11 not121
or15 and17 =>757 =1355
forall608 exists20 let31

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unsat ✅ 15.48080 15.47860
CVC4 CVC4 f7118b2 default unsat ✅ 11.89070 11.87920
veriT veriT-smtcomp2014 default unknown ❌ 2399.22000 2400.10000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2400.01000 2400.03000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.22000 2402.85000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 9.69931 9.70052
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 9.57655 9.57554
veriT veriT default unknown ❌ 2400.01000 2400.33000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.82000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.02404 4.02653
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 1.84063 1.84872
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 1.22296 4.64000
veriT veriT-dev default unsat ✅ 74.77410 74.81740
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.17000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.56953 0.56896
Vampire vampire4.2-smt vampire unsat ✅ 12.82160 50.35000
veriT veriT-2017-06-17 default unsat ✅ 2.47843 2.47813
Z3 z3-4.5.0 default unknown ❌ 600.05400 600.05000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.59806 0.59820
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 37.25830 147.86000
veriT veriT_default unsat ✅ 1.80969 1.80991
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.87000
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.07000 9534.13000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.58769 0.58806
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.60118 0.60147
Par4 Par4-wrapped-sq_default unsat ✅ 0.64446 1.80000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2916.17000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.58596 4.05423
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.04188 3.57191
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.38675 3.99453
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 17.08150 67.35000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 11.69450 46.27000
veriT veriT-wrapped-sq_default unsat ✅ 1.71904 1.71953
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.60000
SMT-COMP 2020 0.57 (3/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.03000 4764.31000
CVC4 CVC4-sq-final_default unsat ✅ 5.27211 5.27161
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.68711 4.68682
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1232.98000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.64012 4.19144
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.64366 7.75878
vampire-4.3-smt_vampire_smtcomp unsat ✅ 11.43230 45.08000
veriT veriT_default unsat ✅ 183.65300 183.64500
veriT+vite_default unsat ✅ 5.61797 5.61832
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.80000
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 14.35670 14.35470
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 77.42140 243.18000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.06000 1227.24000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.42247 5.70234
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 7.71216 30.41000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 1.88368 7.13000
veriT veriT_default unsat ✅ 3.82200 3.82335
Z3 z3-4.8.11_default unknown ❌ 1200.11000 1199.91000
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 13.62860 13.62750
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 98.62990 98.32710
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.98225 5.18678
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 8.45314 33.26000
veriT veriT_default unsat ✅ 3.83451 3.83558
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.10000 1199.93000
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.82000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 unsat ✅ 2.19508 2.09536
iProver iProver v3.9 unsat ✅ 11.90011 42.97907
SMTInterpol SMTInterpol unknown ❌ 1201.71186 1237.51641
Yices2 Yices2 unknown ❌ 1201.49636 1201.27426
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 0.48353 0.36513
iProver iProver v3.9.3 unsat ✅ 190.59334 750.23053
SMTInterpol SMTInterpol unknown ❌ 1201.49534 1263.67768
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.99133 4.16856
Yices2 Yices2 unknown ❌ 1201.65095 1201.25618