Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.679235.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size123441
Compressed Size18703
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 123433
Compressed Size18740
Max. Term Depth15
Asserts 541
Declared Functions506
Declared Constants320
Declared Sorts 573
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true13 false261 ite11 not126
or8 and43 =>804 =1413
forall602 exists28 let55

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unsat ✅ 13.91560 13.91290
CVC4 CVC4 f7118b2 default unsat ✅ 0.55960 0.55591
veriT veriT-smtcomp2014 default unknown ❌ 182.43400 182.47800
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.91000 2400.01000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unsat ✅ 17.02410 17.03040
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 6.41828 6.41802
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 6.25637 6.25505
veriT veriT default unknown ❌ 2400.01000 2400.58000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2401.01000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.88197 1.88311
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 3.98578 4.00294
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 4.98069 19.54000
veriT veriT-dev default unknown ❌ 2400.04000 2401.48000
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2401.01000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 41.93880 41.92280
Vampire vampire4.2-smt vampire unsat ✅ 7.93692 31.29000
veriT veriT-2017-06-17 default unsat ✅ 0.40336 0.39914
Z3 z3-4.5.0 default unknown ❌ 600.03500 599.81000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.70024 0.70044
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 431.51400 1713.07000
veriT veriT_default unsat ✅ 0.40006 0.40030
Z3 z3-4.7.1_default unknown ❌ 1200.09000 1199.98000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 19.17690 76.01400
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 911.79900 904.10600
master-2018-06-10-b19c840-competition-default_default unsat ✅ 455.35900 453.65300
Par4 Par4-wrapped-sq_default unsat ✅ 0.82898 2.27000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.02000 2403.36000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.69217 4.31435
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.17105 3.59953
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.49654 4.27029
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 35.44640 140.06000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 462.02800 1831.80000
veriT veriT-wrapped-sq_default unsat ✅ 0.72810 0.72829
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.09000 2398.80000
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 136.02200 539.93000
CVC4 CVC4-sq-final_default unsat ✅ 457.70800 453.38000
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 911.74200 963.93400
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1216.66000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.69766 4.43608
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 16.05990 63.54000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 449.27500 1781.01000
veriT veriT_default unsat ✅ 49.04600 49.04420
veriT+vite_default unsat ✅ 5.41299 5.41253
Z3 z3-4.8.8_default unknown ❌ 1200.04000 1199.90000
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 465.54000 458.40200
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 492.82700 487.37700
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.13483 5.80501
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 46.64730 185.02000
veriT veriT_default unsat ✅ 1.40826 1.40867
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.10000 1199.84000
Z3 z3-4.8.17_default unknown ❌ 1200.12000 1199.88000
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.51294 0.51198
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.59768 0.59813
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.04000 4447.19000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.02000 1243.80000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.02430 5.47477
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 31.90690 126.13000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.91000
SMT-COMP 2024 0.75 (1/4) cvc5 cvc5 unsat ✅ 481.14925 480.88406
iProver iProver v3.9 unknown ❌ 1201.75805 4760.40300
SMTInterpol SMTInterpol unknown ❌ 1201.71372 1244.77966
Yices2 Yices2 unknown ❌ 1201.52472 1201.37069
SMT-COMP 2025 0.80 (1/5) cvc5 cvc5 unsat ✅ 481.76260 481.55958
iProver iProver v3.9.3 unknown ❌ 1201.79795 4781.76419
SMTInterpol SMTInterpol unknown ❌ 1201.48359 1290.88913
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.14041 4.59415
Yices2 Yices2 unknown ❌ 1201.66166 1201.34578