Benchmark

non-incremental/UF/sledgehammer/QEpres/uf.982274.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size7251
Compressed Size1544
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 7243
Compressed Size1566
Max. Term Depth10
Asserts 45
Declared Functions26
Declared Constants29
Declared Sorts 27
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false2 not9 or3
and4 =>37 =106 forall34
let6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 7.06286 7.05693
CVC4 CVC4 f7118b2 default sat ✅ 40.23450 40.23590
veriT veriT-smtcomp2014 default unknown ❌ 2398.91000 2400.11000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.12000 2400.01000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2401.65000 2402.32000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.10890 20.10890
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.11080 20.11090
veriT veriT default unknown ❌ 2400.01000 2400.95000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.96000
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 302.33400 300.86300
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.73551 9.78357
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.07412 0.06567
veriT veriT-dev default unknown ❌ 2400.02000 2401.18000
Z3 z3-4.4.1 default unknown ❌ 752.80900 753.20500
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 453.37000 450.93000
Vampire vampire4.2-smt vampire sat ✅ 0.14429 0.07193
veriT veriT-2017-06-17 default unknown ❌ 600.02700 599.94000
Z3 z3-4.5.0 default unknown ❌ 600.03100 599.93000
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 484.66200 480.95800
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.12973 0.09206
veriT veriT_default unknown ❌ 1200.03000 1199.86000
Z3 z3-4.7.1_default unknown ❌ 1152.48000 1152.42000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.07000 9535.26000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 964.40300 961.52100
master-2018-06-10-b19c840-competition-default_default sat ✅ 484.41300 481.08900
Par4 Par4-wrapped-sq_default sat ✅ 483.12700 1446.11000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2406.40000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.32055 3.43319
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.14930 3.35080
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.38424 3.33363
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 0.32806 0.26112
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.09591 0.09508
veriT veriT-wrapped-sq_default unknown ❌ 2400.04000 2399.52000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 49.22160 49.21710
SMT-COMP 2020 0.71 (2/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.06000 4767.60000
CVC4 CVC4-sq-final_default sat ✅ 483.71300 481.00900
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 966.02200 961.42800
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.06000 4520.17000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.35917 3.46321
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.13202 0.07545
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.16943 0.09622
veriT veriT_default unknown ❌ 1200.04000 1199.96000
veriT+vite_default unknown ❌ 508.01600 507.88000
Z3 z3-4.8.8_default unknown ❌ 467.39800 467.31700
SMT-COMP 2021 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 481.34000 480.91100
iProver iProver-v3.5-final-fix2_iProver_SMT sat ✅ 0.77334 1.76000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.03000 1802.53000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.71148 9.50154
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.16847 0.09456
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.13605 0.07657
veriT veriT_default unknown ❌ 1200.03000 1199.91000
Z3 z3-4.8.11_default unknown ❌ 1200.09000 1199.82000
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 529.28700 512.39300
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 514.29200 511.08300
iProver iProver-3.8-fix_iprover_SMT sat ✅ 339.39200 1335.76000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.10000 1490.23000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.81221 4.68711
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.17399 0.09904
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.12000 1199.93000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 sat ✅ 540.45091 540.32264
iProver iProver v3.9 sat ✅ 0.86867 1.89451
SMTInterpol SMTInterpol unknown ❌ 1202.72261 1425.43550
Yices2 Yices2 unknown ❌ 1201.25906 1200.61920
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 sat ✅ 540.46516 540.28724
iProver iProver v3.9.3 sat ✅ 0.85292 1.91610
SMTInterpol SMTInterpol unknown ❌ 1201.89075 4413.67611
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.93435 4.15910
Yices2 Yices2 unknown ❌ 1201.32869 1201.08408