Benchmark

non-incremental/UF/sledgehammer/QEpres/uf.649906.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size12288
Compressed Size1780
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 12280
Compressed Size1808
Max. Term Depth8
Asserts 79
Declared Functions22
Declared Constants29
Declared Sorts 27
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false8 not5 or2
and4 =>28 =162 forall80
let47

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 1300.61000 1300.86000
CVC4 CVC4 f7118b2 default sat ✅ 40.26300 40.25190
veriT veriT-smtcomp2014 default unknown ❌ 171.05900 171.02500
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 757.59200 757.59400
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 395.73200 395.90300
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.13400 20.13790
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.13620 20.14190
veriT veriT default unknown ❌ 1215.09000 1215.51000
Z3 z3 4.4.0 default unknown ❌ 299.80600 299.84600
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 307.14200 301.77800
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.80586 9.85951
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.13069 0.13029
veriT veriT-dev default unknown ❌ 2400.03000 2401.37000
Z3 z3-4.4.1 default unknown ❌ 357.15200 357.35600
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 457.82600 451.71500
Vampire vampire4.2-smt vampire sat ✅ 0.12475 0.16220
veriT veriT-2017-06-17 default unknown ❌ 600.01800 599.89000
Z3 z3-4.5.0 default unknown ❌ 350.46700 350.30300
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 488.34200 512.14900
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.16504 0.15625
veriT veriT_default unknown ❌ 1200.02000 1199.95000
Z3 z3-4.7.1_default unknown ❌ 333.97900 333.80400
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2124.31000 8437.81000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 971.03800 962.45500
master-2018-06-10-b19c840-competition-default_default sat ✅ 491.80900 482.08800
Par4 Par4-wrapped-sq_default sat ✅ 485.30500 1451.44000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2408.93000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.31031 3.46544
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.02493 3.32815
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.31598 3.40240
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 1.08310 3.84000
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.16301 0.15635
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2399.76000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 329.92200 329.80800
SMT-COMP 2020 0.71 (2/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.05000 4767.72000
CVC4 CVC4-sq-final_default sat ✅ 487.87100 481.57700
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 968.98700 961.76600
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.04000 4188.97000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.35566 3.37776
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.22971 0.12725
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.29704 0.16274
veriT veriT_default unknown ❌ 1200.11000 1200.14000
veriT+vite_default unknown ❌ 962.78900 962.48000
Z3 z3-4.8.8_default unknown ❌ 307.31200 307.21800
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 490.99500 481.62900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 512.85600 510.79600
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.89103 4.93538
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.29201 0.17897
veriT veriT_default unknown ❌ 1200.03000 1199.77000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1200.04000
Z3 z3-4.8.17_default unknown ❌ 288.43100 288.42300
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 512.33500 510.91100
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 514.11900 511.04900
iProver iProver-3.8-fix_iprover_SMT sat ✅ 339.44800 1333.39000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.05000 4023.38000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.72724 9.18365
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.33126 0.18781
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.86000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 sat ✅ 540.43493 540.20107
iProver iProver v3.9 sat ✅ 0.87283 2.00877
SMTInterpol SMTInterpol unknown ❌ 1202.71965 4495.70044
Yices2 Yices2 unknown ❌ 1201.25283 1201.12190