Benchmark

non-incremental/UF/sledgehammer/FFT/uf.707472.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size14223
Compressed Size2386
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 14215
Compressed Size2446
Max. Term Depth10
Asserts 88
Declared Functions20
Declared Constants30
Declared Sorts 22
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false1 ite3 not7 or3
=>3 =111 forall79 let56

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2406.48000 2406.75000
CVC4 CVC4 f7118b2 default sat ✅ 54.43670 54.42770
veriT veriT-smtcomp2014 default unknown ❌ 216.61900 216.69000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 1512.19000 1512.56000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.15000 2402.61000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 22.01850 22.00770
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 22.03320 22.03560
veriT veriT default unknown ❌ 2400.01000 2400.51000
Z3 z3 4.4.0 default unknown ❌ 460.01800 460.20800
SMT-COMP 2016 0.67 (2/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 314.23000 304.25500
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 10.15920 10.20640
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.49018 0.48640
veriT veriT-dev default unknown ❌ 2400.07000 2401.34000
Z3 z3-4.4.1 default unknown ❌ 480.29000 480.41000
SMT-COMP 2017 0.83 (1/6) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.04800 340.78900
Vampire vampire4.2-smt vampire sat ✅ 0.27798 0.31281
veriT veriT-2017-06-17 default unknown ❌ 600.10400 599.90000
Z3 z3-4.5.0 default unknown ❌ 486.80900 486.70300
SMT-COMP 2018 0.67 (2/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 482.56900 481.47800
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.54317 0.40333
veriT veriT_default unknown ❌ 1200.02000 1199.84000
Z3 z3-4.7.1_default unknown ❌ 613.81600 613.81000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.11000 9515.44000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 968.92200 964.25600
master-2018-06-10-b19c840-competition-default_default sat ✅ 482.73900 481.76300
Par4 Par4-wrapped-sq_default sat ✅ 482.40700 1445.91000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2402.07000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.32298 3.34802
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.07321 3.35007
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.41982 3.31612
Vampire vampire-4.4-smtcomp-wrapped-sq_default sat ✅ 1.96236 7.62000
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.77420 2.83000
veriT veriT-wrapped-sq_default unknown ❌ 2400.03000 2399.64000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 446.08800 445.98300
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default sat ✅ 482.97700 481.82000
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.11000 4724.80000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.08000 4204.59000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.79869 4.72098
Vampire vampire_smt_4.6-fixed_vampire_smtcomp sat ✅ 0.52688 0.28122
vampire_smt_4.5_vampire_smtcomp sat ✅ 0.33964 0.22449
veriT veriT_default unknown ❌ 1200.10000 1199.97000
Z3 z3-4.8.11_default unknown ❌ 294.54900 294.45800
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 485.35200 482.03900
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 517.60300 512.48300
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.70663 4.62879
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.57890 0.30083
veriT veriT_default unknown ❌ 1200.06000 1199.80000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.79000
Z3 z3-4.8.17_default unknown ❌ 485.37100 485.30900
SMT-COMP 2023 0.67 (2/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 523.05600 512.35000
cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 519.36200 512.39300
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.04000 4449.75000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.05000 3916.90000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.88543 4.67274
Vampire vampire_4.8_smt_pre_vampire_smtcomp sat ✅ 0.56126 0.29965
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.92000
SMT-COMP 2024 0.75 (1/4) cvc5 cvc5 sat ✅ 541.10788 540.79300
iProver iProver v3.9 unknown ❌ 1201.73211 4769.03594
SMTInterpol SMTInterpol unknown ❌ 1202.72468 4609.59279
Yices2 Yices2 unknown ❌ 1201.27276 1200.73910