Benchmark

non-incremental/UF/sledgehammer/TypeSafe/uf.1020930.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size6040
Compressed Size1402
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 6032
Compressed Size1410
Max. Term Depth11
Asserts 30
Declared Functions19
Declared Constants19
Declared Sorts 21
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false9 not4 and5 =>39
=67 forall21 exists5 let1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 19.93660 19.93800
CVC4 CVC4 f7118b2 default sat ✅ 40.91080 40.91380
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.07000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.08000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.55017 0.54992
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 20.39560 20.39590
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 20.38240 20.38590
veriT veriT default unknown ❌ 2400.01000 2400.89000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.91000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 340.64700 304.21300
Vampire vampire_smt_4.1 vampire_smtcomp sat ✅ 9.82957 9.86957
vampire_smt_4.1_parallel vampire_smtcomp sat ✅ 0.16672 0.16705
veriT veriT-dev default unknown ❌ 2400.11000 2401.41000
Z3 z3-4.4.1 default sat ✅ 65.51420 65.55070
SMT-COMP 2017 0.67 (2/6) CVC4 CVC4-smtcomp2017-main default sat ✅ 457.13300 451.55500
Vampire vampire4.2-smt vampire sat ✅ 0.37644 0.24400
veriT veriT-2017-06-17 default unknown ❌ 600.11100 600.00000
Z3 z3-4.5.0 default unknown ❌ 600.05400 599.97000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 487.55300 481.56900
Vampire vampire-4.3-smt_vampire_smtcomp sat ✅ 0.26352 0.26390
veriT veriT_default unknown ❌ 1200.02000 1199.91000
Z3 z3-4.7.1_default sat ✅ 0.12375 0.12370
SMT-COMP 2020 0.71 (2/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 446.42500 1281.91000
CVC4 CVC4-sq-final_default sat ✅ 490.57800 481.84300
CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 980.17200 963.20600
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.06000 1368.74000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.51360 3.38319
Vampire vampire_smt_4.5_vampire_smtcomp sat ✅ 0.41888 0.24093
vampire-4.3-smt_vampire_smtcomp sat ✅ 0.46652 0.47008
veriT veriT_default unknown ❌ 1200.02000 1199.92000
veriT+vite_default unknown ❌ 1200.03000 1199.95000
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.72000
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default sat ✅ 487.98000 481.86100
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 523.56200 512.48200
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.88466 5.03008
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp sat ✅ 0.51283 0.27397
veriT veriT_default unknown ❌ 1200.11000 1199.97000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.89000
Z3 z3-4.8.17_default unknown ❌ 1200.04000 1199.94000
SMT-COMP 2024 0.50 (2/4) cvc5 cvc5 sat ✅ 540.38753 540.21217
iProver iProver v3.9 sat ✅ 396.57777 1569.74411
SMTInterpol SMTInterpol unknown ❌ 1201.71412 1256.60006
Yices2 Yices2 unknown ❌ 1201.28077 1200.94992