Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1008378.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size81325
Compressed Size11384
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 81317
Compressed Size11363
Max. Term Depth13
Asserts 349
Declared Functions180
Declared Constants46
Declared Sorts 140
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false164 not24 or4 and40
=>617 =1046 forall468 exists11
let93

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.09000 2402.68000
CVC4 CVC4 f7118b2 default unsat ✅ 1.50554 1.49877
veriT veriT-smtcomp2014 default unknown ❌ 2399.61000 2400.05000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.61000 2400.04000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.76000 2403.61000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.24416 0.24196
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.24145 0.23896
veriT veriT default unknown ❌ 727.93500 728.05500
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.68000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.28854 0.28892
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.54824 2.55919
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.64068 2.36000
veriT veriT-dev default unsat ✅ 60.13200 60.17010
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2400.67000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.28383 0.28137
Vampire vampire4.2-smt vampire unsat ✅ 2.82514 10.74890
veriT veriT-2017-06-17 default unsat ✅ 0.18049 0.17997
Z3 z3-4.5.0 default unknown ❌ 600.02000 599.84000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.29852 0.29856
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 3.70950 14.44000
veriT veriT_default unsat ✅ 0.17848 0.17872
Z3 z3-4.7.1_default unknown ❌ 1200.03000 1199.90000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.40137 0.40065
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.27040 0.27076
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.27510 0.27536
Par4 Par4-wrapped-sq_default unsat ✅ 0.12407 0.00591
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.11000 4730.39000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.47582 3.82509
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.10123 3.54464
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.27417 3.81811
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 16.20210 63.88000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 4.13974 16.22000
veriT veriT-wrapped-sq_default unsat ✅ 0.11754 0.11733
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 352.65500 352.56000
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.37874 0.37819
CVC4 CVC4-sq-final_default unsat ✅ 0.31189 0.31219
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.27088 0.27125
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.12000 1322.21000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.52918 3.98965
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.37423 0.37130
vampire-4.3-smt_vampire_smtcomp unsat ✅ 3.93324 15.23000
veriT veriT_default unsat ✅ 0.44159 0.44184
veriT+vite_default unsat ✅ 0.19803 0.19837
Z3 z3-4.8.8_default unknown ❌ 1200.11000 1199.78000
SMT-COMP 2021 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.32957 0.32967
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 8.32450 31.50250
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 347.96300 365.81600
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.08842 5.26651
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.31672 0.31714
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.49982 0.38559
veriT veriT_default unsat ✅ 1.17213 1.17261
Z3 z3-4.8.11_default unsat ✅ 12.21990 12.21830
SMT-COMP 2022 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 0.33334 0.33348
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.28981 0.29008
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.88451 5.13690
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.52585 0.33452
veriT veriT_default unsat ✅ 0.27607 0.27648
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.03000 1199.98000
Z3 z3-4.8.17_default unsat ✅ 1.85841 1.86009