Benchmark

non-incremental/UF/sledgehammer/TypeSafe/smtlib.1008947.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size53485
Compressed Size7053
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 53477
Compressed Size7104
Max. Term Depth13
Asserts 220
Declared Functions97
Declared Constants30
Declared Sorts 75
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false119 not4 or3 and22
=>523 =741 forall299 exists10
let75

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.04000 2403.03000
CVC4 CVC4 f7118b2 default unsat ✅ 0.83988 0.82787
veriT veriT-smtcomp2014 default unknown ❌ 1111.95000 1112.32000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.41000 2400.07000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 2402.43000 2403.09000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.16883 0.16597
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.16775 0.16497
veriT veriT default unknown ❌ 601.20000 601.40800
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.24000
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.19903 0.19932
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.47373 2.48651
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.79268 2.95000
veriT veriT-dev default unsat ✅ 60.12500 60.15890
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2401.21000
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.16994 0.16912
Vampire vampire4.2-smt vampire unsat ✅ 0.37883 0.37684
veriT veriT-2017-06-17 default unsat ✅ 0.11524 0.11466
Z3 z3-4.5.0 default unknown ❌ 600.01300 599.85000
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.20076 0.20102
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.79558 2.90000
veriT veriT_default unsat ✅ 0.12091 0.12117
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.92000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.29603 0.29524
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.21232 0.21269
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.21481 0.21509
Par4 Par4-wrapped-sq_default unsat ✅ 0.09264 0.00657
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.04000 2450.41000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.28845 3.44792
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.21153 3.38287
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.33059 3.37479
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 2.15707 8.10000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.53044 0.39786
veriT veriT-wrapped-sq_default unsat ✅ 0.07665 0.07687
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 323.11600 323.05800
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.28513 0.28322
CVC4 CVC4-sq-final_default unsat ✅ 0.21365 0.21393
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.18740 0.18778
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.06000 1317.80000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.49167 3.47557
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.31967 0.22606
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.38659 0.38876
veriT veriT_default unsat ✅ 0.22789 0.22815
veriT+vite_default unsat ✅ 0.13978 0.14014
Z3 z3-4.8.8_default unsat ✅ 0.11240 0.11235
SMT-COMP 2021 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 0.21732 0.21763
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 6.80926 25.28560
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 14.30190 22.16460
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.01564 5.22394
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.22372 0.22183
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.33333 0.22819
veriT veriT_default unsat ✅ 1.12325 1.12374
Z3 z3-4.8.11_default unsat ✅ 0.15101 0.15082
SMT-COMP 2022 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.21753 0.21768
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.26178 0.25884
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.88223 5.07002
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.29804 0.23338
veriT veriT_default unsat ✅ 1.15975 1.15678
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.02000 1199.93000
Z3 z3-4.8.17_default unknown ❌ 1200.04000 1199.89000
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.18425 0.18468
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.19817 0.19872
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 6.17029 22.17580
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 30.16670 38.57600
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.87926 4.76050
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.27099 0.27108
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.03000 1199.85000