Benchmark

non-incremental/UF/sledgehammer/QEpres/uf.1036326.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size75296
Compressed Size11380
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 75288
Compressed Size11390
Max. Term Depth11
Asserts 481
Declared Functions126
Declared Constants113
Declared Sorts 141
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false42 ite5 not99
or19 and80 =>382 =1217
forall522 exists39 let103

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.15707 0.14898
CVC4 CVC4 f7118b2 default unsat ✅ 0.18136 0.17797
veriT veriT-smtcomp2014 default unsat ✅ 0.06648 0.05799
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 1162.92000 1163.32000
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.22144 0.22097
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.19678 0.19397
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.19330 0.19097
veriT veriT default unsat ✅ 0.07519 0.07399
Z3 z3 4.4.0 default unknown ❌ 352.99100 353.14100
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.22353 0.22390
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.31428 0.31367
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.64308 2.40000
veriT veriT-dev default unsat ✅ 0.04833 0.04856
Z3 z3-4.4.1 default unknown ❌ 342.00900 342.11100
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.22540 0.22488
Vampire vampire4.2-smt vampire unsat ✅ 1.03980 1.66000
veriT veriT-2017-06-17 default unsat ✅ 0.06965 0.06797
Z3 z3-4.5.0 default unknown ❌ 350.05500 349.99900
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.24401 0.24421
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 3.22819 12.61000
veriT veriT_default unsat ✅ 0.06519 0.06541
Z3 z3-4.7.1_default unknown ❌ 408.32500 408.28800
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.25110 0.24940
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.24648 0.24679
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.24638 0.24673
Par4 Par4-wrapped-sq_default unsat ✅ 0.08036 0.00630
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.05000 7958.70000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.52025 3.85161
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.22469 3.64940
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.47402 3.87689
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 2.88415 10.98000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 42.89460 169.75000
veriT veriT-wrapped-sq_default unsat ✅ 0.06950 0.06988
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 371.07400 371.00700
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.28380 0.28409
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 17.31850 67.39010
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 4214.30000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.01059 5.23500
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.70073 2.33000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.73005 2.72000
veriT veriT_default unsat ✅ 0.06214 0.06249
Z3 z3-4.8.11_default unknown ❌ 229.44900 229.42800
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.25251 0.25304
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.28110 0.28169
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 4.16343 14.60000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.13000 3081.73000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.92072 4.94322
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 1.25668 4.82000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 23.58150 23.58150
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.40263 0.30311
iProver iProver v3.9 unsat ✅ 4.87243 16.25812
SMTInterpol SMTInterpol unknown ❌ 1202.25561 1295.92131
Yices2 Yices2 unsat ✅ 2.30108 2.20000