Benchmark

non-incremental/UF/sledgehammer/QEpres/uf.618143.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size2930
Compressed Size886
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2922
Compressed Size887
Max. Term Depth11
Asserts 15
Declared Functions9
Declared Constants18
Declared Sorts 10
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false2 not2 =>5 =24
forall11 exists1 let3

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.03531 0.02600
CVC4 CVC4 f7118b2 default unsat ✅ 0.03779 0.02300
veriT veriT-smtcomp2014 default unsat ✅ 0.01550 0.00700
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.05295 0.04499
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.03065 0.02999
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.02608 0.02399
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.02622 0.02300
veriT veriT default unsat ✅ 0.00780 0.00600
Z3 z3 4.4.0 default unsat ✅ 0.06769 0.06799
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.02959 0.02992
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 1.54665 1.55577
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.67412 2.44000
veriT veriT-dev default unsat ✅ 0.01254 0.01300
Z3 z3-4.4.1 default unsat ✅ 0.07030 0.07156
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.03218 0.03195
Vampire vampire4.2-smt vampire unsat ✅ 28.70840 113.79000
veriT veriT-2017-06-17 default unsat ✅ 0.04056 0.03921
Z3 z3-4.5.0 default unsat ✅ 0.07396 0.07351
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.03211 0.03229
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 247.80200 985.46000
veriT veriT_default unsat ✅ 0.03957 0.03978
Z3 z3-4.7.1_default unsat ✅ 0.08232 0.08223
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.16203 0.16129
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.03752 0.03786
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.03480 0.03511
Par4 Par4-wrapped-sq_default unsat ✅ 0.04106 0.00464
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 3075.28000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.27644 3.26408
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.07011 3.26838
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.31420 3.28468
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 21.66080 85.15000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 420.20900 1666.20000
veriT veriT-wrapped-sq_default unsat ✅ 0.04195 0.04228
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.08193 0.08190
SMT-COMP 2020 0.29 (5/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.15389 0.14988
CVC4 CVC4-sq-final_default unsat ✅ 0.03666 0.03696
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.03761 0.03801
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.04000 1238.55000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.40235 3.50984
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 195.65500 776.84000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 359.18400 1425.81000
veriT veriT_default unsat ✅ 0.01685 0.01719
veriT+vite_default unsat ✅ 0.01493 0.01526
Z3 z3-4.8.8_default unsat ✅ 0.07539 0.07534
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.03811 0.03840
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.10000 4326.53000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 4101.71000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.89983 4.75305
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 103.81800 411.21000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 485.77400 1824.02000
veriT veriT_default unsat ✅ 0.02019 0.02057
Z3 z3-4.8.11_default unsat ✅ 0.05912 0.05908
SMT-COMP 2023 0.50 (3/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.04106 0.04161
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.03928 0.03987
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 739.90800 2921.40000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.06000 4093.43000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.82362 4.83013
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 75.36880 298.66000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1200.00000
SMT-COMP 2025 0.60 (2/5) cvc5 cvc5 unsat ✅ 0.28467 0.16612
iProver iProver v3.9.3 unsat ✅ 913.56430 3631.36817
SMTInterpol SMTInterpol unknown ❌ 725.23814 2664.16720
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.90345 4.11405
Yices2 Yices2 unknown ❌ 1201.30909 1201.09706