Benchmark

non-incremental/UF/sledgehammer/NS_Shared/uf.854491.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size92880
Compressed Size13943
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 92872
Compressed Size13965
Max. Term Depth20
Asserts 467
Declared Functions208
Declared Constants139
Declared Sorts 221
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true6 false60 ite6 not158
or24 and33 =>420 =1060
forall474 exists13 let222

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.15629 0.14798
CVC4 CVC4 f7118b2 default unsat ✅ 0.20170 0.19097
veriT veriT-smtcomp2014 default unsat ✅ 0.07314 0.06399
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.09282 0.08599
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.14672 0.14598
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.21982 0.21697
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.22110 0.21897
veriT veriT default unsat ✅ 0.08615 0.08499
Z3 z3 4.4.0 default unsat ✅ 0.10459 0.10498
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.26325 0.26356
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.32197 0.32296
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.18753 0.11466
veriT veriT-dev default unsat ✅ 0.05182 0.05201
Z3 z3-4.4.1 default unsat ✅ 0.10634 0.10762
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.26263 0.26177
Vampire vampire4.2-smt vampire unsat ✅ 0.19649 0.18929
veriT veriT-2017-06-17 default unsat ✅ 6.05041 6.04953
Z3 z3-4.5.0 default unsat ✅ 0.11319 0.11260
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.29256 0.29277
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.36264 0.32865
veriT veriT_default unsat ✅ 6.05737 6.05738
Z3 z3-4.7.1_default unsat ✅ 0.12419 0.12412
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.24399 0.24485
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.29284 0.29320
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.29629 0.29657
Par4 Par4-wrapped-sq_default unsat ✅ 0.14253 0.00573
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 2403.88000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.45909 3.93583
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.08198 3.58077
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.41273 3.86449
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.20603 4.43000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.65601 2.33000
veriT veriT-wrapped-sq_default unsat ✅ 6.06341 6.06348
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.12899 0.12898
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.28860 0.28903
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.33003 0.33060
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.64949 5.36000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.12000 1244.70000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.08917 5.02494
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.25633 0.25471
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.05441 0.05437
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.45296 0.33081
iProver iProver v3.9.3 unsat ✅ 44.00003 165.64464
SMTInterpol SMTInterpol unknown ❌ 1201.78785 1779.07639
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.03137 4.35172
Yices2 Yices2 unsat ✅ 0.30589 0.18795