Benchmark

non-incremental/UF/sledgehammer/NS_Shared/uf.861242.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size97563
Compressed Size14658
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 97555
Compressed Size14654
Max. Term Depth20
Asserts 481
Declared Functions214
Declared Constants153
Declared Sorts 227
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false39 ite5 not142
or30 and34 =>434 =1089
forall485 exists20 let233

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 0.18629 0.17797
CVC4 CVC4 f7118b2 default unsat ✅ 0.25547 0.24096
veriT veriT-smtcomp2014 default unsat ✅ 0.07085 0.06999
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.10758 0.09998
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 0.18356 0.18297
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.27583 0.27296
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.27523 0.27296
veriT veriT default unsat ✅ 0.09107 0.08998
Z3 z3 4.4.0 default unsat ✅ 0.12009 0.11998
SMT-COMP 2016 0.33 (4/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.32098 0.32137
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.48709 0.49000
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.86468 3.30000
veriT veriT-dev default unsat ✅ 0.05670 0.05697
Z3 z3-4.4.1 default unsat ✅ 0.12103 0.12227
SMT-COMP 2017 0.33 (4/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.28876 0.28830
Vampire vampire4.2-smt vampire unsat ✅ 0.78225 2.92168
veriT veriT-2017-06-17 default unsat ✅ 6.06070 6.05702
Z3 z3-4.5.0 default unsat ✅ 0.17349 0.17187
SMT-COMP 2018 0.33 (4/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.31231 0.31250
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.85555 3.06000
veriT veriT_default unsat ✅ 6.07393 6.07385
Z3 z3-4.7.1_default unsat ✅ 0.12853 0.12846
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.31267 0.31278
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.31404 0.31438
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.31872 0.31900
Par4 Par4-wrapped-sq_default unsat ✅ 0.14763 0.00582
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 2402.76000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.42697 3.81155
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.04100 3.60066
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.33176 3.80740
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 5.77786 22.42000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.94247 3.56000
veriT veriT-wrapped-sq_default unsat ✅ 6.07967 6.07992
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.13365 0.13367
SMT-COMP 2021 0.43 (4/7) CVC4 CVC4-sq-final_default unsat ✅ 0.36610 0.36640
iProver iProver-v3.5-final-fix2_iProver_SMT unknown ❌ 1200.06000 4752.06000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.03000 1567.68000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.95498 5.91491
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.69990 2.33000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.47933 0.37401
veriT veriT_default unsat ✅ 0.07112 0.07150
Z3 z3-4.8.11_default unsat ✅ 0.14446 0.14442
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.38948 0.28969
iProver iProver v3.9 unsat ✅ 24.95024 91.14687
SMTInterpol SMTInterpol unknown ❌ 1202.22078 1653.01446
Yices2 Yices2 unsat ✅ 0.26888 0.16899
SMT-COMP 2025 0.40 (3/5) cvc5 cvc5 unsat ✅ 0.44973 0.33292
iProver iProver v3.9.3 unsat ✅ 21.99224 79.42710
SMTInterpol SMTInterpol unknown ❌ 1201.91123 2244.06343
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.99538 4.27093
Yices2 Yices2 unsat ✅ 0.29174 0.17027