Benchmark

non-incremental/QF_BV/Sage2/bench_12810.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size14281
Compressed Size2008
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 14273
Compressed Size1921
Max. Term Depth141
Asserts 37
Declared Functions0
Declared Constants82
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not5 =34 let236
bvor16 bvadd45 bvmul45 bvsle1
bvsge1 bvshl16 zero_extend109

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.89785 0.89752
Boolector SMT17 final boolector sat ✅ 41.38880 41.38970
CVC4 CVC4-smtcomp2017-main default sat ✅ 5.63954 11.29410
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 3.73615 3.73648
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.27247 1.27200
Q3B Q3B default unknown ❌ 600.06300 1799.86000
STP stp_st default sat ✅ 0.67136 0.67020
stp_mt default sat ✅ 0.89493 2.06551
Yices2 Yices2-Main default sat ✅ 1.32037 1.31938
Z3 z3-4.5.0 default sat ✅ 144.19700 144.16700
SMT-COMP 2018 Boolector Boolector_default sat ✅ 4.13010 4.12971
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 12.37760 12.37840
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 3.25311 3.25388
MinkeyRink Minkeyrink MT_mt sat ✅ 0.78933 2.50001
Minkeyrink ST_st sat ✅ 1.09043 1.08981
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.89311 0.89278
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.95274 3.12526
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.09105 1.08902
Yices2 Yices 2.6.0_default sat ✅ 0.21280 0.21273
Z3 z3-4.7.1_default sat ✅ 22.83530 22.83410
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 3.20122 3.20122
Boolector Boolector-wrapped-sq_default sat ✅ 4.29727 4.29279
Poolector-wrapped-sq_default sat ✅ 0.18228 0.12651
CVC4 CVC4-sq-final_default sat ✅ 4.29267 4.29296
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.11000 1199.82000
MathSAT MathSAT5_default.sh sat ✅ 1.02672 1.02663
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.18662 0.18684
MinkeyRink Solver 2020.3_default sat ✅ 1.36631 4.85438
STP STP_default sat ✅ 0.86373 2.92898
STP ++ Mergsat v1_default sat ✅ 0.73365 0.73518
Yices2 Yices 2.6.2 bug fix_default sat ✅ 2.86132 2.86118
Z3 z3-4.8.8_default sat ✅ 83.12560 83.09040
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 8.61667 8.61254
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 2.08011 2.08022
STP STP 2022.4_default sat ✅ 2.31466 2.31465
STP 2022.4_default sat ✅ 2.29978 4.49973
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1248.78000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 1.75020 1.74999
Z3-Owl z3-Owl-Final_default sat ✅ 18.47620 18.47500
z3-Owl-Final_default sat ✅ 45.36560 45.36540
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 1.92465 1.80379
Bitwuzla-MachBV-base sat ✅ 1.51628 1.38966
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.43377 1.30487
BVDecide bv_decide sat ✅ 3.49746 3.33937
bv_decide-nokernel sat ✅ 3.60165 3.43519
cvc5 cvc5 sat ✅ 21.13896 21.00558
SMTInterpol SMTInterpol unknown ❌ 1201.49318 1238.02537
Yices2 Yices2 sat ✅ 3.42445 3.29556
Z3alpha Z3-alpha sat ✅ 10.12746 38.84744
Z3 Z3-alpha-base sat ✅ 25.31517 25.17948
Z3-Owl-base sat ✅ 110.00618 109.87495
z3siri-base sat ✅ 25.46561 25.33632
Z3-Owl Z3-Owl sat ✅ 19.83120 19.70009