Benchmark

non-incremental/QF_BV/Sage2/bench_17222.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size67442
Compressed Size2829
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 67434
Compressed Size2841
Max. Term Depth59
Asserts 91
Declared Functions0
Declared Constants25
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not28 =32
let1569 extract1 bvor5 bvadd497
bvmul62 bvult13 bvule15 bvugt5
bvuge25 bvsgt2 bvshl404 bvlshr19
zero_extend549

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.50697 0.50596
Boolector SMT17 final boolector unsat ✅ 1.35260 1.35251
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.91872 7.80971
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01400 599.92000
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.86394 1.86256
Q3B Q3B default unknown ❌ 600.07400 1799.76000
STP stp_st default unsat ✅ 2.96580 2.96537
stp_mt default unsat ✅ 2.90402 6.50689
Yices2 Yices2-Main default unsat ✅ 0.18526 0.18345
Z3 z3-4.5.0 default unsat ✅ 1.80211 1.80143
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.49378 0.49350
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.22732 1.22741
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 657.34100 657.28000
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.09973 4.16655
Minkeyrink ST_st unsat ✅ 1.07118 1.07075
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.97827 0.97568
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.98852 3.77209
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.55098 1.55109
Yices2 Yices 2.6.0_default unsat ✅ 0.16758 0.16749
Z3 z3-4.7.1_default unsat ✅ 7.38192 7.38159
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.29680 1.29673
Poolector-wrapped-sq_default unsat ✅ 1.28710 4.54212
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.18202 2.26173
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.71167 1.71173
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.78020 2.93387
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.99538 0.99547
Par4 Par4-wrapped-sq_default unsat ✅ 0.17103 0.00654
STP STP-2019-wrapped-sq_default unsat ✅ 0.91436 0.91463
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 4.87361 4.87297
stp-minisat-wrapped-sq_default unsat ✅ 1.70428 1.70434
stp-mt-wrapped-sq_default unsat ✅ 0.66946 2.47526
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 4.76595 7.33715
stp-riss-wrapped-sq_default unknown ❌ 0.04597 0.04618
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.16845 0.16841
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.20379 0.20381
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.13672 0.13674
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.05000 2399.77000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.09706 0.09705
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.90095 0.90089
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.53329 1.53319
Boolector Boolector-wrapped-sq_default unsat ✅ 1.91307 1.91289
Poolector-wrapped-sq_default unsat ✅ 1.18046 4.17000
CVC4 CVC4-sq-final_default unsat ✅ 7.25762 7.25731
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1200.06000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.83000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.04868 0.04889
MinkeyRink Solver 2020.3_default unsat ✅ 0.91638 3.48025
STP STP_default unsat ✅ 0.85857 3.27963
STP ++ Mergsat v1_default unsat ✅ 3.55509 3.55668
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.21291 0.21287
Z3 z3-4.8.8_default unsat ✅ 5.46152 5.46116
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.94485 0.84343
cvc5 cvc5 unsat ✅ 4.95561 4.85579
SMTInterpol SMTInterpol unsat ✅ 4.28228 12.54445
STP STP unsat ✅ 0.70706 0.60725
Yices2 Yices2 unsat ✅ 0.49857 0.39860
Z3alpha Z3-alpha unsat ✅ 2.47371 2.37377
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 1.11451 0.98694
Bitwuzla-MachBV-base unsat ✅ 0.98820 0.86923
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.88835 0.76706
BVDecide bv_decide unsat ✅ 3.29709 3.13358
bv_decide-nokernel unsat ✅ 2.62257 2.44141
cvc5 cvc5 unsat ✅ 2.27705 2.15535
SMTInterpol SMTInterpol unsat ✅ 3.07391 8.83815
Yices2 Yices2 unsat ✅ 0.43082 0.31007
Z3alpha Z3-alpha unsat ✅ 1.84908 6.10776
Z3 Z3-alpha-base unsat ✅ 2.40186 2.27979
Z3-Owl-base unsat ✅ 9.98195 9.86344
z3siri-base unsat ✅ 2.39551 2.26977
Z3-Owl Z3-Owl unsat ✅ 1.81348 1.68308