Benchmark

non-incremental/QF_BV/sage/app1/bench_448.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size85409
Compressed Size12160
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 85401
Compressed Size12185
Max. Term Depth216
Asserts 1
Declared Functions0
Declared Constants320
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite91 not78 and1
=217 let206 extract1 bvand50
bvor192 bvadd410 bvmul5 bvsub293
bvult293 bvule637 bvslt1 bvsle73
bvshl193 bvashr5 zero_extend347

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 1.23316 —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.05040 —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unsat ✅ 0.05000 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.05007 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unsat ✅ 0.14508 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.15281 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.50390 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.08184 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.47853 —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.04062 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17733 —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03890 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04535 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02884 0.02799
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.19255 2.32465
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.22583 2.39564
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.08899 1.08883
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.18000
STP stp-cryptominisat4 default unsat ✅ 0.15953 0.15897
stp-cmsat4-v15 default unsat ✅ 0.15909 0.15798
stp-cmsat4-mt-v15 default unsat ✅ 0.16095 0.15998
stp-minisat-v15 default unsat ✅ 0.15844 0.15798
Yices2 Yices default unsat ✅ 0.05027 0.04899
Z3 z3 4.4.0 default unsat ✅ 0.38713 0.38694
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.03873 1.03902
ABC_glucose glucose unsat ✅ 14.09290 14.09980
Boolector Boolector boolector unsat ✅ 0.03646 0.03646
Boolector preprop boolector unsat ✅ 0.03508 0.03548
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.13620 2.21522
MapleSTP MapleSTP default unsat ✅ 0.13166 0.13170
MapleSTP-mt default unsat ✅ 0.13057 0.13058
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.05387 1.05535
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.13703 0.13706
Q3B Q3B default unsat ✅ 0.65468 1.69390
STP stp-cms-exp-2016 default unsat ✅ 0.13503 0.13508
stp-cms-mt-2016 default unsat ✅ 0.13502 0.13508
stp-cms-st-2016 default unsat ✅ 0.13513 0.13515
stp-minisat-st-2016 default unsat ✅ 0.13400 0.13402
Yices2 Yices-2.4.2 default unsat ✅ 0.04662 0.04662
Z3 z3-4.4.1 default unsat ✅ 0.42798 0.42955
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.03555 0.03435
Boolector SMT17 final boolector unsat ✅ 0.03548 0.03469
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.33329 2.55462
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.11069 1.09914
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.05412 0.04652
Q3B Q3B default unsat ✅ 0.67960 1.74128
STP stp_st default unsat ✅ 0.83623 0.83524
stp_mt default unsat ✅ 1.82554 0.86960
Yices2 Yices2-Main default unsat ✅ 0.05184 0.05118
Z3 z3-4.5.0 default unsat ✅ 0.43752 0.43469
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.04933 0.04924
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.38660 2.38642
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.96818 0.96897
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04813 0.04820
Minkeyrink ST_st unsat ✅ 0.04972 0.04980
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.35419 0.35422
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.35385 0.35386
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.35510 0.35514
Yices2 Yices 2.6.0_default unsat ✅ 0.04749 0.04736
Z3 z3-4.7.1_default unsat ✅ 0.37835 0.37827
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.05733 0.05734
Poolector-wrapped-sq_default unsat ✅ 0.17599 0.32176
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.04697 0.04696
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.19807 1.19820
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05725 0.05742
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.05422 0.05425
Par4 Par4-wrapped-sq_default unsat ✅ 0.05758 0.00608
STP STP-2019-wrapped-sq_default unsat ✅ 0.20712 0.20727
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.20601 0.20619
stp-minisat-wrapped-sq_default unsat ✅ 0.20585 0.20597
stp-mt-wrapped-sq_default unsat ✅ 0.20607 0.20619
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.20634 0.20649
stp-riss-wrapped-sq_default unsat ✅ 0.20597 0.20614
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05120 0.05118
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05112 0.05112
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05109 0.05109
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.11405 0.11397
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05076 0.05075
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.44632 0.44627
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.05179 0.05171
Bitwuzla-wrapped_default unsat ✅ 0.05504 0.05501
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.05130 1.05142
MathSAT MathSAT-5.6.8_default unsat ✅ 0.62798 0.62790
STP STP 2022.4_default unsat ✅ 0.04248 0.04250
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.05369 0.05360
Z3++BV z3++bv_0702_default unsat ✅ 0.55575 0.55570
Z3 z3-4.8.17_default unsat ✅ 0.75922 0.76105
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.67278 2.67270
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.10501 1.09982
STP STP 2022.4_default unsat ✅ 0.04268 0.04273
STP 2022.4_default unsat ✅ 0.04258 0.04264
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1262.02000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.05126 0.05118
Z3-Owl z3-Owl-Final_default unsat ✅ 0.72151 0.72150
z3-Owl-Final_default unsat ✅ 0.73165 0.73186
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.25081 0.15129
cvc5 cvc5 unsat ✅ 1.18228 1.08224
SMTInterpol SMTInterpol unsat ✅ 907.12853 943.97621
STP STP unsat ✅ 0.30013 0.20029
Yices2 Yices2 unsat ✅ 0.24303 0.14301
Z3alpha Z3-alpha unsat ✅ 0.29690 0.19728
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.31579 0.19210
Bitwuzla-MachBV-base unsat ✅ 0.29237 0.17567
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.40413 0.27990
BVDecide bv_decide unsat ✅ 19.37935 19.21204
bv_decide-nokernel unsat ✅ 10.34312 10.17881
cvc5 cvc5 unsat ✅ 0.98687 0.86104
SMTInterpol SMTInterpol unknown ❌ 1201.54843 1229.49420
Yices2 Yices2 unsat ✅ 0.31488 0.18420
Z3alpha Z3-alpha unsat ✅ 0.43639 0.45443
Z3 Z3-alpha-base unsat ✅ 0.33185 0.20633
Z3-Owl-base unsat ✅ 0.44291 0.31422
z3siri-base unsat ✅ 0.31829 0.19694
Z3-Owl Z3-Owl unsat ✅ 0.82504 0.70418