Benchmark

non-incremental/QF_BV/sage/app7/bench_1294.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1890130
Compressed Size130834
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1890122
Compressed Size130845
Max. Term Depth7294
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1679 and1
=2264 let7195 extract1262 bvand18896
bvor12317 bvxor1461 bvadd20549 bvmul1
bvsub6618 bvult438 bvule476 bvslt204
bvsle100 bvshl6454 bvashr11949 zero_extend977

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.29197 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.34503 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.32300 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.32325 —
abziz_portfolio_2012_solvers default unsat ✅ 0.32592 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.32539 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.36415 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.44332 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.39355 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 170.72200 —
CVC3-SMT-COMP-2011 default unsat ✅ 143.27700 —
CVC3-SMT-COMP-2012 default unsat ✅ 149.73200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.48180 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.45287 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.56140 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.53297 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.71514 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.68820 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.51526 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.57248 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.50037 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.77512 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.30850 —
STP2-SMT-COMP-2012 default unsat ✅ 0.29744 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.27520 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.35234 —
Z3-SMT-COMP-2011 default unsat ✅ 0.32399 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.51870 0.51792
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.50190 4.08638
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.50411 4.09638
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.39402 0.39294
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.21000
STP stp-cryptominisat4 default unsat ✅ 0.25401 0.25296
stp-cmsat4-v15 default unsat ✅ 0.25524 0.25396
stp-cmsat4-mt-v15 default unsat ✅ 0.25395 0.25296
stp-minisat-v15 default unsat ✅ 0.25231 0.25096
Yices2 Yices default unsat ✅ 0.11263 0.11198
Z3 z3 4.4.0 default unsat ✅ 0.32015 0.31995
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.08081 2.08110
ABC_glucose glucose unsat ✅ 1.07307 1.07420
Boolector Boolector boolector unsat ✅ 0.64343 0.64376
Boolector preprop boolector unsat ✅ 0.62616 0.62645
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.44957 4.01012
MapleSTP MapleSTP default unsat ✅ 0.24240 0.24269
MapleSTP-mt default unsat ✅ 0.24216 0.24214
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.36115 0.36236
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.34915 0.34935
Q3B Q3B default unsat ✅ 0.57440 1.31000
STP stp-cms-exp-2016 default unsat ✅ 0.24940 0.24951
stp-cms-mt-2016 default unsat ✅ 0.25064 0.25072
stp-cms-st-2016 default unsat ✅ 0.25216 0.25223
stp-minisat-st-2016 default unsat ✅ 0.25598 0.25610
Yices2 Yices-2.4.2 default unsat ✅ 0.11326 0.11328
Z3 z3-4.4.1 default unsat ✅ 0.40728 0.40870
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.47323 0.47242
Boolector SMT17 final boolector unsat ✅ 0.51861 0.51728
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.47467 4.00571
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.36780 0.36746
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.72368 0.72306
Q3B Q3B default unsat ✅ 0.55927 1.26000
STP stp_st default unsat ✅ 0.31284 0.31285
stp_mt default unsat ✅ 0.31179 0.31117
Yices2 Yices2-Main default unsat ✅ 0.11277 0.10630
Z3 z3-4.5.0 default unsat ✅ 0.32684 0.32511
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.42647 0.42639
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.28659 2.28600
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.35639 0.35744
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.73718 0.73724
Minkeyrink ST_st unsat ✅ 0.73123 0.73123
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.31315 0.31315
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.31411 0.31409
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.31230 0.31230
Yices2 Yices 2.6.0_default unsat ✅ 0.10433 0.10427
Z3 z3-4.7.1_default unsat ✅ 0.33277 0.33267
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.64882 0.64879
Boolector Boolector-wrapped-sq_default unsat ✅ 0.82283 0.82261
Poolector-wrapped-sq_default unsat ✅ 1.08220 7.47533
CVC4 CVC4-sq-final_default unsat ✅ 3.07633 3.07659
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.45098 0.45093
MathSAT MathSAT5_default.sh unsat ✅ 0.36852 0.36847
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.44515 0.44525
MinkeyRink Solver 2020.3_default unsat ✅ 0.46057 0.46072
STP STP_default unsat ✅ 0.29816 0.29817
STP ++ Mergsat v1_default unsat ✅ 0.29534 0.29699
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.12792 0.12788
Z3 z3-4.8.8_default unsat ✅ 0.21046 0.21038
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.65063 0.65062
Bitwuzla-wrapped_default unsat ✅ 0.71217 0.71206
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.32686 2.32727
MathSAT MathSAT-5.6.8_default unsat ✅ 0.37959 0.37955
STP STP 2022.4_default unsat ✅ 0.34307 0.34307
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.12855 0.12854
Z3++BV z3++bv_0702_default unsat ✅ 0.29393 0.29387
Z3 z3-4.8.17_default unsat ✅ 0.27938 0.28122
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.02679 1.02664
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.75542 1.75282
STP STP 2022.4_default unsat ✅ 0.34549 0.34551
STP 2022.4_default unsat ✅ 0.34749 0.34756
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 511.77400 591.86500
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.12428 0.12422
Z3-Owl z3-Owl-Final_default unsat ✅ 0.93558 0.93545
z3-Owl-Final_default unsat ✅ 0.99904 0.94892
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.71371 0.61413
cvc5 cvc5 unsat ✅ 0.74605 0.64629
SMTInterpol SMTInterpol unsat ✅ 1097.60811 1633.66406
STP STP unsat ✅ 10.80873 10.70426
Yices2 Yices2 unsat ✅ 0.30482 0.20499
Z3alpha Z3-alpha unsat ✅ 0.42340 0.32346
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.66502 0.53812
Bitwuzla-MachBV-base unsat ✅ 0.73384 0.61610
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.86678 0.74118
BVDecide bv_decide unsat ✅ 714.89925 714.67433
bv_decide-nokernel unsat ✅ 636.51288 636.25399
cvc5 cvc5 unsat ✅ 0.83923 0.71719
SMTInterpol SMTInterpol unknown ❌ 1201.88789 2964.96835
Yices2 Yices2 unsat ✅ 0.35451 0.22498
Z3alpha Z3-alpha unsat ✅ 0.67771 0.61432
Z3 Z3-alpha-base unsat ✅ 0.43645 0.30947
Z3-Owl-base unsat ✅ 1.02330 0.90463
z3siri-base unsat ✅ 0.45015 0.32556
Z3-Owl Z3-Owl unsat ✅ 0.99891 0.86838