Benchmark

non-incremental/QF_BV/sage/app7/bench_1944.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1032626
Compressed Size85871
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1032618
Compressed Size85879
Max. Term Depth3930
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1434 and1
=1947 let3896 extract1163 bvand9372
bvor6011 bvxor1315 bvadd10779 bvmul1
bvsub3491 bvult419 bvule425 bvslt186
bvsle96 bvshl3340 bvashr5737 zero_extend887

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.14805 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.22397 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.22873 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.22567 —
abziz_portfolio_2012_solvers default unsat ✅ 0.22773 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.22427 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.19999 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.24134 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.21554 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 139.58100 —
CVC3-SMT-COMP-2011 default unsat ✅ 116.34800 —
CVC3-SMT-COMP-2012 default unsat ✅ 121.19500 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.91324 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.50577 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.31728 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.30092 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.40469 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.38327 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.27954 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.61222 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.81590 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.41234 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.15628 —
STP2-SMT-COMP-2012 default unsat ✅ 0.15471 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.14067 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.24902 —
Z3-SMT-COMP-2011 default unsat ✅ 0.22559 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.26239 0.26096
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.42244 2.34564
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.41550 2.33364
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.22747 0.22697
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.98000
STP stp-cryptominisat4 default unsat ✅ 0.13587 0.13498
stp-cmsat4-v15 default unsat ✅ 0.13385 0.13298
stp-cmsat4-mt-v15 default unsat ✅ 0.13501 0.13398
stp-minisat-v15 default unsat ✅ 0.13481 0.13398
Yices2 Yices default unsat ✅ 0.06442 0.06299
Z3 z3 4.4.0 default unsat ✅ 0.16704 0.16697
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.58535 0.58556
ABC_glucose glucose unsat ✅ 0.58004 0.58107
Boolector Boolector boolector unsat ✅ 0.30013 0.30018
Boolector preprop boolector unsat ✅ 0.29015 0.29027
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.37558 2.27113
MapleSTP MapleSTP default unsat ✅ 0.12763 0.12767
MapleSTP-mt default unsat ✅ 0.12780 0.12784
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.20371 0.20472
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.17570 0.17576
Q3B Q3B default unsat ✅ 0.37652 0.85956
STP stp-cms-exp-2016 default unsat ✅ 0.13051 0.13054
stp-cms-mt-2016 default unsat ✅ 0.13343 0.13347
stp-cms-st-2016 default unsat ✅ 0.13326 0.13331
stp-minisat-st-2016 default unsat ✅ 0.13253 0.13257
Yices2 Yices-2.4.2 default unsat ✅ 0.06432 0.06433
Z3 z3-4.4.1 default unsat ✅ 0.18157 0.18279
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.24519 0.24493
Boolector SMT17 final boolector unsat ✅ 0.27241 0.26930
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.42907 2.33808
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.22097 0.22017
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.42107 0.41848
Q3B Q3B default unsat ✅ 0.37060 0.83501
STP stp_st default unsat ✅ 0.17693 0.17629
stp_mt default unsat ✅ 0.17762 0.17358
Yices2 Yices2-Main default unsat ✅ 0.06317 0.06202
Z3 z3-4.5.0 default unsat ✅ 0.22496 0.22484
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.21923 0.21891
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.24979 1.24989
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.20087 0.20181
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.40453 0.40451
Minkeyrink ST_st unsat ✅ 0.40203 0.40209
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.16445 0.16447
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.16343 0.16348
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.16586 0.16585
Yices2 Yices 2.6.0_default unsat ✅ 0.06134 0.06127
Z3 z3-4.7.1_default unsat ✅ 0.26004 0.25970
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.40024 0.40020
Poolector-wrapped-sq_default unsat ✅ 0.57995 1.85139
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.34115 0.34112
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.26362 1.26386
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.31909 0.31928
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.31874 0.31886
Par4 Par4-wrapped-sq_default unsat ✅ 0.07135 0.00590
STP STP-2019-wrapped-sq_default unsat ✅ 0.17819 0.17836
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.17591 0.17604
stp-minisat-wrapped-sq_default unsat ✅ 0.17767 0.17780
stp-mt-wrapped-sq_default unsat ✅ 0.17700 0.17713
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.17562 0.17571
stp-riss-wrapped-sq_default unsat ✅ 0.17779 0.17794
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.06412 0.06413
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.06381 0.06380
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.06395 0.06394
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.06271 0.06268
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.06377 0.06375
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.24701 0.24697
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.32903 0.32894
Boolector Boolector-wrapped-sq_default unsat ✅ 0.39926 0.39925
Poolector-wrapped-sq_default unsat ✅ 0.57764 1.86248
CVC4 CVC4-sq-final_default unsat ✅ 1.67306 1.67299
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.25305 0.25295
MathSAT MathSAT5_default.sh unsat ✅ 0.20569 0.20560
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.26322 0.26337
MinkeyRink Solver 2020.3_default unsat ✅ 0.27528 0.27540
STP STP_default unsat ✅ 0.15935 0.15943
STP ++ Mergsat v1_default unsat ✅ 0.15262 0.15445
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.07387 0.07383
Z3 z3-4.8.8_default unsat ✅ 0.18754 0.18750
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.32867 0.32860
Bitwuzla-wrapped_default unsat ✅ 0.36416 0.36373
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.40341 1.40081
MathSAT MathSAT-5.6.8_default unsat ✅ 0.21941 0.21935
STP STP 2022.4_default unsat ✅ 0.18097 0.18071
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.07415 0.07412
Z3++BV z3++bv_0702_default unsat ✅ 0.22734 0.22728
Z3 z3-4.8.17_default unsat ✅ 0.20973 0.21217
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.53975 0.53967
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.99112 0.99140
STP STP 2022.4_default unsat ✅ 0.17622 0.17621
STP 2022.4_default unsat ✅ 0.17799 0.17804
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 324.04100 372.85200
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.07182 0.07175
Z3-Owl z3-Owl-Final_default unsat ✅ 0.79019 0.79025
z3-Owl-Final_default unsat ✅ 0.79159 0.79186
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.49733 0.39753
cvc5 cvc5 unsat ✅ 0.46909 0.36938
SMTInterpol SMTInterpol unsat ✅ 732.80909 1092.58411
STP STP unsat ✅ 3.75781 3.65563
Yices2 Yices2 unsat ✅ 0.26338 0.16370
Z3alpha Z3-alpha unsat ✅ 0.33761 0.23797