Benchmark

non-incremental/QF_BV/sage/app1/bench_129.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size60856
Compressed Size8189
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 60848
Compressed Size8188
Max. Term Depth115
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite49 not68 and1
=170 let105 extract1 bvand30
bvor171 bvadd315 bvmul5 bvsub154
bvult181 bvule408 bvslt2 bvsle22
bvshl172 bvashr5 zero_extend277

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.93316 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.76344 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.75284 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.75146 —
abziz_portfolio_2012_solvers default unsat ✅ 0.75395 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.76636 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.08579 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.29000 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.07893 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 20.21920 —
CVC3-SMT-COMP-2011 default unsat ✅ 19.38650 —
CVC3-SMT-COMP-2012 default unsat ✅ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.42257 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.55539 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.22307 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.22808 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.21808 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.21657 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.24725 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.42305 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.67543 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.37763 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.03574 —
STP2-SMT-COMP-2012 default unsat ✅ 0.03784 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.06348 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.80400 —
Z3-SMT-COMP-2011 default unsat ✅ 0.75351 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.13451 0.13298
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.87770 1.70574
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.89730 1.74873
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.89859 0.89786
SMT-RAT SMT-RAT-final default unsat ✅ 72.75440 72.78290
STP stp-cryptominisat4 default unsat ✅ 0.03770 0.03699
stp-cmsat4-v15 default unsat ✅ 0.03596 0.03499
stp-cmsat4-mt-v15 default unsat ✅ 0.03650 0.03499
stp-minisat-v15 default unsat ✅ 0.03633 0.03499
Yices2 Yices default unsat ✅ 0.03316 0.03200
Z3 z3 4.4.0 default unsat ✅ 0.20888 0.20897
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.72046 0.72108
ABC_glucose glucose unsat ✅ 8.84885 8.85410
Boolector Boolector boolector unsat ✅ 0.11437 0.11435
Boolector preprop boolector unsat ✅ 0.12311 0.12316
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.76592 1.48903
MapleSTP MapleSTP default unsat ✅ 0.03305 0.03297
MapleSTP-mt default unsat ✅ 0.03244 0.03242
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.65629 0.65767
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.04409 0.04405
Q3B Q3B default unknown ❌ 2400.02000 7204.33000
STP stp-cms-exp-2016 default unsat ✅ 0.03194 0.03193
stp-cms-mt-2016 default unsat ✅ 0.03287 0.03286
stp-cms-st-2016 default unsat ✅ 0.03228 0.03264
stp-minisat-st-2016 default unsat ✅ 0.03319 0.03318
Yices2 Yices-2.4.2 default unsat ✅ 0.03102 0.03153
Z3 z3-4.4.1 default unsat ✅ 0.20278 0.20423
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.21353 0.21271
Boolector SMT17 final boolector unsat ✅ 0.20649 0.20528
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.99681 1.94861
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.66513 0.66568
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.03568 0.03513
Q3B Q3B default unknown ❌ 600.05700 1799.45000
STP stp_st default unsat ✅ 0.05518 0.05416
stp_mt default unsat ✅ 0.05676 0.05549
Yices2 Yices2-Main default unsat ✅ 0.03447 0.03355
Z3 z3-4.5.0 default unsat ✅ 0.93813 0.93651
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.21197 0.21190
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.61523 1.61524
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.68733 0.68840
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.03860 0.03865
Minkeyrink ST_st unsat ✅ 0.03886 0.03893
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.05837 0.05842
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.05831 0.05837
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.05862 0.05868
Yices2 Yices 2.6.0_default unsat ✅ 0.03080 0.03074
Z3 z3-4.7.1_default unsat ✅ 0.69434 0.69431
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.44115 0.44097
Poolector-wrapped-sq_default unsat ✅ 0.27800 0.39649
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.12403 0.12401
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.74146 0.74167
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.04586 0.04605
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04474 0.04480
Par4 Par4-wrapped-sq_default unsat ✅ 0.04305 0.00659
STP STP-2019-wrapped-sq_default unsat ✅ 0.06887 0.06901
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.06975 0.06989
stp-minisat-wrapped-sq_default unsat ✅ 0.06935 0.06948
stp-mt-wrapped-sq_default unsat ✅ 0.06945 0.06957
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.06893 0.06909
stp-riss-wrapped-sq_default unsat ✅ 0.07034 0.07050
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03908 0.03906
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.07719 0.07718
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.06291 0.06289
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.08452 0.08449
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05391 0.05393
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.11317 1.11310
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.26177 0.26170
MathSAT mathsat-5.6.6_default unsat ✅ 0.33023 0.32850
STP STP 2021.0_default unsat ✅ 0.06422 0.06436
Z3 z3-4.8.11_default unsat ✅ 0.57099 0.57089
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.36463 0.23912
Bitwuzla-MachBV-base unsat ✅ 0.36466 0.24668
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.43489 0.31444
BVDecide bv_decide unsat ✅ 11.19385 11.03334
bv_decide-nokernel unsat ✅ 5.61439 5.44765
cvc5 cvc5 unsat ✅ 0.83877 0.70834
SMTInterpol SMTInterpol unknown ❌ 1201.59319 1227.14455
Yices2 Yices2 unsat ✅ 0.30567 0.18997
Z3alpha Z3-alpha unsat ✅ 0.59371 0.97816
Z3 Z3-alpha-base unsat ✅ 0.77093 0.63589
Z3-Owl-base unsat ✅ 1.51792 1.39864
z3siri-base unsat ✅ 0.61251 0.49290
Z3-Owl Z3-Owl unsat ✅ 6.27765 6.14787