Benchmark

non-incremental/QF_BV/sage/app7/bench_983.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2463722
Compressed Size159389
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2463714
Compressed Size159397
Max. Term Depth9490
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1777 and1
=2387 let9391 extract1306 bvand25322
bvor16615 bvxor1548 bvadd27080 bvmul1
bvsub8747 bvult442 bvule487 bvslt206
bvsle104 bvshl8583 bvashr16161 zero_extend1027

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.36961 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40638 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40218 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.39786 —
abziz_portfolio_2012_solvers default unsat ✅ 0.40039 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.39946 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.49822 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.58167 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.52711 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 117.07800 —
CVC3-SMT-COMP-2011 default unsat ✅ 99.02650 —
CVC3-SMT-COMP-2012 default unsat ✅ 103.55000 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.04396 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.17459 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.75241 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.72119 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.93517 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.90900 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.65374 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.16083 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.61268 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.01446 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.39371 —
STP2-SMT-COMP-2012 default unsat ✅ 0.37126 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.37915 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.39307 —
Z3-SMT-COMP-2011 default unsat ✅ 0.39157 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.71657 0.71589
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.21476 5.19521
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.21486 5.20221
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.50035 0.49992
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.19000
STP stp-cryptominisat4 default unsat ✅ 0.35513 0.35395
stp-cmsat4-v15 default unsat ✅ 0.35192 0.35095
stp-cmsat4-mt-v15 default unsat ✅ 0.35100 0.34995
stp-minisat-v15 default unsat ✅ 0.35023 0.34895
Yices2 Yices default unsat ✅ 0.14351 0.14298
Z3 z3 4.4.0 default unsat ✅ 0.38228 0.38194
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.41782 1.41892
ABC_glucose glucose unsat ✅ 1.41589 1.41533
Boolector Boolector boolector unsat ✅ 0.82723 0.82680
Boolector preprop boolector unsat ✅ 0.80222 0.80264
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.20491 5.18935
MapleSTP MapleSTP default unsat ✅ 0.33402 0.33417
MapleSTP-mt default unsat ✅ 0.34424 0.34375
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.46299 0.46426
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.46504 0.46530
Q3B Q3B default unsat ✅ 0.68532 1.70000
STP stp-cms-exp-2016 default unsat ✅ 0.34543 0.34555
stp-cms-mt-2016 default unsat ✅ 0.34850 0.34868
stp-cms-st-2016 default unsat ✅ 0.37237 0.37255
stp-minisat-st-2016 default unsat ✅ 0.35558 0.35573
Yices2 Yices-2.4.2 default unsat ✅ 0.14441 0.14446
Z3 z3-4.4.1 default unsat ✅ 0.37150 0.37301
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.65280 0.65270
Boolector SMT17 final boolector unsat ✅ 0.66638 0.66631
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.19290 5.10451
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.47244 0.47275
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.93715 0.93620
Q3B Q3B default unsat ✅ 0.65383 1.53000
STP stp_st default unsat ✅ 0.42902 0.42777
stp_mt default unsat ✅ 0.42833 0.42693
Yices2 Yices2-Main default unsat ✅ 0.13786 0.13555
Z3 z3-4.5.0 default unsat ✅ 0.45823 0.44619
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.59248 0.59233
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.95533 2.95512
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.45110 0.45208
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.95920 0.95917
Minkeyrink ST_st unsat ✅ 0.95835 0.95797
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.43111 0.43115
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.43284 0.43291
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.43051 0.43049
Yices2 Yices 2.6.0_default unsat ✅ 0.13110 0.13101
Z3 z3-4.7.1_default unsat ✅ 0.44760 0.44746
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.90542 0.90536
MathSAT mathsat-5.6.6_default unsat ✅ 0.47823 0.47803
STP STP 2021.0_default unsat ✅ 0.41693 0.41703
Z3 z3-4.8.11_default unsat ✅ 0.33922 0.33920
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.34145 1.34128
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.31410 2.31462
STP STP 2022.4_default unsat ✅ 0.44372 0.44369
STP 2022.4_default unsat ✅ 0.44359 0.44349
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 597.50100 685.38100
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.15804 0.15802
Z3-Owl z3-Owl-Final_default unsat ✅ 1.07848 1.07838
z3-Owl-Final_default unsat ✅ 1.08530 2.13558
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.79038 0.66380
Bitwuzla-MachBV-base unsat ✅ 0.89000 0.76111
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.09990 0.96628
BVDecide bv_decide unknown ❌ 1201.36954 1201.01539
bv_decide-nokernel unknown ❌ 1201.35418 1200.94272
cvc5 cvc5 unsat ✅ 1.01659 0.88440
SMTInterpol SMTInterpol unknown ❌ 1201.89348 2865.60818
Yices2 Yices2 unsat ✅ 0.37391 0.24596
Z3alpha Z3-alpha unsat ✅ 0.73109 0.70012
Z3 Z3-alpha-base unsat ✅ 0.44326 0.32480
Z3-Owl-base unsat ✅ 1.06583 0.93451
z3siri-base unsat ✅ 0.43393 0.31692
Z3-Owl Z3-Owl unsat ✅ 1.00781 0.87996