Benchmark

non-incremental/QF_BV/sage/app7/bench_586.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3194740
Compressed Size199472
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3194732
Compressed Size199478
Max. Term Depth12216
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1928 and1
=2573 let12111 extract1405 bvand33312
bvor21990 bvxor1708 bvadd35277 bvmul1
bvsub11442 bvult461 bvule505 bvslt210
bvsle116 bvshl11259 bvashr21388 zero_extend1130

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.46970 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.49642 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.50454 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.50022 —
abziz_portfolio_2012_solvers default unsat ✅ 0.49512 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.49935 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.64844 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.76915 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.68389 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 330.70500 —
CVC3-SMT-COMP-2011 default unsat ✅ 276.49100 —
CVC3-SMT-COMP-2012 default unsat ✅ 287.93200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.74241 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.21031 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.96294 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.91952 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.19458 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.17923 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.83351 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.82010 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.98313 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.30246 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.50055 —
STP2-SMT-COMP-2012 default unsat ✅ 0.47600 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.49342 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.54399 —
Z3-SMT-COMP-2011 default unsat ✅ 0.49157 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.93545 0.93486
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.16451 6.75897
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.17675 6.78197
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.67442 0.67390
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.89000
STP stp-cryptominisat4 default unsat ✅ 0.44802 0.44693
stp-cmsat4-v15 default unsat ✅ 0.44561 0.44493
stp-cmsat4-mt-v15 default unsat ✅ 0.44784 0.44693
stp-minisat-v15 default unsat ✅ 0.44726 0.44593
Yices2 Yices default unsat ✅ 0.18765 0.18697
Z3 z3 4.4.0 default unsat ✅ 0.48111 0.48093
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.81115 1.81221
ABC_glucose glucose unsat ✅ 1.78579 1.78649
Boolector Boolector boolector unsat ✅ 1.04029 1.03855
Boolector preprop boolector unsat ✅ 1.08568 2.12669
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.13905 6.72513
MapleSTP MapleSTP default unsat ✅ 0.43115 0.43136
MapleSTP-mt default unsat ✅ 0.42444 0.42464
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.60272 0.60408
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.60022 0.60053
Q3B Q3B default unsat ✅ 0.84295 2.02000
STP stp-cms-exp-2016 default unsat ✅ 0.43844 0.43867
stp-cms-mt-2016 default unsat ✅ 0.44553 0.44574
stp-cms-st-2016 default unsat ✅ 0.43992 0.44016
stp-minisat-st-2016 default unsat ✅ 0.44255 0.44277
Yices2 Yices-2.4.2 default unsat ✅ 0.18181 0.18189
Z3 z3-4.4.1 default unsat ✅ 0.48609 0.48760
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.88698 0.88515
Boolector SMT17 final boolector unsat ✅ 0.88149 0.87963
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.08083 6.55501
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.60825 0.60857
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.21416 1.21262
Q3B Q3B default unsat ✅ 0.79143 1.89316
STP stp_st default unsat ✅ 0.55072 0.54890
stp_mt default unsat ✅ 0.55415 0.55243
Yices2 Yices2-Main default unsat ✅ 0.17386 0.17243
Z3 z3-4.5.0 default unsat ✅ 0.64260 0.63904
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.76865 0.76852
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.76930 3.76921
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.61246 0.61347
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.23631 1.23643
Minkeyrink ST_st unsat ✅ 1.23077 1.23081
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.55435 0.55436
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.55565 0.55566
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.55634 0.55638
Yices2 Yices 2.6.0_default unsat ✅ 0.16673 0.16668
Z3 z3-4.7.1_default unsat ✅ 0.58613 0.58594
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.18256 2.25260
MathSAT mathsat-5.6.6_default unsat ✅ 0.64694 0.64691
STP STP 2021.0_default unsat ✅ 0.54386 0.54398
Z3 z3-4.8.11_default unsat ✅ 0.44291 0.44270
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.17428 1.17412
Bitwuzla-wrapped_default unsat ✅ 1.26768 1.26756
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.94896 3.94660
MathSAT MathSAT-5.6.8_default unsat ✅ 0.66783 0.66764
STP STP 2022.4_default unsat ✅ 0.58804 0.58808
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.20938 0.20930
Z3++BV z3++bv_0702_default unsat ✅ 0.39606 0.39600
Z3 z3-4.8.17_default unsat ✅ 0.40082 0.40215
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.81850 1.81741
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.95088 2.94788
STP STP 2022.4_default unsat ✅ 0.58402 0.58403
STP 2022.4_default unsat ✅ 0.65555 0.65174
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 741.21700 860.35400
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.20417 0.20414
Z3-Owl z3-Owl-Final_default unsat ✅ 1.23822 1.23805
z3-Owl-Final_default unsat ✅ 1.26324 1.26346
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.95993 0.83519
Bitwuzla-MachBV-base unsat ✅ 1.06130 0.93562
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.23546 1.10968
BVDecide bv_decide unknown ❌ 1201.34259 1200.84493
bv_decide-nokernel unknown ❌ 1201.38501 1200.90406
cvc5 cvc5 unsat ✅ 0.95827 0.83797
SMTInterpol SMTInterpol unknown ❌ 1201.89265 2630.55307
Yices2 Yices2 unsat ✅ 0.36613 0.25079
Z3alpha Z3-alpha unsat ✅ 0.96089 0.94397
Z3 Z3-alpha-base unsat ✅ 0.52245 0.39763
Z3-Owl-base unsat ✅ 1.28287 1.15477
z3siri-base unsat ✅ 0.52452 0.39263
Z3-Owl Z3-Owl unsat ✅ 1.03738 0.91410