Benchmark

non-incremental/QF_BV/sage/app7/bench_1531.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1558603
Compressed Size114527
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1558595
Compressed Size114536
Max. Term Depth5980
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1598 and1
=2165 let5923 extract1238 bvand15171
bvor9837 bvxor1440 bvadd16738 bvmul1
bvsub5416 bvult435 bvule470 bvslt204
bvsle98 bvshl5248 bvashr9519 zero_extend950

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.21956 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.24579 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.24467 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.24087 —
abziz_portfolio_2012_solvers default unsat ✅ 0.24268 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.24402 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.29907 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.36377 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.31690 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 52.03130 —
CVC3-SMT-COMP-2011 default unsat ✅ 44.06320 —
CVC3-SMT-COMP-2012 default unsat ✅ 46.02850 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.26066 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.08389 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.46864 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.44909 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.59184 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.57280 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.41784 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.28862 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.81681 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.61854 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.23478 —
STP2-SMT-COMP-2012 default unsat ✅ 0.22036 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.22661 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.26223 —
Z3-SMT-COMP-2011 default unsat ✅ 0.24005 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.42412 0.42294
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.07752 3.39048
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.09840 3.43048
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.33648 0.33595
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.64000
STP stp-cryptominisat4 default unsat ✅ 0.20970 0.20897
stp-cmsat4-v15 default unsat ✅ 0.20848 0.20797
stp-cmsat4-mt-v15 default unsat ✅ 0.20946 0.20897
stp-minisat-v15 default unsat ✅ 0.20840 0.20697
Yices2 Yices default unsat ✅ 0.09486 0.09398
Z3 z3 4.4.0 default unsat ✅ 0.27453 0.27496
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.89295 0.89277
ABC_glucose glucose unsat ✅ 0.87887 0.87894
Boolector Boolector boolector unsat ✅ 0.53097 0.53124
Boolector preprop boolector unsat ✅ 0.51179 0.51259
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.03157 3.32476
MapleSTP MapleSTP default unsat ✅ 0.19871 0.19878
MapleSTP-mt default unsat ✅ 0.20089 0.20096
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.30021 0.30141
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.27152 0.27150
Q3B Q3B default unsat ✅ 0.50938 0.51172
STP stp-cms-exp-2016 default unsat ✅ 0.20306 0.20315
stp-cms-mt-2016 default unsat ✅ 0.20907 0.20915
stp-cms-st-2016 default unsat ✅ 0.20704 0.20712
stp-minisat-st-2016 default unsat ✅ 0.20732 0.20744
Yices2 Yices-2.4.2 default unsat ✅ 0.09437 0.09437
Z3 z3-4.4.1 default unsat ✅ 0.26299 0.26443
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.42289 0.41449
Boolector SMT17 final boolector unsat ✅ 0.40283 0.40190
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.13161 3.45360
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.30610 0.30560
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.65204 0.64858
Q3B Q3B default unsat ✅ 0.52640 0.91017
STP stp_st default unsat ✅ 0.29879 0.29583
stp_mt default unsat ✅ 0.26739 0.26686
Yices2 Yices2-Main default unsat ✅ 0.10175 0.09479
Z3 z3-4.5.0 default unsat ✅ 0.28528 0.28421
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.34821 0.34813
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.87992 1.87987
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.29776 0.29858
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.60881 0.60884
Minkeyrink ST_st unsat ✅ 0.60909 0.60911
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.25707 0.25703
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.25665 0.25667
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.25592 0.25598
Yices2 Yices 2.6.0_default unsat ✅ 0.08818 0.08810
Z3 z3-4.7.1_default unsat ✅ 0.27921 0.27908
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.67754 0.67753
Poolector-wrapped-sq_default unsat ✅ 0.89422 2.64000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.53463 0.53468
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.92038 1.92035
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.45655 0.45669
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.45382 0.45367
Par4 Par4-wrapped-sq_default unsat ✅ 0.09740 0.00599
STP STP-2019-wrapped-sq_default unsat ✅ 0.26524 0.26539
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.26487 0.26501
stp-minisat-wrapped-sq_default unsat ✅ 0.26852 0.26864
stp-mt-wrapped-sq_default unsat ✅ 0.26676 0.26692
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.27219 0.26295
stp-riss-wrapped-sq_default unsat ✅ 0.26743 0.26752
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.09216 0.09213
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.09172 0.09171
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.09208 0.09209
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09029 0.09029
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.09161 0.09160
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.30137 0.30136
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.53251 0.53243
Bitwuzla-wrapped_default unsat ✅ 0.57032 0.57010
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.94886 1.94840
MathSAT MathSAT-5.6.8_default unsat ✅ 0.32810 0.32801
STP STP 2022.4_default unsat ✅ 0.26888 0.26889
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.11053 0.11050
Z3++BV z3++bv_0702_default unsat ✅ 0.25226 0.25218
Z3 z3-4.8.17_default unsat ✅ 0.24806 0.24986
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.85532 0.85521
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.42111 1.42163
STP STP 2022.4_default unsat ✅ 0.26935 0.26937
STP 2022.4_default unsat ✅ 0.26879 0.26879
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 476.82400 541.84100
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.10460 0.10457
Z3-Owl z3-Owl-Final_default unsat ✅ 0.92640 0.92643
z3-Owl-Final_default unsat ✅ 0.93524 0.93527
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.60440 0.50393
cvc5 cvc5 unsat ✅ 1.10242 1.00261
SMTInterpol SMTInterpol unsat ✅ 994.51745 1432.34779
STP STP unsat ✅ 7.56481 7.46107
Yices2 Yices2 unsat ✅ 0.28186 0.18194
Z3alpha Z3-alpha unsat ✅ 0.39188 0.29233
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.57932 0.46164
Bitwuzla-MachBV-base unsat ✅ 0.60669 0.48861
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.74246 0.61725
BVDecide bv_decide unsat ✅ 421.85823 421.63868
bv_decide-nokernel unsat ✅ 370.84819 370.68173
cvc5 cvc5 unsat ✅ 0.60231 0.48446
SMTInterpol SMTInterpol unknown ❌ 1201.89401 3119.62433
Yices2 Yices2 unsat ✅ 0.29611 0.18053
Z3alpha Z3-alpha unsat ✅ 0.62381 0.54434
Z3 Z3-alpha-base unsat ✅ 0.40595 0.27831
Z3-Owl-base unsat ✅ 0.72884 0.61469
z3siri-base unsat ✅ 0.40358 0.27445
Z3-Owl Z3-Owl unsat ✅ 0.93860 0.79680