Benchmark

non-incremental/QF_BV/sage/app7/bench_1516.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1561175
Compressed Size114110
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1561167
Compressed Size114120
Max. Term Depth6004
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1605 and1
=2175 let5947 extract1244 bvand15183
bvor9843 bvxor1444 bvadd16758 bvmul1
bvsub5423 bvult436 bvule471 bvslt204
bvsle99 bvshl5254 bvashr9524 zero_extend957

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.21961 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.27701 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.28269 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.27920 —
abziz_portfolio_2012_solvers default unsat ✅ 0.28266 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.28099 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.30551 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.36764 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.31418 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 145.66400 —
CVC3-SMT-COMP-2011 default unsat ✅ 122.06000 —
CVC3-SMT-COMP-2012 default unsat ✅ 127.31900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.26343 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.09382 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.46925 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.44814 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.59804 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.57311 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.41774 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.29222 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.85070 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.61386 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.23576 —
STP2-SMT-COMP-2012 default unsat ✅ 0.22579 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.22629 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.30359 —
Z3-SMT-COMP-2011 default unsat ✅ 0.27495 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.42644 0.42494
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.07278 3.38549
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.07071 3.38748
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.33585 0.33495
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.99000
STP stp-cryptominisat4 default unsat ✅ 0.21731 0.21597
stp-cmsat4-v15 default unsat ✅ 0.20963 0.20797
stp-cmsat4-mt-v15 default unsat ✅ 0.20891 0.20797
stp-minisat-v15 default unsat ✅ 0.21651 0.21597
Yices2 Yices default unsat ✅ 0.09524 0.09398
Z3 z3 4.4.0 default unsat ✅ 0.27911 0.27896
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.89348 0.89376
ABC_glucose glucose unsat ✅ 0.89092 0.89112
Boolector Boolector boolector unsat ✅ 0.53671 0.53765
Boolector preprop boolector unsat ✅ 0.52120 0.52142
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.03771 3.33628
MapleSTP MapleSTP default unsat ✅ 0.20170 0.20180
MapleSTP-mt default unsat ✅ 0.19941 0.19951
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.30129 0.30238
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.27033 0.27038
Q3B Q3B default unsat ✅ 0.51872 0.51748
STP stp-cms-exp-2016 default unsat ✅ 0.20395 0.20405
stp-cms-mt-2016 default unsat ✅ 0.20710 0.20717
stp-cms-st-2016 default unsat ✅ 0.20822 0.20832
stp-minisat-st-2016 default unsat ✅ 0.20877 0.20887
Yices2 Yices-2.4.2 default unsat ✅ 0.09475 0.09479
Z3 z3-4.4.1 default unsat ✅ 0.25433 0.25573
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.41370 0.41295
Boolector SMT17 final boolector unsat ✅ 0.43051 0.42915
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.01875 3.26730
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.30969 0.30551
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.60616 0.60541
Q3B Q3B default unsat ✅ 0.49283 0.49447
STP stp_st default unsat ✅ 0.28870 0.28707
stp_mt default unsat ✅ 0.27277 0.27192
Yices2 Yices2-Main default unsat ✅ 0.09696 0.09065
Z3 z3-4.5.0 default unsat ✅ 0.35612 0.35601
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.34824 0.34816
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.87859 1.87873
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.29882 0.29971
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.60882 0.60888
Minkeyrink ST_st unsat ✅ 0.60896 0.60895
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.25605 0.25611
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.25657 0.25648
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.25630 0.25636
Yices2 Yices 2.6.0_default unsat ✅ 0.08868 0.08838
Z3 z3-4.7.1_default unsat ✅ 0.31903 0.31892
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.70878 0.70870
Poolector-wrapped-sq_default unsat ✅ 0.89914 3.09967
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.54427 0.54430
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.95976 1.95991
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.45381 0.45395
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.45162 0.45150
Par4 Par4-wrapped-sq_default unsat ✅ 0.09656 0.00584
STP STP-2019-wrapped-sq_default unsat ✅ 0.26533 0.26548
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.26363 0.26372
stp-minisat-wrapped-sq_default unsat ✅ 0.26595 0.26607
stp-mt-wrapped-sq_default unsat ✅ 0.26959 0.26965
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.26326 0.26339
stp-riss-wrapped-sq_default unsat ✅ 0.26743 0.26761
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.09188 0.09190
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.09234 0.09234
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.09191 0.09191
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09160 0.09162
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.09168 0.09166
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.35007 0.35004
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.53716 0.53715
MathSAT mathsat-5.6.6_default unsat ✅ 0.31749 0.31743
STP STP 2021.0_default unsat ✅ 0.25563 0.25567
Z3 z3-4.8.11_default unsat ✅ 0.21710 0.21706
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.85857 0.85845
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.41276 1.41337
STP STP 2022.4_default unsat ✅ 0.26925 0.26922
STP 2022.4_default unsat ✅ 0.27080 0.27078
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 488.54100 554.32600
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.10558 0.10550
Z3-Owl z3-Owl-Final_default unsat ✅ 0.89994 0.89993
z3-Owl-Final_default unsat ✅ 0.93514 0.93216
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.57992 0.47971
cvc5 cvc5 unsat ✅ 0.72115 0.62084
SMTInterpol SMTInterpol unsat ✅ 1028.78565 1489.50793
STP STP unsat ✅ 7.73636 7.63253
Yices2 Yices2 unsat ✅ 0.27960 0.17913
Z3alpha Z3-alpha unsat ✅ 0.38920 0.28970
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.60921 0.48302
Bitwuzla-MachBV-base unsat ✅ 0.64821 0.52092
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.76308 0.64245
BVDecide bv_decide unsat ✅ 410.18044 410.01662
bv_decide-nokernel unsat ✅ 376.56750 376.39957
cvc5 cvc5 unsat ✅ 0.52811 0.40923
SMTInterpol SMTInterpol unknown ❌ 1201.89622 2954.24350
Yices2 Yices2 unsat ✅ 0.30023 0.18114
Z3alpha Z3-alpha unsat ✅ 0.58419 0.51754
Z3 Z3-alpha-base unsat ✅ 0.38869 0.26964
Z3-Owl-base unsat ✅ 0.78387 0.66198
z3siri-base unsat ✅ 0.39508 0.27809
Z3-Owl Z3-Owl unsat ✅ 0.94163 0.81145