Benchmark

non-incremental/QF_BV/sage/app11/bench_105.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1535747
Compressed Size153320
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1535739
Compressed Size153326
Max. Term Depth4223
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1312
and1 =2115 let2890 extract1503
bvand990 bvor281 bvxor2297 bvadd14666
bvmul1186 bvsdiv16 bvult1100 bvule1514
bvslt123 bvsle162 bvshl8918 bvashr13285
zero_extend10189

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.16865 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40997 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40829 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.41891 —
abziz_portfolio_2012_solvers default unsat ✅ 0.41466 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40783 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.22258 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.30217 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.24035 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.96030 —
CVC3-SMT-COMP-2011 default unsat ✅ 26.38640 —
CVC3-SMT-COMP-2012 default unsat ✅ 27.36590 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.75859 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.66370 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.46595 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.45356 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.53880 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.55176 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.47356 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.98888 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.81658 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.55010 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.11687 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16717 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.27567 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.45872 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40862 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.37413 0.37406
Boolector SMT17 final boolector unsat ✅ 0.32499 0.32441
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.77255 6.73476
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.35187 0.35146
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.73147 0.73092
Q3B Q3B default unsat ✅ 27.10710 80.77000
STP stp_st default unsat ✅ 6.72090 6.72113
stp_mt default unsat ✅ 7.56183 7.55984
Yices2 Yices2-Main default unsat ✅ 0.12612 0.12533
Z3 z3-4.5.0 default unsat ✅ 0.24721 0.24642
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29074 0.29061
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.32898 3.32867
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.29936 0.30045
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68363 0.68370
Minkeyrink ST_st unsat ✅ 0.68258 0.68259
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 19.69850 19.69810
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 19.74010 19.73900
STP-Riss-st-2018_riss-no-stderr unsat ✅ 19.76630 19.76460
Yices2 Yices 2.6.0_default unsat ✅ 0.12287 0.12276
Z3 z3-4.7.1_default unsat ✅ 0.34132 0.34122
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.59126 0.59123
Poolector-wrapped-sq_default unsat ✅ 0.78235 2.78237
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.51959 0.51958
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.39436 3.39443
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.36282 1.36309
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.35618 1.35610
Par4 Par4-wrapped-sq_default unsat ✅ 0.13350 0.00622
STP STP-2019-wrapped-sq_default unsat ✅ 28.34130 28.33820
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 28.01450 28.01310
stp-minisat-wrapped-sq_default unsat ✅ 28.15130 28.13330
stp-mt-wrapped-sq_default unsat ✅ 28.12350 28.12190
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 28.15470 28.15300
stp-riss-wrapped-sq_default unsat ✅ 28.32930 28.32530
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12659 0.12655
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12750 0.12750
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12669 0.12668
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12521 0.12518
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12677 0.12675
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.29369 0.29344
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41953 0.41948
Boolector Boolector-wrapped-sq_default unsat ✅ 0.58182 0.58178
Poolector-wrapped-sq_default unsat ✅ 0.78334 2.57114
CVC4 CVC4-sq-final_default unsat ✅ 3.79191 3.79147
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 87.13170 87.12810
MathSAT MathSAT5_default.sh unsat ✅ 0.30287 0.30276
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 1.05726 1.05724
MinkeyRink Solver 2020.3_default unsat ✅ 1.11667 1.11676
STP STP_default unsat ✅ 10.72250 10.72200
STP ++ Mergsat v1_default unsat ✅ 11.12410 11.12560
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.14014 0.14003
Z3 z3-4.8.8_default unsat ✅ 0.20962 0.20955
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41814 0.41810
MathSAT mathsat-5.6.6_default unsat ✅ 36.71820 36.71760
STP STP 2021.0_default unsat ✅ 31.14080 31.13880
Z3 z3-4.8.11_default unsat ✅ 0.29299 0.29292
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.59656 0.59638
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.36726 6.59798
STP STP 2022.4_default unsat ✅ 0.18972 0.18973
STP 2022.4_default unsat ✅ 0.19072 0.19074
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1228.55000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13841 0.13830
Z3-Owl z3-Owl-Final_default unsat ✅ 1.01745 1.01378
z3-Owl-Final_default unsat ✅ 0.93875 0.93897
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.63431 0.53456
cvc5 cvc5 unsat ✅ 2.05695 1.95602
SMTInterpol SMTInterpol unknown ❌ 1202.72370 1978.49032
STP STP unsat ✅ 9.44707 9.34684
Yices2 Yices2 unsat ✅ 0.30213 0.20212
Z3alpha Z3-alpha unsat ✅ 0.48732 0.38792
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.72159 0.59357
Bitwuzla-MachBV-base unsat ✅ 0.67389 0.54707
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.76813 0.64582
BVDecide bv_decide unknown ❌ 1201.38120 1200.93915
bv_decide-nokernel unknown ❌ 1201.39794 1200.98098
cvc5 cvc5 unsat ✅ 1.05469 0.93847
SMTInterpol SMTInterpol unknown ❌ 1201.87549 2546.50548
Yices2 Yices2 unsat ✅ 0.35541 0.23244
Z3alpha Z3-alpha unsat ✅ 0.64495 0.55191
Z3 Z3-alpha-base unsat ✅ 0.41024 0.29202
Z3-Owl-base unsat ✅ 1.00887 0.87825
z3siri-base unsat ✅ 0.42482 0.29664
Z3-Owl Z3-Owl unsat ✅ 1.04260 0.91455