Benchmark

non-incremental/QF_BV/sage/app7/bench_433.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3257435
Compressed Size205131
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3257427
Compressed Size205137
Max. Term Depth12461
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2003 and1
=2672 let12356 extract1433 bvand33892
bvor22365 bvxor1746 bvadd35968 bvmul2
bvsub11690 bvsdiv3 bvult480 bvule515
bvslt211 bvsle121 bvshl11490 bvashr21795
zero_extend1155

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.48295 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.49129 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.48917 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.48612 —
abziz_portfolio_2012_solvers default unsat ✅ 0.49117 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.49055 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66080 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.78995 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70070 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 172.85100 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.13400 —
CVC3-SMT-COMP-2012 default unsat ✅ 152.87200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.79952 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.49694 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.98350 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.96432 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.20938 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.18408 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.84527 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.87139 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.09245 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.32326 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51312 —
STP2-SMT-COMP-2012 default unsat ✅ 0.48953 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.50881 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.51644 —
Z3-SMT-COMP-2011 default unsat ✅ 0.48229 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.86233 0.86146
Boolector SMT17 final boolector unsat ✅ 0.86635 0.86456
CVC4 CVC4-smtcomp2017-main default unsat ✅ 11.63860 7.29789
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63271 0.63251
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.28752 1.28138
Q3B Q3B default unsat ✅ 0.83922 2.15000
STP stp_st default unsat ✅ 0.84049 0.64492
stp_mt default unsat ✅ 1.24243 0.66479
Yices2 Yices2-Main default unsat ✅ 0.17762 0.17652
Z3 z3-4.5.0 default unsat ✅ 0.74840 0.73893
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.77988 0.77981
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.42091 4.42117
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.62945 0.63021
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.24363 1.24368
Minkeyrink ST_st unsat ✅ 1.25293 1.25292
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.56737 0.56734
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.56798 0.56800
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.56548 0.56527
Yices2 Yices 2.6.0_default unsat ✅ 0.17024 0.17003
Z3 z3-4.7.1_default unsat ✅ 0.55042 0.55032
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.52947 1.52944
Poolector-wrapped-sq_default unsat ✅ 1.79413 6.68000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.24237 1.24232
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.02363 4.02380
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.87109 0.87118
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.86407 0.86416
Par4 Par4-wrapped-sq_default unsat ✅ 0.18285 0.00606
STP STP-2019-wrapped-sq_default unsat ✅ 0.57200 0.57208
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.57053 0.57064
stp-minisat-wrapped-sq_default unsat ✅ 0.57255 0.57272
stp-mt-wrapped-sq_default unsat ✅ 0.56940 0.56942
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.57293 0.57311
stp-riss-wrapped-sq_default unsat ✅ 0.57187 0.57198
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.17756 0.17755
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.17711 0.17710
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.17705 0.17708
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.17503 0.17505
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.17719 0.17715
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.71977 0.71973
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21584 1.21578
Boolector Boolector-wrapped-sq_default unsat ✅ 1.51397 1.51396
Poolector-wrapped-sq_default unsat ✅ 1.78195 6.41486
CVC4 CVC4-sq-final_default unsat ✅ 5.28353 5.28363
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.77909 0.77902
MathSAT MathSAT5_default.sh unsat ✅ 0.64217 0.64202
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.72163 0.72149
MinkeyRink Solver 2020.3_default unsat ✅ 0.74516 0.74525
STP STP_default unsat ✅ 0.53670 0.53672
STP ++ Mergsat v1_default unsat ✅ 0.52977 0.53139
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.21214 0.21211
Z3 z3-4.8.8_default unsat ✅ 0.48942 0.48933
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.86291 1.86257
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.97039 2.96527
STP STP 2022.4_default unsat ✅ 0.59222 0.59217
STP 2022.4_default unsat ✅ 0.59146 0.59149
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 818.39700 938.68900
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.20693 0.20690
Z3-Owl z3-Owl-Final_default unsat ✅ 1.11946 1.11948
z3-Owl-Final_default unsat ✅ 1.16351 1.16372
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.20528 1.10549
cvc5 cvc5 unsat ✅ 1.05262 0.95238
SMTInterpol SMTInterpol unknown ❌ 1202.74991 1414.89053
STP STP unsat ✅ 30.27995 30.16742
Yices2 Yices2 unsat ✅ 0.34881 0.24920
Z3alpha Z3-alpha unsat ✅ 0.58890 0.48927
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.13941 1.00769
Bitwuzla-MachBV-base unsat ✅ 1.18568 1.05827
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.37027 1.23369
BVDecide bv_decide unknown ❌ 1201.39308 1200.98675
bv_decide-nokernel unknown ❌ 1201.40330 1201.04758
cvc5 cvc5 unsat ✅ 1.33646 1.21427
SMTInterpol SMTInterpol unknown ❌ 1201.85217 2172.62300
Yices2 Yices2 unsat ✅ 0.38866 0.26480
Z3alpha Z3-alpha unsat ✅ 0.96020 0.92779
Z3 Z3-alpha-base unsat ✅ 0.49422 0.37628
Z3-Owl-base unsat ✅ 1.19634 1.07967
z3siri-base unsat ✅ 0.49601 0.37792
Z3-Owl Z3-Owl unsat ✅ 1.00997 0.88505