Benchmark

non-incremental/QF_BV/sage/app1/bench_415.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size54276
Compressed Size6874
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 54268
Compressed Size6890
Max. Term Depth87
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite38 not65 and1
=159 let77 extract1 bvand24
bvor171 bvadd285 bvmul5 bvsub115
bvult146 bvule334 bvslt1 bvsle7
bvshl172 bvashr5 zero_extend266

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.89 (1/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 12.73660 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 1.43636 1.43578
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 3.27074 6.51001
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 2.09479 4.15437
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1.53195 1.53177
SMT-RAT SMT-RAT-final default sat ✅ 237.65900 237.76000
STP stp-cryptominisat4 default sat ✅ 5.45173 5.45317
stp-cmsat4-v15 default sat ✅ 9.87006 9.87150
stp-cmsat4-mt-v15 default unknown ❌ 0.39442 0.39294
stp-minisat-v15 default sat ✅ 2.31123 2.31065
Yices2 Yices default sat ✅ 0.03523 0.03399
Z3 z3 4.4.0 default sat ✅ 4.96267 4.96425
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.65570 0.65578
ABC_glucose glucose sat ✅ 7.37822 7.38256
Boolector Boolector boolector sat ✅ 1.59235 1.59327
Boolector preprop boolector sat ✅ 1.59298 1.59384
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 4.08398 8.15213
MapleSTP MapleSTP default sat ✅ 2.24771 2.24885
MapleSTP-mt default sat ✅ 2.23217 7.54873
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.53044 1.53266
MinkeyRink Minkeyrink 2016 default sat ✅ 2.08971 4.08861
Q3B Q3B default unknown ❌ 2400.02000 7203.98000
STP stp-cms-exp-2016 default sat ✅ 66.40400 66.44740
stp-cms-mt-2016 default sat ✅ 11.45430 44.47330
stp-cms-st-2016 default sat ✅ 14.70270 14.71110
stp-minisat-st-2016 default sat ✅ 23.92520 23.93900
Yices2 Yices-2.4.2 default sat ✅ 0.03271 0.03266
Z3 z3-4.4.1 default sat ✅ 5.82571 5.83043
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.31028 0.30755
Boolector SMT17 final boolector sat ✅ 5.92371 5.92292
CVC4 CVC4-smtcomp2017-main default sat ✅ 4.89481 9.62399
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.50926 1.50962
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.81392 0.78446
Q3B Q3B default unknown ❌ 600.09100 1193.91000
STP stp_st default sat ✅ 9.57454 9.56374
stp_mt default sat ✅ 8.19094 30.95700
Yices2 Yices2-Main default sat ✅ 0.03589 0.03588
Z3 z3-4.5.0 default sat ✅ 3.81541 3.81294
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.22254 0.22238
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.39209 3.39180
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.46034 1.46124
MinkeyRink Minkeyrink MT_mt sat ✅ 0.58186 1.52055
Minkeyrink ST_st sat ✅ 0.55783 0.55781
STP STP-CMS-st-2018_default-no-stderr sat ✅ 12.93680 12.93660
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 12.26180 47.44480
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.93667 4.93599
Yices2 Yices 2.6.0_default sat ✅ 0.04381 0.04376
Z3 z3-4.7.1_default sat ✅ 4.41074 4.41047
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.29932 0.29932
Poolector-wrapped-sq_default sat ✅ 0.48249 0.42291
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 1.49491 1.49487
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.48323 2.48346
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.65332 1.88005
MinkeyRink ST-wrapped-sq_default sat ✅ 0.73680 0.73672
Par4 Par4-wrapped-sq_default sat ✅ 0.04201 0.00592
STP STP-2019-wrapped-sq_default sat ✅ 3.48497 3.48546
stp-mergesat-fixed-wrapped-sq_default sat ✅ 10.81900 10.81770
stp-minisat-wrapped-sq_default sat ✅ 0.65609 0.65639
stp-mt-wrapped-sq_default sat ✅ 3.16714 11.18760
stp-portfolio-fixed-wrapped-sq_default sat ✅ 10.98230 14.70470
stp-riss-wrapped-sq_default unknown ❌ 0.44177 0.44194
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.03967 0.03965
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.55251 0.55246
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 1.29503 1.29500
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.16734 0.16735
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.12207 0.12203
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 2.04636 2.04607
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.40981 0.40959
Bitwuzla-wrapped_default sat ✅ 0.41423 0.41412
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 2.63499 2.63535
MathSAT MathSAT-5.6.8_default sat ✅ 0.29395 0.29386
STP STP 2022.4_default sat ✅ 0.31875 0.31552
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.69461 0.69454
Z3++BV z3++bv_0702_default sat ✅ 2.23193 2.23187
Z3 z3-4.8.17_default sat ✅ 2.76983 2.77055
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.47253 0.37260
cvc5 cvc5 sat ✅ 2.65583 2.55574
SMTInterpol SMTInterpol unknown ❌ 1201.72854 1236.18626
STP STP sat ✅ 0.45764 0.35781
Yices2 Yices2 sat ✅ 0.61159 0.50996
Z3alpha Z3-alpha sat ✅ 3.02217 2.92239
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.35964 0.24050
Bitwuzla-MachBV-base sat ✅ 0.41931 0.29961
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.53653 0.42139
BVDecide bv_decide sat ✅ 4.96239 4.79688
bv_decide-nokernel sat ✅ 4.54365 4.37411
cvc5 cvc5 sat ✅ 4.74105 4.61434
SMTInterpol SMTInterpol unknown ❌ 1201.54899 1226.26227
Yices2 Yices2 sat ✅ 0.76089 0.64025
Z3alpha Z3-alpha sat ✅ 4.27821 14.35312
Z3 Z3-alpha-base sat ✅ 3.86951 3.74139
Z3-Owl-base sat ✅ 15.92501 15.78939
z3siri-base sat ✅ 3.93570 3.80793
Z3-Owl Z3-Owl sat ✅ 7.04787 6.92175