Benchmark

non-incremental/QF_BV/sage/app7/bench_312.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3301354
Compressed Size208916
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3301346
Compressed Size208904
Max. Term Depth12638
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2078 and1
=2762 let12533 extract1547 bvand34049
bvor22396 bvxor1957 bvadd36452 bvmul2
bvsub11902 bvsdiv5 bvult487 bvule526
bvslt212 bvsle121 bvshl11677 bvashr21926
zero_extend1310

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49454 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54685 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.53672 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54392 —
abziz_portfolio_2012_solvers default unsat ✅ 0.53538 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.53713 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.65630 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79263 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.69676 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.00900 —
CVC3-SMT-COMP-2011 default unsat ✅ 147.19800 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.86400 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.83578 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.48175 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.98946 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.94544 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.22868 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20372 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87261 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.94151 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.13725 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34640 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.51610 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49387 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52502 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.57367 —
Z3-SMT-COMP-2011 default unsat ✅ 0.53484 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.86811 0.86764
Boolector SMT17 final boolector unsat ✅ 0.87432 0.87365
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.18121 6.70288
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.64610 0.64495
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.24075 1.23999
Q3B Q3B default unsat ✅ 0.83523 2.00000
STP stp_st default unsat ✅ 0.56276 0.56217
stp_mt default unsat ✅ 0.56592 0.56529
Yices2 Yices2-Main default unsat ✅ 0.36929 0.36738
Z3 z3-4.5.0 default unsat ✅ 0.70143 0.70056
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78140 0.78129
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.90003 3.90022
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63577 0.63666
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26499 1.26504
Minkeyrink ST_st unsat ✅ 1.28949 1.28952
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57436 0.57436
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57108 0.57118
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57878 0.57710
Yices2 Yices 2.6.0_default unsat ✅ 0.36742 0.36739
Z3 z3-4.7.1_default unsat ✅ 0.58574 0.58586
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.47917 1.47905
Poolector-wrapped-sq_default unsat ✅ 1.79311 6.68911
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.20039 1.20018
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.11726 4.11724
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.88672 0.88685
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.87703 0.87702
Par4 Par4-wrapped-sq_default unsat ✅ 0.39456 0.00606
STP STP-2019-wrapped-sq_default unsat ✅ 0.58808 0.58532
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.57878 0.57887
stp-minisat-wrapped-sq_default unsat ✅ 0.58930 0.58943
stp-mt-wrapped-sq_default unsat ✅ 0.59063 0.58767
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.58231 0.58205
stp-riss-wrapped-sq_default unsat ✅ 0.58581 0.58577
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.33968 0.33969
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.33910 0.33907
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.34594 0.34590
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.33470 0.33464
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.34069 0.34065
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.54313 0.54310
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24402 1.24397
Boolector Boolector-wrapped-sq_default unsat ✅ 1.49595 1.49581
Poolector-wrapped-sq_default unsat ✅ 1.78119 6.56924
CVC4 CVC4-sq-final_default unsat ✅ 5.34566 5.34566
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.79454 0.79426
MathSAT MathSAT5_default.sh unsat ✅ 0.65215 0.65200
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.73641 0.73656
MinkeyRink Solver 2020.3_default unsat ✅ 0.76123 0.76123
STP STP_default unsat ✅ 0.54429 0.54444
STP ++ Mergsat v1_default unsat ✅ 0.53820 0.53972
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.37659 0.37650
Z3 z3-4.8.8_default unsat ✅ 0.61169 0.61145
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.21872 1.21859
Bitwuzla-wrapped_default unsat ✅ 1.31086 1.31068
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.11870 4.11902
MathSAT MathSAT-5.6.8_default unsat ✅ 0.66589 0.66582
STP STP 2022.4_default unsat ✅ 0.61755 0.61757
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.36907 0.36900
Z3++BV z3++bv_0702_default unsat ✅ 0.73637 0.73588
Z3 z3-4.8.17_default unsat ✅ 0.65105 0.65287
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.88875 1.88856
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.02431 3.02457
STP STP 2022.4_default unsat ✅ 0.59946 0.59951
STP 2022.4_default unsat ✅ 0.60369 0.60369
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 1128.34000 1247.35000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.36683 0.36677
Z3-Owl z3-Owl-Final_default unsat ✅ 1.30473 1.30466
z3-Owl-Final_default unsat ✅ 1.32352 1.32266
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.94700 0.82263
Bitwuzla-MachBV-base unsat ✅ 1.19965 1.06823
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.36775 1.24012
BVDecide bv_decide unknown ❌ 1201.38086 1200.92453
bv_decide-nokernel unknown ❌ 1201.39414 1201.03565
cvc5 cvc5 unsat ✅ 0.84624 0.72982
SMTInterpol SMTInterpol unknown ❌ 1201.88946 1859.53490
Yices2 Yices2 unsat ✅ 0.49134 0.37069
Z3alpha Z3-alpha unsat ✅ 0.94638 0.94000
Z3 Z3-alpha-base unsat ✅ 0.51371 0.39304
Z3-Owl-base unsat ✅ 1.35985 1.24325
z3siri-base unsat ✅ 0.55683 0.43424
Z3-Owl Z3-Owl unsat ✅ 1.07073 0.94143