Benchmark

non-incremental/QF_BV/sage/app7/bench_8543.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4454939
Compressed Size277673
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4454931
Compressed Size277678
Max. Term Depth16927
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2761 and1
=3552 let16822 extract1718 bvand46016
bvor30351 bvxor2315 bvadd49538 bvmul9
bvsub16215 bvsdiv28 bvult641 bvule652
bvslt220 bvsle126 bvshl15895 bvashr30025
zero_extend1521

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.70842 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.70885 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.69947 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.70605 —
abziz_portfolio_2012_solvers default unsat ✅ 0.70380 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.69375 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.95083 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.06660 —
Boolector-SMT-COMP-2012 default unsat ✅ 1.00619 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 420.67600 —
CVC3-SMT-COMP-2011 default unsat ✅ 352.49900 —
CVC3-SMT-COMP-2012 default unsat ✅ 368.00300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.65333 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.60612 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.32088 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.26115 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.65488 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.60871 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.15561 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.58859 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.23932 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.88330 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74651 —
STP2-SMT-COMP-2012 default unsat ✅ 0.71257 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.77304 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.76389 —
Z3-SMT-COMP-2011 default unsat ✅ 0.71088 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.18661 1.18576
Boolector SMT17 final boolector unsat ✅ 1.27713 1.27574
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.92429 9.41924
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.94551 0.93101
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.68860 1.68786
Q3B Q3B default unsat ✅ 1.41158 2.96695
STP stp_st default unsat ✅ 0.87065 0.86412
stp_mt default unsat ✅ 0.88870 0.88774
Yices2 Yices2-Main default unsat ✅ 1.04251 0.48944
Z3 z3-4.5.0 default unsat ✅ 0.90570 0.90473
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.05457 1.05439
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.38143 5.38160
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83805 0.83887
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.70803 1.70791
Minkeyrink ST_st unsat ✅ 1.70857 1.70849
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.83198 0.83201
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.83184 0.83191
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.82923 0.82921
Yices2 Yices 2.6.0_default unsat ✅ 0.47802 0.47792
Z3 z3-4.7.1_default unsat ✅ 0.73817 0.73808
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.03566 2.03551
Poolector-wrapped-sq_default unsat ✅ 2.39696 9.07597
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.65568 1.65555
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.57643 5.57628
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.15489 1.15490
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.15519 1.15531
Par4 Par4-wrapped-sq_default unsat ✅ 0.48985 0.00581
STP STP-2019-wrapped-sq_default unsat ✅ 0.83637 0.83650
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.82762 0.82771
stp-minisat-wrapped-sq_default unsat ✅ 0.81993 0.81988
stp-mt-wrapped-sq_default unsat ✅ 0.83176 0.83183
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.81810 0.81825
stp-riss-wrapped-sq_default unsat ✅ 0.83227 0.83235
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.45278 0.45276
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.44663 0.44665
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.44731 0.44730
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.43921 0.43917
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.44520 0.44523
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.68744 0.68741
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.68216 1.68207
Boolector Boolector-wrapped-sq_default unsat ✅ 2.03115 2.03093
Poolector-wrapped-sq_default unsat ✅ 2.39791 8.93000
CVC4 CVC4-sq-final_default unsat ✅ 7.30578 7.30583
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.05050 1.05026
MathSAT MathSAT5_default.sh unsat ✅ 0.85596 0.85592
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.95334 0.95347
MinkeyRink Solver 2020.3_default unsat ✅ 0.98466 0.98472
STP STP_default unsat ✅ 0.78100 0.78117
STP ++ Mergsat v1_default unsat ✅ 0.77568 0.77731
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.50533 0.50527
Z3 z3-4.8.8_default unsat ✅ 0.49663 0.49657
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.67878 1.67876
MathSAT mathsat-5.6.6_default unsat ✅ 0.87549 0.87540
STP STP 2021.0_default unsat ✅ 0.86047 0.85737
Z3 z3-4.8.11_default unsat ✅ 0.85403 0.85398
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.66759 1.66747
Bitwuzla-wrapped_default unsat ✅ 1.86584 1.86562
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.77302 5.77289
MathSAT MathSAT-5.6.8_default unsat ✅ 0.89384 0.89373
STP STP 2022.4_default unsat ✅ 0.85288 0.85286
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.48889 0.48886
Z3++BV z3++bv_0702_default unsat ✅ 0.95835 0.95820
Z3 z3-4.8.17_default unsat ✅ 0.86521 0.86693
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.15473 1.03671
Bitwuzla-MachBV-base unsat ✅ 1.51754 1.39216
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.71129 1.59289
BVDecide bv_decide unknown ❌ 1201.38598 1200.92006
bv_decide-nokernel unknown ❌ 1201.37404 1200.99005
cvc5 cvc5 unsat ✅ 0.97786 0.85890
SMTInterpol SMTInterpol unknown ❌ 1201.85857 1685.26531
Yices2 Yices2 unsat ✅ 0.52737 0.41253
Z3alpha Z3-alpha unsat ✅ 1.14557 1.16061
Z3 Z3-alpha-base unsat ✅ 0.70361 0.58218
Z3-Owl-base unsat ✅ 1.98423 1.85789
z3siri-base unsat ✅ 0.69428 0.57664
Z3-Owl Z3-Owl unsat ✅ 1.24979 1.12743