Benchmark

non-incremental/QF_BV/sage/app7/bench_4803.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3580534
Compressed Size231728
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3580526
Compressed Size231739
Max. Term Depth13787
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2488 and1
=3256 let13601 extract1705 bvand36364
bvor23894 bvxor2267 bvadd39530 bvmul7
bvsub13023 bvsdiv19 bvult602 bvule626
bvslt219 bvsle124 bvshl12717 bvashr23637
zero_extend1509

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.53173 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.59470 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.58077 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.57833 —
abziz_portfolio_2012_solvers default unsat ✅ 0.58378 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.60499 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.70854 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.85711 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.76561 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 174.91900 —
CVC3-SMT-COMP-2011 default unsat ✅ 148.00000 —
CVC3-SMT-COMP-2012 default unsat ✅ 154.73600 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.15328 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.83121 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.06871 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.03026 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.33094 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.30017 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.93739 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.75926 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.54610 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.46486 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.61603 —
STP2-SMT-COMP-2012 default unsat ✅ 0.53394 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.56529 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.62942 —
Z3-SMT-COMP-2011 default unsat ✅ 0.58073 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.03446 1.03321
Boolector SMT17 final boolector unsat ✅ 0.97720 0.97657
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.69837 7.56380
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.76302 0.76338
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.38691 1.38632
Q3B Q3B default unsat ✅ 0.93596 2.45108
STP stp_st default unsat ✅ 0.63750 0.63316
stp_mt default unsat ✅ 0.62424 0.62393
Yices2 Yices2-Main default unsat ✅ 0.39064 0.38979
Z3 z3-4.5.0 default unsat ✅ 0.57853 0.57069
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.84322 0.84302
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.37512 4.37518
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.68332 0.68435
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.37910 1.37901
Minkeyrink ST_st unsat ✅ 1.37496 1.37495
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.62383 0.62378
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.62468 0.62462
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.62311 0.62319
Yices2 Yices 2.6.0_default unsat ✅ 0.39117 0.39106
Z3 z3-4.7.1_default unsat ✅ 0.88573 0.88544
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.32526 1.32517
Boolector Boolector-wrapped-sq_default unsat ✅ 1.58587 1.58579
Poolector-wrapped-sq_default unsat ✅ 1.88088 7.05965
CVC4 CVC4-sq-final_default unsat ✅ 5.95224 5.95259
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.85945 0.85928
MathSAT MathSAT5_default.sh unsat ✅ 0.70713 0.70700
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.79245 0.79243
MinkeyRink Solver 2020.3_default unsat ✅ 0.81561 0.81570
STP STP_default unsat ✅ 0.58761 0.58770
STP ++ Mergsat v1_default unsat ✅ 0.58598 0.58770
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.40407 0.40402
Z3 z3-4.8.8_default unsat ✅ 0.65472 0.65459
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.32807 1.32793
MathSAT mathsat-5.6.6_default unsat ✅ 0.71579 0.71568
STP STP 2021.0_default unsat ✅ 0.61005 0.61008
Z3 z3-4.8.11_default unsat ✅ 0.68272 0.68261
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.06517 2.06490
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.36801 3.36786
STP STP 2022.4_default unsat ✅ 0.68655 0.68659
STP 2022.4_default unsat ✅ 0.68896 0.68899
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.07000 1315.56000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.39718 0.39710
Z3-Owl z3-Owl-Final_default unsat ✅ 1.09958 1.09952
z3-Owl-Final_default unsat ✅ 1.10640 1.10667
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.31276 1.21302
cvc5 cvc5 unsat ✅ 1.79705 1.69746
SMTInterpol SMTInterpol unknown ❌ 1202.72632 1427.57477
STP STP unsat ✅ 52.76407 52.63709
Yices2 Yices2 unsat ✅ 0.48371 0.38373
Z3alpha Z3-alpha unsat ✅ 0.59402 0.49410
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.00273 0.88562
Bitwuzla-MachBV-base unsat ✅ 1.30274 1.18261
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.38199 1.26224
BVDecide bv_decide unknown ❌ 1201.38821 1201.03535
bv_decide-nokernel unknown ❌ 1201.34955 1200.96867
cvc5 cvc5 unsat ✅ 1.33439 1.20442
SMTInterpol SMTInterpol unknown ❌ 1201.85473 1629.41406
Yices2 Yices2 unsat ✅ 0.52209 0.39096
Z3alpha Z3-alpha unsat ✅ 0.99547 0.97688
Z3 Z3-alpha-base unsat ✅ 0.56835 0.44067
Z3-Owl-base unsat ✅ 1.49503 1.36623
z3siri-base unsat ✅ 0.54517 0.41561
Z3-Owl Z3-Owl unsat ✅ 1.05700 0.93327