Benchmark

non-incremental/QF_BV/sage/app7/bench_780.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4490488
Compressed Size277952
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4490480
Compressed Size277961
Max. Term Depth17041
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2795 and1
=3609 let16933 extract1730 bvand46371
bvor30598 bvxor2344 bvadd49933 bvmul9
bvsub16378 bvsdiv28 bvult649 bvule658
bvslt221 bvsle126 bvshl16049 bvashr30291
zero_extend1533

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.71421 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.68299 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.68368 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.68148 —
abziz_portfolio_2012_solvers default unsat ✅ 0.67802 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.67529 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.96049 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.07932 —
Boolector-SMT-COMP-2012 default unsat ✅ 1.01490 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 409.90900 —
CVC3-SMT-COMP-2011 default unsat ✅ 343.23300 —
CVC3-SMT-COMP-2012 default unsat ✅ 358.36100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.99845 —
CVC4-SMT-EVAL-2013 default unsat ✅ 6.03680 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.33276 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.27071 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.66418 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.64231 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.17257 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.64175 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.30108 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.89115 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.75462 —
STP2-SMT-COMP-2012 default unsat ✅ 0.70849 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.77065 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.73970 —
Z3-SMT-COMP-2011 default unsat ✅ 0.67375 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.17299 1.17193
Boolector SMT17 final boolector unsat ✅ 1.17876 1.17880
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.82628 9.24811
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.86725 0.86696
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.76105 1.75896
Q3B Q3B default unsat ✅ 2.77652 3.14000
STP stp_st default unsat ✅ 0.89140 0.89063
stp_mt default unsat ✅ 0.82769 0.82717
Yices2 Yices2-Main default unsat ✅ 0.59090 0.28728
Z3 z3-4.5.0 default unsat ✅ 1.07933 1.35210
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.05029 1.05018
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.39327 5.39305
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83042 0.83132
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.72399 1.72386
Minkeyrink ST_st unsat ✅ 1.72159 1.72171
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.83541 0.83533
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.83640 0.83649
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.83982 0.83982
Yices2 Yices 2.6.0_default unsat ✅ 0.25962 0.25956
Z3 z3-4.7.1_default unsat ✅ 1.04891 1.04867
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.69908 1.69888
Boolector Boolector-wrapped-sq_default unsat ✅ 2.12403 2.12397
Poolector-wrapped-sq_default unsat ✅ 2.48879 9.26000
CVC4 CVC4-sq-final_default unsat ✅ 7.34288 7.34155
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.05756 1.05752
MathSAT MathSAT5_default.sh unsat ✅ 0.86375 0.86368
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.97043 0.97049
MinkeyRink Solver 2020.3_default unsat ✅ 1.00289 1.00298
STP STP_default unsat ✅ 0.79075 0.79072
STP ++ Mergsat v1_default unsat ✅ 0.78623 0.78785
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.31904 0.31895
Z3 z3-4.8.8_default unsat ✅ 0.74472 0.74459
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.60355 2.60315
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.32090 4.31893
STP STP 2022.4_default unsat ✅ 0.84574 0.84579
STP 2022.4_default unsat ✅ 0.85517 0.85520
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1341.91000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.30563 0.30553
Z3-Owl z3-Owl-Final_default unsat ✅ 1.44050 1.44034
z3-Owl-Final_default unsat ✅ 1.46869 1.46685
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.58696 1.48689
cvc5 cvc5 unsat ✅ 1.91775 1.81714
SMTInterpol SMTInterpol unknown ❌ 1202.72027 1438.51343
STP STP unsat ✅ 69.86615 69.76409
Yices2 Yices2 unsat ✅ 0.42141 0.32158
Z3alpha Z3-alpha unsat ✅ 0.62421 0.52450
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.21075 1.08042
Bitwuzla-MachBV-base unsat ✅ 1.49378 1.36929
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.65860 1.53414
BVDecide bv_decide unknown ❌ 1201.37544 1201.03071
bv_decide-nokernel unknown ❌ 1201.38657 1201.04220
cvc5 cvc5 unsat ✅ 1.69262 1.56107
SMTInterpol SMTInterpol unknown ❌ 1201.89031 1805.81516
Yices2 Yices2 unsat ✅ 0.44925 0.32129
Z3alpha Z3-alpha unsat ✅ 1.11125 1.13311
Z3 Z3-alpha-base unsat ✅ 0.57954 0.46303
Z3-Owl-base unsat ✅ 1.76605 1.63402
z3siri-base unsat ✅ 0.66690 0.52780
Z3-Owl Z3-Owl unsat ✅ 1.22797 1.09869