Benchmark

non-incremental/QF_BV/sage/app7/bench_5869.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3493243
Compressed Size224749
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3493235
Compressed Size224753
Max. Term Depth13367
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2441 and1
=3174 let13262 extract1685 bvand35769
bvor23462 bvxor2213 bvadd38652 bvmul7
bvsub12508 bvsdiv19 bvult589 bvule625
bvslt219 bvsle124 bvshl12321 bvashr23092
zero_extend1489

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.51666 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54292 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54585 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54398 —
abziz_portfolio_2012_solvers default unsat ✅ 0.54807 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.53954 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.69269 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.84103 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.74303 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.02900 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.21700 —
CVC3-SMT-COMP-2012 default unsat ✅ 152.87700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.06464 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.68885 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.04043 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.99699 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.30148 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.26906 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.91323 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.28820 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.45385 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.41276 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.54974 —
STP2-SMT-COMP-2012 default unsat ✅ 0.52079 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.53329 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.59675 —
Z3-SMT-COMP-2011 default unsat ✅ 0.54863 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.99154 0.98352
Boolector SMT17 final boolector unsat ✅ 0.95413 0.95326
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.45555 7.13945
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.70860 0.70472
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.43361 1.40276
Q3B Q3B default unsat ✅ 1.44550 2.38000
STP stp_st default unsat ✅ 1.38762 0.68159
stp_mt default unsat ✅ 0.62472 0.62377
Yices2 Yices2-Main default unsat ✅ 0.33648 0.23608
Z3 z3-4.5.0 default unsat ✅ 0.56339 0.56334
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.82378 0.82368
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.18868 4.18672
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.67554 0.67641
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.34588 1.34581
Minkeyrink ST_st unsat ✅ 1.35099 1.34885
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.60918 0.60921
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.60956 0.60944
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.60961 0.60963
Yices2 Yices 2.6.0_default unsat ✅ 0.21467 0.21456
Z3 z3-4.7.1_default unsat ✅ 0.82784 0.82771
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.54750 1.54736
Poolector-wrapped-sq_default unsat ✅ 1.89577 6.96774
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.24651 1.24658
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.39079 4.38816
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.94920 0.94936
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.94522 0.94524
Par4 Par4-wrapped-sq_default unsat ✅ 0.22839 0.00594
STP STP-2019-wrapped-sq_default unsat ✅ 0.62276 0.62286
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.61433 0.61442
stp-minisat-wrapped-sq_default unsat ✅ 0.62112 0.62118
stp-mt-wrapped-sq_default unsat ✅ 0.62402 0.62416
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.61597 0.61593
stp-riss-wrapped-sq_default unsat ✅ 0.62094 0.62088
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.22378 0.22378
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.22150 0.22151
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.22149 0.22144
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.21930 0.21926
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.22129 0.22111
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.59184 0.59185
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.30608 1.30597
Boolector Boolector-wrapped-sq_default unsat ✅ 1.56186 1.56163
Poolector-wrapped-sq_default unsat ✅ 1.88314 6.97118
CVC4 CVC4-sq-final_default unsat ✅ 5.74322 5.74241
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.84604 0.84599
MathSAT MathSAT5_default.sh unsat ✅ 0.68951 0.68940
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.78060 0.78072
MinkeyRink Solver 2020.3_default unsat ✅ 0.80992 0.80995
STP STP_default unsat ✅ 0.57383 0.57371
STP ++ Mergsat v1_default unsat ✅ 0.57170 0.57342
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.25842 0.25838
Z3 z3-4.8.8_default unsat ✅ 0.40689 0.40684
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.29823 1.29824
MathSAT mathsat-5.6.6_default unsat ✅ 0.69679 0.69665
STP STP 2021.0_default unsat ✅ 0.59424 0.59431
Z3 z3-4.8.11_default unsat ✅ 0.58920 0.58916
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.19975 1.09997
cvc5 cvc5 unsat ✅ 0.83282 0.73336
SMTInterpol SMTInterpol unknown ❌ 1202.75300 1401.72114
STP STP unsat ✅ 42.63344 42.53275
Yices2 Yices2 unsat ✅ 0.38096 0.28100
Z3alpha Z3-alpha unsat ✅ 0.60754 0.50752
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.02638 0.90371
Bitwuzla-MachBV-base unsat ✅ 1.24427 1.11889
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.44591 1.31953
BVDecide bv_decide unknown ❌ 1201.39684 1201.00834
bv_decide-nokernel unknown ❌ 1201.35474 1201.01541
cvc5 cvc5 unsat ✅ 1.30337 1.18449
SMTInterpol SMTInterpol unknown ❌ 1201.88454 1539.19978
Yices2 Yices2 unsat ✅ 0.41677 0.29081
Z3alpha Z3-alpha unsat ✅ 0.98786 0.97700
Z3 Z3-alpha-base unsat ✅ 0.64108 0.51447
Z3-Owl-base unsat ✅ 2.03850 1.90851
z3siri-base unsat ✅ 0.62817 0.50788
Z3-Owl Z3-Owl unsat ✅ 1.27718 1.14404