Benchmark

non-incremental/QF_BV/sage/app7/bench_1793.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1208567
Compressed Size94612
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1208559
Compressed Size94618
Max. Term Depth4634
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1503 and1
=2035 let4577 extract1189 bvand11309
bvor7295 bvxor1349 bvadd12780 bvmul1
bvsub4110 bvult425 bvule447 bvslt190
bvsle96 bvshl3956 bvashr6974 zero_extend904

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.17201 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.18531 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.18902 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.18781 —
abziz_portfolio_2012_solvers default unsat ✅ 0.18751 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.18899 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.23856 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.27660 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.25087 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 9.88598 —
CVC3-SMT-COMP-2011 default unsat ✅ 8.45824 —
CVC3-SMT-COMP-2012 default unsat ✅ 8.78033 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.02988 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.74318 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.36608 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.34184 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.46219 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.44294 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.32644 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.79245 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.15912 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.47640 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.17979 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17102 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.17266 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.19874 —
Z3-SMT-COMP-2011 default unsat ✅ 0.18690 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.32791 0.32695
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.65457 2.71459
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.65443 2.71858
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.25992 0.25896
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.96000
STP stp-cryptominisat4 default unsat ✅ 0.16270 0.16197
stp-cmsat4-v15 default unsat ✅ 0.16293 0.16197
stp-cmsat4-mt-v15 default unsat ✅ 0.16320 0.16197
stp-minisat-v15 default unsat ✅ 0.16173 0.16098
Yices2 Yices default unsat ✅ 0.07609 0.07499
Z3 z3 4.4.0 default unsat ✅ 0.25187 0.25196
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.69766 0.69832
ABC_glucose glucose unsat ✅ 0.68509 0.68531
Boolector Boolector boolector unsat ✅ 0.40164 0.39722
Boolector preprop boolector unsat ✅ 0.38956 0.38996
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.62676 2.67393
MapleSTP MapleSTP default unsat ✅ 0.15431 0.15434
MapleSTP-mt default unsat ✅ 0.15502 0.15509
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.22999 0.23112
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.20955 0.20978
Q3B Q3B default unsat ✅ 0.41723 0.98245
STP stp-cms-exp-2016 default unsat ✅ 0.15855 0.15857
stp-cms-mt-2016 default unsat ✅ 0.16180 0.16188
stp-cms-st-2016 default unsat ✅ 0.16121 0.16135
stp-minisat-st-2016 default unsat ✅ 0.16083 0.16092
Yices2 Yices-2.4.2 default unsat ✅ 0.07547 0.07549
Z3 z3-4.4.1 default unsat ✅ 0.25253 0.25269
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.30373 0.30388
Boolector SMT17 final boolector unsat ✅ 0.31036 0.31013
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.62699 2.63702
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.23617 0.23608
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.46121 0.46015
Q3B Q3B default unsat ✅ 0.40485 0.93854
STP stp_st default unsat ✅ 0.19648 0.19581
stp_mt default unsat ✅ 0.21161 0.21112
Yices2 Yices2-Main default unsat ✅ 0.07263 0.07177
Z3 z3-4.5.0 default unsat ✅ 0.19571 0.19484
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.27048 0.27039
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.47170 1.47158
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.22606 0.22695
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.46504 0.46507
Minkeyrink ST_st unsat ✅ 0.46819 0.46825
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.19937 0.19944
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.19947 0.19947
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.20087 0.20076
Yices2 Yices 2.6.0_default unsat ✅ 0.07044 0.07037
Z3 z3-4.7.1_default unsat ✅ 0.29393 0.29377
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.50158 0.50161
Poolector-wrapped-sq_default unsat ✅ 0.68309 2.32539
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.41341 0.41343
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.51036 1.50927
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.36725 0.36740
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.36368 0.36369
Par4 Par4-wrapped-sq_default unsat ✅ 0.07939 0.00590
STP STP-2019-wrapped-sq_default unsat ✅ 0.20778 0.20778
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.20477 0.20489
stp-minisat-wrapped-sq_default unsat ✅ 0.20675 0.20687
stp-mt-wrapped-sq_default unsat ✅ 0.20808 0.20807
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.20586 0.20595
stp-riss-wrapped-sq_default unsat ✅ 0.20784 0.20801
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.07339 0.07339
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.07449 0.07448
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.07365 0.07364
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.07210 0.07211
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.07326 0.07326
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.25087 0.25086
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40348 0.40342
MathSAT mathsat-5.6.6_default unsat ✅ 0.24525 0.24520
STP STP 2021.0_default unsat ✅ 0.19595 0.19604
Z3 z3-4.8.11_default unsat ✅ 0.20150 0.20143
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.49861 0.37218
Bitwuzla-MachBV-base unsat ✅ 0.54912 0.42189
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.66041 0.53367
BVDecide bv_decide unsat ✅ 216.76235 216.58183
bv_decide-nokernel unsat ✅ 189.36345 189.19005
cvc5 cvc5 unsat ✅ 0.59598 0.47512
SMTInterpol SMTInterpol unknown ❌ 1201.85306 3310.93194
Yices2 Yices2 unsat ✅ 0.32830 0.20264
Z3alpha Z3-alpha unsat ✅ 0.61697 0.53710
Z3 Z3-alpha-base unsat ✅ 0.43810 0.30099
Z3-Owl-base unsat ✅ 0.92330 0.80111
z3siri-base unsat ✅ 0.39922 0.27747
Z3-Owl Z3-Owl unsat ✅ 0.93711 0.81091