Benchmark

non-incremental/QF_BV/sage/app7/bench_1889.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1080444
Compressed Size87493
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1080436
Compressed Size87496
Max. Term Depth4153
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1464 and1
=1983 let4096 extract1171 bvand9894
bvor6359 bvxor1320 bvadd11324 bvmul1
bvsub3640 bvult421 bvule432 bvslt186
bvsle96 bvshl3490 bvashr6053 zero_extend889

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.15385 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.17017 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.16957 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.16919 —
abziz_portfolio_2012_solvers default unsat ✅ 0.16930 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.17298 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.20975 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.24556 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.22113 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 9.70242 —
CVC3-SMT-COMP-2011 default unsat ✅ 8.30396 —
CVC3-SMT-COMP-2012 default unsat ✅ 8.61439 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.95212 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.58519 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.33103 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.30806 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.41315 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.40110 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.29639 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.67877 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.91282 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.42816 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.16084 —
STP2-SMT-COMP-2012 default unsat ✅ 0.15864 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.16071 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.18940 —
Z3-SMT-COMP-2011 default unsat ✅ 0.16545 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.27786 0.27696
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.46365 2.39364
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.46182 2.39464
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.23414 0.23296
SMT-RAT SMT-RAT-final default unknown ❌ 2400.04000 2400.99000
STP stp-cryptominisat4 default unsat ✅ 0.14229 0.14098
stp-cmsat4-v15 default unsat ✅ 0.14098 0.13998
stp-cmsat4-mt-v15 default unsat ✅ 0.14223 0.14098
stp-minisat-v15 default unsat ✅ 0.14294 0.14198
Yices2 Yices default unsat ✅ 0.06840 0.06699
Z3 z3 4.4.0 default unsat ✅ 0.23424 0.23396
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.62033 0.62043
ABC_glucose glucose unsat ✅ 0.61187 0.61169
Boolector Boolector boolector unsat ✅ 0.32572 0.32581
Boolector preprop boolector unsat ✅ 0.31458 0.31495
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.42354 2.33203
MapleSTP MapleSTP default unsat ✅ 0.13270 0.13275
MapleSTP-mt default unsat ✅ 0.13336 0.13341
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.21056 0.21160
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.18369 0.18376
Q3B Q3B default unsat ✅ 0.39011 0.90582
STP stp-cms-exp-2016 default unsat ✅ 0.13794 0.13799
stp-cms-mt-2016 default unsat ✅ 0.13899 0.13905
stp-cms-st-2016 default unsat ✅ 0.13843 0.13860
stp-minisat-st-2016 default unsat ✅ 0.13873 0.13894
Yices2 Yices-2.4.2 default unsat ✅ 0.06817 0.06814
Z3 z3-4.4.1 default unsat ✅ 0.19101 0.19297
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.25999 0.25518
Boolector SMT17 final boolector unsat ✅ 0.28749 0.28678
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.47556 2.38748
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.21492 0.21537
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.41141 0.41079
Q3B Q3B default unsat ✅ 0.41034 0.94277
STP stp_st default unsat ✅ 0.18555 0.18429
stp_mt default unsat ✅ 0.17351 0.17273
Yices2 Yices2-Main default unsat ✅ 0.06833 0.06739
Z3 z3-4.5.0 default unsat ✅ 0.24318 0.24244
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.22923 0.22900
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.29801 1.29820
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.20825 0.20931
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.41536 0.41537
Minkeyrink ST_st unsat ✅ 0.41456 0.41434
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.17187 0.17195
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.17168 0.17174
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.17156 0.17160
Yices2 Yices 2.6.0_default unsat ✅ 0.06437 0.06427
Z3 z3-4.7.1_default unsat ✅ 0.22503 0.22466
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.43377 0.43378
Poolector-wrapped-sq_default unsat ✅ 0.58951 2.01924
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.35625 0.35621
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.31654 1.31686
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.32992 0.33006
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.33051 0.33057
Par4 Par4-wrapped-sq_default unsat ✅ 0.08459 0.00599
STP STP-2019-wrapped-sq_default unsat ✅ 0.18432 0.18444
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.18394 0.18411
stp-minisat-wrapped-sq_default unsat ✅ 0.18475 0.18492
stp-mt-wrapped-sq_default unsat ✅ 0.18461 0.18475
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.18354 0.18368
stp-riss-wrapped-sq_default unsat ✅ 0.18033 0.18041
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.06742 0.06741
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.06673 0.06672
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.06703 0.06704
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.06610 0.06611
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.06717 0.06716
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.20870 0.20865
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.34610 0.34605
MathSAT mathsat-5.6.6_default unsat ✅ 0.22233 0.22229
STP STP 2021.0_default unsat ✅ 0.17561 0.17572
Z3 z3-4.8.11_default unsat ✅ 0.18646 0.18640
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.55354 0.55355
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.18955 1.18167
STP STP 2022.4_default unsat ✅ 0.18475 0.18477
STP 2022.4_default unsat ✅ 0.19246 0.19247
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 334.61300 387.51300
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.07529 0.07526
Z3-Owl z3-Owl-Final_default unsat ✅ 0.87487 0.87466
z3-Owl-Final_default unsat ✅ 0.92770 0.92775
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.64370 0.51686
Bitwuzla-MachBV-base unsat ✅ 0.53055 0.40667
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.60714 0.48516
BVDecide bv_decide unsat ✅ 168.07498 167.94212
bv_decide-nokernel unsat ✅ 142.66643 142.52188
cvc5 cvc5 unsat ✅ 0.55943 0.43046
SMTInterpol SMTInterpol unknown ❌ 1201.90671 3403.55918
Yices2 Yices2 unsat ✅ 0.31640 0.19257
Z3alpha Z3-alpha unsat ✅ 0.53073 0.42900
Z3 Z3-alpha-base unsat ✅ 0.37826 0.25991
Z3-Owl-base unsat ✅ 0.85086 0.72619
z3siri-base unsat ✅ 0.38948 0.27090
Z3-Owl Z3-Owl unsat ✅ 0.91449 0.78515