Benchmark

non-incremental/QF_BV/sage/app1/bench_2578.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size86508
Compressed Size12299
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 86500
Compressed Size12322
Max. Term Depth222
Asserts 1
Declared Functions0
Declared Constants320
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite94 not78 and1
=218 let212 extract1 bvand50
bvor192 bvadd414 bvmul5 bvsub301
bvult298 bvule651 bvslt2 bvsle72
bvshl193 bvashr5 zero_extend350

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 1.52891 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.05115 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.05081 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.05152 —
abziz_portfolio_2012_solvers default unsat ✅ 0.05027 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.06494 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.16705 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.14546 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.15862 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 3.50342 —
CVC3-SMT-COMP-2011 default unsat ✅ 3.01070 —
CVC3-SMT-COMP-2012 default unsat ✅ 3.10977 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.69489 —
CVC4-SMT-EVAL-2013 default unsat ✅ 11.27650 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.53078 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.10881 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.49950 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.50228 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.27712 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.31152 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.06056 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.27095 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.04167 —
STP2-SMT-COMP-2012 default unsat ✅ 0.31400 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.10379 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03926 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04621 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02981 0.02899
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.26715 2.47162
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.25541 2.45263
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.11654 1.11583
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.20000
STP stp-cryptominisat4 default unsat ✅ 0.21977 0.21897
stp-cmsat4-v15 default unsat ✅ 0.22002 0.21897
stp-cmsat4-mt-v15 default unsat ✅ 0.22129 0.21996
stp-minisat-v15 default unsat ✅ 0.21776 0.21697
Yices2 Yices default unsat ✅ 0.05089 0.04999
Z3 z3 4.4.0 default unsat ✅ 0.36989 0.36994
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.05747 1.05774
ABC_glucose glucose unsat ✅ 14.28470 14.29280
Boolector Boolector boolector unsat ✅ 0.03578 0.03565
Boolector preprop boolector unsat ✅ 0.03464 0.03481
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.20231 2.34931
MapleSTP MapleSTP default unsat ✅ 0.40787 0.40808
MapleSTP-mt default unsat ✅ 0.40884 0.40934
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.00950 1.01098
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.26148 0.26082
Q3B Q3B default unsat ✅ 0.69202 1.80880
STP stp-cms-exp-2016 default unsat ✅ 0.40411 0.40431
stp-cms-mt-2016 default unsat ✅ 0.40362 0.40381
stp-cms-st-2016 default unsat ✅ 0.40354 0.40370
stp-minisat-st-2016 default unsat ✅ 0.40425 0.40463
Yices2 Yices-2.4.2 default unsat ✅ 0.05285 0.05281
Z3 z3-4.4.1 default unsat ✅ 0.41891 0.42015
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.03745 0.03603
Boolector SMT17 final boolector unsat ✅ 0.03578 0.03487
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.24513 2.42960
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.93294 0.93212
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04558 0.04423
Q3B Q3B default unsat ✅ 0.74544 1.94059
STP stp_st default unsat ✅ 0.62987 0.62937
stp_mt default unsat ✅ 0.63019 0.62916
Yices2 Yices2-Main default unsat ✅ 0.05005 0.04901
Z3 z3-4.5.0 default unsat ✅ 0.36584 0.36398
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29110 0.29100
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.39234 2.39226
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.92166 0.92205
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.05023 0.05026
Minkeyrink ST_st unsat ✅ 0.04822 0.04828
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.92097 0.92095
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.91976 0.91980
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.92522 0.92534
Yices2 Yices 2.6.0_default unsat ✅ 0.04821 0.04809
Z3 z3-4.7.1_default unsat ✅ 0.38943 0.38929
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.05879 0.05879
Poolector-wrapped-sq_default unsat ✅ 0.17624 0.32592
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.04831 0.04833
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.31011 1.31029
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05520 0.05534
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.05323 0.05332
Par4 Par4-wrapped-sq_default unsat ✅ 0.05330 0.00611
STP STP-2019-wrapped-sq_default unsat ✅ 1.20489 1.20511
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 1.19803 1.19818
stp-minisat-wrapped-sq_default unsat ✅ 1.20178 1.20173
stp-mt-wrapped-sq_default unsat ✅ 1.20576 1.20578
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 1.20030 1.20028
stp-riss-wrapped-sq_default unsat ✅ 1.20437 1.20445
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05386 0.05387
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05432 0.05430
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05397 0.05394
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.11366 0.11368
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05428 0.05423
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.35946 0.35926
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04963 0.04955
Boolector Boolector-wrapped-sq_default unsat ✅ 0.06047 0.06050
Poolector-wrapped-sq_default unsat ✅ 0.17783 0.33407
CVC4 CVC4-sq-final_default unsat ✅ 1.28556 1.28596
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 205.63100 205.60200
MathSAT MathSAT5_default.sh unsat ✅ 0.62313 0.62305
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.04711 0.04717
MinkeyRink Solver 2020.3_default unsat ✅ 0.04905 0.04918
STP STP_default unsat ✅ 2.46429 2.46441
STP ++ Mergsat v1_default unsat ✅ 2.55438 2.55602
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.05531 0.05522
Z3 z3-4.8.8_default unsat ✅ 0.42106 0.42102
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.05699 0.05698
Bitwuzla-wrapped_default unsat ✅ 0.06065 0.06060
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.14146 1.14200
MathSAT MathSAT-5.6.8_default unsat ✅ 0.74296 0.74289
STP STP 2022.4_default unsat ✅ 0.04248 0.04246
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.05650 0.05647
Z3++BV z3++bv_0702_default unsat ✅ 0.58299 0.58290
Z3 z3-4.8.17_default unsat ✅ 0.89136 0.89322
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.25051 0.15086
cvc5 cvc5 unsat ✅ 1.10484 1.00514
SMTInterpol SMTInterpol unknown ❌ 1201.72159 1237.52164
STP STP unsat ✅ 0.28859 0.18844
Yices2 Yices2 unsat ✅ 0.25066 0.15079
Z3alpha Z3-alpha unsat ✅ 0.31503 0.21505
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.29045 0.17403
Bitwuzla-MachBV-base unsat ✅ 0.30095 0.17931
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.36908 0.24790
BVDecide bv_decide unsat ✅ 19.27495 19.10791
bv_decide-nokernel unsat ✅ 10.48564 10.32657
cvc5 cvc5 unsat ✅ 1.04881 0.91959
SMTInterpol SMTInterpol unknown ❌ 1201.57800 1227.58060
Yices2 Yices2 unsat ✅ 0.30173 0.18141
Z3alpha Z3-alpha unsat ✅ 0.45074 0.43080
Z3 Z3-alpha-base unsat ✅ 0.31537 0.19492
Z3-Owl-base unsat ✅ 0.39207 0.25353
z3siri-base unsat ✅ 0.28188 0.15881
Z3-Owl Z3-Owl unsat ✅ 0.84420 0.70876