Benchmark

non-incremental/QF_BV/sage/app7/bench_694.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3107140
Compressed Size193683
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3107132
Compressed Size193688
Max. Term Depth11908
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1879 and1
=2516 let11803 extract1371 bvand32417
bvor21375 bvxor1648 bvadd34315 bvmul1
bvsub11132 bvult453 bvule505 bvslt210
bvsle111 bvshl10951 bvashr20809 zero_extend1092

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.46501 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.51112 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.51097 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.50388 —
abziz_portfolio_2012_solvers default unsat ✅ 0.50887 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.50977 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.62221 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.75189 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.65752 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 152.15900 —
CVC3-SMT-COMP-2011 default unsat ✅ 128.58600 —
CVC3-SMT-COMP-2012 default unsat ✅ 134.43700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.70691 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.12409 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.92783 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.89673 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.16066 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.13494 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.81320 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.71628 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.82547 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.26752 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.49329 —
STP2-SMT-COMP-2012 default unsat ✅ 0.46105 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.49244 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.54664 —
Z3-SMT-COMP-2011 default unsat ✅ 0.50897 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.90571 0.90486
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.07490 6.60400
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.04778 6.57800
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.65445 0.65390
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.64000
STP stp-cryptominisat4 default unsat ✅ 0.43686 0.43593
stp-cmsat4-v15 default unsat ✅ 0.43476 0.43393
stp-cmsat4-mt-v15 default unsat ✅ 0.43458 0.43393
stp-minisat-v15 default unsat ✅ 0.43458 0.43393
Yices2 Yices default unsat ✅ 0.17902 0.17797
Z3 z3 4.4.0 default unsat ✅ 0.54503 0.54492
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.77223 1.77281
ABC_glucose glucose unsat ✅ 1.75590 1.75734
Boolector Boolector boolector unsat ✅ 1.02847 1.02920
Boolector preprop boolector unsat ✅ 1.00139 1.00220
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.04060 6.56262
MapleSTP MapleSTP default unsat ✅ 0.42419 0.42410
MapleSTP-mt default unsat ✅ 0.42201 0.42243
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.58828 0.58952
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.58640 0.58662
Q3B Q3B default unsat ✅ 0.79904 1.85000
STP stp-cms-exp-2016 default unsat ✅ 0.43033 0.43060
stp-cms-mt-2016 default unsat ✅ 0.43743 0.43761
stp-cms-st-2016 default unsat ✅ 0.43699 0.43715
stp-minisat-st-2016 default unsat ✅ 0.43856 0.43878
Yices2 Yices-2.4.2 default unsat ✅ 0.17629 0.17637
Z3 z3-4.4.1 default unsat ✅ 0.47892 0.48045
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.83674 0.83559
Boolector SMT17 final boolector unsat ✅ 0.84625 0.84501
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.35489 6.95966
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.63848 0.63771
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.22739 1.22672
Q3B Q3B default unsat ✅ 0.83605 2.13000
STP stp_st default unsat ✅ 0.55485 0.55437
stp_mt default unsat ✅ 0.54684 0.54595
Yices2 Yices2-Main default unsat ✅ 0.17058 0.17008
Z3 z3-4.5.0 default unsat ✅ 0.57696 0.57528
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.73702 0.73690
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.20586 4.20591
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.59254 0.59347
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.18562 2.27559
Minkeyrink ST_st unsat ✅ 1.19518 1.19513
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.54017 0.54020
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.54350 0.54346
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.54128 0.54118
Yices2 Yices 2.6.0_default unsat ✅ 0.16167 0.16145
Z3 z3-4.7.1_default unsat ✅ 0.54952 0.54947
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.38742 1.38739
Poolector-wrapped-sq_default unsat ✅ 1.69122 6.20809
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.15652 1.15637
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.83257 3.83276
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.82958 0.82944
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.82741 0.82739
Par4 Par4-wrapped-sq_default unsat ✅ 0.17219 0.00604
STP STP-2019-wrapped-sq_default unsat ✅ 0.54708 0.54717
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.54267 0.54048
stp-minisat-wrapped-sq_default unsat ✅ 0.54772 0.54787
stp-mt-wrapped-sq_default unsat ✅ 0.54842 0.54857
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.54314 0.54327
stp-riss-wrapped-sq_default unsat ✅ 0.54717 0.54727
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.16612 0.16601
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.16873 0.16872
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.16966 0.16964
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.16644 0.16642
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.16917 0.16918
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.53314 0.53296
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.14196 1.14189
MathSAT mathsat-5.6.6_default unsat ✅ 0.62810 0.62795
STP STP 2021.0_default unsat ✅ 0.52627 0.52636
Z3 z3-4.8.11_default unsat ✅ 0.43901 0.43895
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.14541 1.14536
Bitwuzla-wrapped_default unsat ✅ 1.23318 1.23310
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.88506 3.88551
MathSAT MathSAT-5.6.8_default unsat ✅ 0.62842 0.62833
STP STP 2022.4_default unsat ✅ 0.58164 0.58162
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.20366 0.20355
Z3++BV z3++bv_0702_default unsat ✅ 0.40310 0.40303
Z3 z3-4.8.17_default unsat ✅ 0.40344 0.40526
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.90474 1.89954
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.86542 2.86382
STP STP 2022.4_default unsat ✅ 0.56105 0.56109
STP 2022.4_default unsat ✅ 0.56098 0.56097
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 721.92900 834.36200
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.19705 0.19695
Z3-Owl z3-Owl-Final_default unsat ✅ 1.02145 1.02140
z3-Owl-Final_default unsat ✅ 1.02756 1.02681