Benchmark

non-incremental/QF_BV/sage/app8/bench_622.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size38516
Compressed Size6891
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 38508
Compressed Size6893
Max. Term Depth108
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not119 and1
=181 let98 extract2 bvand6
bvor63 bvadd335 bvmul11 bvsub99
bvult88 bvule233 bvslt5 bvsle10
bvshl71 zero_extend147 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.65215 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 1.40991 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 1.40926 —
abziz_portfolio_2012_minfeatures default unsat ✅ 1.41584 —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 5.95409 —
Boolector-SMT-COMP-2011 default unsat ✅ 3.36016 —
Boolector-SMT-COMP-2012 default unsat ✅ 8.18290 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.28135 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.39732 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.10572 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.18656 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.10844 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.10695 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.16254 —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.54290 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.27865 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.24641 —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 9.48075 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.54622 —
Z3-SMT-COMP-2011 default unsat ✅ 1.40432 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 1.32615 1.32580
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.55645 1.07783
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.56549 1.09883
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.29840 0.29795
SMT-RAT SMT-RAT-final default unsat ✅ 91.05680 91.07820
STP stp-cryptominisat4 default unsat ✅ 0.39720 0.39594
stp-cmsat4-v15 default unsat ✅ 0.37547 0.37394
stp-cmsat4-mt-v15 default unknown ❌ 0.17943 0.17797
stp-minisat-v15 default unsat ✅ 0.28389 0.28296
Yices2 Yices default unsat ✅ 0.02285 0.02200
Z3 z3 4.4.0 default unsat ✅ 3.37608 3.37749
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 8.12739 8.13197
ABC_glucose glucose unsat ✅ 3.58442 3.58605
Boolector Boolector boolector unsat ✅ 2.38343 2.38275
Boolector preprop boolector unsat ✅ 2.37836 2.37969
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.52189 1.01132
MapleSTP MapleSTP default unsat ✅ 0.31302 0.31311
MapleSTP-mt default unsat ✅ 0.40185 1.01913
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.25865 0.25991
MinkeyRink Minkeyrink 2016 default unsat ✅ 1.11713 1.79043
Q3B Q3B default unknown ❌ 2400.12000 7203.97000
STP stp-cms-exp-2016 default unsat ✅ 0.47076 0.47099
stp-cms-mt-2016 default unsat ✅ 0.36468 1.00503
stp-cms-st-2016 default unsat ✅ 0.36788 0.36797
stp-minisat-st-2016 default unsat ✅ 1.14700 1.14762
Yices2 Yices-2.4.2 default unsat ✅ 0.02635 0.02634
Z3 z3-4.4.1 default unsat ✅ 1.49758 1.50000
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.63902 0.63798
Boolector SMT17 final boolector unsat ✅ 1.18889 1.18788
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.55447 1.97501
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.25885 0.25896
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.50856 0.50698
Q3B Q3B default unknown ❌ 600.07200 1786.05000
STP stp_st default unsat ✅ 3.25557 3.25531
stp_mt default unsat ✅ 4.48654 13.63020
Yices2 Yices2-Main default unsat ✅ 0.02902 0.02834
Z3 z3-4.5.0 default unsat ✅ 1.66020 1.65955
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.26243 0.26230
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.64954 0.64962
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.25457 0.25565
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.34508 0.81366
Minkeyrink ST_st unsat ✅ 0.32109 0.32110
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 5.44680 5.44680
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 4.18369 16.02100
STP-Riss-st-2018_riss-no-stderr unsat ✅ 4.16658 4.16644
Yices2 Yices 2.6.0_default unsat ✅ 0.02426 0.02421
Z3 z3-4.7.1_default unsat ✅ 2.53925 2.53924
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.87050 0.87049
Poolector-wrapped-sq_default unsat ✅ 0.68613 2.27981
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.87069 1.87032
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.56406 0.56426
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.36736 0.97591
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.35127 0.35134
Par4 Par4-wrapped-sq_default unsat ✅ 0.03633 0.00979
STP STP-2019-wrapped-sq_default unsat ✅ 1.27427 1.27453
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 8.33682 8.33605
stp-minisat-wrapped-sq_default unsat ✅ 3.67856 3.67828
stp-mt-wrapped-sq_default unsat ✅ 1.32474 4.63513
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 8.59913 13.24600
stp-riss-wrapped-sq_default unknown ❌ 0.19733 0.19754
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02660 0.02656
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05113 0.05115
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.04236 0.04234
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.04000 2400.07000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.06792 0.06791
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.22029 1.22030
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.84572 0.84555
Boolector Boolector-wrapped-sq_default unsat ✅ 0.92409 0.92410
Poolector-wrapped-sq_default unsat ✅ 0.68328 2.19000
CVC4 CVC4-sq-final_default unsat ✅ 0.39082 0.39105
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 43.10460 43.10370
MathSAT MathSAT5_default.sh unsat ✅ 0.11533 0.11529
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.17529 0.17551
MinkeyRink Solver 2020.3_default unsat ✅ 0.38305 0.99374
STP STP_default unsat ✅ 0.28918 0.71744
STP ++ Mergsat v1_default unsat ✅ 0.30366 0.30534
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04151 0.04143
Z3 z3-4.8.8_default unsat ✅ 1.42345 1.42341
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.93766 0.93763
MathSAT mathsat-5.6.6_default unsat ✅ 0.12284 0.12258
STP STP 2021.0_default unsat ✅ 0.30875 0.82743
Z3 z3-4.8.11_default unsat ✅ 7.40322 7.40280
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.80154 0.80145
Bitwuzla-wrapped_default unsat ✅ 0.75186 0.75172
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.38550 0.38492
MathSAT MathSAT-5.6.8_default unsat ✅ 0.11706 0.11702
STP STP 2022.4_default unsat ✅ 0.35891 0.35892
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.04545 0.04540
Z3++BV z3++bv_0702_default unsat ✅ 0.91973 0.91963
Z3 z3-4.8.17_default unsat ✅ 2.62209 2.62366
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.35625 0.35612
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.45526 0.45583
STP STP 2022.4_default unsat ✅ 0.54327 0.54328
STP 2022.4_default unsat ✅ 0.54648 0.54653
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 11.32250 30.91390
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.02798 0.02792
Z3-Owl z3-Owl-Final_default unsat ✅ 13.38000 13.37980
z3-Owl-Final_default unsat ✅ 13.25460 13.25530
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.34202 0.24221
cvc5 cvc5 unsat ✅ 0.59441 0.49473
SMTInterpol SMTInterpol unsat ✅ 92.01693 114.81961
STP STP unsat ✅ 0.51428 0.41383
Yices2 Yices2 unsat ✅ 0.22998 0.13007
Z3alpha Z3-alpha unsat ✅ 0.81895 0.71852