Benchmark

non-incremental/QF_BV/sage/app7/bench_1722.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1213259
Compressed Size94991
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1213251
Compressed Size94998
Max. Term Depth4656
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1520 and1
=2061 let4599 extract1198 bvand11334
bvor7304 bvxor1368 bvadd12818 bvmul1
bvsub4124 bvult426 bvule449 bvslt193
bvsle97 bvshl3963 bvashr6985 zero_extend914

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.17666 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.18936 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.19107 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.18771 —
abziz_portfolio_2012_solvers default unsat ✅ 0.18716 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.18837 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.23655 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.27964 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.25070 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 9.90324 —
CVC3-SMT-COMP-2011 default unsat ✅ 8.47836 —
CVC3-SMT-COMP-2012 default unsat ✅ 8.78226 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.03727 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.76575 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.37454 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.35653 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.46824 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.46024 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.32677 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.81041 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.16729 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.47796 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.18613 —
STP2-SMT-COMP-2012 default unsat ✅ 0.17142 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.17472 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.20131 —
Z3-SMT-COMP-2011 default unsat ✅ 0.18271 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.33086 0.32995
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.66990 2.73858
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.66972 2.74258
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.26059 0.25996
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.20000
STP stp-cryptominisat4 default unsat ✅ 0.16523 0.16397
stp-cmsat4-v15 default unsat ✅ 0.16297 0.16197
stp-cmsat4-mt-v15 default unsat ✅ 0.16477 0.16397
stp-minisat-v15 default unsat ✅ 0.16453 0.16397
Yices2 Yices default unsat ✅ 0.07646 0.07499
Z3 z3 4.4.0 default unsat ✅ 0.25411 0.25396
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.68927 0.68947
ABC_glucose glucose unsat ✅ 0.67750 0.67817
Boolector Boolector boolector unsat ✅ 0.40274 0.40281
Boolector preprop boolector unsat ✅ 0.39101 0.39111
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.62573 2.67283
MapleSTP MapleSTP default unsat ✅ 0.15485 0.15490
MapleSTP-mt default unsat ✅ 0.15409 0.15410
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.23407 0.23549
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.20866 0.20871
Q3B Q3B default unsat ✅ 0.42289 1.00423
STP stp-cms-exp-2016 default unsat ✅ 0.15859 0.15866
stp-cms-mt-2016 default unsat ✅ 0.16108 0.16113
stp-cms-st-2016 default unsat ✅ 0.16091 0.16096
stp-minisat-st-2016 default unsat ✅ 0.16267 0.16271
Yices2 Yices-2.4.2 default unsat ✅ 0.07651 0.07651
Z3 z3-4.4.1 default unsat ✅ 0.24425 0.24571
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.34824 0.34215
Boolector SMT17 final boolector unsat ✅ 0.33130 0.32951
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.62477 2.63676
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.23673 0.23673
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.47304 0.47209
Q3B Q3B default unsat ✅ 0.39828 0.92196
STP stp_st default unsat ✅ 0.23006 0.22874
stp_mt default unsat ✅ 0.19936 0.19932
Yices2 Yices2-Main default unsat ✅ 0.07393 0.07234
Z3 z3-4.5.0 default unsat ✅ 0.25259 0.25121
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.27101 0.27092
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.49763 1.49367
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.22944 0.23046
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.46769 0.46748
Minkeyrink ST_st unsat ✅ 0.46590 0.46584
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.20085 0.20093
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.20115 0.20121
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.19845 0.19852
Yices2 Yices 2.6.0_default unsat ✅ 0.07135 0.07125
Z3 z3-4.7.1_default unsat ✅ 0.24896 0.24847
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.49436 0.49427
Poolector-wrapped-sq_default unsat ✅ 0.68135 2.31900
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.41925 0.41930
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.50683 1.50717
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.36760 0.36772
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.36488 0.36490
Par4 Par4-wrapped-sq_default unsat ✅ 0.08149 0.00593
STP STP-2019-wrapped-sq_default unsat ✅ 0.20725 0.20742
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.20580 0.20596
stp-minisat-wrapped-sq_default unsat ✅ 0.20612 0.20625
stp-mt-wrapped-sq_default unsat ✅ 0.20679 0.20693
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.20519 0.20534
stp-riss-wrapped-sq_default unsat ✅ 0.20794 0.20811
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.07416 0.07417
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.07450 0.07451
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.07419 0.07421
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.07355 0.07354
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.07389 0.07389
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.27650 0.27644
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40597 0.40587
Boolector Boolector-wrapped-sq_default unsat ✅ 0.50024 0.50014
Poolector-wrapped-sq_default unsat ✅ 0.67880 2.29937
CVC4 CVC4-sq-final_default unsat ✅ 1.94865 1.94872
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.28833 0.28824
MathSAT MathSAT5_default.sh unsat ✅ 0.23691 0.23688
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.30366 0.30379
MinkeyRink Solver 2020.3_default unsat ✅ 0.31482 0.31479
STP STP_default unsat ✅ 0.19358 0.19370
STP ++ Mergsat v1_default unsat ✅ 0.18789 0.18963
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.08653 0.08645
Z3 z3-4.8.8_default unsat ✅ 0.20066 0.20057
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40466 0.40465
MathSAT mathsat-5.6.6_default unsat ✅ 0.24368 0.24364
STP STP 2021.0_default unsat ✅ 0.19775 0.19784
Z3 z3-4.8.11_default unsat ✅ 0.17543 0.17537
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.40257 0.40251
Bitwuzla-wrapped_default unsat ✅ 0.43225 0.43022
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 1.52015 1.51802
MathSAT MathSAT-5.6.8_default unsat ✅ 0.26171 0.25985
STP STP 2022.4_default unsat ✅ 0.20865 0.20869
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.08697 0.08693
Z3++BV z3++bv_0702_default unsat ✅ 0.20567 0.20557
Z3 z3-4.8.17_default unsat ✅ 0.19764 0.19944
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.55431 0.45435
cvc5 cvc5 unsat ✅ 0.70105 0.60067
SMTInterpol SMTInterpol unsat ✅ 848.20182 1258.38400
STP STP unsat ✅ 5.09423 4.99262
Yices2 Yices2 unsat ✅ 0.27032 0.17054
Z3alpha Z3-alpha unsat ✅ 0.47406 0.37471
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.53939 0.41022
Bitwuzla-MachBV-base unsat ✅ 0.59363 0.46973
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.62913 0.50585
BVDecide bv_decide unsat ✅ 218.25359 218.09711
bv_decide-nokernel unsat ✅ 187.90802 187.75907
cvc5 cvc5 unsat ✅ 0.57263 0.44989
SMTInterpol SMTInterpol unknown ❌ 1201.87772 3460.38453
Yices2 Yices2 unsat ✅ 0.30389 0.18648
Z3alpha Z3-alpha unsat ✅ 0.51263 0.43522
Z3 Z3-alpha-base unsat ✅ 0.38351 0.25445
Z3-Owl-base unsat ✅ 0.71243 0.59428
z3siri-base unsat ✅ 0.36574 0.24194
Z3-Owl Z3-Owl unsat ✅ 0.92267 0.79271