Benchmark

non-incremental/QF_BV/sage/app7/bench_2290.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size816667
Compressed Size72518
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 816659
Compressed Size72526
Max. Term Depth3078
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1307 and1
=1795 let3022 extract1114 bvand7055
bvor4502 bvxor1225 bvadd8338 bvmul1
bvsub2708 bvult407 bvule386 bvslt180
bvsle93 bvshl2567 bvashr4203 zero_extend843

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.11309 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.16958 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.17466 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.17709 —
abziz_portfolio_2012_solvers default unsat ✅ 0.17139 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.17039 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.15143 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.18406 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.15578 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 101.41900 —
CVC3-SMT-COMP-2011 default unsat ✅ 84.45610 —
CVC3-SMT-COMP-2012 default unsat ✅ 87.87970 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.73887 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.23903 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.25890 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.23989 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.31855 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.30669 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.22315 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.32474 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.40205 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.31639 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.11831 —
STP2-SMT-COMP-2012 default unsat ✅ 0.11403 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.11429 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.18307 —
Z3-SMT-COMP-2011 default unsat ✅ 0.16713 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.20441 0.20297
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.14267 1.88971
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.14734 1.90171
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.18684 0.18597
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.95000
STP stp-cryptominisat4 default unsat ✅ 0.10877 0.10798
stp-cmsat4-v15 default unsat ✅ 0.10789 0.10698
stp-cmsat4-mt-v15 default unsat ✅ 0.10763 0.10698
stp-minisat-v15 default unsat ✅ 0.10744 0.10598
Yices2 Yices default unsat ✅ 0.05291 0.05199
Z3 z3 4.4.0 default unsat ✅ 0.19822 0.19797
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.47105 0.47137
ABC_glucose glucose unsat ✅ 0.46246 0.46288
Boolector Boolector boolector unsat ✅ 0.22595 0.22604
Boolector preprop boolector unsat ✅ 0.22044 0.22095
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.14047 1.89717
MapleSTP MapleSTP default unsat ✅ 0.10271 0.10273
MapleSTP-mt default unsat ✅ 0.10209 0.10209
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.16628 0.16729
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.13429 0.13432
Q3B Q3B default unsat ✅ 0.32629 0.70803
STP stp-cms-exp-2016 default unsat ✅ 0.10504 0.10507
stp-cms-mt-2016 default unsat ✅ 0.10633 0.10637
stp-cms-st-2016 default unsat ✅ 0.10722 0.10719
stp-minisat-st-2016 default unsat ✅ 0.10721 0.10726
Yices2 Yices-2.4.2 default unsat ✅ 0.05365 0.05364
Z3 z3-4.4.1 default unsat ✅ 0.14128 0.14260
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.20995 0.20473
Boolector SMT17 final boolector unsat ✅ 0.21392 0.20976
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.20310 1.97861
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.17301 0.17262
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.33381 0.33318
Q3B Q3B default unsat ✅ 0.31378 0.66728
STP stp_st default unsat ✅ 0.13543 0.13482
stp_mt default unsat ✅ 0.15830 0.15758
Yices2 Yices2-Main default unsat ✅ 0.05406 0.05255
Z3 z3-4.5.0 default unsat ✅ 0.17588 0.17554
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.17082 0.17045
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.00096 1.00105
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.16855 0.16945
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.31589 0.31589
Minkeyrink ST_st unsat ✅ 0.31680 0.31683
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.12997 0.13000
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.13010 0.13010
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.13140 0.13132
Yices2 Yices 2.6.0_default unsat ✅ 0.05227 0.05220
Z3 z3-4.7.1_default unsat ✅ 0.17274 0.17248
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.30360 0.30360
Poolector-wrapped-sq_default unsat ✅ 0.47855 1.44636
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.25221 0.25221
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.99980 1.00002
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.26666 0.26673
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.26471 0.26473
Par4 Par4-wrapped-sq_default unsat ✅ 0.06061 0.00598
STP STP-2019-wrapped-sq_default unsat ✅ 0.13802 0.13810
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.13814 0.13829
stp-minisat-wrapped-sq_default unsat ✅ 0.13437 0.13441
stp-mt-wrapped-sq_default unsat ✅ 0.13923 0.13939
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.13792 0.13805
stp-riss-wrapped-sq_default unsat ✅ 0.13822 0.13834
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.05297 0.05299
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05310 0.05311
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05382 0.05383
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.05224 0.05223
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.05338 0.05337
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.20172 0.20173
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.25760 0.25753
Boolector Boolector-wrapped-sq_default unsat ✅ 0.30720 0.30722
Poolector-wrapped-sq_default unsat ✅ 0.47717 1.45543
CVC4 CVC4-sq-final_default unsat ✅ 1.30638 1.30648
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.20642 0.20640
MathSAT MathSAT5_default.sh unsat ✅ 0.17052 0.17049
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.22057 0.22066
MinkeyRink Solver 2020.3_default unsat ✅ 0.22765 0.22737
STP STP_default unsat ✅ 0.12782 0.12792
STP ++ Mergsat v1_default unsat ✅ 0.17650 0.17692
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.06075 0.06070
Z3 z3-4.8.8_default unsat ✅ 0.15790 0.15781
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.43200 0.42960
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.78248 0.77606
STP STP 2022.4_default unsat ✅ 0.13756 0.13763
STP 2022.4_default unsat ✅ 0.13655 0.13662
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 270.73900 317.64400
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.05922 0.05908
Z3-Owl z3-Owl-Final_default unsat ✅ 0.78920 0.78900
z3-Owl-Final_default unsat ✅ 0.82015 0.81743
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.41321 0.31343
cvc5 cvc5 unsat ✅ 0.42210 0.32262
SMTInterpol SMTInterpol unsat ✅ 590.90698 858.72853
STP STP unsat ✅ 2.55809 2.45829
Yices2 Yices2 unsat ✅ 0.24936 0.14950
Z3alpha Z3-alpha unsat ✅ 0.32647 0.22672