Benchmark

non-incremental/QF_BV/sage/app7/bench_1643.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1440890
Compressed Size107315
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1440882
Compressed Size107324
Max. Term Depth5535
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1559 and1
=2112 let5478 extract1224 bvand13879
bvor8986 bvxor1404 bvadd15410 bvmul1
bvsub4976 bvult429 bvule458 bvslt198
bvsle97 bvshl4816 bvashr8674 zero_extend933

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.20285 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.22441 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.21786 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.21984 —
abziz_portfolio_2012_solvers default unsat ✅ 0.21915 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.21787 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.28195 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.33380 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.29126 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 45.06170 —
CVC3-SMT-COMP-2011 default unsat ✅ 38.17160 —
CVC3-SMT-COMP-2012 default unsat ✅ 39.89170 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.19243 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.97849 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.43767 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.41843 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.55526 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.53304 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.38613 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.15957 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 2.59098 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.56640 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.21619 —
STP2-SMT-COMP-2012 default unsat ✅ 0.20426 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.20684 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.24275 —
Z3-SMT-COMP-2011 default unsat ✅ 0.21253 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.39232 0.39094
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.94862 3.19251
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.94090 3.18651
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.31517 0.31395
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.95000
STP stp-cryptominisat4 default unsat ✅ 0.19490 0.19397
stp-cmsat4-v15 default unsat ✅ 0.19408 0.19297
stp-cmsat4-mt-v15 default unsat ✅ 0.19403 0.19297
stp-minisat-v15 default unsat ✅ 0.19420 0.19297
Yices2 Yices default unsat ✅ 0.08842 0.08699
Z3 z3 4.4.0 default unsat ✅ 0.28374 0.28396
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.82801 0.82835
ABC_glucose glucose unsat ✅ 0.81255 0.81304
Boolector Boolector boolector unsat ✅ 0.49447 0.49528
Boolector preprop boolector unsat ✅ 0.47396 0.47448
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.91306 3.14259
MapleSTP MapleSTP default unsat ✅ 0.18406 0.18413
MapleSTP-mt default unsat ✅ 0.18450 0.18458
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.28403 0.28523
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.24952 0.24962
Q3B Q3B default unsat ✅ 0.47978 0.82842
STP stp-cms-exp-2016 default unsat ✅ 0.18891 0.18897
stp-cms-mt-2016 default unsat ✅ 0.19285 0.19290
stp-cms-st-2016 default unsat ✅ 0.19161 0.19169
stp-minisat-st-2016 default unsat ✅ 0.19248 0.19313
Yices2 Yices-2.4.2 default unsat ✅ 0.08796 0.08797
Z3 z3-4.4.1 default unsat ✅ 0.25134 0.25250
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.36193 0.36105
Boolector SMT17 final boolector unsat ✅ 0.35920 0.35911
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.96503 3.19500
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.29571 0.29506
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.55989 0.55844
Q3B Q3B default unsat ✅ 0.46773 0.46944
STP stp_st default unsat ✅ 0.24740 0.24262
stp_mt default unsat ✅ 0.26720 0.26603
Yices2 Yices2-Main default unsat ✅ 0.08470 0.08389
Z3 z3-4.5.0 default unsat ✅ 0.26955 0.26878
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.32210 0.32182
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.75680 1.75691
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.27952 0.28056
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.55761 0.55760
Minkeyrink ST_st unsat ✅ 0.56161 0.56166
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.23631 0.23636
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.23716 0.23713
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.23921 0.23905
Yices2 Yices 2.6.0_default unsat ✅ 0.08172 0.08167
Z3 z3-4.7.1_default unsat ✅ 0.32586 0.32571
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.60239 0.60224
Poolector-wrapped-sq_default unsat ✅ 0.78379 2.72603
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.50218 0.50198
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.80981 1.81001
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.43232 0.43231
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.42463 0.42467
Par4 Par4-wrapped-sq_default unsat ✅ 0.10228 0.00582
STP STP-2019-wrapped-sq_default unsat ✅ 0.24554 0.24567
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.24481 0.24496
stp-minisat-wrapped-sq_default unsat ✅ 0.24676 0.24688
stp-mt-wrapped-sq_default unsat ✅ 0.24638 0.24655
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.25420 0.25433
stp-riss-wrapped-sq_default unsat ✅ 0.24407 0.24421
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.08587 0.08586
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.08783 0.08779
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.08636 0.08634
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.08479 0.08477
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.08521 0.08519
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.28860 0.28847
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.48403 0.48396
Boolector Boolector-wrapped-sq_default unsat ✅ 0.60821 0.60822
Poolector-wrapped-sq_default unsat ✅ 0.77793 2.73963
CVC4 CVC4-sq-final_default unsat ✅ 2.34234 2.34232
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.35005 0.35004
MathSAT MathSAT5_default.sh unsat ✅ 0.29198 0.29188
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.35189 0.35191
MinkeyRink Solver 2020.3_default unsat ✅ 0.36475 0.36475
STP STP_default unsat ✅ 0.22707 0.22716
STP ++ Mergsat v1_default unsat ✅ 0.22159 0.22327
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.10086 0.10076
Z3 z3-4.8.8_default unsat ✅ 0.26793 0.26789
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.52335 0.52325
MathSAT mathsat-5.6.6_default unsat ✅ 0.29904 0.29898
STP STP 2021.0_default unsat ✅ 0.23303 0.23311
Z3 z3-4.8.11_default unsat ✅ 0.19949 0.19944
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.75177 0.75170
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.34959 1.34817
STP STP 2022.4_default unsat ✅ 0.24749 0.24752
STP 2022.4_default unsat ✅ 0.24753 0.24758
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 424.37500 488.29400
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.09857 0.09852
Z3-Owl z3-Owl-Final_default unsat ✅ 0.88456 0.88450
z3-Owl-Final_default unsat ✅ 0.88089 0.88112
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.55156 0.45123
cvc5 cvc5 unsat ✅ 0.77771 0.67811
SMTInterpol SMTInterpol unsat ✅ 920.97680 1340.79118
STP STP unsat ✅ 6.90931 6.80688
Yices2 Yices2 unsat ✅ 0.28843 0.18857
Z3alpha Z3-alpha unsat ✅ 0.38878 0.28890