Benchmark

non-incremental/QF_BV/sage/app7/bench_5069.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3577162
Compressed Size230574
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3577154
Compressed Size230581
Max. Term Depth13808
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2481 and1
=3234 let13585 extract1703 bvand36343
bvor23877 bvxor2261 bvadd39496 bvmul7
bvsub13004 bvsdiv19 bvult601 bvule625
bvslt219 bvsle124 bvshl12707 bvashr23620
zero_extend1507

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.52954 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.57701 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.58096 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.58647 —
abziz_portfolio_2012_solvers default unsat ✅ 0.58058 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.57581 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.70718 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.86416 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.74557 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 521.83500 —
CVC3-SMT-COMP-2011 default unsat ✅ 431.58700 —
CVC3-SMT-COMP-2012 default unsat ✅ 449.52900 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.15933 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.86600 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.07084 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.03053 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.33815 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.30985 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.93169 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.75821 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.53168 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.46872 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.61120 —
STP2-SMT-COMP-2012 default unsat ✅ 0.53512 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.56080 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.62939 —
Z3-SMT-COMP-2011 default unsat ✅ 0.57518 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.94652 0.94477
Boolector SMT17 final boolector unsat ✅ 1.00012 0.99905
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.89018 7.82573
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.75724 0.75601
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.47742 1.44729
Q3B Q3B default unsat ✅ 1.07561 2.13000
STP stp_st default unsat ✅ 1.01846 0.71974
stp_mt default unsat ✅ 0.63236 0.63270
Yices2 Yices2-Main default unsat ✅ 0.48825 0.39977
Z3 z3-4.5.0 default unsat ✅ 0.82889 0.82579
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.84070 0.84053
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.33129 4.33133
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.68782 0.68871
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.37706 1.37696
Minkeyrink ST_st unsat ✅ 1.37557 1.37567
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.62369 0.62372
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.62337 0.62340
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.62243 0.62247
Yices2 Yices 2.6.0_default unsat ✅ 0.38907 0.38896
Z3 z3-4.7.1_default unsat ✅ 0.57303 0.57288
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.33920 1.33913
Boolector Boolector-wrapped-sq_default unsat ✅ 1.59613 1.59611
Poolector-wrapped-sq_default unsat ✅ 1.88957 6.93000
CVC4 CVC4-sq-final_default unsat ✅ 5.95160 5.95121
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.85701 0.85689
MathSAT MathSAT5_default.sh unsat ✅ 0.70046 0.70037
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.79202 0.79202
MinkeyRink Solver 2020.3_default unsat ✅ 0.81705 0.81713
STP STP_default unsat ✅ 0.58617 0.58632
STP ++ Mergsat v1_default unsat ✅ 0.58018 0.58190
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.40331 0.40325
Z3 z3-4.8.8_default unsat ✅ 0.64834 0.64824
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.33222 1.33214
MathSAT mathsat-5.6.6_default unsat ✅ 0.71772 0.71768
STP STP 2021.0_default unsat ✅ 0.60609 0.60621
Z3 z3-4.8.11_default unsat ✅ 0.74580 0.74576
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.34994 1.34979
Bitwuzla-wrapped_default unsat ✅ 1.41842 1.41834
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.66403 4.66409
MathSAT MathSAT-5.6.8_default unsat ✅ 0.73908 0.73899
STP STP 2022.4_default unsat ✅ 0.70405 0.70401
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.39663 0.39659
Z3++BV z3++bv_0702_default unsat ✅ 0.73537 0.73536
Z3 z3-4.8.17_default unsat ✅ 0.73019 0.73196
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.08522 2.08479
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.35985 3.35113
STP STP 2022.4_default unsat ✅ 0.69133 0.69141
STP 2022.4_default unsat ✅ 0.68727 0.68710
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.06000 1327.19000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.39430 0.39427
Z3-Owl z3-Owl-Final_default unsat ✅ 1.37894 1.37877
z3-Owl-Final_default unsat ✅ 1.39825 1.39661