Benchmark

non-incremental/QF_BV/sage/app2/bench_489.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size357883
Compressed Size44747
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 357875
Compressed Size44757
Max. Term Depth890
Asserts 1
Declared Functions0
Declared Constants1366
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true39 ite1 not263 and1
=436 let868 extract167 bvand1824
bvor73 bvxor60 bvadd3759 bvmul22
bvsub2426 bvsdiv22 bvult129 bvule251
bvslt167 bvsle68 bvshl2244 bvashr1155
zero_extend1506

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.04742 —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.06366 —
abziz_portfolio_2012_solvers default unsat ✅ 0.06370 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.06408 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.04804 —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unsat ✅ 0.26430 —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ 221.23200 —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04833 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.05402 —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.07654 0.07650
Boolector SMT17 final boolector unsat ✅ 0.07387 0.07263
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.50304 6.83172
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.09468 0.09539
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19461 0.19402
Q3B Q3B default unsat ✅ 0.54356 0.72096
STP stp_st default unsat ✅ 0.05662 0.05553
stp_mt default unsat ✅ 0.05858 0.05746
Yices2 Yices2-Main default unsat ✅ 0.03843 0.03178
Z3 z3-4.5.0 default unsat ✅ 0.26209 0.26101
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07822 0.07817
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.01218 2.01220
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.09074 0.09174
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.20145 0.20144
Minkeyrink ST_st unsat ✅ 0.20018 0.20018
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.05337 0.05336
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.05432 0.05437
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.05305 0.05312
Yices2 Yices 2.6.0_default unsat ✅ 0.03312 0.03303
Z3 z3-4.7.1_default unsat ✅ 0.07801 0.07796
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.13626 0.13629
Poolector-wrapped-sq_default unsat ✅ 0.28029 0.69083
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.12524 0.12525
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.74154 1.74181
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.29844 0.29853
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.29760 0.29747
Par4 Par4-wrapped-sq_default unsat ✅ 0.04663 0.00577
STP STP-2019-wrapped-sq_default unsat ✅ 0.06138 0.06156
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.06121 0.06132
stp-minisat-wrapped-sq_default unsat ✅ 0.06119 0.06132
stp-mt-wrapped-sq_default unsat ✅ 0.06242 0.06255
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.06120 0.06129
stp-riss-wrapped-sq_default unsat ✅ 0.06190 0.06202
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03370 0.03366
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03375 0.03373
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03376 0.03374
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.03338 0.03334
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.03456 0.03453
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.25233 0.25231
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11259 0.11254
MathSAT mathsat-5.6.6_default unsat ✅ 4.37400 4.37407
STP STP 2021.0_default unsat ✅ 0.05798 0.05811
Z3 z3-4.8.11_default unsat ✅ 0.04640 0.04635
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11178 0.11174
Bitwuzla-wrapped_default unsat ✅ 0.11537 0.11531
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.03585 2.03636
MathSAT MathSAT-5.6.8_default unsat ✅ 4.73839 4.73828
STP STP 2022.4_default unsat ✅ 0.06051 0.05986
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.03933 0.03924
Z3++BV z3++bv_0702_default unsat ✅ 69.74960 69.73750
Z3 z3-4.8.17_default unsat ✅ 0.26033 0.26206
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16161 0.16154
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.03573 2.03623
STP STP 2022.4_default unsat ✅ 0.05374 0.05379
STP 2022.4_default unsat ✅ 0.05349 0.05352
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 12.00410 33.74440
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03648 0.03644
Z3-Owl z3-Owl-Final_default unsat ✅ 0.79199 0.79195
z3-Owl-Final_default unsat ✅ 0.79773 0.79803
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.29555 0.19542
cvc5 cvc5 unsat ✅ 1.99531 1.89572
SMTInterpol SMTInterpol unsat ✅ 36.38336 72.64977
STP STP unsat ✅ 0.71928 0.61883
Yices2 Yices2 unsat ✅ 0.23249 0.13250
Z3alpha Z3-alpha unsat ✅ 0.32870 0.22932
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.34709 0.22246
Bitwuzla-MachBV-base unsat ✅ 0.34987 0.22497
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.39746 0.27872
BVDecide bv_decide unsat ✅ 451.01682 450.81631
bv_decide-nokernel unsat ✅ 282.19126 281.95988
cvc5 cvc5 unsat ✅ 1.56032 1.43310
SMTInterpol SMTInterpol unsat ✅ 29.84981 56.26504
Yices2 Yices2 unsat ✅ 0.28289 0.16974
Z3alpha Z3-alpha unsat ✅ 0.41940 0.31038
Z3 Z3-alpha-base unsat ✅ 0.33855 0.20634
Z3-Owl-base unsat ✅ 0.35768 0.23997
z3siri-base unsat ✅ 0.30259 0.18252
Z3-Owl Z3-Owl unsat ✅ 0.81302 0.69279