Benchmark

non-incremental/QF_BV/sage/app7/bench_693.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3107175
Compressed Size193610
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3107167
Compressed Size193615
Max. Term Depth11908
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1880 and1
=2516 let11803 extract1371 bvand32417
bvor21375 bvxor1648 bvadd34315 bvmul1
bvsub11132 bvult453 bvule505 bvslt210
bvsle111 bvshl10951 bvashr20809 zero_extend1092

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.46527 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.50637 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.51262 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.51322 —
abziz_portfolio_2012_solvers default unsat ✅ 0.51458 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.51171 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.62550 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.75036 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.65906 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 246.50500 —
CVC3-SMT-COMP-2011 default unsat ✅ 207.41100 —
CVC3-SMT-COMP-2012 default unsat ✅ 216.49200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.70222 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.10246 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.92938 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.89578 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.16643 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.13159 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.81275 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.71980 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 5.83055 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.25934 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.49301 —
STP2-SMT-COMP-2012 default unsat ✅ 0.46803 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.49485 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.54994 —
Z3-SMT-COMP-2011 default unsat ✅ 0.50211 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.90231 0.90186
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 4.07302 6.60600
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 4.06047 6.59500
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.65982 0.65890
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.76000
STP stp-cryptominisat4 default unsat ✅ 0.43510 0.43393
stp-cmsat4-v15 default unsat ✅ 0.43948 0.43893
stp-cmsat4-mt-v15 default unsat ✅ 0.43557 0.43493
stp-minisat-v15 default unsat ✅ 0.44367 0.44293
Yices2 Yices default unsat ✅ 0.18009 0.17897
Z3 z3 4.4.0 default unsat ✅ 0.47594 0.47593
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.76382 1.76462
ABC_glucose glucose unsat ✅ 1.75307 1.75415
Boolector Boolector boolector unsat ✅ 1.05298 1.05120
Boolector preprop boolector unsat ✅ 1.01377 1.01423
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 4.05049 6.58833
MapleSTP MapleSTP default unsat ✅ 0.47345 0.47365
MapleSTP-mt default unsat ✅ 0.42672 0.42685
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.60865 0.60068
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.59489 0.59494
Q3B Q3B default unsat ✅ 0.80915 2.06000
STP stp-cms-exp-2016 default unsat ✅ 0.42548 0.42569
stp-cms-mt-2016 default unsat ✅ 0.43618 0.43638
stp-cms-st-2016 default unsat ✅ 0.43092 0.43110
stp-minisat-st-2016 default unsat ✅ 0.43939 0.43944
Yices2 Yices-2.4.2 default unsat ✅ 0.18119 0.18124
Z3 z3-4.4.1 default unsat ✅ 0.50977 0.51134
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.86479 0.86088
Boolector SMT17 final boolector unsat ✅ 0.85131 0.85019
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.22289 6.80729
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.61054 0.60991
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.17395 1.17247
Q3B Q3B default unsat ✅ 0.78103 1.88000
STP stp_st default unsat ✅ 0.57763 0.57116
stp_mt default unsat ✅ 0.56371 0.56112
Yices2 Yices2-Main default unsat ✅ 0.17502 0.17420
Z3 z3-4.5.0 default unsat ✅ 0.52760 0.52667
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.73859 0.73850
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.68400 3.68422
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.59697 0.59798
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.18515 1.18503
Minkeyrink ST_st unsat ✅ 1.18649 1.18658
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.54179 0.54186
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.54179 0.54183
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.54266 0.54275
Yices2 Yices 2.6.0_default unsat ✅ 0.16351 0.16336
Z3 z3-4.7.1_default unsat ✅ 0.54869 0.54854
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.15902 1.15903
Boolector Boolector-wrapped-sq_default unsat ✅ 1.38036 1.38028
Poolector-wrapped-sq_default unsat ✅ 1.68160 6.19023
CVC4 CVC4-sq-final_default unsat ✅ 5.06725 5.06688
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.73855 0.73844
MathSAT MathSAT5_default.sh unsat ✅ 0.61744 0.61741
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.68300 0.68306
MinkeyRink Solver 2020.3_default unsat ✅ 0.71169 0.71175
STP STP_default unsat ✅ 0.51419 0.51433
STP ++ Mergsat v1_default unsat ✅ 0.51046 0.51216
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.20186 0.20179
Z3 z3-4.8.8_default unsat ✅ 0.40254 0.40245
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.14478 1.14459
MathSAT mathsat-5.6.6_default unsat ✅ 0.62622 0.62618
STP STP 2021.0_default unsat ✅ 0.52498 0.52506
Z3 z3-4.8.11_default unsat ✅ 0.39822 0.39821
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.85694 1.85663
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 2.85100 2.84953
STP STP 2022.4_default unsat ✅ 0.60268 0.60273
STP 2022.4_default unsat ✅ 0.55963 0.55966
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 739.29500 852.80600
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.19724 0.19718
Z3-Owl z3-Owl-Final_default unsat ✅ 1.02354 1.02346
z3-Owl-Final_default unsat ✅ 1.03546 1.03571
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.24314 1.14325
cvc5 cvc5 unsat ✅ 1.00757 0.90782
SMTInterpol SMTInterpol unknown ❌ 1202.74481 1503.90696
STP STP unsat ✅ 28.34996 28.24008
Yices2 Yices2 unsat ✅ 0.34352 0.24388
Z3alpha Z3-alpha unsat ✅ 0.56544 0.46572
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.91299 0.78292
Bitwuzla-MachBV-base unsat ✅ 1.04869 0.91729
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.20173 1.07354
BVDecide bv_decide unknown ❌ 1201.39178 1200.96193
bv_decide-nokernel unknown ❌ 1201.39543 1201.03274
cvc5 cvc5 unsat ✅ 0.71371 0.59653
SMTInterpol SMTInterpol unknown ❌ 1201.75428 2633.44341
Yices2 Yices2 unsat ✅ 0.38666 0.26275
Z3alpha Z3-alpha unsat ✅ 0.93627 0.89838
Z3 Z3-alpha-base unsat ✅ 0.51624 0.39285
Z3-Owl-base unsat ✅ 1.20415 1.08298
z3siri-base unsat ✅ 0.52131 0.39086
Z3-Owl Z3-Owl unsat ✅ 1.03259 0.91248