Benchmark

non-incremental/QF_BV/sage/app7/bench_163.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3327383
Compressed Size209965
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3327375
Compressed Size209972
Max. Term Depth12792
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2184 and1
=2877 let12687 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36716 bvmul2
bvsub11936 bvsdiv6 bvult497 bvule535
bvslt213 bvsle121 bvshl11740 bvashr22014
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49290 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.54413 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.54527 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.54733 —
abziz_portfolio_2012_solvers default unsat ✅ 0.54384 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.54641 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66072 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79475 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.70171 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 352.03500 —
CVC3-SMT-COMP-2011 default unsat ✅ 294.69000 —
CVC3-SMT-COMP-2012 default unsat ✅ 307.38300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.86014 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.55665 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99272 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.96724 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23382 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20126 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87343 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.99222 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.16901 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.35520 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.52091 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49342 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52621 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.58708 —
Z3-SMT-COMP-2011 default unsat ✅ 0.54485 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.88189 0.87977
Boolector SMT17 final boolector unsat ✅ 0.87615 0.87501
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.40627 7.08731
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.64933 0.65020
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.25491 1.25377
Q3B Q3B default unsat ✅ 0.86510 2.09000
STP stp_st default unsat ✅ 0.58008 0.57683
stp_mt default unsat ✅ 0.56156 0.56070
Yices2 Yices2-Main default unsat ✅ 0.36356 0.36349
Z3 z3-4.5.0 default unsat ✅ 0.50680 0.50665
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78113 0.78104
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.91128 3.91076
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.62814 0.62921
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.26811 1.26811
Minkeyrink ST_st unsat ✅ 1.26358 1.26361
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57044 0.57048
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57456 0.57452
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57356 0.57343
Yices2 Yices 2.6.0_default unsat ✅ 0.36959 0.36950
Z3 z3-4.7.1_default unsat ✅ 0.57057 0.57044
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.49783 1.49783
Poolector-wrapped-sq_default unsat ✅ 1.80091 6.72871
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.21573 1.21558
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.17451 4.17448
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.89879 0.89891
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.89793 0.89778
Par4 Par4-wrapped-sq_default unsat ✅ 0.38491 0.00604
STP STP-2019-wrapped-sq_default unsat ✅ 0.59229 0.59239
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.58729 0.58744
stp-minisat-wrapped-sq_default unsat ✅ 0.59316 0.59328
stp-mt-wrapped-sq_default unsat ✅ 0.59384 0.59266
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.58426 0.58434
stp-riss-wrapped-sq_default unsat ✅ 0.59422 0.59424
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34442 0.34421
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.34231 0.34195
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.34210 0.34210
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.34683 0.34677
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.34102 0.34089
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.54190 0.54192
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.26273 1.26255
Boolector Boolector-wrapped-sq_default unsat ✅ 1.49903 1.49891
Poolector-wrapped-sq_default unsat ✅ 1.78046 6.70414
CVC4 CVC4-sq-final_default unsat ✅ 5.39347 5.39324
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.79706 0.79697
MathSAT MathSAT5_default.sh unsat ✅ 0.65411 0.65411
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.74249 0.74257
MinkeyRink Solver 2020.3_default unsat ✅ 0.76550 0.76558
STP STP_default unsat ✅ 0.54488 0.54502
STP ++ Mergsat v1_default unsat ✅ 0.54063 0.54225
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.38356 0.38338
Z3 z3-4.8.8_default unsat ✅ 0.43721 0.43692
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24320 1.24295
MathSAT mathsat-5.6.6_default unsat ✅ 0.67190 0.67185
STP STP 2021.0_default unsat ✅ 0.56892 0.56908
Z3 z3-4.8.11_default unsat ✅ 0.63322 0.63318
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24156 1.24150
Bitwuzla-wrapped_default unsat ✅ 1.30498 1.30503
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.21806 4.21821
MathSAT MathSAT-5.6.8_default unsat ✅ 0.68143 0.67989
STP STP 2022.4_default unsat ✅ 0.63083 0.63077
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.37848 0.37842
Z3++BV z3++bv_0702_default unsat ✅ 0.40076 0.40064
Z3 z3-4.8.17_default unsat ✅ 0.42462 0.42554
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.89079 1.89017
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.08534 3.08252
STP STP 2022.4_default unsat ✅ 0.60282 0.60283
STP 2022.4_default unsat ✅ 0.60562 0.60557
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.11000 1315.88000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.37014 0.37005
Z3-Owl z3-Owl-Final_default unsat ✅ 1.03185 1.03166
z3-Owl-Final_default unsat ✅ 1.07174 1.06762
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.21008 1.11008
cvc5 cvc5 unsat ✅ 0.73940 0.63968
SMTInterpol SMTInterpol unknown ❌ 1202.74412 1377.69495
STP STP unsat ✅ 35.08529 34.94744
Yices2 Yices2 unsat ✅ 0.46351 0.36373
Z3alpha Z3-alpha unsat ✅ 0.68905 0.58907