Benchmark

non-incremental/QF_BV/sage/app1/bench_1999.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size77086
Compressed Size10992
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 77078
Compressed Size11016
Max. Term Depth186
Asserts 1
Declared Functions0
Declared Constants290
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite82 not74 and1
=198 let176 extract1 bvand44
bvor174 bvadd379 bvmul5 bvsub255
bvult267 bvule580 bvslt2 bvsle57
bvshl175 bvashr5 zero_extend314

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.91098 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.05178 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.04867 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.04846 —
abziz_portfolio_2012_solvers default unsat ✅ 0.04838 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.04796 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.12884 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.11962 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.12541 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.65947 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.28886 —
CVC3-SMT-COMP-2012 default unsat ✅ 2.36703 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.61184 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.74893 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.39368 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.87674 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.37266 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.37944 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.22911 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.27624 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.86004 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.23744 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.03640 —
STP2-SMT-COMP-2012 default unsat ✅ 0.05431 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.09069 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03678 —
Z3-SMT-COMP-2011 default unsat ✅ 0.04335 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02310 0.02200
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.06645 2.07168
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.06627 2.07968
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.82922 0.82887
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.10000
STP stp-cryptominisat4 default unsat ✅ 0.05428 0.05299
stp-cmsat4-v15 default unsat ✅ 0.05268 0.05199
stp-cmsat4-mt-v15 default unsat ✅ 0.05319 0.05199
stp-minisat-v15 default unsat ✅ 0.05234 0.05099
Yices2 Yices default unsat ✅ 0.04157 0.04099
Z3 z3 4.4.0 default unsat ✅ 0.32974 0.32995
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.93303 0.93220
ABC_glucose glucose unsat ✅ 12.39790 12.40500
Boolector Boolector boolector unsat ✅ 0.02882 0.02878
Boolector preprop boolector unsat ✅ 0.02692 0.02691
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.02976 2.00603
MapleSTP MapleSTP default unsat ✅ 0.06330 0.06381
MapleSTP-mt default unsat ✅ 0.06211 0.06209
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.86976 0.87116
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.07472 0.07473
Q3B Q3B default unsat ✅ 0.45669 1.09420
STP stp-cms-exp-2016 default unsat ✅ 0.06229 0.06213
stp-cms-mt-2016 default unsat ✅ 0.06316 0.06294
stp-cms-st-2016 default unsat ✅ 0.06342 0.06339
stp-minisat-st-2016 default unsat ✅ 0.06281 0.06296
Yices2 Yices-2.4.2 default unsat ✅ 0.04255 0.04249
Z3 z3-4.4.1 default unsat ✅ 0.30370 0.30510
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02763 0.02635
Boolector SMT17 final boolector unsat ✅ 0.03491 0.02679
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.09105 2.11903
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.82558 0.82516
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04232 0.04145
Q3B Q3B default unknown ❌ 600.03100 1799.42000
STP stp_st default unsat ✅ 0.10699 0.10617
stp_mt default unsat ✅ 0.10663 0.10662
Yices2 Yices2-Main default unsat ✅ 0.04265 0.04083
Z3 z3-4.5.0 default unsat ✅ 0.34954 0.34820
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.02104 0.02095
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.17876 2.17869
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.67469 0.67575
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04415 0.04417
Minkeyrink ST_st unsat ✅ 0.04413 0.04415
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.04600 0.04607
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.04591 0.04593
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.04641 0.04649
Yices2 Yices 2.6.0_default unsat ✅ 0.04175 0.04168
Z3 z3-4.7.1_default unsat ✅ 0.36066 0.36056
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.03828 0.03820
Boolector Boolector-wrapped-sq_default unsat ✅ 0.04551 0.04554
Poolector-wrapped-sq_default unsat ✅ 0.17822 0.27339
CVC4 CVC4-sq-final_default unsat ✅ 1.09377 1.09410
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 158.76500 158.75500
MathSAT MathSAT5_default.sh unsat ✅ 0.47762 0.47723
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.04555 0.04561
MinkeyRink Solver 2020.3_default unsat ✅ 0.04832 0.04845
STP STP_default unsat ✅ 0.14948 0.14956
STP ++ Mergsat v1_default unsat ✅ 0.14946 0.15119
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04549 0.04541
Z3 z3-4.8.8_default unsat ✅ 0.34898 0.34894
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.03903 0.03898
MathSAT mathsat-5.6.6_default unsat ✅ 0.45037 0.45020
STP STP 2021.0_default unsat ✅ 0.11845 0.11862
Z3 z3-4.8.11_default unsat ✅ 0.34619 0.34616
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.11070 1.11055
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.04002 1.04029
STP STP 2022.4_default unsat ✅ 0.03756 0.03761
STP 2022.4_default unsat ✅ 0.03730 0.03733
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1258.37000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.04729 0.04727
Z3-Owl z3-Owl-Final_default unsat ✅ 0.71976 0.71968
z3-Owl-Final_default unsat ✅ 0.72258 0.72284
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.27250 0.17281
cvc5 cvc5 unsat ✅ 1.29889 1.19921
SMTInterpol SMTInterpol unsat ✅ 412.32590 449.07208
STP STP unsat ✅ 0.27227 0.17234
Yices2 Yices2 unsat ✅ 0.24536 0.14557
Z3alpha Z3-alpha unsat ✅ 0.29587 0.19592
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.34763 0.22089
Bitwuzla-MachBV-base unsat ✅ 0.31160 0.18769
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.39903 0.27430
BVDecide bv_decide unsat ✅ 16.04965 15.92147
bv_decide-nokernel unsat ✅ 8.58545 8.45037
cvc5 cvc5 unsat ✅ 0.89621 0.77292
SMTInterpol SMTInterpol unknown ❌ 1201.78972 1227.92813
Yices2 Yices2 unsat ✅ 0.27295 0.15422
Z3alpha Z3-alpha unsat ✅ 0.44150 0.41592
Z3 Z3-alpha-base unsat ✅ 0.32919 0.20363
Z3-Owl-base unsat ✅ 0.36030 0.24425
z3siri-base unsat ✅ 0.31725 0.18837
Z3-Owl Z3-Owl unsat ✅ 0.83472 0.70720