Benchmark

non-incremental/QF_BV/sage/app1/bench_37.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size85711
Compressed Size12102
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 85703
Compressed Size12141
Max. Term Depth218
Asserts 1
Declared Functions0
Declared Constants320
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite92 not78 and1
=218 let208 extract1 bvand50
bvor192 bvadd410 bvmul5 bvsub294
bvult294 bvule643 bvslt1 bvsle72
bvshl193 bvashr5 zero_extend348

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 2.14926 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 7.07681 —
abziz_portfolio_2011_solvers_2 default sat ✅ 7.17360 —
abziz_portfolio_2012_minfeatures default sat ✅ 7.05442 —
abziz_portfolio_2012_solvers default sat ✅ 6.04247 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 7.07973 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 9.52946 —
Boolector-SMT-COMP-2011 default sat ✅ 3.24855 —
Boolector-SMT-COMP-2012 default sat ✅ 0.58355 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 1.97318 —
CVC4-SMT-EVAL-2013 default sat ✅ 11.52320 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 2.18127 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 2.98134 —
MathSAT5-SMT-COMP-2011 default sat ✅ 1.98176 —
MathSAT5-SMT-COMP-2012 default sat ✅ 1.97638 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.31891 —
SONOLAR-SMT-COMP-2010 default sat ✅ 2.48876 —
SONOLAR-SMT-COMP-2011 default sat ✅ 2.00318 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.96482 —
STP STP2-SMT-COMP-2011 default sat ✅ 4.95181 —
STP2-SMT-COMP-2012 default sat ✅ 10.21670 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 34.07830 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 5.78140 —
Z3-SMT-COMP-2011 default sat ✅ 5.97653 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 3.97757 3.97739
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 8.69790 17.37340
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 10.42340 20.83380
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 4.80161 4.80227
SMT-RAT SMT-RAT-final default sat ✅ 1012.35000 1012.57000
STP stp-cryptominisat4 default sat ✅ 19.62310 19.62600
stp-cmsat4-v15 default sat ✅ 21.08110 21.08480
stp-cmsat4-mt-v15 default unknown ❌ 0.84174 0.84087
stp-minisat-v15 default sat ✅ 9.39599 9.39757
Yices2 Yices default sat ✅ 2.61923 2.61960
Z3 z3 4.4.0 default sat ✅ 7.25013 7.25290
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 16.42670 16.43400
ABC_glucose glucose sat ✅ 14.57460 14.58080
Boolector Boolector boolector sat ✅ 7.10262 7.10568
Boolector preprop boolector sat ✅ 7.11372 7.11771
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 9.98312 19.97030
MapleSTP MapleSTP default sat ✅ 549.15100 549.49700
MapleSTP-mt default sat ✅ 133.08900 528.13000
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 2.95306 2.95570
MinkeyRink Minkeyrink 2016 default sat ✅ 4.29123 12.00600
Q3B Q3B default unknown ❌ 2400.02000 7203.65000
STP stp-cms-exp-2016 default sat ✅ 97.78880 97.84670
stp-cms-mt-2016 default sat ✅ 15.18810 58.01620
stp-cms-st-2016 default sat ✅ 26.50010 26.51760
stp-minisat-st-2016 default sat ✅ 66.33330 66.36650
Yices2 Yices-2.4.2 default sat ✅ 1.83855 1.83954
Z3 z3-4.4.1 default sat ✅ 6.06469 6.06932
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.26563 1.26472
Boolector SMT17 final boolector sat ✅ 2.50685 2.50580
CVC4 CVC4-smtcomp2017-main default sat ✅ 16.95370 33.97460
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 2.67438 2.67475
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.30244 1.31322
Q3B Q3B default unknown ❌ 600.07800 1799.84000
STP stp_st default sat ✅ 13.14360 13.14210
stp_mt default sat ✅ 16.13310 57.54790
Yices2 Yices2-Main default sat ✅ 2.49599 2.49350
Z3 z3-4.5.0 default sat ✅ 9.96988 9.96785
SMT-COMP 2018 Boolector Boolector_default sat ✅ 1.31712 1.31676
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 7.86045 7.86082
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 3.62144 3.62192
MinkeyRink Minkeyrink MT_mt sat ✅ 1.64193 5.67546
Minkeyrink ST_st sat ✅ 3.14172 3.14173
STP STP-CMS-st-2018_default-no-stderr sat ✅ 15.76160 15.76190
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 16.99570 65.30700
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.35832 7.95829
Yices2 Yices 2.6.0_default sat ✅ 4.05324 4.05321
Z3 z3-4.7.1_default sat ✅ 9.30412 9.30366
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.34401 1.34393
Boolector Boolector-wrapped-sq_default sat ✅ 0.47017 0.47016
Poolector-wrapped-sq_default sat ✅ 0.59246 0.60523
CVC4 CVC4-sq-final_default sat ✅ 8.67621 8.67685
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.05000 1199.96000
MathSAT MathSAT5_default.sh sat ✅ 1.08758 2.14744
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.28468 0.28484
MinkeyRink Solver 2020.3_default sat ✅ 1.01592 3.16911
STP STP_default sat ✅ 1.48009 3.85517
STP ++ Mergsat v1_default sat ✅ 0.93808 0.93958
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.93315 0.93309
Z3 z3-4.8.8_default sat ✅ 4.58618 4.58638
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.32529 1.32527
Bitwuzla-wrapped_default sat ✅ 1.48104 1.48090
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 7.62496 7.62426
MathSAT MathSAT-5.6.8_default sat ✅ 2.04262 2.04236
STP STP 2022.4_default sat ✅ 0.99849 0.99536
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.39781 1.39762
Z3++BV z3++bv_0702_default sat ✅ 2.70858 5.35840
Z3 z3-4.8.17_default sat ✅ 2.51178 2.51358
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 3.37855 3.37874
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 7.74033 7.73758
STP STP 2022.4_default sat ✅ 0.92829 0.92826
STP 2022.4_default sat ✅ 0.92756 0.92746
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1255.31000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 4.77470 4.77444
Z3-Owl z3-Owl-Final_default sat ✅ 21.51310 21.51070
z3-Owl-Final_default sat ✅ 18.92530 18.92170
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.68575 0.58576
cvc5 cvc5 sat ✅ 6.98374 6.88390
SMTInterpol SMTInterpol unknown ❌ 1201.74946 1234.37721
STP STP sat ✅ 0.95994 0.86019
Yices2 Yices2 sat ✅ 0.74178 0.64170
Z3alpha Z3-alpha sat ✅ 8.33181 8.23076
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 1.02899 0.90100
Bitwuzla-MachBV-base sat ✅ 1.10810 0.98401
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.58423 0.46335
BVDecide bv_decide sat ✅ 12.08227 11.94472
bv_decide-nokernel sat ✅ 11.46573 11.32076
cvc5 cvc5 sat ✅ 11.10746 10.98780
SMTInterpol SMTInterpol unknown ❌ 1201.59068 1227.79627
Yices2 Yices2 sat ✅ 0.82078 0.69899
Z3alpha Z3-alpha sat ✅ 14.16154 55.30706
Z3 Z3-alpha-base sat ✅ 12.68468 12.56162
Z3-Owl-base sat ✅ 59.25372 59.12451
z3siri-base sat ✅ 13.00956 12.88935
Z3-Owl Z3-Owl sat ✅ 10.58858 10.46001