Benchmark

non-incremental/QF_BV/sage/app1/bench_343.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size56601
Compressed Size7422
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 56593
Compressed Size7427
Max. Term Depth97
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite42 not65 and1
=161 let87 extract1 bvand26
bvor171 bvadd296 bvmul5 bvsub130
bvult158 bvule361 bvslt1 bvsle12
bvshl172 bvashr5 zero_extend270

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.67 (3/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default sat ✅ 3.16840 —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.27448 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default sat ✅ 5.17120 —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 1.46094 1.45978
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 3.73888 7.44487
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 3.64385 7.25990
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1.78151 1.78173
SMT-RAT SMT-RAT-final default sat ✅ 273.50800 273.59700
STP stp-cryptominisat4 default sat ✅ 5.52035 5.52016
stp-cmsat4-v15 default sat ✅ 20.38530 20.39190
stp-cmsat4-mt-v15 default unknown ❌ 0.40404 0.40294
stp-minisat-v15 default sat ✅ 3.25016 3.24950
Yices2 Yices default sat ✅ 0.04302 0.04199
Z3 z3 4.4.0 default sat ✅ 4.66375 4.66529
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.66809 0.66825
ABC_glucose glucose sat ✅ 7.91355 7.91844
Boolector Boolector boolector sat ✅ 1.61405 1.61269
Boolector preprop boolector sat ✅ 1.60795 1.60883
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 3.38220 6.73696
MapleSTP MapleSTP default sat ✅ 1.86499 1.86616
MapleSTP-mt default sat ✅ 2.14549 7.30505
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.30759 1.30971
MinkeyRink Minkeyrink 2016 default sat ✅ 1.99215 3.48894
Q3B Q3B default unknown ❌ 2400.02000 7203.63000
STP stp-cms-exp-2016 default sat ✅ 60.90090 60.92570
stp-cms-mt-2016 default sat ✅ 10.79850 41.79730
stp-cms-st-2016 default sat ✅ 11.36420 11.37070
stp-minisat-st-2016 default sat ✅ 17.55290 17.56210
Yices2 Yices-2.4.2 default sat ✅ 0.06463 0.06462
Z3 z3-4.4.1 default sat ✅ 4.03295 4.03649
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.40412 0.39956
Boolector SMT17 final boolector sat ✅ 1.68623 1.68483
CVC4 CVC4-smtcomp2017-main default sat ✅ 6.72094 13.42590
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.36630 1.36568
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.82456 0.80986
Q3B Q3B default unknown ❌ 600.04100 1786.00000
STP stp_st default sat ✅ 11.39790 11.39640
stp_mt default sat ✅ 11.78760 45.29830
Yices2 Yices2-Main default sat ✅ 0.05478 0.05438
Z3 z3-4.5.0 default sat ✅ 3.23865 3.23736
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.27778 0.27768
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.82070 3.82002
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.98847 1.98913
MinkeyRink Minkeyrink MT_mt sat ✅ 0.73021 2.09575
Minkeyrink ST_st sat ✅ 0.71533 0.71528
STP STP-CMS-st-2018_default-no-stderr sat ✅ 4.75308 4.75300
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.17204 11.30420
STP-Riss-st-2018_riss-no-stderr sat ✅ 4.02001 4.01980
Yices2 Yices 2.6.0_default sat ✅ 0.04925 0.04914
Z3 z3-4.7.1_default sat ✅ 5.63691 5.63563
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.47371 0.47371
Poolector-wrapped-sq_default sat ✅ 0.48604 0.41676
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 2.71120 2.71094
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 3.97611 3.97585
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.65451 1.83804
MinkeyRink ST-wrapped-sq_default sat ✅ 0.64697 0.64702
Par4 Par4-wrapped-sq_default sat ✅ 0.04236 0.00614
STP STP-2019-wrapped-sq_default sat ✅ 4.54792 4.54828
stp-mergesat-fixed-wrapped-sq_default sat ✅ 1.42044 1.42064
stp-minisat-wrapped-sq_default sat ✅ 2.22845 2.22846
stp-mt-wrapped-sq_default sat ✅ 3.23412 11.40980
stp-portfolio-fixed-wrapped-sq_default sat ✅ 4.74430 7.81292
stp-riss-wrapped-sq_default unknown ❌ 0.45988 0.46006
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.03932 0.03932
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.52239 0.52238
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.92726 0.92723
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.24156 0.24157
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.13032 0.13029
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 7.46312 7.46242
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.45530 0.45527
MathSAT mathsat-5.6.6_default sat ✅ 0.23158 0.23155
STP STP 2021.0_default sat ✅ 0.24183 0.32289
Z3 z3-4.8.11_default sat ✅ 1.63038 1.63030
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.51966 0.51954
Bitwuzla-wrapped_default sat ✅ 0.54236 0.54233
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 3.07528 3.07541
MathSAT MathSAT-5.6.8_default sat ✅ 0.34504 0.34499
STP STP 2022.4_default sat ✅ 0.31347 0.31349
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.72866 0.72794
Z3++BV z3++bv_0702_default sat ✅ 0.58947 0.58938
Z3 z3-4.8.17_default sat ✅ 1.65421 1.65472
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.99528 0.99100
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 2.66243 2.66272
STP STP 2022.4_default sat ✅ 0.30008 0.30012
STP 2022.4_default sat ✅ 0.30161 0.30165
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1256.80000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.03962 0.03958
Z3-Owl z3-Owl-Final_default sat ✅ 15.85750 15.85680
z3-Owl-Final_default sat ✅ 16.67560 16.66880
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.52355 0.40210
Bitwuzla-MachBV-base sat ✅ 0.46701 0.33532
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.55070 0.43487
BVDecide bv_decide sat ✅ 5.09082 4.93328
bv_decide-nokernel sat ✅ 4.75698 4.58905
cvc5 cvc5 sat ✅ 2.68850 2.55641
SMTInterpol SMTInterpol unknown ❌ 1201.62525 1227.25730
Yices2 Yices2 sat ✅ 0.75294 0.61983
Z3alpha Z3-alpha sat ✅ 6.24861 23.52531
Z3 Z3-alpha-base sat ✅ 2.46932 2.35254
Z3-Owl-base sat ✅ 9.70247 9.58198
z3siri-base sat ✅ 2.55323 2.42821
Z3-Owl Z3-Owl sat ✅ 6.87371 6.73970