Benchmark

non-incremental/QF_BV/sage/app12/bench_3578.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size21697
Compressed Size2629
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 21689
Compressed Size2644
Max. Term Depth39
Asserts 1
Declared Functions0
Declared Constants142
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite22 not59 and1
=113 let29 bvor66 bvadd73
bvsub56 bvult67 bvule52 bvslt1
bvshl66 zero_extend150

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.19495 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.13820 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.13617 —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default sat ✅ 0.13724 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.13990 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 5.76126 —
Boolector-SMT-COMP-2011 default sat ✅ 2.72145 —
Boolector-SMT-COMP-2012 default sat ✅ 0.02683 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 8.54641 —
CVC3-SMT-COMP-2011 default sat ✅ 7.64473 —
CVC3-SMT-COMP-2012 default sat ✅ 7.85112 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.19792 —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.12092 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.56172 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.10251 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.10858 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.09210 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.10386 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.14067 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.10036 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.06865 —
STP2-SMT-COMP-2012 default sat ✅ 0.14717 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.25543 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.13421 —
Z3-SMT-COMP-2011 default sat ✅ 0.13191 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 3.58327 3.58345
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.28078 0.53492
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.26622 0.50892
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.47954 0.47893
SMT-RAT SMT-RAT-final default sat ✅ 150.95200 151.00200
STP stp-cryptominisat4 default sat ✅ 0.12481 0.12398
stp-cmsat4-v15 default sat ✅ 0.11562 0.11498
stp-cmsat4-mt-v15 default unknown ❌ 0.09365 0.09198
stp-minisat-v15 default sat ✅ 0.10087 0.09998
Yices2 Yices default sat ✅ 0.01248 0.01200
Z3 z3 4.4.0 default sat ✅ 0.14222 0.14198
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 4.06506 4.04114
ABC_glucose glucose sat ✅ 1.79091 1.79204
Boolector Boolector boolector sat ✅ 1.96822 1.96930
Boolector preprop boolector sat ✅ 1.88338 1.88442
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.35847 0.69381
MapleSTP MapleSTP default sat ✅ 0.20419 0.20428
MapleSTP-mt default sat ✅ 0.22873 0.59205
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.47084 0.47208
MinkeyRink Minkeyrink 2016 default sat ✅ 0.31908 0.50118
Q3B Q3B default unknown ❌ 2400.02000 7203.58000
STP stp-cms-exp-2016 default sat ✅ 0.24798 0.24808
stp-cms-mt-2016 default sat ✅ 0.22826 0.59094
stp-cms-st-2016 default sat ✅ 0.21941 0.21951
stp-minisat-st-2016 default sat ✅ 0.35252 0.35263
Yices2 Yices-2.4.2 default sat ✅ 0.01391 0.01387
Z3 z3-4.4.1 default sat ✅ 0.15564 0.15697
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.66680 0.66555
Boolector SMT17 final boolector sat ✅ 0.66416 0.66333
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.35485 0.67076
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.51712 0.51679
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.17152 0.14072
Q3B Q3B default unknown ❌ 600.03400 1799.78000
STP stp_st default sat ✅ 1.01974 1.01608
stp_mt default sat ✅ 1.11724 3.26049
Yices2 Yices2-Main default sat ✅ 0.01353 0.01276
Z3 z3-4.5.0 default sat ✅ 0.36809 0.36786
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.53418 0.53405
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.55719 0.55728
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.56681 0.56783
MinkeyRink Minkeyrink MT_mt sat ✅ 0.07447 0.09382
Minkeyrink ST_st sat ✅ 0.06918 0.06935
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.42186 0.42157
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.48742 0.87111
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.35560 1.35556
Yices2 Yices 2.6.0_default sat ✅ 0.01455 0.01445
Z3 z3-4.7.1_default sat ✅ 0.33420 0.33408
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.96675 0.96660
Boolector Boolector-wrapped-sq_default sat ✅ 0.67340 0.67338
Poolector-wrapped-sq_default sat ✅ 0.68134 2.25000
CVC4 CVC4-sq-final_default sat ✅ 0.25500 0.25529
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1199.93000
MathSAT MathSAT5_default.sh sat ✅ 0.12665 0.12661
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.06582 0.06609
MinkeyRink Solver 2020.3_default sat ✅ 0.07060 0.08406
STP STP_default sat ✅ 0.12009 0.22265
STP ++ Mergsat v1_default sat ✅ 0.16187 0.16352
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.03941 0.03932
Z3 z3-4.8.8_default sat ✅ 0.39821 0.39813
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.04658 0.04653
MathSAT mathsat-5.6.6_default sat ✅ 0.23112 0.23098
STP STP 2021.0_default sat ✅ 0.12147 0.23010
Z3 z3-4.8.11_default sat ✅ 0.45223 0.45212
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.31469 0.21478
cvc5 cvc5 sat ✅ 0.39937 0.29994
SMTInterpol SMTInterpol unknown ❌ 1201.72090 1244.29098
STP STP sat ✅ 0.44285 0.34270
Yices2 Yices2 sat ✅ 0.26078 0.16012
Z3alpha Z3-alpha sat ✅ 0.35892 0.25920
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.29632 0.17367
Bitwuzla-MachBV-base sat ✅ 0.34518 0.21430
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.38799 0.26739
BVDecide bv_decide sat ✅ 2.97269 2.80272
bv_decide-nokernel sat ✅ 2.85148 2.72843
cvc5 cvc5 sat ✅ 0.38825 0.26448
SMTInterpol SMTInterpol unknown ❌ 1201.77190 1231.75795
Yices2 Yices2 sat ✅ 0.29732 0.16540
Z3alpha Z3-alpha sat ✅ 0.55731 0.85990
Z3 Z3-alpha-base sat ✅ 1.01562 0.89459
Z3-Owl-base sat ✅ 3.29072 3.17383
z3siri-base sat ✅ 1.01063 0.89521
Z3-Owl Z3-Owl sat ✅ 4.59665 4.46543