Benchmark

non-incremental/QF_BV/sage/app12/bench_3591.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size21560
Compressed Size2616
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 21552
Compressed Size2629
Max. Term Depth39
Asserts 1
Declared Functions0
Declared Constants142
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite21 not59 and1
=113 let29 bvor66 bvadd73
bvsub55 bvult64 bvule52 bvslt1
bvshl66 zero_extend149

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.20193 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.15407 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.15139 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.15133 —
abziz_portfolio_2012_solvers default sat ✅ 0.15148 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.15075 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 5.39789 —
Boolector-SMT-COMP-2011 default sat ✅ 2.61888 —
Boolector-SMT-COMP-2012 default sat ✅ 0.02718 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 10.78400 —
CVC3-SMT-COMP-2011 default sat ✅ 9.66521 —
CVC3-SMT-COMP-2012 default sat ✅ 9.95965 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.14737 —
CVC4-SMT-EVAL-2013 default sat ✅ 17.49160 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.11224 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.59341 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.10211 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.10453 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.09597 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.04813 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.13342 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.10432 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.07141 —
STP2-SMT-COMP-2012 default sat ✅ 0.15964 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.37076 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.14850 —
Z3-SMT-COMP-2011 default sat ✅ 0.15301 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 2.20297 2.20266
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.30926 0.58991
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.29133 0.55791
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.52643 0.52592
SMT-RAT SMT-RAT-final default sat ✅ 156.82800 156.86700
STP stp-cryptominisat4 default sat ✅ 0.12900 0.12798
stp-cmsat4-v15 default sat ✅ 0.13536 0.13398
stp-cmsat4-mt-v15 default unknown ❌ 0.09378 0.09298
stp-minisat-v15 default sat ✅ 0.10946 0.10898
Yices2 Yices default sat ✅ 0.01199 0.01100
Z3 z3 4.4.0 default sat ✅ 0.16902 0.16897
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 4.12263 4.09748
ABC_glucose glucose sat ✅ 1.81885 1.80822
Boolector Boolector boolector sat ✅ 3.28379 3.28566
Boolector preprop boolector sat ✅ 3.18948 3.19125
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.42381 0.82236
MapleSTP MapleSTP default sat ✅ 0.21532 0.21544
MapleSTP-mt default sat ✅ 0.24287 0.62422
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.61267 0.61394
MinkeyRink Minkeyrink 2016 default sat ✅ 0.32754 0.50401
Q3B Q3B default unknown ❌ 2400.03000 7203.48000
STP stp-cms-exp-2016 default sat ✅ 0.24704 0.24708
stp-cms-mt-2016 default sat ✅ 0.23658 0.60916
stp-cms-st-2016 default sat ✅ 0.21435 0.21497
stp-minisat-st-2016 default sat ✅ 0.15200 0.15205
Yices2 Yices-2.4.2 default sat ✅ 0.01322 0.01314
Z3 z3-4.4.1 default sat ✅ 0.15851 0.15979
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.21305 1.21159
Boolector SMT17 final boolector sat ✅ 3.28888 3.28750
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.32335 0.62008
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.38013 0.38107
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.17135 0.14223
Q3B Q3B default unknown ❌ 600.05200 1794.63000
STP stp_st default sat ✅ 0.43367 0.43235
stp_mt default sat ✅ 0.62236 1.14797
Yices2 Yices2-Main default sat ✅ 0.01375 0.01264
Z3 z3-4.5.0 default sat ✅ 0.38897 0.38823
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.53679 0.53643
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.57576 0.57587
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.45542 0.45623
MinkeyRink Minkeyrink MT_mt sat ✅ 0.07626 0.09533
Minkeyrink ST_st sat ✅ 0.07022 0.07042
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.41960 0.41952
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.47805 0.83710
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.35825 1.35796
Yices2 Yices 2.6.0_default sat ✅ 0.01530 0.01461
Z3 z3-4.7.1_default sat ✅ 0.41910 0.41903
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.98788 0.98778
Boolector Boolector-wrapped-sq_default sat ✅ 0.92915 0.92916
Poolector-wrapped-sq_default sat ✅ 0.68092 2.32000
CVC4 CVC4-sq-final_default sat ✅ 0.19777 0.19806
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.01000 1199.66000
MathSAT MathSAT5_default.sh sat ✅ 0.12721 0.12713
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.06673 0.06696
MinkeyRink Solver 2020.3_default sat ✅ 0.07441 0.08872
STP STP_default sat ✅ 0.08248 0.12522
STP ++ Mergsat v1_default sat ✅ 0.06769 0.06932
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.02238 0.01452
Z3 z3-4.8.8_default sat ✅ 0.37412 0.37404
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.29732 0.19774
cvc5 cvc5 sat ✅ 0.33335 0.23354
SMTInterpol SMTInterpol unknown ❌ 1201.72285 1243.00215
STP STP sat ✅ 0.39198 0.29212
Yices2 Yices2 sat ✅ 0.25199 0.15206
Z3alpha Z3-alpha sat ✅ 0.41726 0.31732
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.30960 0.17632
Bitwuzla-MachBV-base sat ✅ 0.29819 0.18102
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.38612 0.26605
BVDecide bv_decide sat ✅ 3.02629 2.85911
bv_decide-nokernel sat ✅ 2.95177 2.78726
cvc5 cvc5 sat ✅ 0.42329 0.30568
SMTInterpol SMTInterpol unknown ❌ 1201.38512 1227.79841
Yices2 Yices2 sat ✅ 0.29033 0.16788
Z3alpha Z3-alpha sat ✅ 0.54531 0.80357
Z3 Z3-alpha-base sat ✅ 1.05437 0.91894
Z3-Owl-base sat ✅ 3.33451 3.21074
z3siri-base sat ✅ 1.05946 0.93605
Z3-Owl Z3-Owl sat ✅ 4.72127 4.58081