Benchmark

non-incremental/QF_BV/sage/app8/bench_223.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size49054
Compressed Size8642
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 49046
Compressed Size8643
Max. Term Depth148
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not166 and1
=235 let138 extract3 bvand9
bvor63 bvadd474 bvmul11 bvsub130
bvult144 bvule329 bvslt6 bvsle11
bvshl71 zero_extend147 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.78699 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.62161 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.59816 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.60723 —
abziz_portfolio_2012_solvers default sat ✅ 0.60955 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.62716 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.16731 —
Boolector-SMT-COMP-2011 default sat ✅ 4.59599 —
Boolector-SMT-COMP-2012 default sat ✅ 0.13040 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.44128 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.58749 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.16502 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.28635 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.16182 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.15391 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.27141 —
SONOLAR-SMT-COMP-2010 default sat ✅ 0.91495 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.70696 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.36005 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.23478 —
STP2-SMT-COMP-2012 default sat ✅ 0.42942 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.64258 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.61245 —
Z3-SMT-COMP-2011 default sat ✅ 0.60150 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.78419 0.78288
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.75916 1.47877
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.78076 1.52177
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.40004 0.39894
SMT-RAT SMT-RAT-final default sat ✅ 124.12500 124.17500
STP stp-cryptominisat4 default sat ✅ 0.27572 0.27496
stp-cmsat4-v15 default sat ✅ 0.37839 0.37694
stp-cmsat4-mt-v15 default unknown ❌ 0.23044 0.22896
stp-minisat-v15 default sat ✅ 0.23346 0.23196
Yices2 Yices default sat ✅ 0.04730 0.04599
Z3 z3 4.4.0 default sat ✅ 0.74372 0.74389
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.68087 0.67760
ABC_glucose glucose sat ✅ 5.59359 5.59766
Boolector Boolector boolector sat ✅ 1.47213 1.47127
Boolector preprop boolector sat ✅ 1.48414 1.48496
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.70939 1.38180
MapleSTP MapleSTP default sat ✅ 0.37320 0.37339
MapleSTP-mt default sat ✅ 0.40331 0.98127
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.35013 0.35126
MinkeyRink Minkeyrink 2016 default sat ✅ 1.82795 2.69108
Q3B Q3B default unknown ❌ 2400.04000 7204.29000
STP stp-cms-exp-2016 default sat ✅ 0.53988 0.54017
stp-cms-mt-2016 default sat ✅ 0.44096 1.13663
stp-cms-st-2016 default sat ✅ 0.39343 0.39361
stp-minisat-st-2016 default sat ✅ 0.34409 0.34418
Yices2 Yices-2.4.2 default sat ✅ 0.03240 0.03234
Z3 z3-4.4.1 default sat ✅ 0.81495 0.81702
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.31487 0.31352
Boolector SMT17 final boolector sat ✅ 1.62640 1.62619
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.84094 1.64459
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.41591 0.41228
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.62562 0.61579
Q3B Q3B default unknown ❌ 600.04800 1787.05000
STP stp_st default sat ✅ 0.70495 0.70389
stp_mt default sat ✅ 0.99204 2.17951
Yices2 Yices2-Main default sat ✅ 0.04221 0.04132
Z3 z3-4.5.0 default sat ✅ 0.95259 0.94466
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.24360 0.24346
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.81654 0.81664
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.33793 0.33898
MinkeyRink Minkeyrink MT_mt sat ✅ 0.35161 0.54452
Minkeyrink ST_st sat ✅ 0.32867 0.32869
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.38453 0.38435
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.41972 0.85503
STP-Riss-st-2018_riss-no-stderr sat ✅ 0.96274 0.96260
Yices2 Yices 2.6.0_default sat ✅ 0.03356 0.03347
Z3 z3-4.7.1_default sat ✅ 1.02944 1.02926
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.39277 0.39256
Bitwuzla-wrapped_default sat ✅ 0.43442 0.43433
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.75162 0.75215
MathSAT MathSAT-5.6.8_default sat ✅ 0.22612 0.22606
STP STP 2022.4_default sat ✅ 0.25900 0.25898
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.06207 0.06204
Z3++BV z3++bv_0702_default sat ✅ 0.38810 0.38801
Z3 z3-4.8.17_default sat ✅ 0.89379 0.89036
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.36808 0.24559
Bitwuzla-MachBV-base sat ✅ 0.40126 0.28316
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.56274 0.44110
BVDecide bv_decide sat ✅ 6.41286 6.26722
bv_decide-nokernel sat ✅ 6.26733 6.10799
cvc5 cvc5 sat ✅ 0.95530 0.84139
SMTInterpol SMTInterpol unknown ❌ 1201.38781 1224.73820
Yices2 Yices2 sat ✅ 0.39609 0.26416
Z3alpha Z3-alpha sat ✅ 1.10926 2.95927
Z3 Z3-alpha-base sat ✅ 1.16540 1.04259
Z3-Owl-base sat ✅ 3.41312 3.28294
z3siri-base sat ✅ 1.24233 1.10653
Z3-Owl Z3-Owl sat ✅ 5.51875 5.38428