Benchmark

non-incremental/QF_BV/sage/app9/bench_2979.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size49727
Compressed Size8860
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 49719
Compressed Size8856
Max. Term Depth156
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not167 and1
=238 let146 extract3 bvand9
bvor63 bvadd479 bvmul11 bvsub131
bvult149 bvule332 bvslt6 bvsle11
bvshl71 zero_extend147 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.77497 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.58034 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.57430 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.57603 —
abziz_portfolio_2012_solvers default sat ✅ 0.57080 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.59682 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.14973 —
Boolector-SMT-COMP-2011 default sat ✅ 4.84816 —
Boolector-SMT-COMP-2012 default sat ✅ 0.13467 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.44162 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.55890 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.16214 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.25950 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.15874 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.14595 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.27012 —
SONOLAR-SMT-COMP-2010 default sat ✅ 0.98415 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.71727 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.33362 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.23302 —
STP2-SMT-COMP-2012 default sat ✅ 0.35947 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.50457 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.57858 —
Z3-SMT-COMP-2011 default sat ✅ 0.56926 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.70939 0.70889
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.75818 1.47678
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.77873 1.51877
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.37936 0.37794
SMT-RAT SMT-RAT-final default sat ✅ 109.76700 109.79100
STP stp-cryptominisat4 default sat ✅ 0.28255 0.28196
stp-cmsat4-v15 default sat ✅ 0.33455 0.33395
stp-cmsat4-mt-v15 default unknown ❌ 0.23693 0.23596
stp-minisat-v15 default sat ✅ 0.24412 0.24296
Yices2 Yices default sat ✅ 0.04871 0.04799
Z3 z3 4.4.0 default sat ✅ 0.66951 0.66990
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.63298 0.63309
ABC_glucose glucose sat ✅ 5.64574 5.64877
Boolector Boolector boolector sat ✅ 1.36023 1.36149
Boolector preprop boolector sat ✅ 1.37394 1.37483
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.75374 1.46884
MapleSTP MapleSTP default sat ✅ 0.36288 0.36304
MapleSTP-mt default sat ✅ 0.39885 0.92977
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.36502 0.36619
MinkeyRink Minkeyrink 2016 default sat ✅ 1.83464 2.66541
Q3B Q3B default unknown ❌ 2400.12000 7204.10000
STP stp-cms-exp-2016 default sat ✅ 0.52915 0.52955
stp-cms-mt-2016 default sat ✅ 0.41339 1.01400
stp-cms-st-2016 default sat ✅ 0.38050 0.38071
stp-minisat-st-2016 default sat ✅ 0.32156 0.32172
Yices2 Yices-2.4.2 default sat ✅ 0.04782 0.04781
Z3 z3-4.4.1 default sat ✅ 0.67117 0.67284
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.30725 0.30621
Boolector SMT17 final boolector sat ✅ 1.55660 1.55671
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.83040 1.62213
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.34176 0.34274
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.55775 0.55468
Q3B Q3B default unknown ❌ 600.02900 1799.70000
STP stp_st default sat ✅ 0.66279 0.66220
stp_mt default sat ✅ 0.75683 2.04790
Yices2 Yices2-Main default sat ✅ 0.04268 0.04176
Z3 z3-4.5.0 default sat ✅ 0.82065 0.81956
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.25051 0.25040
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.81721 0.81739
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.32984 0.33094
MinkeyRink Minkeyrink MT_mt sat ✅ 0.34531 0.50020
Minkeyrink ST_st sat ✅ 0.31976 0.31978
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.51736 0.73703
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.47139 1.07141
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.03366 1.03366
Yices2 Yices 2.6.0_default sat ✅ 0.03819 0.03812
Z3 z3-4.7.1_default sat ✅ 0.74511 0.74500
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.42023 0.42007
MathSAT mathsat-5.6.6_default sat ✅ 0.16486 0.16481
STP STP 2021.0_default sat ✅ 0.24547 0.36873
Z3 z3-4.8.11_default sat ✅ 0.76856 0.76848
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.37876 0.25934
Bitwuzla-MachBV-base sat ✅ 0.39063 0.27208
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.55124 0.43091
BVDecide bv_decide sat ✅ 6.46813 6.29268
bv_decide-nokernel sat ✅ 6.16127 6.00279
cvc5 cvc5 sat ✅ 0.74826 0.62152
SMTInterpol SMTInterpol unknown ❌ 1201.48511 1225.96435
Yices2 Yices2 sat ✅ 0.37054 0.24696
Z3alpha Z3-alpha sat ✅ 1.03703 2.69167
Z3 Z3-alpha-base sat ✅ 2.98699 2.85939
Z3-Owl-base sat ✅ 11.25733 11.12606
z3siri-base sat ✅ 3.05714 2.92555
Z3-Owl Z3-Owl sat ✅ 5.16392 5.03710