Benchmark

non-incremental/QF_BV/sage/app8/bench_494.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size41465
Compressed Size7435
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 41457
Compressed Size7474
Max. Term Depth110
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not134 and1
=198 let100 extract2 bvand7
bvor63 bvadd374 bvmul11 bvsub110
bvult99 bvule264 bvslt6 bvsle12
bvshl71 zero_extend147 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.55154 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.59083 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.59147 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.58363 —
abziz_portfolio_2012_solvers default sat ✅ 0.59118 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.60089 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 3.12567 —
Boolector-SMT-COMP-2011 default sat ✅ 2.99500 —
Boolector-SMT-COMP-2012 default sat ✅ 0.07149 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.33646 —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.15971 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.46599 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.11972 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.14724 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.21041 —
SONOLAR-SMT-COMP-2010 default sat ✅ 0.66837 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.51303 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.25014 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.19064 —
STP2-SMT-COMP-2012 default sat ✅ 0.28134 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 0.62973 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.57634 —
Z3-SMT-COMP-2011 default sat ✅ 0.57962 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.52036 0.51892
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.60508 1.17282
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.63390 1.23281
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.34337 0.34295
SMT-RAT SMT-RAT-final default sat ✅ 80.41290 80.43680
STP stp-cryptominisat4 default sat ✅ 0.25030 0.24896
stp-cmsat4-v15 default sat ✅ 0.27706 0.27596
stp-cmsat4-mt-v15 default unknown ❌ 0.20536 0.20397
stp-minisat-v15 default sat ✅ 0.20499 0.20397
Yices2 Yices default sat ✅ 0.03315 0.03199
Z3 z3 4.4.0 default sat ✅ 0.69931 0.69989
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.49884 0.49892
ABC_glucose glucose sat ✅ 3.91955 3.92199
Boolector Boolector boolector sat ✅ 0.96924 0.96975
Boolector preprop boolector sat ✅ 0.97673 0.97726
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.60727 1.18265
MapleSTP MapleSTP default sat ✅ 0.27114 0.27182
MapleSTP-mt default sat ✅ 0.30487 0.67642
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.27649 0.27749
MinkeyRink Minkeyrink 2016 default sat ✅ 1.23313 1.75266
Q3B Q3B default unknown ❌ 2400.02000 7204.29000
STP stp-cms-exp-2016 default sat ✅ 0.46337 0.46194
stp-cms-mt-2016 default sat ✅ 0.31976 0.74707
stp-cms-st-2016 default sat ✅ 0.30172 0.30180
stp-minisat-st-2016 default sat ✅ 0.22456 0.22461
Yices2 Yices-2.4.2 default sat ✅ 0.05013 0.05012
Z3 z3-4.4.1 default sat ✅ 0.58478 0.58678
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.22943 0.22876
Boolector SMT17 final boolector sat ✅ 1.05138 1.04747
CVC4 CVC4-smtcomp2017-main default sat ✅ 5.73950 1.52908
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.35300 0.34124
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.46868 0.42671
Q3B Q3B default unknown ❌ 600.07300 1799.45000
STP stp_st default sat ✅ 0.43788 0.43624
stp_mt default sat ✅ 0.45611 1.17786
Yices2 Yices2-Main default sat ✅ 0.04389 0.04273
Z3 z3-4.5.0 default sat ✅ 0.79426 0.79295
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.16606 0.16598
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.73904 0.73918
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.26689 0.26789
MinkeyRink Minkeyrink MT_mt sat ✅ 0.27151 0.46270
Minkeyrink ST_st sat ✅ 0.25394 0.25395
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.25098 0.25094
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.27347 0.48967
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.05000 1199.95000
Yices2 Yices 2.6.0_default sat ✅ 0.03933 0.03923
Z3 z3-4.7.1_default sat ✅ 0.79926 0.79902
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.23244 0.23244
Poolector-wrapped-sq_default sat ✅ 0.27384 0.25614
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 0.95052 0.95043
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.52387 0.52409
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.23143 0.37450
MinkeyRink ST-wrapped-sq_default sat ✅ 0.21083 0.21091
Par4 Par4-wrapped-sq_default sat ✅ 0.04805 0.00603
STP STP-2019-wrapped-sq_default sat ✅ 0.28487 0.28524
stp-mergesat-fixed-wrapped-sq_default sat ✅ 5.48326 5.48317
stp-minisat-wrapped-sq_default sat ✅ 0.27900 0.27919
stp-mt-wrapped-sq_default sat ✅ 0.30625 0.56061
stp-portfolio-fixed-wrapped-sq_default sat ✅ 5.65816 5.87593
stp-riss-wrapped-sq_default unknown ❌ 0.21522 0.21540
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.03915 0.03915
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.06697 0.06697
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.22555 0.22550
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.47294 0.47297
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.07156 0.07158
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.62378 0.62379
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.28512 0.28503
Boolector Boolector-wrapped-sq_default sat ✅ 0.25758 0.25758
Poolector-wrapped-sq_default sat ✅ 0.28832 0.23933
CVC4 CVC4-sq-final_default sat ✅ 0.51096 0.51118
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.10000 1199.98000
MathSAT MathSAT5_default.sh sat ✅ 0.14572 0.14570
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.19494 0.19518
MinkeyRink Solver 2020.3_default sat ✅ 0.21451 0.27433
STP STP_default sat ✅ 0.18458 0.28131
STP ++ Mergsat v1_default sat ✅ 0.14868 0.15028
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.05671 0.05662
Z3 z3-4.8.8_default sat ✅ 0.73166 0.73155
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.28342 0.28340
Bitwuzla-wrapped_default sat ✅ 0.24039 0.24029
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.58435 0.58239
MathSAT MathSAT-5.6.8_default sat ✅ 0.15249 0.15244
STP STP 2022.4_default sat ✅ 0.19610 0.19615
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.06131 0.06124
Z3++BV z3++bv_0702_default sat ✅ 0.37912 0.37904
Z3 z3-4.8.17_default sat ✅ 0.57525 0.57702
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.38096 0.28095
cvc5 cvc5 sat ✅ 0.94102 0.84074
SMTInterpol SMTInterpol unknown ❌ 1201.74052 1232.09425
STP STP sat ✅ 0.38134 0.28134
Yices2 Yices2 sat ✅ 0.28360 0.18378
Z3alpha Z3-alpha sat ✅ 0.43074 0.33123