Benchmark

non-incremental/QF_BV/sage/app1/bench_310.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size57903
Compressed Size7650
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 57895
Compressed Size7665
Max. Term Depth102
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite44 not67 and1
=165 let92 extract1 bvand28
bvor171 bvadd300 bvmul5 bvsub137
bvult166 bvule375 bvslt1 bvsle17
bvshl172 bvashr5 zero_extend272

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.67 (3/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default sat ✅ 4.07541 —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.37718 —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default sat ✅ 2.33587 —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 1.51002 1.50977
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 3.84352 7.65583
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 3.54199 7.05093
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 2.00559 2.00569
SMT-RAT SMT-RAT-final default sat ✅ 212.97900 213.02100
STP stp-cryptominisat4 default sat ✅ 5.74327 5.74413
stp-cmsat4-v15 default sat ✅ 23.19380 23.20250
stp-cmsat4-mt-v15 default unknown ❌ 0.41479 0.41394
stp-minisat-v15 default sat ✅ 2.60164 2.60160
Yices2 Yices default sat ✅ 0.04811 0.04699
Z3 z3 4.4.0 default sat ✅ 3.43968 3.44048
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.69483 0.69521
ABC_glucose glucose sat ✅ 8.33013 8.33419
Boolector Boolector boolector sat ✅ 3.02407 3.02570
Boolector preprop boolector sat ✅ 2.99670 2.99865
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.83903 5.65295
MapleSTP MapleSTP default sat ✅ 1.84807 1.84925
MapleSTP-mt default sat ✅ 2.21658 7.51438
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.56112 1.56280
MinkeyRink Minkeyrink 2016 default sat ✅ 2.11302 3.78402
Q3B Q3B default unknown ❌ 2400.03000 7203.28000
STP stp-cms-exp-2016 default sat ✅ 97.63970 97.64460
stp-cms-mt-2016 default sat ✅ 8.15054 29.90380
stp-cms-st-2016 default sat ✅ 25.36180 25.37080
stp-minisat-st-2016 default sat ✅ 15.83530 15.84460
Yices2 Yices-2.4.2 default sat ✅ 0.09674 0.09669
Z3 z3-4.4.1 default sat ✅ 5.23700 5.24127
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.29552 0.29463
Boolector SMT17 final boolector sat ✅ 1.83182 1.83101
CVC4 CVC4-smtcomp2017-main default sat ✅ 4.61910 9.21450
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.39594 1.39634
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.83477 0.80423
Q3B Q3B default unknown ❌ 600.10200 1799.83000
STP stp_st default sat ✅ 3.68949 3.68850
stp_mt default sat ✅ 12.89630 39.11740
Yices2 Yices2-Main default sat ✅ 0.09080 0.08976
Z3 z3-4.5.0 default sat ✅ 3.94142 3.94102
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.26729 0.26720
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 4.08617 4.08616
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.76396 1.76483
MinkeyRink Minkeyrink MT_mt sat ✅ 0.68671 1.89376
Minkeyrink ST_st sat ✅ 0.62012 0.61980
STP STP-CMS-st-2018_default-no-stderr sat ✅ 13.56960 13.56800
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 12.20720 47.21160
STP-Riss-st-2018_riss-no-stderr sat ✅ 14.70050 14.69930
Yices2 Yices 2.6.0_default sat ✅ 0.07327 0.07318
Z3 z3-4.7.1_default sat ✅ 7.24880 7.24812
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.39685 0.39683
Poolector-wrapped-sq_default sat ✅ 0.38279 0.35974
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 4.48871 8.86850
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 2.90839 2.90848
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.69445 1.96329
MinkeyRink ST-wrapped-sq_default sat ✅ 0.62319 0.62328
Par4 Par4-wrapped-sq_default sat ✅ 0.08514 0.00616
STP STP-2019-wrapped-sq_default sat ✅ 3.83924 3.83887
stp-mergesat-fixed-wrapped-sq_default sat ✅ 10.11090 10.11000
stp-minisat-wrapped-sq_default sat ✅ 2.13978 2.13975
stp-mt-wrapped-sq_default sat ✅ 6.83262 21.18410
stp-portfolio-fixed-wrapped-sq_default sat ✅ 10.52760 16.31050
stp-riss-wrapped-sq_default unknown ❌ 0.46450 0.46470
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.08028 0.08029
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.89875 0.89874
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 0.81769 0.81759
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 0.35754 0.35737
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.14022 0.14026
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 14.77340 14.77220
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.46627 0.46623
Boolector Boolector-wrapped-sq_default sat ✅ 0.40833 0.40833
Poolector-wrapped-sq_default sat ✅ 0.59055 0.99584
CVC4 CVC4-sq-final_default sat ✅ 6.15250 6.15189
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1199.80000
MathSAT MathSAT5_default.sh sat ✅ 0.29863 0.29856
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.28202 0.28218
MinkeyRink Solver 2020.3_default sat ✅ 0.44220 0.91707
STP STP_default sat ✅ 0.34398 0.69992
STP ++ Mergsat v1_default sat ✅ 0.49561 0.49723
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.73065 0.72996
Z3 z3-4.8.8_default sat ✅ 2.53710 2.53693
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.47026 0.47017
Bitwuzla-wrapped_default sat ✅ 0.43752 0.43612
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 2.97025 2.96820
MathSAT MathSAT-5.6.8_default sat ✅ 0.75984 0.75974
STP STP 2022.4_default sat ✅ 0.34564 0.34376
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.62072 0.61715
Z3++BV z3++bv_0702_default sat ✅ 1.76501 1.76488
Z3 z3-4.8.17_default sat ✅ 4.27917 4.28077
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.43882 0.31846
Bitwuzla-MachBV-base sat ✅ 0.49325 0.37568
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.55603 0.43844
BVDecide bv_decide sat ✅ 5.28177 5.13670
bv_decide-nokernel sat ✅ 4.95451 4.80100
cvc5 cvc5 sat ✅ 5.54673 5.41992
SMTInterpol SMTInterpol unknown ❌ 1201.58437 1227.44331
Yices2 Yices2 sat ✅ 1.03546 0.91306
Z3alpha Z3-alpha sat ✅ 3.53993 12.77709
Z3 Z3-alpha-base sat ✅ 1.70273 1.57431
Z3-Owl-base sat ✅ 6.15097 6.03529
z3siri-base sat ✅ 1.75543 1.63304
Z3-Owl Z3-Owl sat ✅ 7.39407 7.26405