Benchmark

non-incremental/QF_BV/sage/app1/bench_421.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size53918
Compressed Size6882
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 53910
Compressed Size6901
Max. Term Depth82
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite37 not65 and1
=159 let72 extract1 bvand24
bvor171 bvadd285 bvmul5 bvsub113
bvult144 bvule329 bvslt1 bvsle7
bvshl172 bvashr5 zero_extend265

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.77396 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 2.34380 —
abziz_portfolio_2011_solvers_2 default sat ✅ 2.43144 —
abziz_portfolio_2012_minfeatures default sat ✅ 2.43583 —
abziz_portfolio_2012_solvers default sat ✅ 2.37082 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 2.42874 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.29553 —
Boolector-SMT-COMP-2011 default sat ✅ 3.32452 —
Boolector-SMT-COMP-2012 default sat ✅ 0.08458 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 129.09600 —
CVC3-SMT-COMP-2011 default sat ✅ 118.52000 —
CVC3-SMT-COMP-2012 default sat ✅ 121.30400 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.99938 —
CVC4-SMT-EVAL-2013 default sat ✅ 1.14683 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 1.08872 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 1.28911 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.22709 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.24297 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.97523 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.52433 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.04083 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.70398 —
STP STP2-SMT-COMP-2011 default sat ✅ 2.23177 —
STP2-SMT-COMP-2012 default sat ✅ 1.89409 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 5.70190 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 3.87158 —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 1.44682 1.44678
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.25152 4.46732
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 5.52724 11.03930
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 2.05448 2.05369
SMT-RAT SMT-RAT-final default sat ✅ 148.99400 149.06600
STP stp-cryptominisat4 default sat ✅ 5.88996 5.89010
stp-cmsat4-v15 default sat ✅ 12.46590 12.46810
stp-cmsat4-mt-v15 default unknown ❌ 0.40160 0.40094
stp-minisat-v15 default sat ✅ 1.77370 1.77273
Yices2 Yices default sat ✅ 0.03127 0.03000
Z3 z3 4.4.0 default sat ✅ 5.07430 5.07623
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.61478 0.61465
ABC_glucose glucose sat ✅ 7.41846 7.42202
Boolector Boolector boolector sat ✅ 1.57345 1.57438
Boolector preprop boolector sat ✅ 1.56724 1.56808
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 2.56753 5.10599
MapleSTP MapleSTP default sat ✅ 2.25676 2.25804
MapleSTP-mt default sat ✅ 2.66688 9.37853
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.24624 1.24783
MinkeyRink Minkeyrink 2016 default sat ✅ 1.91612 3.37920
Q3B Q3B default unknown ❌ 2400.03000 7203.95000
STP stp-cms-exp-2016 default sat ✅ 41.90570 41.90820
stp-cms-mt-2016 default sat ✅ 9.64056 36.52910
stp-cms-st-2016 default sat ✅ 19.38600 19.39870
stp-minisat-st-2016 default sat ✅ 18.67700 18.68730
Yices2 Yices-2.4.2 default sat ✅ 0.03590 0.03589
Z3 z3-4.4.1 default sat ✅ 4.50165 4.50285
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.35239 0.34928
Boolector SMT17 final boolector sat ✅ 1.69138 1.69111
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.19182 6.35494
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.45515 1.45516
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.66261 0.65359
Q3B Q3B default unknown ❌ 600.05000 1799.81000
STP stp_st default sat ✅ 1.03971 1.03815
stp_mt default sat ✅ 1.62005 3.32435
Yices2 Yices2-Main default sat ✅ 0.03085 0.03084
Z3 z3-4.5.0 default sat ✅ 3.39011 3.38963
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.24071 0.24066
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 2.43861 2.43836
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.58968 1.59055
MinkeyRink Minkeyrink MT_mt sat ✅ 0.67863 1.89109
Minkeyrink ST_st sat ✅ 0.61237 0.61242
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.98847 2.98820
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 2.65041 9.21251
STP-Riss-st-2018_riss-no-stderr sat ✅ 3.50370 3.50340
Yices2 Yices 2.6.0_default sat ✅ 0.03139 0.03128
Z3 z3-4.7.1_default sat ✅ 3.09767 3.09720
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.36371 0.36361
Boolector Boolector-wrapped-sq_default sat ✅ 0.31852 0.31852
Poolector-wrapped-sq_default sat ✅ 0.38065 0.35652
CVC4 CVC4-sq-final_default sat ✅ 2.63516 2.63536
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.63000
MathSAT MathSAT5_default.sh sat ✅ 0.30678 0.30667
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.25548 0.25572
MinkeyRink Solver 2020.3_default sat ✅ 0.27666 0.34426
STP STP_default sat ✅ 0.21602 0.27452
STP ++ Mergsat v1_default sat ✅ 0.18724 0.18900
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.36337 0.36330
Z3 z3-4.8.8_default sat ✅ 1.61738 1.61623
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.39537 0.39534
MathSAT mathsat-5.6.6_default sat ✅ 0.30601 0.30592
STP STP 2021.0_default sat ✅ 0.28432 0.54264
Z3 z3-4.8.11_default sat ✅ 2.67839 2.67831
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.45857 0.35892
cvc5 cvc5 sat ✅ 3.22789 3.12746
SMTInterpol SMTInterpol unknown ❌ 1201.71792 1232.64959
STP STP sat ✅ 0.44755 0.34758
Yices2 Yices2 sat ✅ 0.43378 0.33362
Z3alpha Z3-alpha sat ✅ 1.70091 1.60095
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.32564 0.20845
Bitwuzla-MachBV-base sat ✅ 0.42997 0.31343
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.56937 0.43978
BVDecide bv_decide sat ✅ 4.83321 4.69299
bv_decide-nokernel sat ✅ 4.46824 4.32741
cvc5 cvc5 sat ✅ 2.47932 2.35389
SMTInterpol SMTInterpol unknown ❌ 1201.79029 1227.49542
Yices2 Yices2 sat ✅ 1.00738 0.89019
Z3alpha Z3-alpha sat ✅ 4.06633 13.49449
Z3 Z3-alpha-base sat ✅ 3.32804 3.21147
Z3-Owl-base sat ✅ 13.34609 13.22362
z3siri-base sat ✅ 3.37595 3.26131
Z3-Owl Z3-Owl sat ✅ 7.50865 7.38283