Benchmark

non-incremental/QF_BV/sage/app8/bench_397.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size43699
Compressed Size7797
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 43691
Compressed Size7799
Max. Term Depth128
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not144 and1
=211 let118 extract3 bvand9
bvor63 bvadd398 bvmul11 bvsub115
bvult115 bvule279 bvslt6 bvsle11
bvshl71 zero_extend147 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 0.65687 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.82187 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.80562 —
abziz_portfolio_2012_minfeatures default sat ✅ 0.80678 —
abziz_portfolio_2012_solvers default sat ✅ 0.80745 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 0.80478 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 5.76253 —
Boolector-SMT-COMP-2011 default sat ✅ 3.93300 —
Boolector-SMT-COMP-2012 default sat ✅ 0.62409 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.32768 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.45127 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.12338 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 0.22192 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.12164 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.11399 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.20573 —
SONOLAR-SMT-COMP-2010 default sat ✅ 2.72671 —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.64057 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.30861 —
STP STP2-SMT-COMP-2011 default sat ✅ 0.22869 —
STP2-SMT-COMP-2012 default sat ✅ 0.33641 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 2.15573 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.96925 —
Z3-SMT-COMP-2011 default sat ✅ 0.80433 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.89667 0.89586
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.62579 1.21281
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.60729 1.17882
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.32939 0.32895
SMT-RAT SMT-RAT-final default unsat ✅ 126.79700 126.84900
STP stp-cryptominisat4 default unsat ✅ 0.38413 0.38294
stp-cmsat4-v15 default unsat ✅ 0.36947 0.36794
stp-cmsat4-mt-v15 default unknown ❌ 0.21179 0.21097
stp-minisat-v15 default unsat ✅ 0.28230 0.28096
Yices2 Yices default unsat ✅ 0.02295 0.02200
Z3 z3 4.4.0 default unsat ✅ 3.92009 3.92140
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.77378 0.76870
ABC_glucose glucose unsat ✅ 4.62525 4.62789
Boolector Boolector boolector unsat ✅ 1.05663 1.05274
Boolector preprop boolector unsat ✅ 1.06143 1.05923
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.57843 1.11239
MapleSTP MapleSTP default unsat ✅ 0.37613 0.37022
MapleSTP-mt default unsat ✅ 0.41318 1.05037
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.32037 0.31575
MinkeyRink Minkeyrink 2016 default unsat ✅ 1.48689 2.28182
Q3B Q3B default unsat ✅ 1460.30000 4382.97000
STP stp-cms-exp-2016 default unsat ✅ 0.48803 0.48823
stp-cms-mt-2016 default unsat ✅ 0.41553 1.06778
stp-cms-st-2016 default unsat ✅ 0.38104 0.37537
stp-minisat-st-2016 default unsat ✅ 0.87125 0.87170
Yices2 Yices-2.4.2 default unsat ✅ 0.02572 0.02565
Z3 z3-4.4.1 default unsat ✅ 0.71759 0.71650
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.25496 0.25429
Boolector SMT17 final boolector unsat ✅ 1.21981 1.21292
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.79090 1.54251
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.28349 0.28364
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.54138 0.50731
Q3B Q3B default unknown ❌ 600.03500 1799.25000
STP stp_st default unsat ✅ 1.76141 1.76040
stp_mt default unsat ✅ 1.81276 6.44721
Yices2 Yices2-Main default unsat ✅ 0.03458 0.03371
Z3 z3-4.5.0 default unsat ✅ 2.27459 2.27402
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.28887 0.28873
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.70569 0.70580
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.28596 0.28704
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.33871 0.66521
Minkeyrink ST_st unsat ✅ 0.32166 0.32177
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 1.50059 1.50050
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.99702 3.31174
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.60437 1.60448
Yices2 Yices 2.6.0_default unsat ✅ 0.03020 0.03014
Z3 z3-4.7.1_default unsat ✅ 4.87474 4.87460
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.39278 0.39276
Poolector-wrapped-sq_default unsat ✅ 0.38727 0.31816
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.01314 1.01321
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.47334 0.47354
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.31692 0.67091
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.29684 0.29692
Par4 Par4-wrapped-sq_default unsat ✅ 0.03291 0.00590
STP STP-2019-wrapped-sq_default unsat ✅ 1.42168 1.42196
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 6.77378 6.77283
stp-minisat-wrapped-sq_default unsat ✅ 1.51720 1.51734
stp-mt-wrapped-sq_default unsat ✅ 1.37610 4.77283
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 6.95105 9.58152
stp-riss-wrapped-sq_default unknown ❌ 0.21344 0.21365
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.02658 0.02655
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.04876 0.04876
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.04945 0.04949
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 1630.92000 1630.84000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.07275 0.07276
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.92002 0.91997
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.42545 0.42540
Boolector Boolector-wrapped-sq_default unsat ✅ 0.47514 0.47506
Poolector-wrapped-sq_default unsat ✅ 0.38284 0.32972
CVC4 CVC4-sq-final_default unsat ✅ 0.58738 0.58758
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 24.19940 24.19910
MathSAT MathSAT5_default.sh unsat ✅ 0.12048 0.12027
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.21050 0.21063
MinkeyRink Solver 2020.3_default unsat ✅ 0.33298 0.67803
STP STP_default unsat ✅ 0.41796 1.13860
STP ++ Mergsat v1_default unsat ✅ 0.51109 0.51235
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04998 0.04990
Z3 z3-4.8.8_default unsat ✅ 1.85004 1.85002
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.01700 1.01685
MathSAT mathsat-5.6.6_default unsat ✅ 0.14412 0.14410
STP STP 2021.0_default unsat ✅ 0.29607 0.68011
Z3 z3-4.8.11_default unsat ✅ 1.04750 1.04743
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.47693 0.47687
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.47507 0.47429
STP STP 2022.4_default unsat ✅ 0.29722 0.29724
STP 2022.4_default unsat ✅ 0.29667 0.29670
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 13.14000 35.14990
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03191 0.03188
Z3-Owl z3-Owl-Final_default unsat ✅ 10.77300 10.77110
z3-Owl-Final_default unsat ✅ 11.46550 11.46300
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.38027 0.28054
cvc5 cvc5 unsat ✅ 0.92848 0.82885
SMTInterpol SMTInterpol unsat ✅ 150.53008 173.74069
STP STP unsat ✅ 0.47227 0.37251
Yices2 Yices2 unsat ✅ 0.23784 0.13791
Z3alpha Z3-alpha unsat ✅ 0.47659 0.37704