Benchmark

non-incremental/QF_BV/sage/app9/bench_3131.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size43979
Compressed Size7849
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 43971
Compressed Size7859
Max. Term Depth135
Asserts 1
Declared Functions0
Declared Constants155
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite2 not144 and1
=211 let125 extract3 bvand9
bvor63 bvadd398 bvmul11 bvsub115
bvult120 bvule278 bvslt6 bvsle11
bvshl71 zero_extend147 sign_extend1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.56443 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.55914 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.55827 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.56025 —
abziz_portfolio_2012_solvers default unsat ✅ 0.55947 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.56061 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.17544 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.49221 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.13221 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.63465 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.00223 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.13811 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.60748 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.13271 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.14294 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.20006 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.06017 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.51906 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.25035 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.18457 —
STP2-SMT-COMP-2012 default unsat ✅ 0.30344 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 1.99403 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.52241 —
Z3-SMT-COMP-2011 default unsat ✅ 0.55812 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.19017 0.18897
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.02742 2.01769
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.33864 2.64460
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.35620 0.35495
SMT-RAT SMT-RAT-final default unsat ✅ 70.02360 70.05240
STP stp-cryptominisat4 default unsat ✅ 0.25248 0.25196
stp-cmsat4-v15 default unsat ✅ 0.27526 0.27396
stp-cmsat4-mt-v15 default unknown ❌ 0.21924 0.21797
stp-minisat-v15 default unsat ✅ 0.21528 0.21397
Yices2 Yices default unsat ✅ 0.03037 0.02899
Z3 z3 4.4.0 default unsat ✅ 0.63472 0.63490
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.56548 0.56565
ABC_glucose glucose unsat ✅ 4.13913 4.14090
Boolector Boolector boolector unsat ✅ 0.13248 0.13238
Boolector preprop boolector unsat ✅ 0.14457 0.14492
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.36572 2.70091
MapleSTP MapleSTP default unsat ✅ 0.30901 0.30918
MapleSTP-mt default unsat ✅ 0.32303 0.71927
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.29457 0.29563
MinkeyRink Minkeyrink 2016 default unsat ✅ 1.31795 1.81128
Q3B Q3B default unsat ✅ 16.57280 49.29000
STP stp-cms-exp-2016 default unsat ✅ 0.35020 0.35022
stp-cms-mt-2016 default unsat ✅ 0.31610 0.70048
stp-cms-st-2016 default unsat ✅ 0.29964 0.30018
stp-minisat-st-2016 default unsat ✅ 0.32710 0.32722
Yices2 Yices-2.4.2 default unsat ✅ 0.02959 0.02957
Z3 z3-4.4.1 default unsat ✅ 0.54946 0.55112
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.19894 0.19645
Boolector SMT17 final boolector unsat ✅ 0.23097 0.22962
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.23079 2.42467
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.31684 0.31688
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.43909 0.40081
Q3B Q3B default unsat ✅ 38.98290 116.41000
STP stp_st default unsat ✅ 1.34722 1.34665
stp_mt default unsat ✅ 1.88782 4.95200
Yices2 Yices2-Main default unsat ✅ 0.02898 0.02796
Z3 z3-4.5.0 default unsat ✅ 0.78035 0.78045
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.17676 0.17666
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.18302 1.18322
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.31870 0.31978
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.27402 0.41726
Minkeyrink ST_st unsat ✅ 0.25897 0.25902
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.98130 0.98122
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 1.00858 3.37475
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.41164 1.41163
Yices2 Yices 2.6.0_default unsat ✅ 0.02670 0.02664
Z3 z3-4.7.1_default unsat ✅ 0.78539 0.78509
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.26796 0.26794
Poolector-wrapped-sq_default unsat ✅ 0.27861 0.35334
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.14088 0.14089
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.62571 1.62607
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05837 0.05855
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.05582 0.05593
Par4 Par4-wrapped-sq_default unsat ✅ 0.03685 0.00614
STP STP-2019-wrapped-sq_default unsat ✅ 1.09972 1.10004
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 6.79786 6.79850
stp-minisat-wrapped-sq_default unsat ✅ 0.95162 0.95184
stp-mt-wrapped-sq_default unsat ✅ 0.92030 2.96772
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 6.89211 8.57993
stp-riss-wrapped-sq_default unknown ❌ 0.22476 0.22500
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03069 0.03067
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.05205 0.05206
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.05573 0.05572
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 1933.28000 1933.01000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.07633 0.07638
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.70274 0.70275
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.11109 1.11019
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.40568 1.40617
STP STP 2022.4_default unsat ✅ 0.19695 0.19696
STP 2022.4_default unsat ✅ 0.19615 0.19617
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 5.12384 13.84550
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.02930 0.02927
Z3-Owl z3-Owl-Final_default unsat ✅ 9.98563 9.98482
z3-Owl-Final_default unsat ✅ 9.91872 9.91757
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.93082 0.83085
cvc5 cvc5 unsat ✅ 2.13128 2.03168
SMTInterpol SMTInterpol unsat ✅ 134.96994 156.62850
STP STP unsat ✅ 0.40453 0.30477
Yices2 Yices2 unsat ✅ 0.24378 0.14380
Z3alpha Z3-alpha unsat ✅ 1.00921 0.90953
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.77725 0.65924
Bitwuzla-MachBV-base unsat ✅ 0.96623 0.84516
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.81803 0.69585
BVDecide bv_decide unsat ✅ 9.68514 9.53537
bv_decide-nokernel unsat ✅ 5.32254 5.17493
cvc5 cvc5 unsat ✅ 1.92939 1.81075
SMTInterpol SMTInterpol unsat ✅ 128.20800 144.70571
Yices2 Yices2 unsat ✅ 0.35096 0.23262
Z3alpha Z3-alpha unsat ✅ 0.89184 2.14845
Z3 Z3-alpha-base unsat ✅ 0.83949 0.70579
Z3-Owl-base unsat ✅ 2.64943 2.52122
z3siri-base unsat ✅ 0.81020 0.68150
Z3-Owl Z3-Owl unsat ✅ 4.29297 4.16646