Benchmark

non-incremental/QF_BV/mcm/13.smt2

more info in 'N. P. Lopes, L. Aksoy, V. Manquinho, J. Monteiro.
 Optimally Solving the MCM Problem Using Pseudo-Boolean Satisfiability.
 Technical Report RT/43/2010, INESC-ID, Nov. 2010'.
Benchmark
Size100007
Compressed Size6567
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2013-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 99999
Compressed Size6579
Max. Term Depth11
Asserts 20
Declared Functions0
Declared Constants30
Declared Sorts 0
Defined Functions4
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

Bool3 ite9 not1 or19
and774 =866 BitVec1 extract1
bvand3 bvor1 bvadd276 bvsub497
bvult20 bvugt552 bvshl2974 bvlshr2
zero_extend2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ 0.00929
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 11.38090
abziz_portfolio_2011_solvers_2 default sat ✅ 9.49008
abziz_portfolio_2012_minfeatures default sat ✅ 9.67424
abziz_portfolio_2012_solvers default unknown ❌ 5.12089
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ 5.11617
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ 0.00939
Boolector-SMT-COMP-2011 default unknown ❌ 0.00922
Boolector-SMT-COMP-2012 default unknown ❌ 0.00953
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.02370
CVC3-SMT-COMP-2011 default unknown ❌ 0.02284
CVC3-SMT-COMP-2012 default unknown ❌ 0.03256
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default sat ✅ 76.66200
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 10.96360
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 7.47128
MathSAT5-SMT-COMP-2011 default sat ✅ 4.39365
MathSAT5-SMT-COMP-2012 default sat ✅ 4.56652
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 4.13956
SONOLAR-SMT-COMP-2010 default unknown ❌ 0.00963
SONOLAR-SMT-COMP-2011 default unknown ❌ 0.00951
SONOLAR-SMT-COMP-2012 default sat ✅ 5.72162
STP STP2-SMT-COMP-2011 default unknown ❌ 0.01281
STP2-SMT-COMP-2012 default sat ✅ 3.80285
simplifyingSTP-SMT-COMP-2010 default unknown ❌ 0.01224
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 8.00321
Z3-SMT-COMP-2011 default sat ✅ 6.17640
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 78.80430 78.82000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.69639 5.32019
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 12.15500 24.28630
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 6.55755 6.55900
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.21000
STP stp-cryptominisat4 default sat ✅ 4.65546 4.65629
stp-cmsat4-v15 default sat ✅ 19.54140 19.54600
stp-cmsat4-mt-v15 default unknown ❌ 0.84500 0.84387
stp-minisat-v15 default sat ✅ 5.48935 5.49016
Yices2 Yices default sat ✅ 4.28769 4.28735
Z3 z3 4.4.0 default sat ✅ 6.10831 6.11107
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc unknown ❌ 0.06254 0.06262
ABC_glucose glucose unknown ❌ 0.06273 0.06267
Boolector Boolector boolector sat ✅ 73.94880 73.99160
Boolector preprop boolector sat ✅ 73.94660 73.98380
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 28.26250 56.64050
MapleSTP MapleSTP default sat ✅ 9.29690 9.30162
MapleSTP-mt default sat ✅ 10.77800 40.17350
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.82471 1.82684
MinkeyRink Minkeyrink 2016 default sat ✅ 7.57046 17.69570
Q3B Q3B default unknown ❌ 2400.08000 7203.60000
STP stp-cms-exp-2016 default sat ✅ 11.72590 11.73370
stp-cms-mt-2016 default sat ✅ 5.70057 20.12040
stp-cms-st-2016 default sat ✅ 9.78108 9.78757
stp-minisat-st-2016 default sat ✅ 6.72635 6.72983
Yices2 Yices-2.4.2 default sat ✅ 3.82309 3.82525
Z3 z3-4.4.1 default sat ✅ 6.00128 11.91590
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 8.74831 8.74707
Boolector SMT17 final boolector sat ✅ 42.31420 42.30810
CVC4 CVC4-smtcomp2017-main default sat ✅ 27.54200 55.17120
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 4.19669 4.19706
MinkeyRink MinkeyRink 2017.3a default sat ✅ 7.47182 5.72000
Q3B Q3B default unknown ❌ 0.81093 1.35683
STP stp_st default sat ✅ 7.54263 7.54117
stp_mt default sat ✅ 6.27311 21.47260
Yices2 Yices2-Main default sat ✅ 3.50374 3.50349
Z3 z3-4.5.0 default sat ✅ 12.33170 12.32980
SMT-COMP 2018 Boolector Boolector_default sat ✅ 4.18305 4.18240
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 7.43547 7.43533
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 2.79689 2.79802
MinkeyRink Minkeyrink MT_mt sat ✅ 4.71603 16.78800
Minkeyrink ST_st sat ✅ 6.80335 6.80295
STP STP-CMS-st-2018_default-no-stderr sat ✅ 11.06260 11.06320
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 6.54560 22.83770
STP-Riss-st-2018_riss-no-stderr sat ✅ 8.40630 8.40573
Yices2 Yices 2.6.0_default sat ✅ 8.12088 8.11954
Z3 z3-4.7.1_default sat ✅ 22.56950 22.56770
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 7.24044 7.23957
Boolector Boolector-wrapped-sq_default sat ✅ 6.45602 6.45546
Poolector-wrapped-sq_default sat ✅ 7.40477 28.96000
CVC4 CVC4-sq-final_default sat ✅ 10.02240 10.01280
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.05000 1199.97000
MathSAT MathSAT5_default.sh sat ✅ 5.06976 5.06930
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.58357 0.58376
MinkeyRink Solver 2020.3_default sat ✅ 1.81163 5.47278
STP STP_default sat ✅ 3.64033 12.31990
STP ++ Mergsat v1_default sat ✅ 14.01590 14.01680
Yices2 Yices 2.6.2 bug fix_default sat ✅ 3.35064 3.35022
Z3 z3-4.8.8_default sat ✅ 4.93995 4.93924
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 7.12408 7.12281
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 11.56800 11.56810
STP STP 2022.4_default sat ✅ 9.13113 9.13080
STP 2022.4_default sat ✅ 9.08572 9.08591
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.13000 1257.89000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 4.78150 4.78096
Z3-Owl z3-Owl-Final_default sat ✅ 21.91290 21.91210
z3-Owl-Final_default sat ✅ 28.27780 28.27480
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 3.57918 3.46266
Bitwuzla-MachBV-base sat ✅ 3.94915 3.82986
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 3.96448 3.84655
BVDecide bv_decide sat ✅ 16.04052 15.90036
bv_decide-nokernel sat ✅ 15.98234 15.81215
cvc5 cvc5 sat ✅ 8.19077 8.06172
SMTInterpol SMTInterpol unknown ❌ 1201.48490 1234.66740
Yices2 Yices2 sat ✅ 3.88931 3.76851
Z3alpha Z3-alpha sat ✅ 4.26547 13.94884
Z3 Z3-alpha-base sat ✅ 2.26421 2.14634
Z3-Owl-base sat ✅ 8.24982 8.13234
z3siri-base sat ✅ 2.35973 2.22993
Z3-Owl Z3-Owl sat ✅ 9.87265 9.73898