Benchmark

non-incremental/QF_BV/mcm/12.smt2

more info in 'N. P. Lopes, L. Aksoy, V. Manquinho, J. Monteiro.
 Optimally Solving the MCM Problem Using Pseudo-Boolean Satisfiability.
 Technical Report RT/43/2010, INESC-ID, Nov. 2010'.
Benchmark
Size60588
Compressed Size4504
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2013-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 60580
Compressed Size4518
Max. Term Depth12
Asserts 6
Declared Functions0
Declared Constants9
Declared Sorts 0
Defined Functions4
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

Bool3 ite10 not1 or5
and379 =395 BitVec1 extract1
bvand3 bvor1 bvadd134 bvsub244
bvult6 bvugt268 bvshl1456 bvlshr2
zero_extend2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ 0.00978
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 2.89736
abziz_portfolio_2011_solvers_2 default sat ✅ 2.83525
abziz_portfolio_2012_minfeatures default sat ✅ 2.90507
abziz_portfolio_2012_solvers default sat ✅ 2.83504
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 2.92696
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ 0.00968
Boolector-SMT-COMP-2011 default unknown ❌ 0.00982
Boolector-SMT-COMP-2012 default unknown ❌ 0.00950
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.03177
CVC3-SMT-COMP-2011 default unknown ❌ 0.03111
CVC3-SMT-COMP-2012 default unknown ❌ 0.02993
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 7.78375
CVC4-SMT-EVAL-2013 default sat ✅ 21.97090
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 1.58873
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 2.03950
MathSAT5-SMT-COMP-2011 default sat ✅ 0.88128
MathSAT5-SMT-COMP-2012 default sat ✅ 2.10717
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.55326
SONOLAR-SMT-COMP-2010 default unknown ❌ 0.00963
SONOLAR-SMT-COMP-2011 default unknown ❌ 0.00958
SONOLAR-SMT-COMP-2012 default sat ✅ 0.84714
STP STP2-SMT-COMP-2011 default unknown ❌ 0.00986
STP2-SMT-COMP-2012 default sat ✅ 1.30441
simplifyingSTP-SMT-COMP-2010 default unknown ❌ 0.00985
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 2.77217
Z3-SMT-COMP-2011 default sat ✅ 2.85107
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 1.42001 1.41978
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 1.12574 2.20166
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 1.50633 2.96655
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.71736 0.71689
SMT-RAT SMT-RAT-final default unsat ✅ 204.25900 204.30600
STP stp-cryptominisat4 default sat ✅ 0.83494 0.83387
stp-cmsat4-v15 default sat ✅ 0.74129 0.74089
stp-cmsat4-mt-v15 default unknown ❌ 0.39242 0.39094
stp-minisat-v15 default sat ✅ 1.03191 1.03084
Yices2 Yices default sat ✅ 0.63368 0.63290
Z3 z3 4.4.0 default sat ✅ 3.26148 3.26250
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 0.06120 0.06105
ABC_glucose glucose unknown ❌ 0.06216 0.06190
Boolector Boolector boolector sat ✅ 3.45283 3.45477
Boolector preprop boolector sat ✅ 3.53494 3.53695
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1.76022 3.47945
MapleSTP MapleSTP default sat ✅ 1.29151 1.29232
MapleSTP-mt default sat ✅ 1.59987 5.17661
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 2.17641 2.17916
MinkeyRink Minkeyrink 2016 default sat ✅ 2.03164 3.16138
Q3B Q3B default sat ✅ 1795.33000 5388.77000
STP stp-cms-exp-2016 default sat ✅ 1.13164 1.13226
stp-cms-mt-2016 default sat ✅ 1.09852 3.21684
stp-cms-st-2016 default sat ✅ 0.91881 0.91932
stp-minisat-st-2016 default sat ✅ 1.49732 1.49827
Yices2 Yices-2.4.2 default sat ✅ 0.25837 0.25849
Z3 z3-4.4.1 default sat ✅ 2.78375 2.78636
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.38446 1.38392
Boolector SMT17 final boolector sat ✅ 5.04714 5.04705
CVC4 CVC4-smtcomp2017-main default sat ✅ 1.61604 3.18944
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.92428 0.92492
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.84513 0.81157
Q3B Q3B default unknown ❌ 0.43995 0.79892
STP stp_st default sat ✅ 1.15145 1.15088
stp_mt default sat ✅ 1.33065 3.92708
Yices2 Yices2-Main default sat ✅ 0.65473 0.65406
Z3 z3-4.5.0 default sat ✅ 3.16505 3.16487
SMT-COMP 2018 Boolector Boolector_default sat ✅ 1.31522 1.31497
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.98687 0.98700
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.14957 1.15064
MinkeyRink Minkeyrink MT_mt sat ✅ 0.73767 2.03806
Minkeyrink ST_st sat ✅ 0.84491 0.84510
STP STP-CMS-st-2018_default-no-stderr sat ✅ 0.74028 0.73617
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.89281 2.22952
STP-Riss-st-2018_riss-no-stderr sat ✅ 2.04867 2.04402
Yices2 Yices 2.6.0_default sat ✅ 0.24416 0.24410
Z3 z3-4.7.1_default sat ✅ 3.27075 3.27054
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.55424 1.55412
Boolector Boolector-wrapped-sq_default sat ✅ 0.57976 0.57970
Poolector-wrapped-sq_default sat ✅ 0.38010 0.36424
CVC4 CVC4-sq-final_default sat ✅ 0.87489 0.87524
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1199.96000
MathSAT MathSAT5_default.sh sat ✅ 0.78381 0.78375
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.27254 0.27280
MinkeyRink Solver 2020.3_default sat ✅ 0.62218 1.58326
STP STP_default sat ✅ 0.81171 2.22252
STP ++ Mergsat v1_default sat ✅ 1.32167 1.32333
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.54291 0.54099
Z3 z3-4.8.8_default sat ✅ 1.53746 1.53729
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.64320 1.64308
Bitwuzla-wrapped_default sat ✅ 1.65790 1.65759
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 1.43685 1.43740
MathSAT MathSAT-5.6.8_default sat ✅ 1.51162 1.51134
STP STP 2022.4_default sat ✅ 0.60423 0.60407
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.24667 0.24660
Z3++BV z3++bv_0702_default sat ✅ 1.67612 1.67585
Z3 z3-4.8.17_default sat ✅ 0.62351 0.62529
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 2.90143 2.90125
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 4.85495 4.85462
STP STP 2022.4_default sat ✅ 1.29644 1.29648
STP 2022.4_default sat ✅ 1.30244 1.30246
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.10000 1250.31000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.29114 0.29111
Z3-Owl z3-Owl-Final_default sat ✅ 9.26712 9.26633
z3-Owl-Final_default sat ✅ 9.18492 9.18540
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 0.78877 0.68884
cvc5 cvc5 sat ✅ 1.12640 1.02694
SMTInterpol SMTInterpol unknown ❌ 1201.71852 1259.55065
STP STP sat ✅ 3.12166 3.02027
Yices2 Yices2 sat ✅ 1.21208 1.11174
Z3alpha Z3-alpha sat ✅ 1.21001 1.10852
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.63305 0.51338
Bitwuzla-MachBV-base sat ✅ 0.64600 0.52899
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.76510 0.64089
BVDecide bv_decide sat ✅ 5.63525 5.48227
bv_decide-nokernel sat ✅ 5.46825 5.30068
cvc5 cvc5 sat ✅ 1.07298 0.94487
SMTInterpol SMTInterpol unknown ❌ 1201.39090 1238.80890
Yices2 Yices2 sat ✅ 0.72428 0.59925
Z3alpha Z3-alpha sat ✅ 0.92324 2.33372
Z3 Z3-alpha-base sat ✅ 0.88794 0.76871
Z3-Owl-base sat ✅ 3.18747 3.06811
z3siri-base sat ✅ 0.89802 0.77584
Z3-Owl Z3-Owl sat ✅ 4.11104 3.98813