Benchmark

non-incremental/QF_BV/mcm/87.smt2 

more info in 'N. P. Lopes, L. Aksoy, V. Manquinho, J. Monteiro.
 Optimally Solving the MCM Problem Using Pseudo-Boolean Satisfiability.
 Technical Report RT/43/2010, INESC-ID, Nov. 2010'.
Benchmark
Size97623
Compressed Size7686
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2013-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 97615
Compressed Size7697
Max. Term Depth13
Asserts 10
Declared Functions0
Declared Constants15
Declared Sorts 0
Defined Functions4
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

Bool3 ite11 not1 or9
and639 =668 BitVec1 extract1
bvand3 bvor1 bvadd226 bvsub412
bvult10 bvugt452 bvshl2464 bvlshr2
zero_extend2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ 0.00985 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 62.35520 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 66.19460 —
abziz_portfolio_2012_minfeatures default unknown ❌ 5.10957 —
abziz_portfolio_2012_solvers default unknown ❌ 5.09858 —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ 5.09561 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ 0.01026 —
Boolector-SMT-COMP-2011 default unknown ❌ 0.00981 —
Boolector-SMT-COMP-2012 default unknown ❌ 0.00976 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.03020 —
CVC3-SMT-COMP-2011 default unknown ❌ 0.02926 —
CVC3-SMT-COMP-2012 default unknown ❌ 0.02860 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 518.40400 —
CVC4-SMT-EVAL-2013 default unsat ✅ 87.77940 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 48.47060 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 26.42050 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 53.54820 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 62.45650 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 13.24390 —
SONOLAR-SMT-COMP-2010 default unknown ❌ 0.00771 —
SONOLAR-SMT-COMP-2011 default unknown ❌ 0.00984 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 13.31630 —
STP STP2-SMT-COMP-2011 default unknown ❌ 0.00991 —
STP2-SMT-COMP-2012 default unsat ✅ 18.46830 —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ 0.01244 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 22.09130 —
Z3-SMT-COMP-2011 default unsat ✅ 20.68480 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 43.12680 43.14240
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 23.95620 47.98870
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 43.98510 88.14860
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 34.10570 34.12180
SMT-RAT SMT-RAT-final default unsat ✅ 613.63700 613.74300
STP stp-cryptominisat4 default unsat ✅ 54.66460 54.68570
stp-cmsat4-v15 default unsat ✅ 30.04760 30.04540
stp-cmsat4-mt-v15 default unknown ❌ 0.70492 0.70389
stp-minisat-v15 default unsat ✅ 29.63770 29.63750
Yices2 Yices default unsat ✅ 45.90240 45.92100
Z3 z3 4.4.0 default unsat ✅ 30.62170 30.63630
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc unknown ❌ 0.06318 0.06287
ABC_glucose glucose unknown ❌ 0.06334 0.06310
Boolector Boolector boolector unsat ✅ 105.84300 105.90300
Boolector preprop boolector unsat ✅ 53.40520 53.43060
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 53.70170 107.73800
MapleSTP MapleSTP default unsat ✅ 33.47500 33.49170
MapleSTP-mt default unsat ✅ 37.92040 148.21000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 33.46560 33.48910
MinkeyRink Minkeyrink 2016 default unsat ✅ 16.10340 54.52520
Q3B Q3B default unknown ❌ 2400.03000 7203.18000
STP stp-cms-exp-2016 default unsat ✅ 26.88980 53.68240
stp-cms-mt-2016 default unsat ✅ 21.86270 84.63860
stp-cms-st-2016 default unsat ✅ 22.88830 22.90050
stp-minisat-st-2016 default unsat ✅ 186.59500 186.69700
Yices2 Yices-2.4.2 default unsat ✅ 39.99200 40.00670
Z3 z3-4.4.1 default unsat ✅ 31.89080 31.91050
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 23.29630 23.29560
Boolector SMT17 final boolector unsat ✅ 55.49090 55.48790
CVC4 CVC4-smtcomp2017-main default unsat ✅ 61.73840 124.03500
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 21.86110 21.85840
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 18.64770 32.09590
Q3B Q3B default unknown ❌ 0.60382 1.19737
STP stp_st default unsat ✅ 33.89880 33.87820
stp_mt default unsat ✅ 45.70720 116.74900
Yices2 Yices2-Main default unsat ✅ 54.43230 54.43410
Z3 z3-4.5.0 default unsat ✅ 34.39840 34.39530
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 16.23740 16.23680
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 12.94140 12.94070
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 29.14660 29.14530
MinkeyRink Minkeyrink MT_mt unsat ✅ 23.01810 89.88050
Minkeyrink ST_st unsat ✅ 21.04900 21.04900
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 40.78550 40.78580
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 34.66120 135.10300
STP-Riss-st-2018_riss-no-stderr unsat ✅ 31.45420 31.45220
Yices2 Yices 2.6.0_default unsat ✅ 50.28490 50.28160
Z3 z3-4.7.1_default unsat ✅ 37.04860 37.04920
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 16.01250 16.01130
Poolector-wrapped-sq_default unsat ✅ 19.12290 94.13540
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 43.15680 43.15610
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 23.67690 23.67530
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 20.71540 80.75970
MinkeyRink ST-wrapped-sq_default unsat ✅ 19.84180 19.84160
Par4 Par4-wrapped-sq_default unsat ✅ 15.49540 46.30000
STP STP-2019-wrapped-sq_default unsat ✅ 34.56370 34.56120
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 50.97620 50.97450
stp-minisat-wrapped-sq_default unsat ✅ 29.41450 29.41510
stp-mt-wrapped-sq_default unsat ✅ 36.96450 144.15800
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 58.90470 137.19200
stp-riss-wrapped-sq_default unknown ❌ 0.75914 0.75934
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 48.03620 48.03350
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 23.88910 23.88890
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 27.11920 27.12040
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.78000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 16.10500 16.10420
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 29.60300 29.60150
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 16.47900 16.47890
MathSAT mathsat-5.6.6_default unsat ✅ 50.54120 50.53600
STP STP 2021.0_default unsat ✅ 35.99420 141.08100
Z3 z3-4.8.11_default unsat ✅ 23.48230 23.48180
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 16.00000 15.99870
Bitwuzla-wrapped_default unsat ✅ 17.95490 17.95600
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 33.53540 33.53150
MathSAT MathSAT-5.6.8_default unsat ✅ 48.19080 48.18710
STP STP 2022.4_default unsat ✅ 28.89590 28.89440
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 19.44220 19.44070
Z3++BV z3++bv_0702_default unsat ✅ 23.44850 23.44770
Z3 z3-4.8.17_default unsat ✅ 28.19180 28.19070
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 14.73550 14.73500
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 31.26350 31.26580
STP STP 2022.4_default unsat ✅ 22.06570 22.06670
STP 2022.4_default unsat ✅ 22.00330 22.00070
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1251.67000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 51.16020 51.15740
Z3-Owl z3-Owl-Final_default unsat ✅ 25.34460 25.34460
z3-Owl-Final_default unsat ✅ 35.74600 35.74250
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 11.49794 11.39747
cvc5 cvc5 unsat ✅ 29.68269 29.56552
SMTInterpol SMTInterpol unknown ❌ 1201.72029 1278.93337
STP STP unsat ✅ 25.23172 25.12004
Yices2 Yices2 unsat ✅ 17.81697 17.70911
Z3alpha Z3-alpha unsat ✅ 74.68868 74.56143
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 8.91292 8.78652
Bitwuzla-MachBV-base unsat ✅ 7.60308 7.48324
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 7.60443 7.48579
BVDecide bv_decide unsat ✅ 34.13249 33.98351
bv_decide-nokernel unsat ✅ 18.38940 18.25514
cvc5 cvc5 unsat ✅ 22.02843 21.88915
SMTInterpol SMTInterpol unknown ❌ 1201.48818 1231.00915
Yices2 Yices2 unsat ✅ 22.21020 22.08148
Z3alpha Z3-alpha unsat ✅ 34.17640 135.14096
Z3 Z3-alpha-base unsat ✅ 17.32357 17.19347
Z3-Owl-base unsat ✅ 61.30016 61.17527
z3siri-base unsat ✅ 17.59190 17.46240
Z3-Owl Z3-Owl unsat ✅ 15.32938 15.20186