Benchmark

non-incremental/QF_BV/mcm/111.smt2 

more info in 'N. P. Lopes, L. Aksoy, V. Manquinho, J. Monteiro.
 Optimally Solving the MCM Problem Using Pseudo-Boolean Satisfiability.
 Technical Report RT/43/2010, INESC-ID, Nov. 2010'.
Benchmark
Size477921
Compressed Size24333
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2013-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 477913
Compressed Size24341
Max. Term Depth12
Asserts 36
Declared Functions0
Declared Constants54
Declared Sorts 0
Defined Functions4
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

Bool3 ite10 not1 or35
and3766 =4067 BitVec1 extract1
bvand3 bvor1 bvadd1312 bvsub2453
bvult36 bvugt2624 bvshl14710 bvlshr2
zero_extend2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.78 (2/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ 0.01824 —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ 5.44719 —
abziz_portfolio_2011_solvers_2 default unknown ❌ 5.45392 —
abziz_portfolio_2012_minfeatures default unknown ❌ 5.44165 —
abziz_portfolio_2012_solvers default unknown ❌ 5.44956 —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ 5.42722 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ 0.00926 —
Boolector-SMT-COMP-2011 default unknown ❌ 0.00965 —
Boolector-SMT-COMP-2012 default unknown ❌ 0.00931 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.02381 —
CVC3-SMT-COMP-2011 default unknown ❌ 0.02372 —
CVC3-SMT-COMP-2012 default unknown ❌ 0.02393 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default sat ✅ 79.10970 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ 0.00929 —
SONOLAR-SMT-COMP-2011 default unknown ❌ 0.00939 —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unknown ❌ 0.01032 —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ 0.00942 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 363.61100 —
Z3-SMT-COMP-2011 default sat ✅ 149.87600 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 450.35900 450.53400
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 644.79000 1294.89000
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 681.13500 1366.62000
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 114.38800 114.43400
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.89000
STP stp-cryptominisat4 default sat ✅ 805.65400 805.79300
stp-cmsat4-v15 default sat ✅ 555.37600 555.54100
stp-cmsat4-mt-v15 default unknown ❌ 5.11491 5.11522
stp-minisat-v15 default sat ✅ 86.25100 86.28490
Yices2 Yices default sat ✅ 294.83500 294.95900
Z3 z3 4.4.0 default sat ✅ 337.23500 337.29700
SMT-COMP 2016 0.30 (7/10) ABC ABC_default default_abc unknown ❌ 0.07615 0.07606
ABC_glucose glucose unknown ❌ 0.07864 0.07580
Boolector Boolector boolector sat ✅ 340.95000 341.12700
Boolector preprop boolector sat ✅ 344.37100 344.56500
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1047.65000 2104.23000
MapleSTP MapleSTP default unknown ❌ 2400.02000 2401.56000
MapleSTP-mt default sat ✅ 1145.12000 4533.07000
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1042.39000 1042.84000
MinkeyRink Minkeyrink 2016 default unknown ❌ 2400.04000 9466.44000
Q3B Q3B default unknown ❌ 2400.02000 7203.43000
STP stp-cms-exp-2016 default unknown ❌ 2400.02000 2401.39000
stp-cms-mt-2016 default sat ✅ 151.17800 582.55700
stp-cms-st-2016 default unknown ❌ 2400.03000 2401.32000
stp-minisat-st-2016 default sat ✅ 702.40200 702.87900
Yices2 Yices-2.4.2 default sat ✅ 64.04330 64.07570
Z3 z3-4.4.1 default sat ✅ 228.89900 229.03200
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.05500 599.93500
Boolector SMT17 final boolector unknown ❌ 600.09800 600.10900
CVC4 CVC4-smtcomp2017-main default sat ✅ 512.89600 1029.26000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01400 599.96000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 117.01500 228.34000
Q3B Q3B default unknown ❌ 8.83744 23.90100
STP stp_st default sat ✅ 411.88800 411.80200
stp_mt default sat ✅ 120.23200 362.53400
Yices2 Yices2-Main default sat ✅ 374.41000 374.35800
Z3 z3-4.5.0 default sat ✅ 385.20700 385.12500
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 795.67100 795.46000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.06000 1199.97000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 988.96400 988.89500
MinkeyRink Minkeyrink MT_mt sat ✅ 174.80600 682.74300
Minkeyrink ST_st sat ✅ 171.16800 171.11000
STP STP-CMS-st-2018_default-no-stderr unknown ❌ 1200.11000 1199.80000
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 258.71300 992.40300
STP-Riss-st-2018_riss-no-stderr sat ✅ 83.89990 83.87990
Yices2 Yices 2.6.0_default sat ✅ 278.99500 279.00500
Z3 z3-4.7.1_default sat ✅ 688.61700 688.50900
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default sat ✅ 161.29500 161.21500
Poolector-wrapped-sq_default sat ✅ 185.66900 735.48000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unknown ❌ 2400.02000 2399.78000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 189.85900 189.69000
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 143.11000 546.38000
MinkeyRink ST-wrapped-sq_default sat ✅ 209.24500 209.18000
Par4 Par4-wrapped-sq_default sat ✅ 141.12300 423.22000
STP STP-2019-wrapped-sq_default sat ✅ 390.43100 390.34500
stp-mergesat-fixed-wrapped-sq_default sat ✅ 260.86900 260.81600
stp-minisat-wrapped-sq_default sat ✅ 507.96800 507.95700
stp-mt-wrapped-sq_default sat ✅ 322.24700 1259.58000
stp-portfolio-fixed-wrapped-sq_default sat ✅ 603.09500 1381.20000
stp-riss-wrapped-sq_default unknown ❌ 5.97683 5.77146
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 115.96800 115.96900
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 109.37500 109.33400
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 847.40500 847.36300
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.08000 2399.96000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 515.71500 515.66600
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1880.11000 1879.99000
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 72.03360 72.02630
Boolector Boolector-wrapped-sq_default sat ✅ 142.74100 142.72800
Poolector-wrapped-sq_default sat ✅ 170.87400 677.11800
CVC4 CVC4-sq-final_default sat ✅ 265.70100 265.54700
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.91000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.67000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 3.06194 3.06205
MinkeyRink Solver 2020.3_default sat ✅ 122.01900 474.31800
STP STP_default sat ✅ 152.18500 592.41500
STP ++ Mergsat v1_default sat ✅ 305.72300 305.72600
Yices2 Yices 2.6.2 bug fix_default sat ✅ 122.22200 122.21700
Z3 z3-4.8.8_default sat ✅ 448.99400 448.82400
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 65.99650 65.96460
Bitwuzla-wrapped_default sat ✅ 61.80620 61.80700
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 247.33400 247.18900
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.03000 1199.60000
STP STP 2022.4_default sat ✅ 235.32100 235.24000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 111.55800 111.55300
Z3++BV z3++bv_0702_default sat ✅ 62.90640 62.90490
Z3 z3-4.8.17_default sat ✅ 191.22500 191.19200
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 161.45400 161.45100
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 242.31700 242.24000
STP STP 2022.4_default sat ✅ 115.79400 115.78900
STP 2022.4_default sat ✅ 116.38600 116.37900
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.12000 1261.91000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 228.18000 228.18600
Z3-Owl z3-Owl-Final_default sat ✅ 119.77900 119.76000
z3-Owl-Final_default sat ✅ 184.65000 184.62900