Benchmark

non-incremental/QF_BV/mcm/94.smt2 

more info in 'N. P. Lopes, L. Aksoy, V. Manquinho, J. Monteiro.
 Optimally Solving the MCM Problem Using Pseudo-Boolean Satisfiability.
 Technical Report RT/43/2010, INESC-ID, Nov. 2010'.
Benchmark
Size154344
Compressed Size9097
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2013-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 154336
Compressed Size8978
Max. Term Depth13
Asserts 24
Declared Functions0
Declared Constants39
Declared Sorts 0
Defined Functions4
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

Bool3 ite11 not1 or23
and1256 =1389 BitVec1 extract1
bvand3 bvor3 bvadd443 bvsub810
bvult26 bvugt890 bvshl4848 bvlshr2
zero_extend2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.44 (5/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ 0.01021 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 432.05200 —
abziz_portfolio_2011_solvers_2 default sat ✅ 291.83100 —
abziz_portfolio_2012_minfeatures default sat ✅ 110.49100 —
abziz_portfolio_2012_solvers default unknown ❌ 5.18666 —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ 5.16414 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ 0.00967 —
Boolector-SMT-COMP-2011 default unknown ❌ 0.01105 —
Boolector-SMT-COMP-2012 default unknown ❌ 0.01019 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.02549 —
CVC3-SMT-COMP-2011 default unknown ❌ 0.01989 —
CVC3-SMT-COMP-2012 default unknown ❌ 0.02535 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 371.41200 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default sat ✅ 262.54000 —
MathSAT5-SMT-COMP-2012 default sat ✅ 105.48400 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ 0.00955 —
SONOLAR-SMT-COMP-2011 default unknown ❌ 0.01107 —
SONOLAR-SMT-COMP-2012 default sat ✅ 1026.52000 —
STP STP2-SMT-COMP-2011 default unknown ❌ 0.01086 —
STP2-SMT-COMP-2012 default sat ✅ 445.03700 —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ 0.01022 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 148.54100 —
Z3-SMT-COMP-2011 default sat ✅ 424.94900 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 616.39100 616.65000
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 78.41730 157.32700
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 2319.44000 4658.92000
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1639.83000 1640.49000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.18000
STP stp-cryptominisat4 default sat ✅ 1048.98000 1049.36000
stp-cmsat4-v15 default sat ✅ 298.15400 298.20700
stp-cmsat4-mt-v15 default unknown ❌ 1.68968 1.68874
stp-minisat-v15 default sat ✅ 49.51470 49.53450
Yices2 Yices default sat ✅ 190.65600 190.69800
Z3 z3 4.4.0 default sat ✅ 741.95600 742.21500
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc unknown ❌ 0.06414 0.06377
ABC_glucose glucose unknown ❌ 0.06951 0.06932
Boolector Boolector boolector sat ✅ 1215.78000 1216.56000
Boolector preprop boolector sat ✅ 1211.40000 1212.06000
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1092.78000 2194.57000
MapleSTP MapleSTP default unknown ❌ 2400.03000 2401.36000
MapleSTP-mt default sat ✅ 1871.55000 7430.48000
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 620.11400 620.36200
MinkeyRink Minkeyrink 2016 default sat ✅ 388.39300 1516.20000
Q3B Q3B default unknown ❌ 2400.09000 7203.78000
STP stp-cms-exp-2016 default sat ✅ 1526.14000 1527.11000
stp-cms-mt-2016 default sat ✅ 241.28500 950.23500
stp-cms-st-2016 default sat ✅ 657.81500 658.11500
stp-minisat-st-2016 default unknown ❌ 2400.01000 2401.35000
Yices2 Yices-2.4.2 default sat ✅ 110.35200 110.40600
Z3 z3-4.4.1 default sat ✅ 268.43300 268.50900
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.01800 599.96300
Boolector SMT17 final boolector sat ✅ 573.94700 573.87300
CVC4 CVC4-smtcomp2017-main default sat ✅ 221.59600 444.81500
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.04500 599.99000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 304.68600 610.24000
Q3B Q3B default unknown ❌ 12.53230 25.29170
STP stp_st default unknown ❌ 600.02000 600.00300
stp_mt default unknown ❌ 600.04600 2380.00000
Yices2 Yices2-Main default sat ✅ 581.71800 581.63000
Z3 z3-4.5.0 default sat ✅ 140.78700 140.79300
SMT-COMP 2018 0.57 (3/7) Boolector Boolector_default unknown ❌ 1200.11000 1200.01000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1200.01000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 334.35500 334.30100
MinkeyRink Minkeyrink MT_mt sat ✅ 210.07700 831.64600
Minkeyrink ST_st sat ✅ 533.87900 533.85200
STP STP-CMS-st-2018_default-no-stderr sat ✅ 1181.30000 1181.11000
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 284.66800 1124.86000
STP-Riss-st-2018_riss-no-stderr sat ✅ 387.71100 387.72400
Yices2 Yices 2.6.0_default unknown ❌ 1200.01000 1199.84000
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.90000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 167.31900 167.31200
Boolector Boolector-wrapped-sq_default sat ✅ 43.02380 43.01550
Poolector-wrapped-sq_default sat ✅ 51.61840 204.07000
CVC4 CVC4-sq-final_default sat ✅ 115.57600 115.57400
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.11000 1200.03000
MathSAT MathSAT5_default.sh sat ✅ 791.69400 791.36000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.06263 1.06279
MinkeyRink Solver 2020.3_default sat ✅ 152.35900 601.89000
STP STP_default sat ✅ 230.64600 912.99600
STP ++ Mergsat v1_default sat ✅ 408.04900 408.01000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 88.70230 88.69700
Z3 z3-4.8.8_default sat ✅ 609.85000 609.70700
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 124.62000 124.62700
Bitwuzla-wrapped_default sat ✅ 239.80900 239.78800
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 51.86990 51.86870
MathSAT MathSAT-5.6.8_default sat ✅ 622.08100 621.84300
STP STP 2022.4_default sat ✅ 176.67100 176.65500
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 153.74000 153.70000
Z3++BV z3++bv_0702_default sat ✅ 178.99500 178.99600
Z3 z3-4.8.17_default sat ✅ 533.43400 533.32300
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 138.01500 137.99900
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 60.74780 60.74100
STP STP 2022.4_default sat ✅ 79.81290 79.81280
STP 2022.4_default sat ✅ 80.34140 80.33500
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1262.77000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 408.86900 408.77900
Z3-Owl z3-Owl-Final_default sat ✅ 364.99500 364.96700
z3-Owl-Final_default sat ✅ 98.28830 98.27490
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 37.96359 37.86303
cvc5 cvc5 sat ✅ 77.82137 77.68525
SMTInterpol SMTInterpol unknown ❌ 1201.76768 1434.31182
STP STP sat ✅ 290.38597 290.28276
Yices2 Yices2 sat ✅ 111.57370 111.43808
Z3alpha Z3-alpha unknown ❌ 1201.71830 1201.05481