Benchmark

non-incremental/QF_BV/mcm/49.smt2

more info in 'N. P. Lopes, L. Aksoy, V. Manquinho, J. Monteiro.
 Optimally Solving the MCM Problem Using Pseudo-Boolean Satisfiability.
 Technical Report RT/43/2010, INESC-ID, Nov. 2010'.
Benchmark
Size104043
Compressed Size7536
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2013-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 104035
Compressed Size7548
Max. Term Depth13
Asserts 18
Declared Functions0
Declared Constants27
Declared Sorts 0
Defined Functions4
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

Bool3 ite11 not1 or17
and769 =846 BitVec1 extract1
bvand3 bvor1 bvadd274 bvsub494
bvult18 bvugt548 bvshl2956 bvlshr2
zero_extend2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ 0.00940
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 294.73200
abziz_portfolio_2011_solvers_2 default unsat ✅ 294.94100
abziz_portfolio_2012_minfeatures default unknown ❌ 5.12934
abziz_portfolio_2012_solvers default unknown ❌ 5.11746
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ 5.12430
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ 0.00928
Boolector-SMT-COMP-2011 default unknown ❌ 0.00967
Boolector-SMT-COMP-2012 default unknown ❌ 0.00912
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.02487
CVC3-SMT-COMP-2011 default unknown ❌ 0.01969
CVC3-SMT-COMP-2012 default unknown ❌ 0.03461
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unsat ✅ 214.41000
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 214.85200
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 82.86800
MathSAT5-SMT-COMP-2011 default unsat ✅ 289.64400
MathSAT5-SMT-COMP-2012 default unsat ✅ 195.52900
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 108.19400
SONOLAR-SMT-COMP-2010 default unknown ❌ 0.00919
SONOLAR-SMT-COMP-2011 default unknown ❌ 0.00916
SONOLAR-SMT-COMP-2012 default unsat ✅ 172.33200
STP STP2-SMT-COMP-2011 default unknown ❌ 0.00929
STP2-SMT-COMP-2012 default unsat ✅ 105.16700
simplifyingSTP-SMT-COMP-2010 default unknown ❌ 0.00923
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 103.35400
Z3-SMT-COMP-2011 default unsat ✅ 140.83700
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 155.96000 156.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 117.37200 235.47300
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 554.21500 1112.10000
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 122.39000 122.43900
SMT-RAT SMT-RAT-final default unsat ✅ 1031.11000 1031.35000
STP stp-cryptominisat4 default unsat ✅ 508.98400 509.20500
stp-cmsat4-v15 default unsat ✅ 95.13420 95.16450
stp-cmsat4-mt-v15 default unknown ❌ 0.96428 0.96285
stp-minisat-v15 default unsat ✅ 137.83700 137.89300
Yices2 Yices default unsat ✅ 142.82600 142.84900
Z3 z3 4.4.0 default unsat ✅ 294.08300 294.18900
SMT-COMP 2016 0.30 (7/10) ABC ABC_default default_abc unknown ❌ 0.06306 0.06282
ABC_glucose glucose unknown ❌ 0.06363 0.06371
Boolector Boolector boolector unsat ✅ 130.29800 130.36500
Boolector preprop boolector unsat ✅ 128.91400 128.99300
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 630.78200 1267.23000
MapleSTP MapleSTP default unknown ❌ 2400.03000 2401.58000
MapleSTP-mt default unknown ❌ 2400.09000 9537.60000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 132.77800 132.84900
MinkeyRink Minkeyrink 2016 default unsat ✅ 91.28020 348.64700
Q3B Q3B default unknown ❌ 2400.02000 7203.52000
STP stp-cms-exp-2016 default unsat ✅ 395.45300 395.67800
stp-cms-mt-2016 default unsat ✅ 154.85900 611.61500
stp-cms-st-2016 default unsat ✅ 389.93000 390.09400
stp-minisat-st-2016 default unsat ✅ 1188.56000 1189.34000
Yices2 Yices-2.4.2 default unsat ✅ 595.44000 595.77300
Z3 z3-4.4.1 default unsat ✅ 287.35300 287.50900
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 253.66100 253.60800
Boolector SMT17 final boolector unsat ✅ 153.05600 153.04500
CVC4 CVC4-smtcomp2017-main default unsat ✅ 506.16000 1015.96000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 180.19800 180.18900
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 131.28100 259.69000
Q3B Q3B default unknown ❌ 0.67330 1.32030
STP stp_st default unsat ✅ 170.69500 170.65400
stp_mt default unsat ✅ 248.52100 785.85700
Yices2 Yices2-Main default unsat ✅ 333.60400 333.56900
Z3 z3-4.5.0 default unsat ✅ 274.76700 274.72300
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 214.49200 214.48200
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 131.88300 131.86000
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 290.29600 290.31200
MinkeyRink Minkeyrink MT_mt unsat ✅ 110.75600 438.50100
Minkeyrink ST_st unsat ✅ 147.63600 147.63000
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 261.48900 261.49100
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 205.44100 813.41400
STP-Riss-st-2018_riss-no-stderr unsat ✅ 124.91500 124.91000
Yices2 Yices 2.6.0_default unsat ✅ 207.48300 207.47100
Z3 z3-4.7.1_default unsat ✅ 123.55800 123.55400
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 79.46830 79.46320
Poolector-wrapped-sq_default unsat ✅ 101.48500 401.74600
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 746.88400 746.74700
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 192.55500 192.50000
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 136.38600 539.98300
MinkeyRink ST-wrapped-sq_default unsat ✅ 174.77700 174.76900
Par4 Par4-wrapped-sq_default unsat ✅ 57.35390 171.95000
STP STP-2019-wrapped-sq_default unsat ✅ 220.43900 220.41000
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 211.28800 211.28400
stp-minisat-wrapped-sq_default unsat ✅ 174.59900 174.58800
stp-mt-wrapped-sq_default unsat ✅ 267.04400 1037.03000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 269.95700 731.51300
stp-riss-wrapped-sq_default unknown ❌ 1.14042 1.14067
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 545.34200 545.29600
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 37.09510 37.09490
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 287.49400 287.45200
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.84000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 211.32900 211.34000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 342.88000 342.86000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 72.46020 72.45720
Boolector Boolector-wrapped-sq_default unsat ✅ 47.54470 47.54250
Poolector-wrapped-sq_default unsat ✅ 58.00030 229.42000
CVC4 CVC4-sq-final_default unsat ✅ 93.71990 93.70940
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.08000 1199.97000
MathSAT MathSAT5_default.sh unsat ✅ 619.14900 619.13800
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.64804 0.64829
MinkeyRink Solver 2020.3_default unsat ✅ 105.35300 416.77000
STP STP_default unsat ✅ 179.66800 709.54200
STP ++ Mergsat v1_default unsat ✅ 185.09700 185.08400
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 52.95310 52.95040
Z3 z3-4.8.8_default unsat ✅ 579.21400 579.15200
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default unsat ✅ 114.08100 114.07800
MathSAT mathsat-5.6.6_default unknown ❌ 1200.03000 1199.93000
STP STP 2021.0_default unsat ✅ 193.22300 765.84600
Z3 z3-4.8.11_default unsat ✅ 467.10000 467.06100
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 39.00910 39.00130
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 248.42500 248.41600
STP STP 2022.4_default unsat ✅ 85.58060 85.55620
STP 2022.4_default unsat ✅ 87.92760 87.93190
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.06000 1256.33000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 695.85700 695.84400
Z3-Owl z3-Owl-Final_default unsat ✅ 221.21900 221.18600
z3-Owl-Final_default unsat ✅ 129.51200 129.51100
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 47.56798 47.42183
Bitwuzla-MachBV-base unsat ✅ 28.21637 28.09098
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 27.53390 27.39373
BVDecide bv_decide unsat ✅ 61.80941 61.66077
bv_decide-nokernel unsat ✅ 39.42877 39.27972
cvc5 cvc5 unsat ✅ 227.94760 227.77614
SMTInterpol SMTInterpol unknown ❌ 1201.45099 1232.82628
Yices2 Yices2 unsat ✅ 146.54497 146.38962
Z3alpha Z3-alpha unsat ✅ 650.60813 2599.77629
Z3 Z3-alpha-base unsat ✅ 417.41831 417.24251
Z3-Owl-base unknown ❌ 1201.25942 1201.00298
z3siri-base unsat ✅ 422.28612 422.08574
Z3-Owl Z3-Owl unsat ✅ 84.58433 84.44615