Benchmark

non-incremental/QF_BV/mcm/35.smt2

more info in 'N. P. Lopes, L. Aksoy, V. Manquinho, J. Monteiro.
 Optimally Solving the MCM Problem Using Pseudo-Boolean Satisfiability.
 Technical Report RT/43/2010, INESC-ID, Nov. 2010'.
Benchmark
Size133542
Compressed Size9167
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2013-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 133534
Compressed Size9205
Max. Term Depth12
Asserts 19
Declared Functions0
Declared Constants30
Declared Sorts 0
Defined Functions4
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

Bool3 ite10 not1 or18
and991 =1075 BitVec1 extract1
bvand3 bvor2 bvadd351 bvsub638
bvult20 bvugt704 bvshl3818 bvlshr2
zero_extend2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ 0.00974
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 67.60420
abziz_portfolio_2011_solvers_2 default sat ✅ 66.42030
abziz_portfolio_2012_minfeatures default unknown ❌ 5.13288
abziz_portfolio_2012_solvers default unknown ❌ 5.13172
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ 5.12470
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ 0.00961
Boolector-SMT-COMP-2011 default unknown ❌ 0.00979
Boolector-SMT-COMP-2012 default unknown ❌ 0.00985
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.02442
CVC3-SMT-COMP-2011 default unknown ❌ 0.01930
CVC3-SMT-COMP-2012 default unknown ❌ 0.02437
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default sat ✅ 146.83100
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 82.10680
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 211.08200
MathSAT5-SMT-COMP-2011 default sat ✅ 58.23650
MathSAT5-SMT-COMP-2012 default sat ✅ 50.73510
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 72.07140
SONOLAR-SMT-COMP-2010 default unknown ❌ 0.00993
SONOLAR-SMT-COMP-2011 default unknown ❌ 0.00989
SONOLAR-SMT-COMP-2012 default sat ✅ 11.00340
STP STP2-SMT-COMP-2011 default unknown ❌ 0.01095
STP2-SMT-COMP-2012 default sat ✅ 59.28940
simplifyingSTP-SMT-COMP-2010 default unknown ❌ 0.02226
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 47.40270
Z3-SMT-COMP-2011 default sat ✅ 59.78400
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 197.80500 197.86700
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 63.35060 127.05700
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 249.29600 500.17800
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 188.35400 188.43200
SMT-RAT SMT-RAT-final default unsat ✅ 1008.85000 1009.09000
STP stp-cryptominisat4 default sat ✅ 231.18200 231.29800
stp-cmsat4-v15 default sat ✅ 58.23860 58.26710
stp-cmsat4-mt-v15 default unknown ❌ 1.11636 1.11583
stp-minisat-v15 default sat ✅ 111.06600 111.07600
Yices2 Yices default sat ✅ 78.86710 78.88400
Z3 z3 4.4.0 default sat ✅ 62.25660 62.26650
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc unknown ❌ 0.06462 0.06444
ABC_glucose glucose unknown ❌ 0.06408 0.06398
Boolector Boolector boolector sat ✅ 178.84400 178.94300
Boolector preprop boolector sat ✅ 178.05600 178.15300
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 197.80200 397.00400
MapleSTP MapleSTP default unknown ❌ 2400.01000 2401.32000
MapleSTP-mt default sat ✅ 186.24600 735.55300
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 44.57230 44.59580
MinkeyRink Minkeyrink 2016 default sat ✅ 17.58890 53.68610
Q3B Q3B default unknown ❌ 2400.03000 7203.74000
STP stp-cms-exp-2016 default sat ✅ 113.16600 113.20600
stp-cms-mt-2016 default sat ✅ 86.42970 340.00500
stp-cms-st-2016 default sat ✅ 93.03190 93.08670
stp-minisat-st-2016 default sat ✅ 1295.77000 1296.51000
Yices2 Yices-2.4.2 default sat ✅ 76.64660 76.69760
Z3 z3-4.4.1 default sat ✅ 67.62940 67.66930
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 112.34300 112.30000
Boolector SMT17 final boolector sat ✅ 95.73940 95.73800
CVC4 CVC4-smtcomp2017-main default sat ✅ 202.01000 405.39000
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 75.64700 75.65150
MinkeyRink MinkeyRink 2017.3a default sat ✅ 18.83600 32.28000
Q3B Q3B default unknown ❌ 0.96512 1.83303
STP stp_st default sat ✅ 101.30100 101.29300
stp_mt default sat ✅ 75.27580 235.30500
Yices2 Yices2-Main default sat ✅ 64.98430 64.97950
Z3 z3-4.5.0 default sat ✅ 51.95910 51.95790
SMT-COMP 2018 Boolector Boolector_default sat ✅ 96.04590 96.04520
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 143.32400 143.31100
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 122.74800 122.73900
MinkeyRink Minkeyrink MT_mt sat ✅ 56.72490 223.27000
Minkeyrink ST_st sat ✅ 56.27000 56.26410
STP STP-CMS-st-2018_default-no-stderr sat ✅ 126.12100 126.10900
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 61.57230 240.87400
STP-Riss-st-2018_riss-no-stderr sat ✅ 23.20260 23.20080
Yices2 Yices 2.6.0_default sat ✅ 22.90840 22.90900
Z3 z3-4.7.1_default sat ✅ 119.72000 119.68500
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 83.72560 83.72680
Boolector Boolector-wrapped-sq_default sat ✅ 9.51862 9.51706
Poolector-wrapped-sq_default sat ✅ 11.12370 43.67440
CVC4 CVC4-sq-final_default sat ✅ 28.44180 28.43560
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.03000 1200.00000
MathSAT MathSAT5_default.sh sat ✅ 197.17800 197.10200
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.74167 0.74186
MinkeyRink Solver 2020.3_default sat ✅ 38.69350 151.35300
STP STP_default sat ✅ 39.61310 154.50900
STP ++ Mergsat v1_default sat ✅ 114.75400 114.72400
Yices2 Yices 2.6.2 bug fix_default sat ✅ 15.68950 15.68380
Z3 z3-4.8.8_default sat ✅ 87.74490 87.73270
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 53.01610 53.01540
MathSAT mathsat-5.6.6_default sat ✅ 87.39250 87.37830
STP STP 2021.0_default sat ✅ 73.73610 283.13900
Z3 z3-4.8.11_default sat ✅ 247.51500 247.41700